Toward real-time grocery detection for the visually impaired

Research output: Contribution to journalConference articleResearchpeer-review

We present a study on grocery detection using our object detection system, Shelf Scanner, which seeks to allow a visually impaired user to shop at a grocery store without additional human assistance. Shelf Scanner allows online detection of items on a shopping list, in video streams in which some or all items could appear simultaneously. To deal with the scale of the object detection task, the system leverages the approximate planarity of grocery store shelves to build a mosaic in real time using an optical flow algorithm. The system is then free to use any object detection algorithm without incurring a loss of data due to processing time. For purposes of speed we use a multi class naive-Bayes classifier inspired by NIMBLE, which is trained on enhanced SURF descriptors extracted from images in the GroZi-120 dataset. It is then used to compute per-class probability distributions on video key points for final classification. Our results suggest Shelf Scanner could be useful in cases where high-quality training data is available.

Original languageEnglish
Journal2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops, CVPRW 2010
Pages (from-to)49-56
Number of pages8
DOIs
Publication statusPublished - 2010
Externally publishedYes
Event2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops, CVPRW 2010 - San Francisco, CA, United States
Duration: 13 Jun 201018 Jun 2010

Conference

Conference2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops, CVPRW 2010
CountryUnited States
CitySan Francisco, CA
Period13/06/201018/06/2010

ID: 302048295