A Mobile Phone Application Enabling Visually Impaired Users to Find and Read Product Barcodes
While there are many barcode readers available for identifying products in a supermarket or at home on mobile phones (e.g., Red Laser iPhone app), such readers are inaccessible to blind or visually impaired persons because of their reliance on visual feedback from the user to center the barcode in the camera’s field of view. We describe a mobile phone application that guides a visually impaired user to the barcode on a package in real-time using the phone’s built-in video camera. Once the barcode is located by the system, the user is prompted with audio signals to bring the camera closer to the barcode until it can be resolved by the camera, which is then decoded and the corresponding product information read aloud using text-to-speech. Experiments with a blind volunteer demonstrate proof of concept of our system, which allowed the volunteer to locate barcodes which were then translated to product information that was announced to the user. We successfully tested a series of common products, as well as user-generated barcodes labeling household items that may not come with barcodes.
KeywordsMobile Phone Camera Phone Candidate Area Blind User Computer Vision Algorithm
Unable to display preview. Download preview PDF.
- 1.Internet UPC Database, http://www.upcdatabase.com/
- 3.Narasimhan, P.: Trinetra: Assistive technologies for grocery shopping for the blind. In: IEEE-BAIS Symposium on Research in Assistive Technologies, Dayton, OH (April 2007)Google Scholar
- 4.Tekin, E., Coughlan, J.M.: An algorithm enabling blind users to find and read barcodes. In: IEEE Workshop on Applications of Computer Vision, Snowbird, UT (December 2009)Google Scholar
- 5.Tekin, E., Coughlan, J.M.: A bayesian algorithm for reading 1d barcodes. In: Sixth Canadian Conference on Computer and Robot Vision, Kelowna, BC, Canada (May 2009)Google Scholar
- 6.Wachenfeld, S., Terlunen, S., Jiang, X.: Robust recognition of 1-D barcodes using camera phones. In: 9th International Conference on Pattern Recognition, Tampa, FL, December 2008, pp. 1–4 (2008)Google Scholar