A Vision-Based System for Object Identification and Information Retrieval in a Smart Home

  • Raphael Grech
  • Dorothy Monekosso
  • Deon de Jager
  • Paolo Remagnino
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6439)


This paper describes a hand held device developed to assist people to locate and retrieve information about objects in a home. The system developed is a standalone device to assist persons with memory impairments such as people suffering from Alzheimer’s disease. A second application is object detection and localization for a mobile robot operating in an ambient assisted living environment. The device relies on computer vision techniques to locate a tagged object situated in the environment. The tag is a 2D color printed pattern with a detection range and a field of view such that the user may point from a distance of over 1 meter.


Smart home object detection and recognition 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Bradski, G., Kaehler, A.: Learning OpenCV: Computer Vision With The OpenCV Library. O’Reilly Media, Sebastopol (2008)Google Scholar
  2. 2.
    Coughlan, J., Manduchi, R.: Color targets: fiducials to help visually impaired people find their way by camera phone. EURASIP Journal on Image and Video Processing 2007(96357), 1–13 (2007)CrossRefGoogle Scholar
  3. 3.
    Coughlan, J., Manduchi, R.: Functional assessment of a camera phone-based wayfing system operated by blind and visually impaired users. International Journal on Artificial Intelligence Tools 18(3), 379–397 (2009)CrossRefGoogle Scholar
  4. 4.
    Hallberg, J., Nugent, C.D., Davies, R.J., Donnelly, M.: Localisation of forgotten items using rfid technology. In: International Conference on Information Technology and Applications in Biomedicine, pp. 1–4 (2009)Google Scholar
  5. 5.
    Kulyukin, V., Gharpure, C., Nicholson, J.: Robocart: Toward robot-assisted navigation of grocery stores by the visually impaired. In: IEEE International Conference on Intelligent Robots and Systems, pp. 2845–2850 (2005)Google Scholar
  6. 6.
    Kulyukin, V., Gharpure, C., Sute, P., De Graw, N., Nicholson, J.: A robotic wayfinding system for the visually impaired. In: International Conference on Innovative Applications of Artificial Intelligence, pp. 864–869 (2004)Google Scholar
  7. 7.
    Merler, M., Galleguillos, C., Belongie, S.: Recognizing groceries in situ using in vitro training data. In: IEEE International Conference on Computer Vision and Pattern Recognition, pp. 1–8 (2007)Google Scholar
  8. 8.
    Narasimhan, P., Gandhi, R., Rossi, D.: Smartphone-based assistive technologies for the blind. In: International Conference on Compilers, Architecture, and Synthesis for Embedded Systems, pp. 223–232 (2009)Google Scholar
  9. 9.
    Zhang, J., Zhang, Q., Hu, J.: Rgb color centroids segmentation (ccs) for face detection. International Journal on Graphics, Vision and Image Processing 9(II), 1–9 (2009)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2010

Authors and Affiliations

  • Raphael Grech
    • 2
  • Dorothy Monekosso
    • 1
  • Deon de Jager
    • 2
  • Paolo Remagnino
    • 2
  1. 1.Computer Science Research InstituteUniversity of UlsterUK
  2. 2.Digital Imaging Research CentreKingston UniversityUK

Personalised recommendations