Keygraphs for Sign Detection in Indoor Environments by Mobile Phones

  • Henrique Morimitsu
  • Marcelo Hashimoto
  • Rodrigo B. Pimentel
  • Roberto M. CesarJr.
  • Roberto HirataJr.
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6658)

Abstract

We present an application for mobile phones to detect indoor signs and help in localization. Because it depends only on device capabilities, it is flexible and unconstrained. Detection is accomplished online by keygraph matching between sign images collected offline and the image from a mobile camera phone. After detection we apply a simple localization method based on a comparison between the detected sign and a dataset, consisting of images of the whole environment taken at different positions. We show the results obtained using the application in a local indoor environment.

This is a preview of subscription content, log in to check access.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Arth, C., Wagner, D., Klopschitz, M., Irschara, A., Schmalstieg, D.: Wide area localization on mobile phones. In: Proceedings of IEEE International Symposium on Mixed and Augmented Reality (ISMAR), pp. 73–82 (2009)Google Scholar
  2. 2.
    Bay, H., Ess, A., Tuytelaars, T., Gool, L.V.: Surf: Speeded up robust features. In: Computer Vision and Image Understanding (CVIU), vol. 110(3), pp. 346–359 (2008)Google Scholar
  3. 3.
    de Berg, M., Cheong, O., van Kreveld, M., Overmars, M.: Computational Geometry: Algorithms and Applications, 3rd edn. Springer, Heidelberg (2008)CrossRefMATHGoogle Scholar
  4. 4.
    Gammeter, S., Gassmann, A., Bossard, L., Quack, T., Gool, L.V.: Server-side object recognition and client-side object tracking for mobile augmented reality. In: IEEE International Workshop on Mobile Vision (2010)Google Scholar
  5. 5.
    Hartley, R., Zisserman, A.: Multiple View Geometry in Computer Vision, 2nd edn. Cambridge University Press, Cambridge (2004)CrossRefMATHGoogle Scholar
  6. 6.
    Hashimoto, M., Cesar Jr, R.M.: Object detection by keygraph classification. Graph-Based Representations in Pattern Recognition 5534, 223–232 (2009)CrossRefGoogle Scholar
  7. 7.
    Lowe, D.G.: Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision 60, 91–110 (2004)CrossRefGoogle Scholar
  8. 8.
    Manduchi, R., Coughlan, J., Ivanchenko, V.: Search strategies of visually impaired persons using a camera phone wayfinding system. In: 11th International Conference on Computers Helping People with Special Needs, ICCHP (2008)Google Scholar
  9. 9.
    Matas, J., Chum, O., Urba, M., Padja, T.: Robust wide baseline stereo from maximally stable extremal regions. In: Proceedings of British Machine Vision Conference, pp. 384–396 (2002)Google Scholar
  10. 10.
    Muja, M., Lowe, D.G.: Fast approximate nearest neighbors with automatic algorithm configuration. In: International Conference on Computer Vision Theory and Application (VISSAPP), pp. 331–340. INSTICC Press (2009)Google Scholar
  11. 11.
    Mulloni, A., Wagner, D., Barakonyi, I., Schmalstieg, D.: Indoor positioning and navigation with camera phones. IEEE Pervasive Computing 8, 22–31 (2009)CrossRefGoogle Scholar
  12. 12.
    Paucher, R., Turk, M.: Location-based augmented reality on mobile phones. In: IEEE International Workshop on Mobile Vision (2010)Google Scholar
  13. 13.
    Ravi, N., Shankar, P., Frankel, A., Elgammal, A., Iftode, L.: Indoor localization using camera phones. In: Proceedings of the Seventh IEEE Workshop on Mobile Computing Systems and Applications, pp. 1–7 (2006)Google Scholar
  14. 14.
    Rohs, M., Zweifel, P.: A conceptual framework for camera phone-based interaction techniques. In: Gellersen, H.-W., Want, R., Schmidt, A. (eds.) PERVASIVE 2005. LNCS, vol. 3468, pp. 171–189. Springer, Heidelberg (2005)CrossRefGoogle Scholar
  15. 15.
    Shi, J., Tomasi, C.: Good features to track. In: IEEE Conference on Computer Vision and Pattern Recognition, CVPR (1994)Google Scholar
  16. 16.
    Takacs, G., Chandrasekhar, V., Gelfand, N., Xiong, Y., Chen, W.C., Bismpigiannis, T., Grzeszczuk, R., Pulli, K., Girod, B.: Outdoors augmented reality on mobile phones using loxel-based visual feature organization. In: Proceedings of the 1st ACM Internation Conference on Multimedia Information Retrieval (MIR), pp. 427–434 (2008)Google Scholar
  17. 17.
    Tell, D., Carlsson, S.: Wide baseline point matching using affine invariants computed from intensity profiles. In: Vernon, D. (ed.) ECCV 2000. LNCS, vol. 1842, pp. 814–828. Springer, Heidelberg (2000)CrossRefGoogle Scholar
  18. 18.
    Tell, D., Carlsson, S.: Combining appearance and topology for wide baseline matching. In: Heyden, A., Sparr, G., Nielsen, M., Johansen, P. (eds.) ECCV 2002. LNCS, vol. 2350, pp. 68–81. Springer, Heidelberg (2002)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2011

Authors and Affiliations

  • Henrique Morimitsu
    • 1
  • Marcelo Hashimoto
    • 1
  • Rodrigo B. Pimentel
    • 1
  • Roberto M. CesarJr.
    • 1
  • Roberto HirataJr.
    • 1
  1. 1.Instituto de Matemática e Estatística - IMEUniversidade de São Paulo - USPBrazil

Personalised recommendations