Using Mobile Phone Cameras to Interact with Ontological Data

  • Pierluigi Grillo
  • Silvia Likavec
  • Ilaria Lombardi
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6928)


In addition to being used to access data and services on the Internet, mobile phones can also be used to retrieve information about physical objects. In this paper we present a framework and a prototype implementation of a reality browsing system that exploits mobile camera phones as access points to ontological knowledge with the corresponding physical counterparts. The use of ontologies to represent the information about the objects of the domain permits for application of reasoning and querying techniques on domain elements. Users can identify a desired product by framing its logo, obtaining further information about the object in a direct, natural and intuitive way. In addition, users can perform Web 2.0 actions on objects, contributing to the creation and development of the network of objects and users. We also provide a brief description of the implemented interface and a real world user evaluation.


Mobile Phone Augmented Reality Domain Ontology Phone Camera Ontological Knowledge 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Biamino, G., Grillo, P., Lombardi, I., Marcengo, A., Rapp, A., Simeoni, R., Vernero, F.: “The Wheel”: an innovative visual model for interacting with a social web of things. In: Proc. of Visual Interfaces to the Social and Semantic Web, VISSW 2011(2011)Google Scholar
  2. 2.
    Bizer, C., Seaborne, A.: D2RQ - Treating Non-RDF Databases as Virtual RDF Graphs. In: McIlraith, S.A., Plexousakis, D., van Harmelen, F. (eds.) ISWC 2004. LNCS, vol. 3298. Springer, Heidelberg (2004),
  3. 3.
    Chiabrando, E., Furnari, R., Grillo, P., Likavec, S., Lombardi, I.: Dynamic interface reconfiguration based on different ontological relations. In: Smith, M.J., Salvendy, G. (eds.) HCII 2011, Part I. LNCS, vol. 6771, pp. 538–547. Springer, Heidelberg (2011)CrossRefGoogle Scholar
  4. 4.
    Gray, D., Kozintsev, I., Wu, Y., Haussecker, H.: Wikireality: augmenting reality with community driven websites. In: Proc. of the 2009 IEEE Intl. Conf. on Multimedia and Expo., ICME 2009, pp. 1290–1293. IEEE Press, Los Alamitos (2009)Google Scholar
  5. 5.
    Likavec, S., Lombardi, I., Nantiat, A., Picardi, C., Theseider Dupré, D.: Threading facts into a collective narrative world. In: Aylett, R., Lim, M.Y., Louchart, S., Petta, P., Riedl, M. (eds.) ICIDS 2010. LNCS, vol. 6432, pp. 86–97. Springer, Heidelberg (2010)CrossRefGoogle Scholar
  6. 6.
    Louvel, J., Boileau, T.: Restlet in Action. Manning Publications Co. (2009)Google Scholar
  7. 7.
    Megliola, M., Toffolo, S., Zoellner, M., Hodgson, B., Speller, L.: Intelligent tourism through ubiquitous services: Lessons learnt from two field studies. In: Proc. of eChallenges e-2009, IIMC (2009)Google Scholar
  8. 8.
    Pielot, M., Henze, N., Nickel, C., Menke, C., Samadi, S., Boll, S.: Evaluation of camera phone based interaction to access information related to posters. In: Proc. of Mobile Interaction with the Real World, MIRW 2008, pp. 61–72 (2008)Google Scholar
  9. 9.
    PIEMONTE Team. WantEat: interacting with social networks of intelligent things and people in the world of enogastronomy. In: Proc. of Interacting with Smart Objects Workshop 2011 (2011)Google Scholar
  10. 10.
    Rekimoto, J., Ayatsuka, Y.: Cybercode: designing augmented reality environments with visual tags. In: Proc. of DARE 2000 on Designing augmented reality environments, DARE 2000, pp. 1–10 (2000)Google Scholar
  11. 11.
    Richardson, L., Ruby, S.: RESTful web services. In: Media, O, (ed.) (2007),
  12. 12.
    Rohs, M., Gfeller, B.: Using camera-equipped mobile phones for interacting with real-world objects. In: Advances in Pervasive Computing, pp. 265–271 (2004)Google Scholar
  13. 13.
    Takacs, G., Xiong, Y., Grzeszczuk, R., Chandrasekhar, V., chao Chen, W., Pulli, K., Gelfand, N., Bismpigiannis, T., Girod, B.: Outdoors augmented reality on mobile phone using loxel-based visual feature organization. In: Proc. of ACM International Conference on Multimedia Information Retrieval, pp. 427–434 (2008)Google Scholar
  14. 14.
    Toye, E., Sharp, R., Madhavapeddy, A., Scott, D., Upton, E., Blackwell, A.: Interacting with mobile services: an evaluation of camera-phones and visual tags. Personal and Ubiquitous Computing 11(2), 97–106 (2007)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2012

Authors and Affiliations

  • Pierluigi Grillo
    • 1
  • Silvia Likavec
    • 1
  • Ilaria Lombardi
    • 1
  1. 1.Dipartimento di InformaticaUniversità di TorinoTorinoItaly

Personalised recommendations