Natural Interaction and Wearable Augmented Reality for the Enjoyment of the Cultural Heritage in Outdoor Conditions

  • Giuseppe Caggianese
  • Pietro Neroni
  • Luigi Gallo
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8853)


In this paper, a first prototype of a wearable, interactive augmented reality (AR) system for the enjoyment of the cultural heritage in outdoor environments, is presented. By using a binocular see-through display and a time-of-flight (ToF) depth sensor, the system provides the users with a visual augmentation of their surroundings and with touchless interaction techniques to interact with synthetic elements overlapping with the real world. The papers describes the hardware and software system components, and details the interface specifically designed for a socially acceptable cultural heritage exploration. Furthermore, the paper discusses the lesson learned from the first public presentation of the prototype we have carried out in Naples, Italy.


Cultural Heritage Augmented Reality Hand Gesture Depth Sensor Augmented Reality Application 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
  2. 2.
  3. 3.
  4. 4.
  5. 5.
  6. 6.
  7. 7.
  8. 8.
    Bai, H., Lee, G., Billinghurst, M.: Using 3d hand gestures and touch input for wearable ar interaction. In: CHI 2014 Extended Abstracts on Human Factors in Computing Systems, CHI EA 2014, pp. 1321–1326. ACM, New York (2014)Google Scholar
  9. 9.
    Billinghurst, M.: Augmented reality interfaces in human computation systems. In: Michelucci, P. (ed.) Handbook of Human Computation, pp. 317–331. Springer, New York (2013)Google Scholar
  10. 10.
    Boring, S., Jurmu, M., Butz, A.: Scroll, tilt or move it: Using mobile phones to continuously control pointers on large public displays. In: Proceedings of the 21st Annual Conference of the Australian Computer-Human Interaction Special Interest Group: Design: Open 24/7, OZCHI 2009, pp. 161–168. ACM, New York (2009)Google Scholar
  11. 11.
    Bowman, D.A., Wingrave, C.A., Campbell, J.M., Ly, V.Q., Rhoton, C.J.: Novel uses of pinch gloves for virtual environment interaction techniques. Virtual Reality 6(3), 122–129 (2002)CrossRefGoogle Scholar
  12. 12.
    Datcu, D., Lukosch, S.: Free-hands interaction in augmented reality. In: Proceedings of the 1st Symposium on Spatial User Interaction, SUI 2013, pp. 33–40. ACM, New York (2013)Google Scholar
  13. 13.
    Essmaeel, K., Gallo, L., Damiani, E., De Pietro, G., Dipanda, A.: Temporal denoising of kinect depth data. In: 2012 Eighth International Conference on Signal Image Technology and Internet Based Systems (SITIS), pp. 47–52. IEEE (2012)Google Scholar
  14. 14.
    Feiner, S., MacIntyre, B., Hollerer, T., Webster, A.: A touring machine: Prototyping 3d mobile augmented reality systems for exploring the urban environment. In: Proceedings of the 1st IEEE International Symposium on Wearable Computers, ISWC 1997, p. 74. IEEE Computer Society, Washington, DC (1997)Google Scholar
  15. 15.
    Gallo, L., Minutolo, A.: Design and comparative evaluation of smoothed pointing: A velocity-oriented remote pointing enhancement technique. International Journal of Human-Computer Studies 70(4), 287–300 (2012)CrossRefGoogle Scholar
  16. 16.
    Gallo, L., Ciampi, M., Minutolo, A.: Smoothed pointing: a user-friendly technique for precision enhanced remote pointing. In: 2010 International Conference on Complex, Intelligent and Software Intensive Systems (CISIS), pp. 712–717. IEEE (2010)Google Scholar
  17. 17.
    Hollerer, T., Feiner, S., Terauchi, T., Rashid, G., Hallaway, D.: Exploring mars: Developing indoor and outdoor user interfaces to a mobile augmented reality system. Computers and Graphics 23, 779–785 (1999)CrossRefGoogle Scholar
  18. 18.
    Jacob, R.J.K., Leggett, J.J., Myers, B.A., Pausch, R.: An agenda for human-computer interaction research: Interaction styles and input/output devices (1993)Google Scholar
  19. 19.
    Kerr, S.J., Rice, M.D., Teo, Y., Wan, M., Cheong, Y.L., Ng, J., Ng-Thamrin, L., Thura-Myo, T., Wren, D.: Wearable mobile augmented reality: Evaluating outdoor user experience. In: Proceedings of the 10th International Conference on Virtual Reality Continuum and Its Applications in Industry, VRCAI 2011, pp. 209–216. ACM, New York (2011)Google Scholar
  20. 20.
    Kumar, A., Waldron, K.J.: The workspaces of a mechanical manipulator. Journal of Mechanical Design 103(3) (1980)Google Scholar
  21. 21.
    Lee, M., Billinghurst, M., Baek, W., Green, R., Woo, W.: A usability study of multimodal input in an augmented reality environment. Virtual Reality 17(4), 293–305 (2013)CrossRefGoogle Scholar
  22. 22.
    Mine, M.R.: Virtual environment interaction techniques. University of North Carolina at Chapel Hill, Chapel Hill, NC, USA, Tech. rep. (1995)Google Scholar
  23. 23.
    Park, G., Ha, T., Woo, W.: Hand Tracking with a Near-Range Depth Camera for Virtual Object Manipulation in an Wearable Augmented Reality. In: Shumaker, R., Lackey, S. (eds.) VAMR 2014, Part I. LNCS, vol. 8525, pp. 396–405. Springer, Heidelberg (2014)Google Scholar
  24. 24.
    Placitelli, A.P., Gallo, L.: Low-cost augmented reality systems via 3d point cloud sensors. In: 2011 Seventh International Conference on Signal-Image Technology and Internet-Based Systems (SITIS), pp. 188–192. IEEE (2011)Google Scholar
  25. 25.
    Pulli, K., Chen, W.C., Gelfand, N., Grzeszczuk, R., Tico, M., Vedantham, R., Wang, X., Xiong, Y.: Mobile visual computing. In: International Symposium on Ubiquitous Virtual Reality, ISUVR 2009, pp. 3–6 (July 2009)Google Scholar
  26. 26.
    Starner, T.: Project glass: An extension of the self. IEEE Pervasive Computing 12(2), 14–16 (2013)CrossRefGoogle Scholar
  27. 27.
    Vlahakis, V., Karigiannis, J., Tsotros, M., Gounaris, M., Almeida, L., Stricker, D., Gleue, T., Christou, I.T., Carlucci, R., Ioannidis, N.: Archeoguide: First results of an augmented reality, mobile computing system in cultural heritage sites. In: Proceedings of the 2001 Conference on Virtual Reality, Archeology, and Cultural Heritage, VAST 2001, pp. 131–140. ACM, New York (2001)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2014

Authors and Affiliations

  • Giuseppe Caggianese
    • 1
  • Pietro Neroni
    • 1
  • Luigi Gallo
    • 1
  1. 1.Institute for High Performance Computing and NetworkingNational Research Council of Italy (ICAR-CNR)NaplesItaly

Personalised recommendations