Skip to main content
SpringerLink
Log in

Day and night at the museum: intangible computer interfaces for public exhibitions

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Computer technologies have been adopted in many different venues, including public exhibitions and museums, as they can easily support the exchange of natural interactions and provide unimaginable exploration tools of masterpieces and exhibits. This has led many to design and implement a plethora of different technologies for the detection, tracking and action recognition of visitors within a museum. Nonetheless, no single approach has been firmly accepted so far, as it typically suffers from the limitation of adopting separate techniques for detecting, tracking and recognizing the actions of visitors. The contribution of this paper is that of filling this gap: we propose a unifying methodology through which all of the abovementioned services can be handled within a museum. Furthermore, such methodology results being: (a) simple to implement, (b) non-invasive and (c) requiring minimal hardware resources. As significant evidence, we present the experimental results drawn from two relevant implementations: Mercator Atlas Robot exhibited at the Poggi Palace Museum of Bologna and Tortellino X-Perience at the World Expo held in Shanghai. Finally, we indicate how the presented approach can be extended to efficiently support any interaction with several visitors simultaneously.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

Similar content being viewed by others

References

  1. Albaum G (1997) “The Likert scale revisited: An alternate version”, Journal of the Market Research Society Market Research Society, ABI/INFORM Global 39(2):331

    Google Scholar 

  2. Arnab S, Petridis P, Dunwell I, de Freitas S (2011) “Enhacing learning in distributed virtual worlds through touch: A browser-based architecture for haptic interaction”, Serious Games and Edutainment Applications, Springer, pp. 149–167

  3. Bay H, Fasel B, Van Gool L (2006) “Interactive museum guide: Fast and robust recognition of museum objects”, in Proc. of the First International Workshop on Mobile Vision, Graz

  4. Bergamasco M (1999) “Le Musee del Formes Pures”, In Proc. of the 8th IEEE International Workshop on Robot and Human Interaction, Pisa

  5. Bologna Shanghai World Expo. Available online, accessed on the 20th of June 2011: http://www.bolognaexpo2010.it/zh20/tortellino-x-perience

  6. Brave S, Dahley A (1997) “In touch: A medium for haptic interpersonal communication”, In Proc. of the CHI ‘97 extended abstracts on Human factors in computing systems: looking to the future. Atlanta, pp. 363–364

  7. Cameron F, Kenderdine S (eds) (2006) Theorizing digital cultural heritage: A critical discourse. MIT Press, Cambridge

    Google Scholar 

  8. Carrozzino M, Bergamasco M (2010) “Beyond virtual museums: experiencing immersive virtual reality in real museums”, Journal of Cultural Heritage, Elsevier 11:452–458

    Google Scholar 

  9. Ciavarella C, Paternò F (2004) “Design of a handheld, location-aware guide for indoor environments”, Personal and Ubiquitous Computing, Springer 8(2):82–91

  10. Cohen E (1985) “The tourist guide: the origins, structure, and dynamics of a role”, Annals of Tourism Research, Elsevier, 12:5–29

  11. Feng-Sheng C, Chih-Ming F, Chung-Lin H (2003) Hand gesture recognition using a real-time tracking method and hidden markov models. Image Vis Comput 21(8):745–758

    Article  Google Scholar 

  12. Freeman WT, Anderson DB, Dodge CN, Roth M, Weissman CD, Yerazunis WS, Kage H, Kyuma I, Miyake Y, Tanaka K (1998) Computer vision for interactive computer graphics. IEEE Comput Graph Appl 18(3):42–53

    Article  Google Scholar 

  13. Fujiyoshi H, Lipton AJ (1998) “Real-time human motion analysis by Image Skeletonization”, in Proc. of the Fourth IEEE Workshop on Applications of Computer Vision, 1998. WACV ‘98. Proceedings, Princeton, pp.15–21

  14. Ghiani G, Paternò F, Santoro C, Spano LD (2009) “UbiCicero: a location-aware, multi-device museum guide”, Interacting with Computers, Elsevier 21(4):288–303

    Google Scholar 

  15. Giles J (2011) “One per cent: Video games teaches you to make the perfect tortellini”, New Scientist, Jan. 2011. Available online, accessed on the 20th of June 2011: http://www.newscientist.com/blogs/onepercent/2011/01/computer-game-that-teaches-you.html

  16. Han B, Comaniciu D, Davis L (2004) “Sequential kernel density approximation through mode propagation: Applications to background modeling”, In Proc. of the Asian Conference on Computer Vision

  17. Ishi H (2008) “Tangible bits: Beyond pixels,” In Proc. of the ACM Second International Conference on Tangible and Embedded Interaction, Bonn

  18. Kehl R, Van Gool L (2004) “Real-time pointing gesture recognition for an immersive environment”, in Proc. of the Sixth IEEE International Conference on Automatic Face and Gesture Recognition, Southampton, pp. 577–582

  19. Linge N, Bates D, Booth K, Parsons D, Heatly L, Webb P, Holgate R (2012) Realizing the potential of multimedia visitor guides: practical experiences of developing mi-guide. Museum Management and Curatorship, Taylor and Francis 27(1):67–82

    Article  Google Scholar 

  20. Malerczyk C (2004) “Interactive museum exhibit using pointing gesture recognition”, In Proc. of the 12-th International Conference in Central Europe on Computer Graphics, Visualization and Computer Vision, Plze-Bory, pp. 165–171

  21. Manresa C, Varona J, Mas R, Perales FJ (2005) Hand tracking and gesture recognition for human-computer interaction. Electronic Letters on Comput Vis Image Anal 5(3):96–104

    Google Scholar 

  22. Marfia G, Roccetti M, Varni A, Zanichelli M (2012) “Mercator atlas robot: Bridging the gap between ancient maps and modern travelers with gestural mixed reality”, In Proc. of the 21st IEEE International Conference on Computer Communication Networks (ICCCN 2012) - 8th International Workshop on Networking Issues in Multimedia Entertainment (NIME 2012), Munich

  23. Milosevic B, Farella E, Benini L (2010) “Continuous gesture recognition for resource constrained smart objects”, In Proc. of the International Conference on Mobile Ubiquitous Computing, Systems, Services and Technologies, Florence

  24. Mitzman D (2011) “Italian hi-tech software teaches perfect pasta skills”, BBC News (06/22/11). Available online, accessed on the 20th of June 2011: http://www.bbc.co.uk/news/world-europe-13856559

  25. Moeslund TB, Hilton A, Krüger V (2006) “A survey of advances in vision-based human motion capture and analysis”, Comput. Vis. Image Underst., Elsevier, New York, 104(2–3): 90–126

  26. Papagiannakis G, Singh G, Magnenat-Thalmann N (2008) A survey of mobile and wireless technologies for augmented reality systems. Comput Animat Virtual Worlds 19(1):3–22

    Article  Google Scholar 

  27. Pasch M, Bianchi-Berthouze N, Van Dijk B, Nijholt A (2009) “Movement-based sports video games: investigating motivation and gaming experience”, Entertainment Computing, Elsevier 1(2):49–61

  28. Pietroni E, Antinucci F (2010) “The approval of the franciscan rule. Virtual experience among the characters of Giotto’s Work”, in Proc. of Eleventh International Symposium on Virtual Reality, Archeology and Cultural Heritage, Paris, pp. 171–178

  29. Reis T, de Sa M, Carrico L (2008) “Multimodal artefact manipulation: Evaluation in real contexts”, In Proc. of Third International Conference on Pervasive Computing and Applications, Istanbul, pp. 570–575

  30. Rhalibi A, Merabti M, Fergus P, Yuanyuan S (2008) “Perceptual user interface as games controller”, in Proc. 5th IEEE Consumer Communications and Networking Conference, Las Vegas, pp. 1059–1064

  31. Robertson J (2011) “The wonderful world of cooking interfaces”, Computers, creativity and learning (Blog). Available online, accessed on the 20th of June 2011: http://judyrobertson.typepad.com/judy_robertson/2011/02/the-wonderful-world-of-cooking-interfaces.html

  32. Roccetti M, Marfia G (2011) “Recognizing intuitive pre-defined gestures for cultural specific interactions: An image-based approach”, In Proc. of the 3rd IEEE International Workshop on Digital Entertainment, Networked Virtual Environments, and Creative Technology, Las Vegas

  33. Roccetti M, Marfia G, Amoroso A, Caraceni S, Varni A (2012) ”Augmenting augmented reality with pairwise interactions: The case of count Luigi Ferdinando Marsili shooting game”, in Proc. of the 4th IEEE International Workshop on Digital Entertainment, Networked Virtual Environments, and Creative Technology (DENVECT’12) - 9th IEEE Communications and Networking Conference (CCNC 2012), Las Vegas

  34. Roccetti M, Marfia G, Zanichelli M (2010) The art and craft of making the tortellino: playing with a digital gesture recognizer for preparing pasta culinary recipes. ACM Computers in Entertainment, ACM, vol. 8, n. 4

  35. Rubegni E, Memarovic N, Langheinrich M (2011) “CATS: Using scenario dramatization to rapidly design public displays for stimulating community interaction”, in Proc. of the 29th ACM International Conference on Design of communication (SIGDOC ’11)

  36. Simpson Z (2002) “Shadow garden”, In SIGGRAPH 2002 Electronic Art and Animation Catalog

  37. Snibbe SS, Raffle HS (2009) “Social immersive media: Pursuing best practices for multi-user interactive camera/projector exhibits”, In Proc. of the 27th international conference on Human factors in computing systems

  38. Sridhar A, Sowmya A (2008) “Multiple camera, multiple person tracking with pointing gesture recognition in immersive environments”, Advances in Visual Computing, Lecture Notes in Computer Science 5358:508–519

  39. Stock O, Zancanaro Z, Busetta P, Callaway C, Kruger A, Kruppa M, Kuflik T, Not W, Rocchi C (2007) “Adaptive, intelligent presentation of information for the museum visitor in PEACH”, User Modeling and User-Adapted Interaction, Springer, 17(3):257–304

  40. Vicario L, Monje M (2003) Another Guggenheim effect? the generation of a potentially Gentrifiable Neighbourhood in Bilbao. Urban Stud 40:2451–2468

    Article  Google Scholar 

  41. Wang RY, Popovic J (2009) Real-time hand-tracking with a color glove. ACM Trans Graph 28(3):1–8

    Google Scholar 

  42. Wren C, Azarbayejani A, Darrell T, Pentland A (1997) Pfinder: real-time tracking of the human body. IEEE Trans Patt Anal Machine Intell 19(7):780–785

    Article  Google Scholar 

  43. Yu E, Aggarwal JK (2009) “Human action recognition with extremities as semantic posture representation”, In Proc. of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, Miami, pp.1–8

  44. Zabulis X, Baltzakis H, Argyros A (2009) “Vision-based hand gesture recognition for human-computer interaction”, The Universal Access Handbook, Human Factors and Ergonomics, page 34.1–34.30. Lawrence Erlbaum Associates, Inc. (LEA)

  45. Mitra S, Acharaya T (2007) “Gesture recognition: a survey”, Trans. On Sys., Man and Cyb., IEEE, New York, 37(3):311–324

Download references

Acknowledgements

The authors acknowledge the Miur PRIN ALTERNET Project for supporting this work.

Author information

Authors and Affiliations

  1. University of Bologna, Mura Anteo Zamboni 7, 40127, Bologna, Italy

    Marco Roccetti, Gustavo Marfia & Cristian Bertuccioli

Authors
  1. Marco Roccetti
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Gustavo Marfia
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Cristian Bertuccioli
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Marco Roccetti.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Roccetti, M., Marfia, G. & Bertuccioli, C. Day and night at the museum: intangible computer interfaces for public exhibitions. Multimed Tools Appl 69, 1131–1157 (2014). https://doi.org/10.1007/s11042-013-1512-y

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-013-1512-y

Keywords

Search

Navigation