The EPOCH Multimodal Interface for Interacting with Digital Heritage Artefacts

  • Panagiotis Petridis
  • Daniel Pletinckx
  • Katerina Mania
  • Martin White
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4270)


In recent years, 3D and virtual reality have emerged as areas of extreme interest as methods for visualizing digital museum artefacts in context, and particularly over the Internet. The technology associated with these new visualization techniques has until now been very expensive. The advent of cheap computing and graphics cards coupled with increasing Internet ‘broadband’ access has made possible the implementation of effective virtual museums both online and within the museum. Virtual museums are valuable for the end-user for efficient and remote learning about their local heritage in a diverse multimodal manner. Multimodal access to museum artefacts can help the user to better understand and appreciate the objects and stories that the museum brings forward, but also creates a closer psychological bond between the user and his past. If we now couple cheap computing technologies, 3D and virtual reality with appropriate 3D interaction techniques based on formal usability evaluations, museums are able to implement high fidelity exhibitions that are intuitive for the museum visitor. This paper reports on the latest technological additions to the EPOCH Multimodal Interface, which is used as an interaction interface that can be implemented as part of a virtual museum interactive system.


Virtual Reality Virtual Environment Augmented Reality Virtual Object Input Device 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Aliakseyeu, D., Martens, J.B., Subramanian, S., Rauterberg, M.: Interaction Techniques for Navigation through and Manipulation of 2D and 3D Data. In: Proceedings of Eight Eurographics conference on Virtual Environments 2002 (2002)Google Scholar
  2. 2.
    Billinghurst, M., Kato, H., Poupyrev, I.: The MagicBook: A Traditional AR Interface. Computer and Graphics (2001)Google Scholar
  3. 3.
    Bowman, D., Kruijff, E., LaViola, J., Poupyrev, I.: An Introduction to 3D User Interface Design. Presence: Teleoperators and Virtual Environments 10(1), 96–108 (2001)CrossRefGoogle Scholar
  4. 4.
    Brogni, A., Avizzano, C.A., Evangelista, C., Bergamasco, M.: Technological Approach for Cultural Heritage: Augmented Reality. In: Proc. of 8th International Workshop on Robot and Human Interaction (1999)Google Scholar
  5. 5.
    Digicult Progress Report. Digicult Progress Report (Internet) (2006) (cited 01/06/2006), Available from:
  6. 6.
    Frohlich, B.P.J., Wind, J., Wesche, G., Gobel, M.: Cubic-Mouse-Based Interaction in Virtual Environments. IEEE Computer Graphics and Applications 20(4), 12–15 (2000)CrossRefGoogle Scholar
  7. 7.
    Hinckley, K., Pausch, R., Goble, J.C., Kassell, N.F.: A survey of design issues in spatial input. In: Proceedings of the Symposium on User Interface Software and Technology. ACM Press, New York (1994)Google Scholar
  8. 8.
    Hoffman, H., Groen, J., Rousseau, S., Hollander, A., Winn, W., Wells, M., Furness, T.: Tactile Augmentation: Enhancing presence in virtual reality with tactile feedback from real objects. American Psychological Society, San Francisco (1996)Google Scholar
  9. 9.
    Hoffman, H.: Virtual Reality: A New Tool for Interdisciplinary Psychology Research. CyberPsycology & Behaviour (1998)Google Scholar
  10. 10.
    Intersence (Internet) (2006) (cited 04/07/06), Available from:
  11. 11.
    Liarokapis, F., White, M., Lister, P.F.: Augmented Reality Interface Toolkit. In: IEEE Proc. International Symposium on Augmented and Virtual Reality, IV 2004-AVR, London (2004)Google Scholar
  12. 12.
    Liarokapis, F., Mourkoussis, N., White, M., Darcy, J., Sifniotis, M., Petridis, P., Basu, A., Lister, P.F.: Web3D and Augmented Reality to support Engineering Education. In: World Transactions on Engineering and Technology Education, UICEE (2004)Google Scholar
  13. 13.
    Mase, K., Kadobayashi, R., Nakatsu, R.: Meta-museum: A Supportive Augmented Reality Environment for Knowledge Sharing. In: Proceedings of International Conference on Virtual Systems and Multimedia (1996)Google Scholar
  14. 14.
  15. 15.
    Milosavljevic, M., Dale, R., Green, S.J., Paris, C., Williams, S.: Virtual Museums on the Information Superhighway: Prospects and Potholes. In: Proceedings of CIDOC 1998, the Annual Conference of the International Committee for Documentation of the International Council of Museums, Melbourne, Australia (1998)Google Scholar
  16. 16.
    Mourkoussis, N., Mania, K., Petridis, P., White, M., Rivera, F., Pletinckx, D.: An analysis of the effect of technological fidelity on perceptual fidelity. In: Proceedings of the IEA 2006 (International Ergonomics Association), 16th World Congress on Ergonomics, The Hague, Netherlands (to appear, 2006)Google Scholar
  17. 17.
    Mourkoussis, N., Liarokapis, F., Basu, A., White, M., Lister, P.F.: Using XML Technologies to Present Digital Content with Augmented Reality. In: Eurographics Ireland Chapter Workshop Proceedings, Cork (2004)Google Scholar
  18. 18.
    Mourkoussis, N., Liarokapis, F., Darcy, J., Pettersson, M., Petridis, P., Lister, P., White, M.: Virtual and Augmented Reality Applied to Educational and Cultural Heritage Domains. In: Proceedings of Business Applications of Virtual Reality, Workshop, Poland, Poznan (2002)Google Scholar
  19. 19.
    Oosterlynck, D., Pletinckx, D., White, M., Petridis, P., Thalmann, D., Clavien, M.: EPOCH Showcase 2.4.2: Multimodal Interface for Safe Presentation Of Valuable Objects. In: VAST 2004, Brussels, Belgium (2004)Google Scholar
  20. 20.
    Oviatt, S.: Multimodal Interfaces. In: Handbook of Human-Computer Interaction. Lawrence Erlbaum, Mahwah (2002)Google Scholar
  21. 21.
    Petridis, P., White, M., Mourkousis, N., Liarokapis, F., Sifiniotis, M., Basu, A., Gatzidis, C.: Exploring and Interacting with Virtual Museums. In: CAA 2005: The World in your eyes, Tomar, Portugal (2005)Google Scholar
  22. 22.
    Petridis, P., Pletinckx, D., White, M.: A Multimodal Interface for Presenting and Handling Virtual Artifacts. In: Proceedings of the Eleventh International Conference On Virtual Systems and Multimedia, Belgium, Ghent (2005)Google Scholar
  23. 23.
    Petridis, P., Mania, K., Pletinckx, D., White, M.: Usability Evaluation of the EPOCH Multimodal User Interface: Designing 3D Tangible Interactions. In: ACM Symposium on Virtual Reality Software and Technology, Cyprus (to appear, 2006)Google Scholar
  24. 24.
    PhotoModeler (Internet) (2006) (cited 05/02/2006), Available from:
  25. 25.
    Roussou, M.: Immersive Interactive Virtual Reality in the Museum. In: Proc. of TiLE (Trends in Leisure Entertainment) (2001)Google Scholar
  26. 26.
    Spacemouse (Internet) (2006) (cited 04/07/06), Available from:
  27. 27.
    Starner, T., Mann, S., Rhodes, B., Levine, J., Healey, J., Kirsch, D., Picard, R.W., Pentland, A.: Augmented Reality through Wearable Computing. Presence: Teleoperators and Virtual Environments 6(4), 386–398 (1997)Google Scholar
  28. 28.
    Subramanian, S., Aliakseyeu, D., Martens, J.B.: Empirical Evaluation of Performance in Hybrid 3D and 2D Interfaces. In: Human Computer Interaction - Interact 2003. OS Press, (c) IFIP, Zürich (2003)Google Scholar
  29. 29.
    Van Dam, A., Forsberg, A.S., Laidlaw, D.H., LaViola, J.J., Simpson, R.M.: Immersive VR for Scientific Visualization: A Progress Report. IEEE Computer Graphics and Applications 20(6), 26–52 (2000)CrossRefGoogle Scholar
  30. 30.
    White, M., Mourkoussis, N., Darcy, J., Petridis, P., Liarokapis, F., Lister, P., Walczak, K., Wojciechowski, R., Cellary, W., Chmielewski, J., Stawniak, M., Wiza, W., Patel, M., Stevenson, J., Manley, J., Giorgini, F., Sayd, P., Gaspard, F.: ARCO-An Architecture for Digitization, Management and Presentation of Virtual Exhibitions. In: IEEE Proceedings of 22nd International Conference on Computer Graphics, Greece, Crete (2004)Google Scholar
  31. 31.
    Witmer, B.G., Singer, M.J.: Measuring Presence in Virtual Environments: A Presence Questionnaire. Presence: Teleoperators and Virtual Environments 7(3), 225–240 (1998)CrossRefGoogle Scholar
  32. 32.
    Wuthrich, C.A.: An analysis and a Model of 3D Interaction Methods and Devices for Virtual Reality. In: Proc. of the Eurographics Workshop (1999)Google Scholar
  33. 33.
    Pletinckx, D., Silberman, N.A., Callebaut, D.: Heritage Presentation through Interactive Storytelling: A New Multimedia Database Approach. Journal of Visualization and Computer Animation (June 2003)Google Scholar
  34. 34.
    EPOCH Network of Excellence [Internet], 3DKIOSK info is available in the Research Section (2006) (cited, 04/07/06, available from

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Panagiotis Petridis
    • 1
  • Daniel Pletinckx
    • 2
  • Katerina Mania
    • 1
  • Martin White
    • 1
  1. 1.Department of Information TechnologyUniversity of SussexUnited Kingdom
  2. 2.Visual Dimension bvbaEnameBelgium

Personalised recommendations