Enhancing Learning in Distributed Virtual Worlds through Touch: A Browser-based Architecture for Haptic Interaction

  • Sylvester ArnabEmail author
  • Panagiotis Petridis
  • Ian Dunwell
  • Sara de Freitas


As technology evolves to support an increasingly diverse range of pedagogic approaches, various kinds of technology-driven interventions have already been integrated into conventional teaching methods, which include web-based tools and mobile devices, social networking environments and computer games. Such integration is capable of providing platforms to support formal and informal learning experiences, in both blended and standalone contexts. Innovations in teaching and learning, promoting a knowledge society, and supporting tremendous growth in demand for highly educated and skilled individuals, are influenced by the advances in technology as well as the emergence of a new generation for whom technology is an integral part of the learning process. This generation is able to migrate between existing and new technologies, building socially driven communities, and has high expectations of fidelity and dynamics from virtual learning environments.

However, as well as providing support for this fidelity, it is important to consider the pedagogic models that underpin innovative, technology-enhanced learning techniques. In order to increase and sustain engagement and receptiveness of the learner and to ensure effective learning outcomes, immersive learning facilitates the complete involvement of learners in their learning environment, harnessing techniques of exploration to enhance understanding of particular subjects. Whereas an encyclopaedic approach for understanding the characteristics of an ancient artefact requires a degree of intrinsic motivation on the part of the learner, examining and exploring the artefact first-hand via visual, social or tactile interaction can prove a more compelling and engaging experience, reaching wider student audiences more effectively.

Supporting experiential and exploratory models of learning, this chapter describes a method to combine different sensory elements of an immersive experience, to create an engaging and immersive multimodal approach to learning. By introducing tactile interfaces with visual and social, it is envisaged that learner perceptions will be more immersed and the gap between virtual and real spaces will be bridged by deeper involvement of the learner. By stimulating visual and tactile perceptions, real learning experiences may be more accurately replicated in a virtual world.


Virtual Environment Haptic Device Multimodal Interface Tactile Perception Virtual Learning Environment 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. Arnab, S., Raja, V.: Chapter 4: Simulating a deformable object using a surface mass spring system. In: Proceedings of the 3rd International Conference on Geometric Modeling and Imaging. GMAI, IEEE Computer Society, London, pp. 21–26 (2008). doi: 10.1109/GMAI.2008.24Google Scholar
  2. Arnab, S., Solanki, M., Raja, V.: A deformable surface model for breast simulation. In: 20th International Conference of the Society for Medical Innovation and Technology, Vienna, Austria, 28–30 Aug 2008Google Scholar
  3. Arnab, S., Petridis, P., Dunwell, I., de Freitas, S.: Touching artefacts in an ancient world on a browser-based platform. In: IADIS International Conference: Web Virtual Reality and Three-Dimensional Worlds 2010, Freiburg, Germany (2010)Google Scholar
  4. Bergamasco, M., Frisoli, A., Barbagli, F.: Haptics technologies and cultural heritage applications. In: Proceedings of Computer Animation, IEEE Computer Society, Geneva, Switzerland (2002). doi: 10.1109/CA.2002.1017503Google Scholar
  5. Bialeschki, M.: The three Rs for experiential education researchers. J. Experiential Educ.. 29(3), 366–368 (2007)Google Scholar
  6. Brewster, S.A: The impact of haptic ‘touching’ technology on cultural applications. In: Proceedings of EVA 2001, Vasari UK, s28, pp. 1–14 (2001)Google Scholar
  7. Brewster, S.A.: The impact of haptic ‘touching’ technology on cultural applications. In: Hemsley, J., Cappellini, V., Stanke, G. (eds.) Digital Applications for Cultural Heritage Institutions, pp. 273–284. Ashgate Press, Surrey, UK (2005)Google Scholar
  8. Brown, J.: New learning environments for the 21st century: Exploring the edge. Change. September/October, 18–24 (2006)Google Scholar
  9. Butler, M., Neave, P.: Object appreciation through haptic interaction. In: Proceedings of Ascilite, Melbourne (2008)Google Scholar
  10. Chalmer, A., Debattista, K., Ramic-Brkic, B.: Towards high-fidelity multi-sensory virtual environments. Visual Comput. Springer Berlin/Heidelberg 25(12), 1101–1108 (2009). doi: 10.1007/s00371-009-0389-2Google Scholar
  11. Chial, V.B., Greenish, S., Okamura, A.: On the display of haptic recordings for cutting biological tissues. In: 10th International Symposium on Haptic Interfaces for Virtual Environment and Tele-operator Systems, IEEE Virtual Reality Conference, pp. 80–87. Orlando, FL, USA (2002)Google Scholar
  12. Dawson, S., Cotin, S., Meglan, D., Shaffer, D.W., Ferrell, M.: Designing a computer based simulator for interventional cardiology training. Catheter. Cardiovas. Interv. 51, 522–527 (2000)CrossRefGoogle Scholar
  13. de Freitas, S., Neumann, T.: The use of ‘exploratory learning’ for supporting immersive learning in virtual environments. Comput. Educ. 52(2), 343–352 (2009)CrossRefGoogle Scholar
  14. Dettori, A., Avizzano, C.A., Marcheschi, S., Angerilli, M., Bergamasco, M., Loscos, C., Guerraz, A.: Art Touch with CREATE haptic interface. In: Proceedings of the 11th International Conference on Advanced Robotics, University of Coimbra, Portugal, June 30–July 3, 2003. doi = 10.1145/ 1180495.1180523Google Scholar
  15. Figueroa, P., Coral, M., Boulanger, P., Borda, J., Londono, P., Vega, F., Prieto, F., Restrepo, D.: Multi-modal exploration of small artefacts: An exhibition at the Gold Museum in Bogota. In: Spencer, S.N. (ed.) Proceedings of the 16th ACM Symposium on Virtual Reality Software and Technology (VRST ’09). ACM, New York, pp. 67–74 (2009). doi: 10.1145/1643928.1643945CrossRefGoogle Scholar
  16. Frisoli, A.: The Museum of Pure Form. PERCRO. (2004). Accessed 10 Feb 2011
  17. Gillenwater, C., Kumar, A., Moynihan, B., Van Drimmelen. J.: Use of haptics to augment presence in an experiential HCI environment. Haptics, presence, & experiential HCI environments, University of North Carolina at Chapel Hill. White paper. (2007). Accessed 10 Feb 2011
  18. Greenish, S., Hayward, V., Chial, V., Okamura, A.: Measurement, analysis, and display of haptic signals during surgical cutting.  Presence 6(12), 626–651 (2002)Google Scholar
  19. Guidi, G., Frischer, B.: Virtualizing ancient Rome: 3d acquisition and modeling of a large plaster-of-paris model of imperial Rome. In: Videometrics VIII, San Jose, CA, USA, pp. 119–133 (2005)Google Scholar
  20. Guidi, G., Frischer, B., Lucenti, I.: Rome reborn – virtualizing the ancient imperial Rome. In: Workshop on 3D Virtual Reconstruction and Visualization of Complex Architectures, ETH Zurich, Switzerland, 12–13 July 2007Google Scholar
  21. Jones, G., Andre, T., Negishi, A., Tretter, T., Kubasko, D., Bokinsky, A., Taylor, R., Superfine, R.: Hands-on science: The impact of haptic experiences on attitudes and concepts. National Association of Research in Science Teaching Annual Meeting, Philadelphia, PA (2003)Google Scholar
  22. Jones, M., Bokinsky, A., Tretter, T., Negishi, A. A comparision of learning with haptic and visual modalities. Haptics-e Electronic J. Haptics Res. 4(0). (2005). Accessed 21 Feb 2011
  23. Kaklanis, N., Tzovaras, D., Moustakas, K.: Haptic navigation in the world wide web. Universal Access in Human-Computer Interaction. Applications and Services. Lecture Notes in Computer Science, Vol. 5616, 707–715. Springer-Verlag, Berlin (2009)Google Scholar
  24. Katz, D.: The world of touch (Trans., Krueger, L.). Lawrence Erlbaum, Hillsdale, NJ (1989)Google Scholar
  25. Kolb, D.: Experiential Learning. Prentice Hall, New Jersey (1984)Google Scholar
  26. Laycock, S., Day, A.: Recent developments and applications of haptic devices. Comput. Graph. Forum 22(2), 117–132 (2003)CrossRefGoogle Scholar
  27. Lieu, A., Tendick, F., Cleary, K., Kaufmann, C.: A survey of surgical simulation: Applications, technology, and education. Presence 12(6), 599–614 (2003)CrossRefGoogle Scholar
  28. Minogue, J., Jones, M.G.: Haptics in education: Exploring an untapped sensory modality. Rev. Educ. Res. 76(3), 317–348 (2006)CrossRefGoogle Scholar
  29. Morris, D., Tan, H., Barbagli, F., Chang, T., Salisbury, K.: Haptic feedback enhances force skill learning. In: EuroHaptics Conference, 2007 and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. World Haptics 2007. Second Joint, pp. 21–26, 22–24 (2007). doi: 10.1109/WHC.2007.65Google Scholar
  30. Newell, F.N., Ernst, M.O., Tjan, B.S., Bülthoff, H.H.: Viewpoint dependence in visual and haptic object recognition. Psychol. Sci. 12(1), 37–42 (2001)CrossRefGoogle Scholar
  31. OFNS: Internet access: Households and individuals. Office for National Statistics. (2010). Accessed 10 Feb 2011
  32. Panzoli, D., Peters, C., Dunwell, I., Sanchez, S., Petridis, P., Protopsaltis, A., Scesa, V., de Freitas, S.: Levels of interaction: A user-guided experience in large-scale virtual environments. In: IEEE 2nd International Conference in Games and Virtual Worlds for Serious Applications (VS GAMES10), IEEE, Braga, Portugal, pp. 87–90, 26–27 Mar 2010. ISBN: 978-0-7695-3986-7Google Scholar
  33. Parker, B., Myrick, F.: A critical examination of high-fidelity human patient simulation within the context of nursing pedagogy. Nurse Educ. Today 29(3), 322–329 (2009)CrossRefGoogle Scholar
  34. Petridis, P., Dunwell, I., de Freitas, S., Panzoli, D.: An engine selection framework for high fidelity serious games. In: The 2nd International Conference on Games and Virtual Worlds for-Serious-Applications (VSgames’10), Braga, Portugal, 25–26 Mar (2010)Google Scholar
  35. Prensky, M.: Digital natives, digital immigrants. On the Horizon. MCB Univ. Press 9(5) (2001)Google Scholar
  36. Recker, S.: Virtual Gettysburg: Bringing the battlefield to life. (2007). Accessed 21 Feb 2011
  37. Ruffaldi, E., Frisoli, A., Gottlieb, C., Tecchia, F., Bergamasco, M.: A haptic toolkit for the development of immersive and web enabled games. In: Symposium on Virtual Reality Software and Technology (VRST), ACM, New York, Cyprus, pp. 320–323, 1–3 Nov 2006. doi: 10.1145/1180495.1180559Google Scholar
  38. Satava, R.M.: Surgical education and surgical simulation. World J. Surg. 25, 1484–1489 (2001)CrossRefGoogle Scholar
  39. Schiphorst, T.: Really, really small: The palpability of the invisible. In: Creativity and Cognition, pp. 7–16 (2007)Google Scholar
  40. Shams, L., Seitz, A.: Benefits of multisensory learning. Trends Cogn. Sci. 12(11), 411–417 (2008)CrossRefGoogle Scholar
  41. Solanki, M., Raja, V.: Modelling palpable masses for a virtual breast examination. In: 9th International Conference on Virtual-Reality Continuum and Its Applications in Industry, Seoul, South Korea, 12–13 Dec 2010. doi: 10.1109/BIYOMUT.2010.5479779Google Scholar
  42. Srinivasan, M.A., Basdogan, C.: Haptics in virtual environments: Taxonomy, research status and challenges. Comput. Graph. 21(4), 393–404 (1997)CrossRefGoogle Scholar
  43. Stone, R.J.: Haptic feedback: A potted history from telepresence to virtual reality. Robotica 10, 461–467 (1992)CrossRefGoogle Scholar
  44. Troche, J., Jacobson, J.: An exemplar of Ptolemaic Egyptian temples. Computer Applications in Archaeology (CAA), Granada, Spain, April (2010)Google Scholar
  45. Van Schaik, P., Turnbull, T., Van Wersch, A., Drummond, S.: Presence within a mixed reality environment. CyberPsychol Behav. 7(5), 540–552 (2004)CrossRefGoogle Scholar
  46. Warburton, S.: Second life in higher education: Assessing the potential for and the barriers to deploying virtual words in learning and teaching. Br. J. Educ. Technol. 40(3), 414–426 (2009)CrossRefMathSciNetGoogle Scholar
  47. Warburton, S., Garcia, M.P.: Defining a framework for teaching practices inside virtual immersive environments: The tension between control and pedagogical approach. In: Proceedings of RELive ’08 Conference, United Kingdom (2008)Google Scholar
  48. White, M., Petridis, P., Liarokapis, F., Plecinckx, D.: Multimodal mixed reality interfaces for visualizing digital heritage. Int. J. Archit. Comput. (IJAC) 5(2), 322–337, Special Issue on Cultural Heritage, Multi-Science (2008)Google Scholar

Copyright information

© Springer-Verlag London Limited 2011

Authors and Affiliations

  • Sylvester Arnab
    • 1
    Email author
  • Panagiotis Petridis
    • 1
  • Ian Dunwell
    • 1
  • Sara de Freitas
    • 2
  1. 1.Serious Games InstituteCoventry UniversityCoventryUK
  2. 2.Serious Games Institute (SGI)Coventry UniversityCoventryUK

Personalised recommendations