Skip to main content
SpringerLink
Log in

A Survey of Haptics in Serious Gaming

  • Conference paper
  • First Online:
Games and Learning Alliance (GALA 2013)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 8605))

Included in the following conference series:

Abstract

Serious gaming often requires high level of realism for training and learning purposes. Haptic technology has been proved to be useful in many applications with an additional perception modality complementary to the audio and the vision. It provides novel user experience to enhance the immersion of virtual reality with a physical control-layer. This survey focuses on the haptic technology and its applications in serious gaming. Several categories of related applications are listed and discussed in details, primarily on haptics acts as cognitive aux and main component in serious games design. We categorize haptic devices into tactile, force feedback and hybrid ones to suit different haptic interfaces, followed by description of common haptic gadgets in gaming. Haptic modeling methods, in particular, available SDKs or libraries either for commercial or academic usage, are summarized. We also analyze the existing research difficulties and technology bottleneck with haptics and foresee the future research directions.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Dondlinger, M.J.: Educational video game design: a review of the literature. J. Appl. Educ. Technol. 4, 21–31 (2007)

    Google Scholar 

  2. Coles, T.R., Meglan, D., John, N.W.: The role of haptics in medical training simulators: a survey of the state of the art. IEEE Trans. Haptics 4, 51–66 (2011)

    Article  Google Scholar 

  3. Rego, P., Moreira, P.M., Reis, L.P.: Serious games for rehabilitation: a survey and a classification towards a taxonomy. In: 2010 5th Iberian Conference on Information Systems and Technologies (CISTI), pp. 1–6. IEEE (2010)

    Google Scholar 

  4. Kincaid, J.P., Westerlund, K.K.: Simulation in education and training. In: Proceedings of the 2009 Winter Simulation Conference (WSC), pp. 273–280. IEEE (2009)

    Google Scholar 

  5. Derryberry, A.: Serious games: online games for learning. Adobe Whitepaper, November 2007

    Google Scholar 

  6. Chan, M.S., Black, J.B.: Learning Newtonian mechanics with an animation game: the role of presentation format on mental model acquisition. In: Annual Meeting of the American Educational Research Association (AERA), Citeseer, San Francisco (2006)

    Google Scholar 

  7. Okamura, A.M., Richard, C., Cutkosky, M.R.: Feeling is believing: using a force-feedback joystick to teach dynamic systems. J. Eng. Educ. 91, 345–350 (2002)

    Article  Google Scholar 

  8. Krenek, A., Cernohorsky, M., Kabelác, Z., Ac, Z.K.: Haptic visualization of molecular model (1999)

    Google Scholar 

  9. Persson, P.B., Cooper, M.D., Tibell, L.A.E., Ainsworth, S., Ynnerman, A., Jonsson, B.H.: Designing and evaluating a haptic system for biomolecular education. In: Virtual Reality Conference, VR ‘07, pp. 171–178. IEEE (2007)

    Google Scholar 

  10. Chui, C.-K., Ong, J.S., Lian, Z.-Y., Wang, Z., Teo, J., Zhang, J., Yan, C.-H., Ong, S.-H., Wang, S.-C., Wong, H.-K.: Haptics in computer-mediated simulation: training in vertebroplasty surgery. Simul. Gaming 37, 438–451 (2006)

    Article  Google Scholar 

  11. Jing, Q., Yim-Pan, C., Wai-Man, P., Choi, K.-S., Pheng-Ann, H.: Learning blood management in orthopedic surgery through gameplay. IEEE Comput. Graph. Appl. 30, 45–57 (2010)

    Article  Google Scholar 

  12. De Paolis, L.T.: Serious game for laparoscopic suturing training. In: 2012 Sixth International Conference on Complex, Intelligent and Software Intensive Systems (CISIS), pp. 481–485. IEEE (2012)

    Google Scholar 

  13. Pan, J.J., Chang, J., Yang, X., Zhang, J.J., Qureshi, T., Howell, R., Hickish, T.: Graphic and haptic simulation system for virtual laparoscopic rectum surgery. Int. J. Med. Robot. Comput. Assist. Surg. 7, 304–317 (2011)

    Google Scholar 

  14. Yuan, B., Folmer, E., Harris Jr., F.: Game accessibility: a survey. Univ. Access Inf. Soc. 10, 81–100 (2011)

    Article  Google Scholar 

  15. Goude, D., Björk, S., Rydmark, M.: Game design in virtual reality systems for stroke rehabilitation. Stud. Health Technol. Inf. 125, 146–148 (2007)

    Google Scholar 

  16. Broeren, J., Sunnerhagen, K.S., Rydmark, M.: Haptic virtual rehabilitation in stroke: transferring research into clinical practice. Phys. Ther. Rev. 14, 322–335 (2009)

    Article  Google Scholar 

  17. Delbressine, F., Timmermans, A., Beursgens, L., de Jong, M., van Dam, A., Verweij, D., Janssen, M., Markopoulos, P.: Motivating arm-hand use for stroke patients by serious games. In: Conference Proceedings: Annual International Conference of the IEEE Engineering in Medicine and Biology Society, pp. 3564–3567 (2012)

    Google Scholar 

  18. De Weyer, T., Robert, K., Renny Octavia Hariandja, J., Alders, G., Coninx, K.: The social maze: a collaborative game to motivate MS patients for upper limb training. In: Herrlich, M., Malaka, R., Masuch, M. (eds.) ICEC 2012. LNCS, vol. 7522, pp. 476–479. Springer, Heidelberg (2012)

    Chapter  Google Scholar 

  19. Xu, Z., Yu, H., Yan, S.: Motor rehabilitation training after stroke using haptic handwriting and games. In: Proceedings of the 4th International Convention on Rehabilitation Engineering & Assistive Technology, 31. Singapore Therapeutic, Assistive & Rehabilitative Technologies (START) Centre (2010)

    Google Scholar 

  20. Pernalete, N., Edwards, S., Gottipati, R., Tipple, J., Kolipakam, V., Dubey, R.V.: Eye-hand coordination assessment/therapy using a robotic haptic device. In: 9th International Conference on Rehabilitation Robotics, ICORR 2005, pp. 25–28 (2005)

    Google Scholar 

  21. Pernalete, N., Tang, F., Chang, S.M., Cheng, F.Y., Vetter, P., Stegemann, M., Grantner, J.: Development of an evaluation function for eye-hand coordination robotic therapy. In: 2011 IEEE International Conference on Rehabilitation Robotics (ICORR), pp. 1–6 (2011)

    Google Scholar 

  22. Brütsch, K., Schuler, T., Koenig, A., Zimmerli, L., Mérillat, S., Lünenburger, L., Riener, R., Jäncke, L., Meyer-Heim, A.: Influence of virtual reality soccer game on walking performance in robotic assisted gait training for children (2010)

    Google Scholar 

  23. Henschke, M., Hobbs, D., Wilkinson, B.: Developing serious games for children with cerebral palsy: case study and pilot trial. In: Proceedings of the 24th Australian Computer-Human Interaction Conference, pp. 212–221. ACM (2012)

    Google Scholar 

  24. Yuan, B., Folmer, E.: Blind hero: enabling guitar hero for the visually impaired. In: Proceedings of the 10th International ACM SIGACCESS Conference on Computers and Accessibility, pp.169–176. ACM, Halifax (2008)

    Google Scholar 

  25. Němec, V., Sporka, A.J., Slavik, P.: Haptic and spatial audio based navigation of visually impaired users in virtual environment using low cost devices. In: Stary, C., Stephanidis, C. (eds.) UI4ALL 2004. LNCS, vol. 3196, pp. 452–459. Springer, Heidelberg (2004)

    Chapter  Google Scholar 

  26. Hayward, V., Astley, O.R., Cruz-Hernandez, M., Grant, D., Robles-De-La-Torre, G.: Haptic interfaces and devices. Sens. Rev. 24, 16–29 (2004)

    Article  Google Scholar 

  27. Benali-Khoudja, M., Hafez, M., Alexandre, J.-M., Kheddar, A.: Tactile interfaces: a state-of-the-art survey. In: Int. Symposium on Robotics (2004)

    Google Scholar 

  28. Benali-Khoudja, M., Hafez, M., Kheddar, A.: VITAL: an electromagnetic integrated tactile display. Displays 28, 133–144 (2007)

    Article  Google Scholar 

  29. Hasser, C., Weisenberger, J.M.: Preliminary evaluation of a shape memory alloy tactile feedback display. In: Proceedings of the ASME Winter Annual Meeting, Symposium on Haptic Interfaces for Virtual Environments and Teleoperator Systems (1993)

    Google Scholar 

  30. Tan, H.Z., Pentland, A.: Tactual displays for wearable computing. Pers. Technol. 1, 225–230 (1997)

    Article  Google Scholar 

  31. Pawluk, D.T., Van Buskirk, C., Killebrew, J., Hsiao, S., Johnson, K.: Control and pattern specification for a high density tactile array. In: IMECE Proc. of the ASME Dyn. Sys. and Control Div., pp. 97–102 (1998)

    Google Scholar 

  32. Ikei, Y., Yamada, M., Fukuda, S.: A new design of haptic texture display-Texture Display2-and its preliminary evaluation. In: Proceedings of the IEEE Virtual Reality 2001, pp. 21–28. IEEE (2001)

    Google Scholar 

  33. Wagner, C.R., Lederman, S.J., Howe, R.D.: A tactile shape display using RC servomotors. In: Proceedings of the 10th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, HAPTICS 2002, pp. 354–355. IEEE (2002)

    Google Scholar 

  34. Sato, K., Igarashi, E., Kimura, M.: Development of non-constrained master arm with tactile feedback device. In: Fifth International Conference on Advanced Robotics, ICAR 91, Robots in Unstructured Environments, 1991, pp. 334–338. IEEE (1991)

    Google Scholar 

  35. Watanabe, T., Fukui, S.: A method for controlling tactile sensation of surface roughness using ultrasonic vibration. In: Proceedings of the 1995 IEEE International Conference on Robotics and Automation 1995, pp. 1134–1139. IEEE (1995)

    Google Scholar 

  36. Benali-Khoudja, M., Beny, A.L., Hafez, M., Kheddar, A.: VT vector-touch: a new slip/stretch tactile display. In: Proceedings of the 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems, (IROS 2004), vol. 3584, pp. 3583–3588 (2004)

    Google Scholar 

  37. Chinello, F., Malvezzi, M., Pacchierotti, C., Prattichizzo, D.: A three DoFs wearable tactile display for exploration and manipulation of virtual objects. In: 2012 IEEE Haptics Symposium (HAPTICS), pp. 71–76 (2012)

    Google Scholar 

  38. Marquardt, N., Nacenta, M.A., Young, J.E., Carpendale, S., Greenberg, S., Sharlin, E.: The Haptic Tabletop Puck: tactile feedback for interactive tabletops. In: Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces, pp. 85–92. ACM, Banff (2009)

    Google Scholar 

  39. Hoshi, T.: Development of aerial-input and aerial-tactile-feedback system. In: 2011 IEEE World Haptics Conference (WHC), pp. 569–573 (2011)

    Google Scholar 

  40. Bouzit, M., Burdea, G., Popescu, G., Boian, R.: The Rutgers Master II-new design force-feedback glove. IEEE/ASME Trans. Mechatron. 7, 256–263 (2002)

    Article  Google Scholar 

  41. Chen, E., Eberman, B., Marcus, B.A.: Method and Apparatus to Create a Complex Tctile Sensation. Microsoft Corporation, US (1998)

    Google Scholar 

  42. Frisoli, A., Rocchi, F., Marcheschi, S., Dettori, A., Salsedo, F., Bergamasco, M.: A new force-feedback arm exoskeleton for haptic interaction in virtual environments. In: First Joint Eurohaptics Conference, 2005 and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, 2005. World Haptics 2005, pp. 195–201 (2005)

    Google Scholar 

  43. Mackenzie, I.S.: Movement characteristics using a mouse with tactile and force feedback. Int. J. Hum.-Comput. Stud. 45, 483–493 (1996)

    Article  Google Scholar 

  44. Hasser, C.J., Daniels, M.W.: Tactile feedback with adaptive controller for a force-reflecting haptic display. 1. Design. In: Proceedings of the 1996 Fifteenth Southern Biomedical Engineering Conference 1996, pp. 526–529 (1996)

    Google Scholar 

  45. Kuchenbecker, K.J., Provancher, W.R., Niemeyer, G., Cutkosky, M.R.: Haptic display of contact location. In: Proceedings of the 12th International Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, HAPTICS ‘04, pp. 40–47 (2004)

    Google Scholar 

  46. Kuchenbecker, K.J., Ferguson, D., Kutzer, M., Moses, M., Okamura, A.M.: The touch thimble: providing fingertip contact feedback during point-force haptic interaction. In: Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, Haptics 2008, pp. 239–246 (2008)

    Google Scholar 

  47. Wagner, C.R., Perrin, D.P., Feller, R.L., Howe, R.D., Clatz, O., Delingette, H., Ayache, N.: Integrating tactile and force feedback with finite element models. In: Proceedings of the 2005 IEEE International Conference on Robotics and Automation, ICRA 2005, pp. 3942–3947 (2005)

    Google Scholar 

  48. Microsoft. http://www.microsoft.com/hardware/en-gb/touch-technology

  49. Schneider, C., Mustufa, T., Okamura, A.: A magnetically-actuated friction feedback mouse. In: Proceedings of EuroHaptics 2004, Munich, Allemagne, pp. 330–337 (2004)

    Google Scholar 

  50. Wanjoo, P., Sehyung, P., Laehyun, K., Seungjae, S.: Haptic mouse interface actuated by an electromagnet. In: 2011 International Conference on Complex, Intelligent and Software Intensive Systems (CISIS), pp. 643–646 (2011)

    Google Scholar 

  51. Nintendo. http://www.nintendo.com/wii/enhance/#/accessories

  52. Orozco, M., Silva, J., El Saddik, A., Petriu, E.: The role of haptics in games. In: El Saddik, A. (ed.) Haptics Rendering and Applications (2012). ISBN 978-953

    Google Scholar 

  53. TN Games. http://tngames.com/

  54. Palan, S.: Tactile Gaming Vest (TGV) (2010). http://iroboticist.com/2010/03/26/tgv/

  55. Mohellebi, H., Kheddar, A., Espie, S.: Adaptive haptic feedback steering wheel for driving simulators. IEEE Trans. Veh. Technol. 58, 1654–1666 (2009)

    Article  Google Scholar 

  56. Sungjae, H., Jung-hee, R.: The Haptic steering Wheel: vibro-tactile based navigation for the driving environment. In: 2010 8th IEEE International Conference on Pervasive Computing and Communications Workshops (PERCOM Workshops), pp. 660–665 (2010)

    Google Scholar 

  57. Ryu, J., Kim, H.: A Haptic Modeling System (2010)

    Google Scholar 

  58. Ott, R., De Perrot, V., Thalmann, D., Vexo, F.: MHaptic: a haptic manipulation library for generic virtual environments. In: International Conference on Cyberworlds, CW ‘07, pp. 338–345 (2007)

    Google Scholar 

  59. Anderson, T.G., Breckenridge, A., Davidson, G.S.: FGB: a graphical and haptic user interface for creating graphical, haptic user interfaces. Sandia National Labs., Albuquerque, NM (US); Sandia National Labs., Livermore, CA (US) (1999)

    Google Scholar 

  60. Yongwon, S., Beom-Chan, L., Yeongmi, K., Jong-Phil, K., Ryu, J.: K-HapticModelerTM: a haptic modeling scope and basic framework. In: IEEE International Workshop on Haptic, Audio and Visual Environments and Games, HAVE 2007, pp. 136–141 (2007)

    Google Scholar 

  61. Eid, M., Andrews, S., Alamri, A., El Saddik, A.: HAMLAT: a HAML-based authoring tool for haptic application development. In: Ferre, M. (ed.) EuroHaptics 2008. LNCS, vol. 5024, pp. 857–866. Springer, Heidelberg (2008)

    Google Scholar 

  62. SensAbleTechnologies. http://www.sensable.com/documents/documents/OpenHaptics_datasheet_hi.pdf

  63. Conti, F., Barbagli, F., Balaniuk, R., Halg, M., Lu, C., Morris, D., Sentis, L., Vileshin, E., Warren, J., Khatib, O.: The CHAI libraries. In: Proceedings of Eurohaptics 2003, pp. 496–500 (2003)

    Google Scholar 

  64. SenseGraphics. http://www.sensegraphics.com/datasheet/H3DAPI_datasheet.pdf

  65. ReachinTechnologies. http://www.reachin.se/products/ReachinAPI/

  66. ReachinTechnologies. http://www.haptx.com

  67. De Pascale, M., Prattichizzo, D.: The haptik library: a component based architecture for uniform access to haptic devices. IEEE Rob. Autom. Mag. 14, 64–75 (2007)

    Article  Google Scholar 

  68. McLaughlin, M.L., Hespanha, J.P., Sukhatme, G.S.: Introduction to Haptics. Prentice-Hall, Upper Saddle River (2002)

    Google Scholar 

  69. Otaduy, M.A., Lin, M.C.: Introduction to haptic rendering. In: ACM SIGGRAPH 2005 Courses, 3. ACM, Los Angeles (2005)

    Google Scholar 

  70. Bathe, K.-J.: Finite Element Procedures. Prentice Hall, Englewood Cliffs (1996)

    Google Scholar 

  71. Teran, J., Blemker, S., Hing, V., Fedkiw, R.: Finite volume methods for the simulation of skeletal muscle. In: Proceedings of the 2003 ACM SIGGRAPH/Eurographics Symposium on Computer Animation, pp. 68–74. Eurographics Association (2003)

    Google Scholar 

  72. James, D.L., Pai, D.K.: Multiresolution green’s function methods for interactive simulation of large-scale elastostatic objects. ACM Trans. Graph. (TOG) 22, 47–82 (2003)

    Article  Google Scholar 

  73. Chang, J., Yang, X., Pan, J.J., Li, W., Zhang, J.J.: A fast hybrid computation model for rectum deformation. Vis. Comput. 27, 97–107 (2011)

    Article  Google Scholar 

  74. Basdogan, C., Ho, C.-H., Srinivasan, M.A., Slater, M.: An experimental study on the role of touch in shared virtual environments. ACM Trans. Comput.-Hum. Interact. 7, 443–460 (2000)

    Article  Google Scholar 

  75. Kim, J., Kim, H., Tay, B.K., Muniyandi, M., Srinivasan, M.A., Jordan, J., Mortensen, J., Oliveira, M., Slater, M.: Transatlantic touch: a study of haptic collaboration over long distance. Presence: Teleoperators Virtual Environ. 13, 328–337 (2004)

    Article  Google Scholar 

  76. Liu, G., Lu, K.: Networked multiplayer cooperative interaction using decoupled motion control method in a shared virtual environment with haptic, visual and movement feedback. Computer Animation and Virtual Worlds (2012)

    Google Scholar 

  77. Yokokohji, Y., Hollis, R.L., Kanade, T.: What you can see is what you can feel-development of a visual/haptic interface to virtual environment. In: Proceedings of the IEEE 1996 Virtual Reality Annual International Symposium, pp. 46–53, 265. IEEE (1996)

    Google Scholar 

  78. Inami, M., Kawakami, N., Sekiguchi, D., Yanagida, Y., Maeda, T., Tachi, S.: Visuo-haptic display using head-mounted projector. In: Proceedings of the Virtual Reality 2000, pp. 233–240. IEEE (2000)

    Google Scholar 

  79. Arsenault, R., Ware, C.: Eye-hand co-ordination with force feedback. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 408–414. ACM (2000)

    Google Scholar 

  80. Avanzini, F., Crosato, P.: Haptic-auditory rendering and perception of contact stiffness. In: McGookin, D., Brewster, S. (eds.) HAID 2006. LNCS, vol. 4129, pp. 24–35. Springer, Heidelberg (2006)

    Chapter  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. National Centre for Computer Animation, The Media School, Bournemouth University, Fern Barrow, Poole, Dorset, BH12 5BB, UK

    Shujie Deng, Jian Chang & Jian J. Zhang

Authors
  1. Shujie Deng
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jian Chang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jian J. Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jian Chang .

Editor information

Editors and Affiliations

  1. University of Genova, Genova, Italy

    Alessandro De Gloria

Rights and permissions

Reprints and permissions

Copyright information

© 2014 Springer International Publishing Switzerland

About this paper

Cite this paper

Deng, S., Chang, J., Zhang, J.J. (2014). A Survey of Haptics in Serious Gaming. In: De Gloria, A. (eds) Games and Learning Alliance. GALA 2013. Lecture Notes in Computer Science(), vol 8605. Springer, Cham. https://doi.org/10.1007/978-3-319-12157-4_11

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-12157-4_11

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-12156-7

  • Online ISBN: 978-3-319-12157-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation