Skip to main content

Advertisement

SpringerLink
Log in

Multimodal, visuo-haptic games for abstract theory instruction: grabbing charged particles

  • Original Paper
  • Published:
Journal on Multimodal User Interfaces Aims and scope Submit manuscript

Abstract

An extensive metamorphosis is currently taking place in the education industry due to the rapid adoption of different technologies and the proliferation of new student-instructor and student–student interaction models. While traditional face-to-face interaction is still the norm, mobile, online and virtual augmentations are increasingly adopted worldwide. Moreover, with the advent of gaming technology besides the 3D visual paradigm, the “touch” and “feel” paradigm is slowly taking its place in the user interface design through gamification. While haptic (force feedback) devices were barely available a decade ago outside research laboratories, the rapid rise in gaming technology has driven the cost significantly lower enabling the spread of these devices in many households and the wide public. This article presents a novel haptic-based training tool implemented as a gaming scenario to assist students in learning of abstract concepts in Physics. The focus is on electromagnetism as one of the fundamental forces in nature and specifically the abstractions used as building blocks around the Lorentz force. Experimental results suggest that by introducing well designed visual-haptic interfaces in presenting abstract concepts, students become better engaged in the classrooms and superior learning outcomes can be achieved.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

Similar content being viewed by others

References

  1. Hayward J (2018) Haptics 2018–2028: technologies, markets and players”. https://www.idtechex.com/research/reports/haptics-2018-2028-technologies-markets-and-players-000596.asp. Accessed 20 Jan 2019

  2. Hamza-Lup FG, Bogdan CM, Popovici DM, Costea OD (2011) A survey of visuo-haptic simulation in surgical training. In: International conference on mobile, hybrid, and on-line learning, 22–28 February, Gosier, Guadeloupe, France

  3. Hamza-Lup FG, Kocadag FA (2013) Simulating forces. Learning through touch, virtual laboratories. In: International conference on mobile, hybrid, and on-line learning, 26 February–1 March, Nice, France, pp 55–58

  4. Danieau F, Lécuyer A, Guillotel P, Fleureau J, Mollet N, Christie M (2013) Enhancing audiovisual experience with haptic Feedback: a survey on HAV. IEEE Trans Haptics 6:193–205

    Article  Google Scholar 

  5. Robertson S, Munteanu C, Penn G (2018) Designing pronunciation learning tools: the case for interactivity against over-engineering. In: Proceedings of the 2018 CHI conference on human factors in computing systems (CHI ‘18). ACM, New York, NY, USA

  6. Coffield F, Moseley D, Hall E, Ecclestone K (2004) Learning styles and pedagogy in post-16 learning. A systematic and critical review. Learning and Skills Research Centre, London

    Google Scholar 

  7. Comai S, Mazza D (2010) A haptic-based framework for chemistry education: experiencing molecular interactions with touch. In: Lytras MD et al (eds) Technology enhanced learning. Quality of teaching and educational reform. TECH-EDUCATION 2010. Communications in computer and information science, vol 73. Springer, Berlin

    Google Scholar 

  8. Minogue J, Gail Jones M (2006) Haptics in education: exploring an untapped sensory modality. Rev Educ Res 76(3):317–348. https://doi.org/10.3102/00346543076003317

    Article  Google Scholar 

  9. San Diego JP, Cox MJ, Quinn BFA, Newton JT, Banerjee A, Woolford M (2012) Researching haptics in higher education: the complexity of developing haptics virtual learning systems and evaluating its impact on students’ learning. Comput Educ 59(1):156–166

    Article  Google Scholar 

  10. Hamza-Lup FG, Baird WH (2012) Feel the static and kinetic friction. In: EuroHaptics 2012, part I, LNCS 7282, 12–15 June, Tampere, Finland, pp 181 192

  11. Okamura AM, Richard C, Cutkosky MR (2002) Feeling is believing: using a force-feedback joystick to teach dynamic systems. J Eng Educ 91:345–349

    Article  Google Scholar 

  12. Neri L, Noguez J, Robledo-Rella V, Escobar-Castillejos D, Gonzalez-Nucamendi A (2018) Teaching classical mechanics concepts using visuo-haptic simulators. J Edu Technol Soc 21(2):85–97

    Google Scholar 

  13. Butt AL, Kardong-Edgren S, Ellertson A (2018) Using game-based virtual reality with haptics for skill acquisition. Clin Simul Nurs 16(25–32):1876–1899

    Google Scholar 

  14. Ria S, Cox ML, Quinn BF, San Diego JP, Bakir A, Woolford MJ (2018) A scoring system for assessing learning progression of dental students’ clinical skills using haptic virtual workstations. J Dent Educ 82(3):277–285

    Article  Google Scholar 

  15. Hamza-Lup FG, Bogdan CM, Popovici DM, Seitan A (2013) Liver pathology simulation: algorithm for haptic rendering and force maps for palpation assessment. In: Medicine meets virtual reality (MMVR 2013), San Diego, California, USA

  16. Stone JE, Gullingsrud J, Schulten K (2001) A system for interactive molecular dynamics. In: ACM symposium on interactive 3D graphics, pp 191–194

  17. Sankaranarayanan G, Weghorst S, Sanner M, Gillet A, Olson A (2003) Role of haptics in teaching structural molecular biology. In: Proceedings of 11th symposium on haptic interfaces for virtual environment and teleoperator systems, Los Angeles, CA

  18. Edwards BI, Bielawski KS, Prada R, Cheok AD (2018) Haptic virtual reality and immersive learning for enhanced organic chemistry instruction. Virtual Reality 23(4):363–373

    Article  Google Scholar 

  19. Williams RL, Chen Meng-Yun, Seaton Jeffery M (2003) Haptics-augmented simple machines educational tools. J Sci Educ Technol 12(1):16–27

    Article  Google Scholar 

  20. Silverman LK, Leviton LP, Haas SC (2015) Engaging different types of gifted learners. In: Vidergor HE, Harris CR (eds) Applied practice for educators of gifted and able learners. Sense Publishers, Rotterdam

    Google Scholar 

  21. Britannica E (2018) “Loretz Foce” encyclopedia Britannica. https://www.britannica.com/science/Lorentz-force. Accessed 15 Jan 2019

  22. Britannica E (2017) “Fleming’s Rule—Right HandRule”, encyclopedia Britannica. https://www.britannica.com/science/right-hand-rule-electromagnetism. Accessed 6 Jan 2019

  23. Stickel M (2014) Teaching electromagnetism with the inverted classroom approach: student perceptions and lessons learned. In: ASEE annual conference and exposition, conference proceedings

  24. Busan AM (2014) Learning styles of medical students—implications in education. Curr Health Sci J 40(2):104–110. https://doi.org/10.12865/CHSJ.40.02.04

    Article  Google Scholar 

  25. Wolfman SA, Bates RA (2005) Kinesthetic learning in the classroom. J Comput Sci Coll 21(1):203–206

    Google Scholar 

  26. Yapton MJ, England Mind Tools Ltd (1998) How your learning style affects use of mnemonics. http://www.mindtools.com/mnemlstylo.htm. Accessed 10 Jan 2019

  27. Poondej C, Lerdpornkulrat T (2016) The development of gamified learning activities to increase student engagement in learning. Aust Educ Comput 31(2):1–16

    Google Scholar 

  28. Pedreira O, García F, Brisaboa N, Piattini M (2015) Gamification in software engineering—a systematic mapping. Inf Softw Technol 57:157–168

    Article  Google Scholar 

  29. Arkadium (2017) 82% of millennials return to news sites that regularly use visuals. https://www.arkadium.com/newsroom/82-of-millennials-return-to-news-sites-that-regularly-use-visuals/. Accessed 15 Jan 2019

  30. SenseGraphics (2018) H3DAPI—data sheet and white pages. www.sensegraphics.com/datasheet/H3DAPI_datasheet.pdf. Accessed 15 Jan 2019

  31. Tsalamlal MY, Ouarti N, Ammi M (2013) Non-intrusive haptic interfaces: state-of-the art survey. In: Oakley I, Brewster S (eds) Haptic and audio interaction design (HAID 2013), Lecture notes in computer science, vol 7989. Springer, Berlin, Heidelberg

  32. Novint (2016) Novint falcon game controller. https://www.sandia.gov/research/research_development_100_awards/_assets/documents/2007_winners/novint_SAND2007-1997P.pdf. Accessed 18 Jan 2019

  33. CHAI3D (2018) Computer haptics and active interfaces—CHAI3D. https://www.chai3d.org. Accessed 10 Oct 2018

  34. OpenHaptics (2018) Open haptic by 3D systems “OpenHaptics Developer Edition. https://www.3dsystems.com/haptics-devices/openhaptics. Accessed 10 Oct 2018

  35. SOFA (2018) Simulation open framework architecture (SOFA). http://www.sofa-framework.org. Accessed 2 Oct 2018

  36. Popovici DM, Hamza-Lup FG, Seitan A, Bogdan CM (2012) Comparative study of APIs and frameworks for haptic application development. In: 12th international conference on cyber worlds, Darmstadt, Germania, 25–27 September, 2012, pp 37–44

  37. X3D (2018) The X3D standard. https://www.web3d.org

  38. Python (2018) Programming language introduction. https://www.python.org/about/. Accessed 4 Jan 2019

  39. Hamza-Lup FG, Stanescu IA (2010) The haptic paradigm in education: challenges and case studies. Internet Higher Educ J 13(1):78–81

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Computer Science, Georgia Southern University, Savannah, GA, 31419, USA

    Felix G. Hamza-Lup

  2. Management and Marketing, Valahia University of Targoviste, Targoviste, Romania

    Ioana R. Goldbach

Authors
  1. Felix G. Hamza-Lup
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ioana R. Goldbach
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Felix G. Hamza-Lup.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Hamza-Lup, F.G., Goldbach, I.R. Multimodal, visuo-haptic games for abstract theory instruction: grabbing charged particles. J Multimodal User Interfaces 15, 1–10 (2021). https://doi.org/10.1007/s12193-020-00327-x

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12193-020-00327-x

Keywords

Search

Navigation