Skip to main content
SpringerLink
Log in

Enhancing User Role in Augmented Reality Interactive Simulations

  • Chapter
  • First Online:
Human Factors in Augmented Reality Environments

Abstract

Recent hardware and software improvements fuelled the developing of innovative methodologies for achieving interactive simulations in augmented reality environments. These new approaches have changed the role of the user which is not more a simple spectator of the scene, but he is an active protagonist, altering the contents and taking part into simulation. All these enhancements have deeply modified the concept of augmented reality and have opened new scenarios for future applications in different technical and entertainment fields. The purpose of the chapter is to present recent methodologies for implementing high-interactive augmented reality simulations. In a first part, the chapter describes the most important approaches underling architectures, tangible interfaces, system-related and user-related aspects. Then, the chapter focuses on the emerging natural interface concept which allows to interpret the intent of the user without the use of additional tracking devices. This methodology is suitable for didactical, entertainment and technical applications and experimental tests are presented in order to evaluate the relating human factor as usability, accuracy, robustness, training difficulties, realism in comparison with standard methodologies.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
eBook
USD 16.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. R.T. Azuma, Y. Baillot R. Behringer, S. Feiner, S. Julier and B. MacIntyre. Recent advances in augmented reality. IEEE Computer Graphics, vol. 21(6), pp. 34–47, 2001.

    Google Scholar 

  2. J. Carmigniani, B. Furht, M. Anisetti, P. Ceravolo, E. Damiani, M. Ivkovic. Augmented reality technologies, systems and applications. Multimedia Tools and Applications, vol. 51, pp. 341–377, 2011.

    Article  Google Scholar 

  3. O. Bimber, R. Raskar. Spatial Augmented Reality: Merging Real and Virtual Worlds. A K Peters, Ltd, 2005.

    Google Scholar 

  4. J.L. Lugrin, M. Cavazza. Towards AR Game Engines. Proceedings of SEARIS - 3rd Workshop on Software Engineering and Architecture of Realtime Interactive Systems, Waltham, MA, USA, 2010.

    Google Scholar 

  5. L.T. De Paolis, G. Aloisio, M. Pulimeno. A Simulation of a Billiards Game Based on Marker Detection. Proceedings of the 2nd international Conferences on Advances in Computer-Human interactions, IEEE Computer Society, Washington, DC, USA, 2009.

    Google Scholar 

  6. O. Oda, L.J. Lister, S. White, S. Feiner. Developing an augmented reality racing game. Proceedings of the 2nd international Conference on Intelligent Technologies For interactive Entertainment, Cancun, Mexico, 2008.

    Google Scholar 

  7. C. Matysczok, R. Radkowski, J. Berssenbruegge. ARBowling: Immersive and Realistic Game Play in Real Environments Using Augmented Reality. of the 3rd IEEE/ACM international Symposium on Mixed and Augmented Reality, IEEE Computer Society, Washington, DC, USA, 2004.

    Google Scholar 

  8. F. Liarokapis. An augmented reality interface for visualizing and interacting with virtual content. Virtual Reality, vol. 11, pp. 23–43, 2007.

    Article  Google Scholar 

  9. P. Buchanan, H. Seichter, M. Billinghurst M, R. Grasset. Augmented reality and rigid body simulation for edutainment: the interesting mechanism - an AR puzzle to teach Newton physics. Proceedings of the 2008 international Conference on Advances in Computer Entertainment Technology, Yokohama, Japan, 2008.

    Google Scholar 

  10. S. Irawati, S. Hong, J Kim, H Ko. 3D edutainment environment: learning physics through VR/AR experiences. Proceedings of the International Conference on Advances in Computer Entertainment Technology, New York, NY, USA, 2008.

    Google Scholar 

  11. F. Liarokapis, P. Petridis, P.F. Lister, M. White. Multimedia augmented reality interface for E-learning (MARIE). World Transactions on Engineering and Technology Education, vol. 1(2), pp. 173–176, 2002.

    Google Scholar 

  12. Z. Pan, A.D. Cheok, H. Yang, J. Zhu, J. Shi. Virtual reality and mixed reality for virtual learning environments. Computers & Graphics, vol. 30, pp. 20–28, 2006.

    Article  Google Scholar 

  13. E. Samset, A. Talsma, O. Elle, L. Aurdal, H. Hirschberg, E. Fosse. A virtual environment for surgical image guidance in intraoperative MRI. Computer Aided Surgery, vol. 7(4), pp. 187–196, 2002.

    Google Scholar 

  14. P. Edwards, D. Hawkes, D. Hill, D. Jewell, R. Spink, A. Strong, M. Gleeson. Augmented reality in the stereo operating microscope for otolaryngology and neurological guidance. Computer Assisted Surgery, vol. 1(3), pp. 172–178, 1995.

    Google Scholar 

  15. M. Rosenthal, A. State, J. Lee, G. Hirota, J. Ackerman, K. Keller, E.D. Pisano, M. Jiroutek, K. Muller, H. Fuchs. Augmented reality guidance for needle biopsies: A randomized, controlled trial in phantoms. Lecture Notes in Computer Science: Medical Image Computing and Computer- Assisted Interventions (MICCAI), vol. 2208, pp. 240–248, 2001.

    Google Scholar 

  16. M.A. Livingston, L.J. Rosenblum, S.J. Julier, D. Brown, Y. Baillot, J.E. Swan, J.L. Gabbard, D. Hix. An augmented reality system for military operations in urban terrain. Proceedings of Interservice/Industry Training, Simulation, and Education Conference, Orlando, FL, USA, 2002.

    Google Scholar 

  17. M.A. Livingston, J.E. Swan, J.L. Gabbard, T.H. Höllerer, D. Hix, S.J. Julier, Y. Baillot, D. Brown. Resolving multiple occluded layers in augmented reality. Proceedings of the International Symposium on Mixed and Augmented Reality (ISMAR2003), Tokyo, Japan, 2003.

    Google Scholar 

  18. G. Klinker, O. Creighton et al. Augmented maintenance of powerplants: A prototyping case study of a mobile AR system. Proceedings of ISAR ‘01 - The Second IEEE and ACM International Symposium on Augmented Reality, New York, NY, USA, 2001.

    Google Scholar 

  19. B. Schwald, J. Figue, E. Chauvineau et al. STARMATE: Using Augmented Reality Technology for Computer Guided Maintenance of Complex Mechanical Elements. E-work and Ecommerce, vol. 1, pp. 196–202, 2001.

    Google Scholar 

  20. M. Stilman, P. Michel, J. Chestnutt, K. Nishiwaki, S. Kagami, J.J. Kuffner. Augmented Reality for Robot Development and Experimentation. Tech. Report CMU-RI-TR-05-55, Robotics Institute, Carnegie Mellon University, Pittsburgh, PA, USA, 2005.

    Google Scholar 

  21. S.K. Ong, Y. Pang, A.Y.C. Nee. Augmented Reality Aided Assembly Design and Planning. Annals of the CIRP, vol. 56(1), pp. 49–52, 2007.

    Google Scholar 

  22. P.P. Valentini, E. Pezzuti, D. Gattamelata. Virtual engineering in Augmented Reality. Chapter in Computer Animation, Nova Science Publisher Inc., New York, 2010.

    Google Scholar 

  23. Y. Pang, A.Y.C. Nee, S.K. Ong, M.L. Yuan, K. Youcef-Toumi. Assembly Feature Design in an Augmented Reality Environment. Assembly Automation, vol. 26(1), pp. 34–43, 2006.

    Google Scholar 

  24. P.P. Valentini. Interactive cable harnessing in Augmented Reality. International Journal on Interactive Design and Manufacturing, vol. 5, pp. 45–53, 2011.

    Article  Google Scholar 

  25. P.P. Valentini. Reverse Engineering Tools in Augmented Reality to Support Acquisition, Processing and Interactive Study of Cultural and Archaeological Heritage. Chapter in Virtual Reality, Nova Science Publisher Inc., New York, 2011.

    Google Scholar 

  26. W. Dangelmaier, M. Fischer, J. Gausemeier, M. Grafe, C. Matysczok, B. Mueck. Virtual and augmented reality support for discrete manufacturing system simulation. Computers in Industry, vol. 56, pp. 371–383, 2005.

    Article  Google Scholar 

  27. S.K. Ong, A.Y.C. Nee. Virtual and Augmented Reality Applications in Manufacturing. Springer, London, United Kingdom, 2004.

    Google Scholar 

  28. R. Reif, D. Walch. Augmented & Virtual Reality applications in the field of logistics. Visual Computing, vol. 24, pp. 987–994, 2008.

    Article  Google Scholar 

  29. S. Kirchner, P. Jablonka. Virtual Archaeology - VR based knowledge management and marketing in archaeology first results - nexts steps. Proceedings of the 2001 Conference on Virtual Reality, Archeology and Cultural Heritage Glyfada, Greece, 2001.

    Google Scholar 

  30. Liarokapis F, Sylaiou S et al. (2004) An interactive visualization interface for virtual museum. Proceedings of the 5th international symposium on Virtual Reality, Archaeology- Cultural Heritage, Brussels and Oudenaarde, Belgium

    Google Scholar 

  31. J. Vallino. Interactive augmented reality. PhD thesis, Department of Computer Science, University of Rochester, USA, 1998.

    Google Scholar 

  32. S. Kim, A.K. Dey. AR interfacing with prototype 3D applications based on user-centered interactivity. Computer-Aided Design, vol. 42, pp. 373–386, 2010.

    Article  Google Scholar 

  33. J. Gabbard, D. Hix. A Taxonomy of Usability Characteristics in Virtual Environments, Virginia Polytechnic Institute and State University, VA, USA, 1997.

    Google Scholar 

  34. C. Esposito. User interfaces for virtual reality systems. Human Factors in Computing Systems, CHI96 Conference Tutorial Notes, 1996.

    Google Scholar 

  35. F. Merienne. Human factors consideration in the interaction process with virtual environment. International Journal of Interactive Design and Manufacturing, vol. 4(2), pp. 83–86, 2010.

    Google Scholar 

  36. D. Bowmann, E. Kruijf, J. La Viola, I. Poupyrev. 3D User Interfaces: Theory and Practice. Addison-Wesley, 2005.

    Google Scholar 

  37. A. Jaimes, N. Sebe. Multimodal human-computer interaction: A survey. Computer vision and image understanding, vol. 108(1–2), pp. 116–134, 2007.

    Google Scholar 

  38. K. Fishkin. A taxonomy for and analysis of tangible interfaces. Personal Ubiquitous Computing, vol. 8(5), pp. 347–358, 2004.

    Google Scholar 

  39. B. Ullmer, H. Ishii. Emerging frameworks for tangible user interfaces. IBM Systems Journal, vol. 39(3–4), pp. 915–931, 2000.

    Google Scholar 

  40. M. Fiorentino, G. Monno, A.E. Uva. Tangible Interfaces for Augmented Engineering Data Management. Chapter in Augmented Reality, Intech, Croatia, 2010.

    Google Scholar 

  41. M. Akamatsu, I.S. MacKenzie, T. Hasbrouc. A Comparison of Tactile, Auditory, and Visual Feedback in a Pointing Task using a Mouse-type Device. Ergonomics, vol. 38, pp. 816–827, 1995.

    Article  Google Scholar 

  42. H. Slay, B. Thomas, R. Vernik. Tangible user interaction using augmented reality. Proceedings of the 3rd Australasian Conference on User interfaces, Melbourne, Victoria, Australia, 2002.

    Google Scholar 

  43. D. Bowmann, E. Kruijf, J. La Viola, I. Poupyrev. An Introduction to 3-D User Interface Design. Presence: Teleoperators and Virtual Environments, vol. 10(1), pp. 96–108, 2001.

    Article  Google Scholar 

  44. G.A. Lee, C. Nelles, M. Billinghurst, G.J. Kim. Immersive Authoring of Tangible Augmented Reality Applications. Proceedings of the 3rd IEEE/ACM international Symposium on Mixed and Augmented Reality, IEEE Computer Society, Washington, DC, USA, 2004.

    Google Scholar 

  45. P.P. Valentini, E. Pezzuti. Interactive Multibody Simulation in Augmented Reality. Journal of Theoretical and Applied Mechanics, vol. 48(3), pp. 733–750, 2010.

    Google Scholar 

  46. G. Guerra-Filho. Optical motion capture: theory and implementation. Journal of Theoretical and Applied Informatics, vol. 12(2), pp. 61–89, 2005.

    Google Scholar 

  47. D. Roetenberg. Inertial and magnetic sensing of human motion, Ph.D. dissertation, University of Twente, Twente, The Netherlands, 2006.

    Google Scholar 

  48. P.P. Valentini, L. Mariti. Improving interactive multibody simulation using precise tracking and sequential impulse solver. Proceedings of ECCOMAS Multibody Dynamics Congress, Bruxelles, Belgium, 2011.

    Google Scholar 

  49. P.P. Valentini, E. Pezzuti. Dynamic Splines for interactive simulation of elastic beams in Augmented Reality, Proc. of IMPROVE 2011 International congress, Venice, Italy, 2011.

    Google Scholar 

  50. P.P. Valentini. Interactive virtual assembling in augmented reality. International Journal on Interactive Design and Manufacturing, vol. 3, pp. 109–119, 2009.

    Article  Google Scholar 

  51. T. Berliner et al. Modelling of Humanoid forms from depth maps. U.S. Patent Application Publication n. US 2010/0034457 A1, 2010.

    Google Scholar 

  52. D.E. Breen, R.T. Whitaker, E. Rose, M. Tuceryan. Interactive Occlusion and Automatic Object Placement for Augmented Reality. Proceedings of Computer Graphics Forum EUROGRAPHICS’96, Poitiers, France, 1996.

    Google Scholar 

  53. J. Fischer, D. Bartz, W. Straßer. Occlusion Handling for Medical Augmented Reality using a Volumetric Phantom Model. Proceedings of ACM Symposium on Virtual Reality Software and Technology, Hong Kong, Cina, 2004.

    Google Scholar 

  54. K. Hayashi, H. Kato, S. Nishida. Occlusion detection of real objects using contour based stereo matching. Proceedings of ICAT, Christchurch, New Zealand, 2005.

    Google Scholar 

  55. Y. Tian, T. Tao Guan, C. Wang. Real-Time Occlusion Handling in Augmented Reality Based on an Object Tracking Approach. Sensors, vol. 10, pp. 2885–2900, 2010.

    Article  Google Scholar 

  56. J. Fischer, B. Huhle, A. Schilling. Using Time-of-Flight Range Data for Occlusion Handling in Augmented Reality. Proceedings of Eurographics Symposium on Virtual Environments (EGVE), Weimar, Germany, 2007.

    Google Scholar 

  57. C. Chae, K. Ko. Introduction of Physics Simulation in Augmented Reality. Proceedings of the International Symposium on Ubiquitous Virtual Reality, ISUVR. IEEE Computer Society, Washington, DC, USA, 2008.

    Google Scholar 

  58. W. Huagen, G. Shuming, P. Qunsheng. Virtual Grasping for Virtual Assembly Tasks. Proceedings of the 3rd International Conference on Image and Graphics, Hong Kong, China, 2004.

    Google Scholar 

  59. D.A. Bowmann, L.F. Hodges. An evaluation of techniques for grabbing and manipulating remote objects in immersive virtual environments, Proceeding of the Symposium on Interactive 3D Graphics, Providence, RI, USA, 1997.

    Google Scholar 

  60. B. Mac Namee, D. Beaney, Q. Dong. Motion in augmented reality games: an engine for creating plausible physical interactions in augmented reality games. Internaional Journal of Computer Games Technology, Article ID 979235, 2010.

    Google Scholar 

  61. B.V. Mirtich. Impulse-based dynamic simulation of rigid body systems. PhD thesis, University of California, Berkeley, CA, USA, 1996.

    Google Scholar 

  62. A. Schmitt, J. Bender, H. Prautzsch. On the convergence and correctness of impulse-based dynamic simulation. Internal report, n. 17, Institut für Betriebs und Dialogsysteme, Karlsruhe, Germany, 2005.

    Google Scholar 

  63. A. Schmitt, J. Bender. Impulse-based dynamic simulation of multibody systems: numerical comparison with standard methods. Proceedings of Automation of Discrete Production Engineering, Sozopol, Bulgaria, 2005.

    Google Scholar 

  64. E. Coumans. Bullet 2.74 Physics SDK Manual, 2009. [Online]. Available: http://bulletphysics.com [accessed may 2011].

Download references

Author information

Authors and Affiliations

  1. Department of Industrial Engineering, University of Rome “Tor Vergata”, via del Politecnico 1, 00133, Rome, Italy

    Pier Paolo Valentini

Authors
  1. Pier Paolo Valentini
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Pier Paolo Valentini .

Editor information

Editors and Affiliations

  1. CSIRO ICT Centre, Pembroke Road, Marsfield, 1710, New South Wales, Australia

    Weidong Huang

  2. CSIRO ICT Centre, Pembroke Road, Marsfield, 1710, New South Wales, Australia

    Leila Alem

  3. Mail Code 5580, Washington, 20375, District of Columbia, USA

    Mark A. Livingston

Rights and permissions

Reprints and permissions

Copyright information

© 2013 Springer Science+Business Media New York

About this chapter

Cite this chapter

Valentini, P.P. (2013). Enhancing User Role in Augmented Reality Interactive Simulations. In: Huang, W., Alem, L., Livingston, M. (eds) Human Factors in Augmented Reality Environments. Springer, New York, NY. https://doi.org/10.1007/978-1-4614-4205-9_10

Download citation

  • DOI: https://doi.org/10.1007/978-1-4614-4205-9_10

  • Published:

  • Publisher Name: Springer, New York, NY

  • Print ISBN: 978-1-4614-4204-2

  • Online ISBN: 978-1-4614-4205-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation