Skip to main content
SpringerLink
Log in

The eXperience Induction Machine: A New Paradigm for Mixed-Reality Interaction Design and Psychological Experimentation

  • Chapter
  • First Online:
The Engineering of Mixed Reality Systems

Part of the book series: Human-Computer Interaction Series ((HCIS))

Abstract

The eXperience Induction Machine (XIM) is one of the most advanced mixed-reality spaces available today. XIM is an immersive space that consists of physical sensors and effectors and which is conceptualized as a general-purpose infrastructure for research in the field of psychology and human–artifact interaction. In this chapter, we set out the epistemological rational behind XIM by putting the installation in the context of psychological research. The design and implementation of XIM are based on principles and technologies of neuromorphic control. We give a detailed description of the hardware infrastructure and software architecture, including the logic of the overall behavioral control. To illustrate the approach toward psychological experimentation, we discuss a number of practical applications of XIM. These include the so-called, persistent virtual community, the application in the research of the relationship between human experience and multi-modal stimulation, and an investigation of a mixed-reality social interaction paradigm.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 219.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. U. Bernardet, M. Blanchard, and P.F.M.J. Verschure, “IQR: A Distributed System for Real-Time Real-World Neuronal Simulation,” Neurocomputing, vol. 44–46, Jun. 2002, pp. 1043–1048.

    Article  Google Scholar 

  2. P. Milgram and F. Kishino, “A Taxonomy of Mixed Reality Visual Displays,” IEICE Transactions on Information Systems, vol. E77–D, Dec. 1994, pp. 1321–1329.

    Google Scholar 

  3. C. Coutrix and L. Nigay, “Mixed reality: a model of mixed interaction,” Proceedings of the Working Conference on Advanced Visual Interfaces, Venezia, Italy: ACM, 2006, pp. 43–50.

    Google Scholar 

  4. Y. Okuno, H. Kakuta, T. Takayama, and K. Asai, “Jellyfish party: blowing soap bubbles in mixed reality space,” Proceedings. The 2nd IEEE and ACM International Symposium on Mixed and Augmented Reality, 2003, pp. 358–359.

    Google Scholar 

  5. T. Narumi, A. Hiyama, T. Tanikawa, and M. Hirose, “Inter-glow,” ACM SIGGRAPH 2007 Emerging Technologies, San Diego, California: ACM, 2007, p. 14.

    Google Scholar 

  6. D. Tavares, A. Burlamaqui, A. Dias, M. Monteiro, V. Antunes, G. Thó, T. Tavares, C. Lima, L. Gonçalves, G. Lemos, P. Alsina, and A. Medeiros, “Hyperpresence – An application environment for control of multi-user agents in mixed reality spaces,” Proceedings of the 36th Annual Symposium on Simulation, IEEE Computer Society, 2003, p. 351.

    Google Scholar 

  7. A.D. Cheok, X. Yang, Z.Z. Ying, M. Billinghurst, and H. Kato, “Touch-Space: Mixed Reality Game Space Based on Ubiquitous, Tangible, and Social Computing,” Personal and Ubiquitous Computing, vol. 6, Dec. 2002, pp. 430–442.

    Article  Google Scholar 

  8. H. Ishii and B. Ullmer, “Tangible bits: towards seamless interfaces between people, bits and atoms,” Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Atlanta, Georgia, United States: ACM, 1997, pp. 234–241.

    Google Scholar 

  9. D. Birchfield, B. Mechtley, S. Hatton, and H. Thornburg, “Mixed-reality learning in the art museum context,” Proceeding of the 16th ACM International Conference on Multimedia, Vancouver, British Columbia, Canada: ACM, 2008, pp. 965–968.

    Google Scholar 

  10. V.B.D. Stanton and T. Pridmore, “Classroom collaboration in the design of tangible interfaces for storytelling,” CHI ’01: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, New York, USA: ACM, 2001, pp. 482 489.

    Google Scholar 

  11. W. Strauss, M. Fleischmann, M. Thomsen, J. Novak, U. Zlender, T. Kulessa, and F. Pragasky, “Staging the space of mixed reality – Reconsidering the concept of a multi user environment,” Proceedings of the Fourth Symposium on Virtual Reality Modeling Language, Paderborn, Germany: ACM, 1999, pp. 93–98.

    Google Scholar 

  12. A.D. Cheok, W. Weihua, X. Yang, S. Prince, F.S. Wan, M. Billinghurst, and H. Kato, “Interactive theatre experience in embodied + wearable mixed reality space,” Proceedings of the 1st International Symposium on Mixed and Augmented Reality, IEEE Computer Society, 2002, p. 59.

    Google Scholar 

  13. B. Brumitt, B. Meyers, J. Krumm, A. Kern, and S. Shafer, “EasyLiving: Technologies for Intelligent Environments,” Null, 2000, pp. 12–29.

    Google Scholar 

  14. R.A. Brooks, “The intelligent room project,” Proceedings of the 2nd International Conference on Cognitive Technology (CT ’97), IEEE Computer Society, 1997, p. 271.

    Google Scholar 

  15. T. Höllerer, J. Kuchera-Morin, and X. Amatriain, “The allosphere: a large-scale immersive surround-view instrument,” Proceedings of the 2007 Workshop on Emerging Displays Technologies: Images and Beyond: The Future of Displays and Interacton, San Diego, California: ACM, 2007, p. 3.

    Google Scholar 

  16. M. Mine, “Towards virtual reality for the masses: 10 years of research at Disney’s VR studio,” Proceedings of the Workshop on Virtual Environments 2003, Zurich, Switzerland: ACM, 2003, pp. 11–17.

    Google Scholar 

  17. A.F. Bobick, S.S. Intille, J.W. Davis, F. Baird, C.S. Pinhanez, L.W. Campbell, Y.A. Ivanov, A. Schutte, and A. Wilson, The KidsRoom: A Perceptually-Based Interactive and Immersive Story Environment,” Presence: Teleoperators & Virtual Environments, vol. 8, 1999, pp. 369–393.

    Google Scholar 

  18. K. Eng, A. Baebler, U. Bernardet, M. Blanchard, M. Costa, T. Delbruck, R.J. Douglas, K. Hepp, D. Klein, J. Manzolli, M. Mintz, F. Roth, U. Rutishauser, K. Wassermann, A.M. Whatley, A. Wittmann, R. Wyss, and P.F.M.J. Verschure, “Ada – intelligent space: An articial creature for the Swiss Expo.02,” Proceedings of the 2003 IEEE International Conference on Robotics and Automation (ICRA 2003), Sept. 14–19, 2003.

    Google Scholar 

  19. K. Eng, R. Douglas, and P.F.M.J. Verschure, “An Interactive Space that Learns to Influence Human Behavior,” Systems, Man and Cybernetics, Part A, IEEE Transactions on, vol. 35, 2005, pp. 66–77.

    Article  Google Scholar 

  20. R.L. Atkinson, R.C. Atkinson, and E.E. Smith, Hilgards Einführung in die Psychologie, Spektrum Akademischer, Verlag, 2001.

    Google Scholar 

  21. M. Eysenck, Perspectives On Psychology, Psychology Press, Routledge, London, 1994.

    Google Scholar 

  22. H. Coolican, Research Methods and Statistics in Psychology, A Hodder Arnold Publication, London, 2004.

    Google Scholar 

  23. S. Freud, Das Ich und das Es: Metapsychologische Schriften., Fischer (Tb.), Frankfurt, 1992.

    Google Scholar 

  24. A. Gaggioli, “Using Virtual Reality in Experimental Psychology,” Towards Cyberpsychology, Amsterdam: IOS Press, 2001, pp. 157–174.

    Google Scholar 

  25. M. Slater, A. Antley, A. Davison, D. Swapp, C. Guger, C. Barker, N. Pistrang, and M.V. Sanchez-Vives, “A Virtual Reprise of the Stanley Milgram Obedience Experiments,” PLoS ONE, vol. 1, 2006, p. e39.

    Article  Google Scholar 

  26. P.F.M.J. Verschure, T. Voegtlin, and R. Douglas, “Environmentally Mediated Synergy Between Perception and Behaviour in Mobile Robots,” Nature, vol. 425, 2003, pp. 620–624.

    Article  Google Scholar 

  27. H. Gubler, M. Parath, and N. Bischof, “Eine Ästimationsstudie zur Sicherheits- und Erregungsregulation während der Adoleszenz,” Untersuchungen zur Systemanalyse der sozialen Motivation (III), vol. 202, 1994, pp. 95–132.

    Google Scholar 

  28. W. Barfield, D. Zeltzer, T. Sheridan, and M. Slater, “Presence and Performance Within Virtual Environments,” Virtual Environments and Advanced Interface Design, Oxford University Press, Inc., Oxford, 1995, pp. 473–513.

    Google Scholar 

  29. T. Nagel, “What Is It Like to be a Bat?,” Philosophical Review, vol. 83, 1974, pp. 435–450.

    Article  Google Scholar 

  30. W.A. IJsselsteijn, H. de Ridder, J. Freeman, and S.E. Avons, “Presence: Concept, Determinants, and Measurement,” Human Vision and Electronic Imaging V, San Jose, CA, USA: 2000, pp. 520–529.

    Google Scholar 

  31. M. Slater, “RAVE Manifesto,” Barcelona, 2008.

    Google Scholar 

  32. J. Lessiter, J. Freeman, E. Keogh, and J. Davidoff, “A Cross-Media Presence Questionnaire: The ITC-Sense of Presence Inventory,” Presence: Teleoperators & Virtual Environments, vol. 10, 2001, pp. 282–297.

    Article  Google Scholar 

  33. G. Riva, C. Botella, P. Legeron, and G. Optale, Cybertherapy: Internet and Virtual Reality As Assessment and Rehabilitation Tools for Clinical Psychology and Neuroscience, IOS Press, 2004.

    Google Scholar 

  34. A. Frisoli, F. Simoncini, M. Bergamasco, and F. Salsedo, “Kinematic Design of a Two Contact Points Haptic Interface for the Thumb and Index Fingers of the Hand,” Journal of Mechanical Design, vol. 129, May. 2007, pp. 520–529.

    Article  Google Scholar 

  35. Z. Mathews, S. Bermúdez i Badia, and P.F.M.J. Verschure, “A novel brain-based approach for multi-modal multi-target tracking in a mixed reality space,” Proceedings of 4th INTUITION International Conference and Workshop on Virtual Reality 2007, Athens: 2007.

    Google Scholar 

  36. J. Manzolli and P.F.M.J. Verschure, “Roboser: A Real-World Composition System,” Computer Music Journal, vol. 29, 2005, pp. 55–74.

    Article  Google Scholar 

  37. K. Wassermann, J. Manzolli, K. Eng, and P.F.M.J. Verschure, “Live Soundscape Composition Based on Synthetic Emotions,” IEEE Multimedia, vol. 10, 2003, pp. 82–90.

    Article  Google Scholar 

  38. M. Slater, A. Frisoli, F. Tecchia, C. Guger, B. Lotto, A. Steed, G. Pfurtscheller, R. Leeb, M. Reiner, M.V. Sanchez-Vives, P. Verschure, and U. Bernardet, “Understanding and Realizing Presence in the Presenccia Project,” Computer Graphics and Applications, IEEE, vol. 27, 2007, pp. 90–93.

    Article  Google Scholar 

  39. T.W. Schubert, “The sense of presence in virtual environments: A three-component scale measuring spatial presence, involvement, and realness,” Zeitschrift für Medienpsychologie, vol. 15, 2003, pp. 69–71.

    Article  Google Scholar 

  40. B.G. Witmer and M.J. Singer, “Measuring Presence in Virtual Environments: A Presence Questionnaire,” Presence: Teleoperators & Virtual Environments, vol. 7, 1998, pp. 225–240.

    Article  Google Scholar 

  41. A. Brogni, V. Vinayagamoorthy, A. Steed, and M. Slater, “Variations in physiological responses of participants during different stages of an immersive virtual environment experiment,” Proceedings of the ACM Symposium on Virtual Reality Software and Technology, Limassol, Cyprus: ACM, 2006, pp. 376–382.

    Google Scholar 

  42. P.M. Emmelkamp and M. Felten, “The process of exposure in vivo: cognitive and physiological changes during treatment of acrophobia,” Behaviour Research and Therapy, vol. 23, 1985, pp. 219–223.

    Article  Google Scholar 

  43. M. Meehan, B. Insko, M. Whitton, and J. Frederick P. Brooks, “Physiological measures of presence in stressful virtual environments,” Proceedings of the 29th Annual Conference on Computer Graphics and Interactive Techniques, San Antonio, Texas: ACM, 2002, pp. 645–652.

    Google Scholar 

  44. M. Slater, “How Colorful Was Your Day? Why Questionnaires Cannot Assess Presence in Virtual Environments,” Presence: Teleoperators & Virtual Environments, vol. 13, 2004, pp. 484–493.

    Article  Google Scholar 

  45. U. Bernardet, M. Inderbitzin, S. Wierenga, A. Väljamäe, A. Mura, and P.F.M.J. Verschure, “Validating presence by relying on recollection: Human experience and performance in the mixed reality system XIM,” The 11th Annual International Workshop on Presence, October 25–27, 2008, pp. 178–182.

    Google Scholar 

  46. H. Dinh, N. Walker, L. Hodges, C. Song, and A. Kobayashi, “Evaluating the importance of multi-sensory input on memory and the sense of presence in virtual environments,” Virtual Reality, 1999. Proceedings, IEEE, 1999, pp. 222–228.

    Google Scholar 

  47. M. Inderbitzin, S. Wierenga, A. Väljamäe, U. Bernardet, and P.F.M.J. Verschure, “Social cooperation and competition in the mixed reality space eXperience Induction Machine.,” The 11th Annual International Workshop on Presence, October 25–27, 2008, pp. 314–318.

    Google Scholar 

  48. Anna Mura, B. Rezazadeh, A. Duff, J. Manzolli, S.L. Groux, Z. Mathews, U. Bernardet, S. Wierenga, S. Bermudez, S., and P. Verschure, “re(PER)curso: an interactive mixed reality chronicle,” ACM SIGGRAPH 2008 talks, Los Angeles, California: ACM, 2008, pp. 1–1.

    Google Scholar 

  49. T. Delbrück, A.M. Whatley, R. Douglas, K. Eng, K. Hepp, and P.F.M.J. Verschure, “A Tactile Luminous Floor for an Interactive Autonomous Space,” Robotics Autonomous System, vol. 55, 2007, pp. 433–443.

    Article  Google Scholar 

Download references

Acknowledgments

This work was carried out as part of the PRESENCCIA project, an EU-funded Integrated Project under the IST programme (Project Number 27731). The Original Floor System was developed by Institute of Neuroinformatics of ETH Zurich and of University of Zurich.

Author information

Authors and Affiliations

  1. SPECS@IUA: Laboratory for Synthetic Perceptive, Emotive, and Cognitive Systems, Universitat Pompeu Fabra, 08018, Barcelona, Spain

    Ulysses Bernardet

  2. SPECS@IUA: Laboratory for Synthetic Perceptive, Emotive, and Cognitive Systems, Universitat Pompeu Fabra, Tànger 135, 08018, Barcelona, Spain

    Sergi Bermúdez i Badia, Armin Duff, Martin Inderbitzin, Sylvain Le Groux, Zenon Mathews, Anna Mura & Paul F.M.J Verschure

  3. Interdisciplinary Nucleus for Sound Communications (NICS), State University of Campinas, Rua da Reitoria, 165 – Cidade Universitária “Zeferino Vaz” Campinas, São Paulo, Brasil

    Jônatas Manzolli

  4. Department of Applied Acoustics, Chalmers University of Technology, SE-412 96, Göteborg, Sweden

    Aleksander Väljamäe

  5. Research Laboratory for Synthetic Perceptive, Emotive and Cognitive Systems (SPECS), Institute of Audiovisual Studies, Universitat Pompeu Fabra, Barcelona, Spain

    Aleksander Väljamäe

  6. ICREA, Technology Department, Universitat Pompeu Fabra, Tánger 135, 08018, Barcelona, Spain

    Paul F.M.J Verschure

Authors
  1. Ulysses Bernardet
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Sergi Bermúdez i Badia
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Armin Duff
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Martin Inderbitzin
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Sylvain Le Groux
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Jônatas Manzolli
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Zenon Mathews
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Anna Mura
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Aleksander Väljamäe
    View author publications

    You can also search for this author in PubMed Google Scholar

  10. Paul F.M.J Verschure
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Ulysses Bernardet .

Editor information

Editors and Affiliations

  1. Institut de Recherches en, Université Toulouse III, route de Narbonne 118 , Toulouse CX 4, 31062, France

    Emmanuel Dubois

  2. Dept. Computing Science, University of Glasgow, Lilybank Gdns. 17, Glasgow, G12 8QQ, United Kingdom

    Philip Gray

  3. Labo. d'Informatique de Grenoble (LIG), Université Grenoble I, rue de la Bibliotheque 385, Grenoble, 38041, France

    Laurence Nigay

Rights and permissions

Reprints and permissions

Copyright information

© 2010 Springer-Verlag London

About this chapter

Cite this chapter

Bernardet, U. et al. (2010). The eXperience Induction Machine: A New Paradigm for Mixed-Reality Interaction Design and Psychological Experimentation. In: Dubois, E., Gray , P., Nigay, L. (eds) The Engineering of Mixed Reality Systems. Human-Computer Interaction Series. Springer, London. https://doi.org/10.1007/978-1-84882-733-2_18

Download citation

  • DOI: https://doi.org/10.1007/978-1-84882-733-2_18

  • Published:

  • Publisher Name: Springer, London

  • Print ISBN: 978-1-84882-732-5

  • Online ISBN: 978-1-84882-733-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation