Advertisement

Embodiment in Virtual Reality Performance

Conference paper
  • 176 Downloads
Part of the Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering book series (LNICST, volume 367)

Abstract

In this publication, we present artistic and technical developments in creating and presenting dance performances in media art, where embodiment is crucial in the artistic process. We study and compare three distinct performances with dancers and one choreographer in the same dance company between 2009 and 2020. The degree of immersion in performance is then compared between the three pieces, created at Balleteatro, in Porto, addressing the transition from the real to the virtual in the performance perspective, with practical cases and direct observations in the way the audience learns different states of body representation through technological means. We initially present the NUVE performance (2010), interpreted by Né Barros, Co:Lateral (2016–2019), a performance that crosses different realities, and, finally, the transition to the UNA work (2020) that takes place in total virtuality. This publication focuses on the developments, the public experience, and the results obtained in more than 20 exhibitions in different locations, either in theater or auditorium and in conference venues.

Keywords

Embodiment Performance Virtual reality 

Notes

Acknowledgments

We are grateful to the entire Balleteatro technical and producing team that has supported the three projects described in this paper over the past ten years. To the research center CITAR (Research Center in Science and Technology of the Arts), School of Arts, Universidade Católica Portuguesa. To Casa Rolão in Braga for the space for some rehearsals. To the UNESCO Braga Media Arts organization, for the support in part of some equipment. To the EAI ArtsIT 2018 conference organization, in Braga. We would also like to thank the University of Minho’s engageLab laboratory for all the NUVE performance support in 2010. We also acknowledge the Openframeworks, OpenCV and Unity communities always very supportive in the on-line forums. Co:Lateral had the support of Direção Geral das Artes (https://www.dgartes.gov.pt/pt/noticia/2758).

References

  1. 1.
    Blades, H., DeLahunta, S.: Digital aptitude - finding the right questions for dance studies. Routledge Int. Handbook Res. Methods Digit. Human. 31–45, (2020).  https://doi.org/10.4324/9780429777028-4
  2. 2.
    Moura, J.M., Marcos, A., Barros, N., Branco, P.: NUVE: resizing the digital gesture. Int. J. Creative Interfaces Comput. Graph. 5, 87–100 (2014).  https://doi.org/10.4018/ijcicg.2014070106CrossRefGoogle Scholar
  3. 3.
    Leach, J.: Choreographic objects: contemporary dance, digital creations and prototyping social visibility. J. Cult. Econ. 7, 458–475 (2014).  https://doi.org/10.1080/17530350.2013.858058CrossRefGoogle Scholar
  4. 4.
    Kozel, S.: Closer: Performance, Technologies, Phenomenology. MIT Press, Leonardo Book Series (2007)Google Scholar
  5. 5.
    Cisneros, R.E., Wood, K., Whatley, S., et al.: Virtual reality and choreographic practice: the potential for new creative methods. Body Space Technol. 18, 1–32.  https://doi.org/10.16995/bst.305
  6. 6.
    Brooks, A.L.: Body Electric and Reality Feedback loops: Virtual Interactive Space & Entertainment Potentials. South Korea (2004)Google Scholar
  7. 7.
    Brooks, A.L.: Virtual Interactive Space (VIS): creating a unique dynamic HCI ludic engaging design (apparatus/method) for human performance and (re)habilitation. In: Antona, M., Stephanidis, C. (eds.) UAHCI 2015. LNCS, vol. 9176, pp. 419–427. Springer, Cham (2015).  https://doi.org/10.1007/978-3-319-20681-3_39CrossRefGoogle Scholar
  8. 8.
    Saltz, D.Z.: The art of interaction: interactivity, performativity, and computers. J. Aesthet. Art Critic. 55, 117–127 (1997).  https://doi.org/10.2307/431258CrossRefGoogle Scholar
  9. 9.
    Dixon, S.: Digital Performance: A History of New Media in Theater, Dance, Performance Art, and Installation. MIT Press (2007)CrossRefGoogle Scholar
  10. 10.
    Forest, F., Sugarman, D., Weston, J.: Communication esthetics, interactive participation and artistic systems of communication and expression. Des. Issues 4, 97–115 (1988).  https://doi.org/10.2307/1511394CrossRefGoogle Scholar
  11. 11.
    Heilig, M.L.: Sensorama U.S. Patent No. 3,050,870. 870 (1962)Google Scholar
  12. 12.
    Sutherland, I.E.: The ultimate display. In: Proceedings of the Congress of the Internation Federation of Information Processing (IFIP), pp. 506–508 (1965)Google Scholar
  13. 13.
    Moura, J.M., Kolen’ko, Y.: Sci-fi Miners: a virtual reality journey to the nanocluster scale. In: Proceedings of the 9th International Conference on Digital and Interactive Arts, pp. 1–10 (2019).  https://doi.org/10.1145/3359852.3359912
  14. 14.
    Fisher, S.S.: The NASA ames VIEWlab Project-A brief history. Presence: Teleoperators Virtual Environ. 25, 339–348 (2016).  https://doi.org/10.1162/PRES_a_00277
  15. 15.
    Lanier, J.: Virtually there. Sci. Am. 284, 66–75 (2001)CrossRefGoogle Scholar
  16. 16.
    Lanier, J.: Dawn of the New Everything : A Journey Through Virtual Reality. Bodley Head (2017)Google Scholar
  17. 17.
    Steuer, J.: Defining virtual reality: dimensions determining telepresence. J. Commun. 42, 73–93 (1992).  https://doi.org/10.1111/j.1460-2466.1992.tb00812.xCrossRefGoogle Scholar
  18. 18.
    Gigante, M.A.: Virtual reality: definitions. History Appl. Virtual Reality Syst. 3–14, (1993). https://doi.org/10.1016/b978-0-12-227748-1.50009-3
  19. 19.
    Cruz-Neira, C., Sandin, D.J., DeFanti, T.A.: Surround-screen projection-based virtual reality: the design and implementation of the CAVE. In: Proceedings of the 20th Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH 1993, pp. 135–142 (1993).  https://doi.org/10.1145/166117.166134
  20. 20.
    Swanson, K.: Second life: a science library presence in virtual reality. Sci. Technol. Libr. 27, 79–86 (2007).  https://doi.org/10.1300/J122v27n03_06CrossRefGoogle Scholar
  21. 21.
    Mazuryk, T., Gervautz, M.: Virtual Reality History. Applications, Technology and Future (1999)Google Scholar
  22. 22.
    Grau, O.: On the Visual Power of Digital Arts. For a New Archive and Museum Infrastructure in the 21st Century. Ediciones de la Universidad de Castilla-La Mancha (2016)Google Scholar
  23. 23.
    Shi, J., Honjo, T., Zhang, K., Furuya, K.: Using virtual reality to assess landscape: a comparative study between on-site survey and virtual reality of aesthetic preference and landscape cognition. Sustainability 12, 1–6 (2020).  https://doi.org/10.3390/su12072875CrossRefGoogle Scholar
  24. 24.
    Jamieson, H.V.: Adventures in cyberformance - experiments at the interface of theatre and the internet. Queensland University of Technology (2008)Google Scholar
  25. 25.
    Riva, G., Mantovani, F., Capideville, C.S., et al.: Affective interactions using virtual reality: the link between presence and emotions. Cyberpsychol. Behav. 10, 45–56 (2007).  https://doi.org/10.1089/cpb.2006.9993CrossRefGoogle Scholar
  26. 26.
    Baños, R.M., Botella, C., Alcañiz, M., et al.: Immersion and emotion: their impact on the sense of presence. Cyberpsychol. Behav. 7, 734–741 (2004).  https://doi.org/10.1089/cpb.2004.7.734CrossRefGoogle Scholar
  27. 27.
    Riva, G.: Virtual Reality. The Palgrave Encyclopedia of the Possible 1–10, (2020).  https://doi.org/10.1007/978-3-319-98390-5_34-1
  28. 28.
    Loomis, J.M.: Distal Attribution and Presence. Presence: Teleoperators Virtual Environ. 1, 113–119 (1992).  https://doi.org/10.1162/pres.1992.1.1.113
  29. 29.
    Auvray, M., Hanneton, S., Lenay, C., O’Regan, K.: There is something out there: distal attributtion in sensory substitution, twenty years later. J. Integr. Neurosci. 4, 505–521 (2005).  https://doi.org/10.1142/S0219635205001002CrossRefGoogle Scholar
  30. 30.
    Milgram, P., Takemura, H., Utsumi, A., Kishino, F.: Augmented reality : a class of displays on the reality - virtuality continuum. Syst. Res. 2351, 1–2 (1994).  https://doi.org/10.1117/12.197321CrossRefGoogle Scholar
  31. 31.
    Moura, J.M., Marcos, A.F., Barros, N., Branco, P.: NUVE: in between the analog and virtual body. In: Proceedings of 5th International Conference Tangible Embedded Embodied Interact TEI 2011 (2011).  https://doi.org/10.1145/1935701.1935804
  32. 32.
    Moura, J.M., Barros, N., Ferreira-Lopes, P.: Co: Lateral – realidades e virtualidades incorporadas. In: Vilela, E., Barros, N. (eds.) Performances no Contemporâneo, Coleção Es, pp. 179–198. Faculdade de Letras da Universidade do Porto, Politics and Knowledge Research Group, Instituto de Filosofia, Universidade do Porto, Porto (2018)Google Scholar
  33. 33.
    Krueger, M.W., Gionfriddo, T., Hinrichsen, K.: VIDEOPLACE - an artificial reality. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems - CHI 1985, pp. 35–43 (1985).  https://doi.org/10.1145/1165385.317463
  34. 34.
    Buscher, M., Hughes, J., O’Brien, J., Rodden, T.: Presence and Representation in Multimedia Art and Electronic Landscapes. The eSCAPE Project (1998)Google Scholar
  35. 35.
    Benayoun, M.: World Skin, A Photo Safari In The Land Of War By Maurice Benayoun - ADA | Archive Of Digital Art. https://www.digitalartarchive.at/database/general/work/world-skin.html. Accessed 6 May 2020
  36. 36.
    Moura, J.M.: A Dança como Performance Digital: O Projeto NUVE. Universidade do Minho (2012)Google Scholar
  37. 37.
    Moura, J.M., Barros, N., Ferreira-Lopes, P.: From real to virtual embodied performance-a case study between dance and technology. In: Park, J., Nam, J., Park, J.W. (eds.) Proceedings of the 25th International Symposium on Electronic Art (ISEA 2019). ISEA International, Gwangju, pp 370–377 (2019)Google Scholar
  38. 38.
    Microsoft: Kinect. https://pt.wikipedia.org/wiki/Kinect(2010)
  39. 39.
    Orbbec: Orbbec – Intelligent computing for everyone everywhere (2018). https://orbbec3d.com/. Accessed 21 Nov 2018
  40. 40.
    INTEL Intel®’s RealSenseTM. https://www.intelrealsense.com/. Accessed 21 Nov 2019
  41. 41.
    Lieberman, Z., Castro, A., Community, O.: Openframeworks (2004). https://openframeworks.cc
  42. 42.
    Fry, B., Reas, C.: Processing.org. In: Processing (2001). https://processing.org/
  43. 43.
    Bradski, G.: The OpenCV Library. Dr Dobb’s J Softw Tools (2000)Google Scholar
  44. 44.
    OpenCV Community OpenCV: Background Subtraction. https://docs.opencv.org/3.4/db/d5c/tutorial_py_bg_subtraction.html. Accessed 21 Nov 2018
  45. 45.
    Bruhn, A., Weickert, J., Schnörr, C.: Lucas/Kanade meets Horn/Schunck: combining local and global optic flow methods. Int. J. Comput. Vision 61, 1–21 (2005).  https://doi.org/10.1023/B:VISI.0000045324.43199.43CrossRefGoogle Scholar
  46. 46.
    Moura, J.M., Sousa, J., Branco, P., Marcos, A.F.: You move you interact : a full-body dance in-between reality and virtuality. In: Barbosa, Á., Marcos, A. (ed.) ARTECH 2008 : Proceedings of the 4th International Conference on Digital Arts. Universidade Católica Portuguesa, pp. 49–54 (2008)Google Scholar
  47. 47.
    Albert, J.A., Owolabi, V., Gebel, A., et al.: Evaluation of the pose tracking performance of the azure kinect and kinect v2 for gait analysis in comparison with a gold standard: a pilot study. Sensors (Switzerland) 20, 1–22 (2020).  https://doi.org/10.3390/s20185104CrossRefGoogle Scholar
  48. 48.
    Moura, J.M., Ferreira-Lopes, P.: Generative Face from Random Data, on How Computers Imagine Humans. In: Proceedings of the 8th International Conference on Digital Arts – ARTECH 2017, pp. 85–91 (2017).  https://doi.org/10.1145/3106548.3106605
  49. 49.
    Moura, J.M., Barros, N., Ferreira-Lopes, P.: UNA (by Né Barros and João Martinho Moura, 2020) | João Martinho Moura. https://jmartinho.net/una/. Accessed 6 Aug 2020

Copyright information

© ICST Institute for Computer Sciences, Social Informatics and Telecommunications Engineering 2021

Authors and Affiliations

  1. 1.School of ArtsUniversidade Católica PortuguesaPortoPortugal
  2. 2.BalleteatroPortoPortugal
  3. 3.University of Applied Sciences Mainz - IMGMainzGermany

Personalised recommendations