Abstract
This article is based on the CIGALE project, an interdisciplinary research between digital art, linguistics, and theater on motion capture and interaction with artistic, co-speech and expressive gestures. The aim of this project is to explore an interactive gestural dialogue between spectator and virtual actor. We will explain how our artistic modalities deal with space, time, and movement in a particular way to achieve our specific artistic goal: to encourage the emergence of a gestural interaction between human and virtual actors, thus giving the feeling of a “living” dialogue opening on an aesthetics of improvisation. First, we will describe the design and development process of InterACTE, an artistic installation for improvised gestural interaction between a spectator and a digital partner (virtual actor). Then, from seven recorded videos of interactions between the virtual actor and the spectator, we will present the interdisciplinary study we conducted with an artistic approach, and a linguistic approach.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
The CIGALE project (Capture and Interaction with Artistic, Language and Expressive Gestures), supported by the Labex ARTS-H2H and led by the Digital Image and Virtual Reality team of the AI-AC laboratory of the University of Paris 8, the Laboratory Structures Formelles du Langage of the CNRS and the University of Paris 8, UQAM University, the Conservatoire National Supérieur d'Art Dramatique, the Laboratory for Movement Analysis, the Solidanim company and the association Arts resonances.
- 2.
InterACTE (2015) Dimitrios Batras, Judith Guez, Jean-François Jego, Marie-Hélène Tramus, University Paris 8 Campus Exhibition, Ars Electronica 2015. See the video: https://www.youtube.com/watch?v=U-Kqv-xeI3k.
- 3.
Video recordings made during two exhibitions: University Paris 8’s Campus Exhibition of the Ars Electronica International Festival, Linz Austria, September 2015; Les Vitrines du Labex Arts-H2H, Theater Gérard Philipe, Saint-Denis, France, October 2015.
- 4.
See the video: https://www.dailymotion.com/video/x71d509.
- 5.
See the video: https://www.dailymotion.com/video/x71d6dl.
- 6.
See the video: https://www.dailymotion.com/video/x71d6wr.
- 7.
A = KC2/3 with A: angular velocity and C: curvature.
- 8.
\(v = \propto K^{1/3} .\left| \tau \right|^{1/6}\) with v: tangential velocity; K: curvature; τ: torsion; ∝: coefficient.
- 9.
See the video: https://www.dailymotion.com/video/x72f1q5.
- 10.
Corpora, in this context, refer to the tools used in corpus linguistics. A corpus is a unit of linguistic data (an annotated recording, a sample taken from real world examples of natural movement and behavior patterns) that represents body motion. Corpora require specialized software tools to be viewed and analyzed.
- 11.
Diadochal motion refers to two successive movements in any joint where a rotation of the bone is possible, which imposes conjunct rotation upon the bone that has been moved.
Bibliography
Batras, D., Guez, J., Jego, J. F., & Tramus, M. H. (2016). A virtual reality agent-based platform for improvisation between real and virtual actors using gestures. In Proceeding VRIC ‘16. Virtual Reality International Conference—Laval Virtual, March 2016, New York, NY, USA ©2016. Paper No. 34. ISBN 978-1-4503-4180-6.
Berthoz, A. (1997). Le Sens du mouvement. Paris: Odile Jacob.
Berthoz, A. (2009). La Simplexité. Paris: Odile Jacob.
Berthoz, A. (2013). La Vicariance: le cerveau créateur de mondes. Paris: Odile Jacob.
Berthoz, A., & Tramus, M. H. (2015). Towards creative vicariance. Journal Hybrid 02 | 2015. http://www.hybrid.univ-paris8.fr/lodel/index.php?id=590. Accessed 19 Jan 2020.
Boutet, D. (2015). Conditions formelles d’une analyse de la négation gestuelle. Vestnik of Moscow State Linguistic University, Discourse as social practice: priorities and prospects, 6(717), 116–129.
Bennequin, D., Fuchs, R., Berthoz, A., & Flash, T. (2009). Movement timing and invariance arise from several geometries. PLoS Computational Biology, 5(7), e1000426.
Cheng, P. L. (2006). Simulation of Codman’s paradox reveals a general law of motion. Journal of Biomechanics, 39(7), 1201–1207.
Codman, E. A. (1984). The shoulder: Rupture of the supraspinatus tendon and other lesions in or about the subacromial bursa. RE Kreiger.
Flash, T., & Handzel, A. A. (2007). Affine differential geometry analysis of human arm movements. Biological Cybernetics, 96, 577–601.
Konczak, J., Borutta, M,. Topka, H., & Dichgans, J. (1995). The development of goal-directed reaching in infants: Hand trajectory formation and joint torque control. Experimental Brain Research, 106(1), 156–168. https://doi.org/10.1007/BF00241365. Accessed 19 Jan 2020.
Lacquantini, F., Terzuolo, C., & Viviani, P. (1983). The law relating the kinematic and figural aspects of drawing movements. Acta Psychologica, 54, 115–130.
MacConaill, M. A. (1948). The movements of bones and joints. Journal of Bone & Joint Surgery, British Volume, 30-B(2), 322–326.
Maoz, U., Berthoz, A., & Flash, T. (2009). Complex unconstrained three-dimensional hand movement and constant equi-affine speed. Journal of Neurophysiology, 101(2), 1002–1015.
Maoz, U., & Flash, T. (2014). Spatial constant equi-affine speed and motion perception. Journal of Neurophysiology, 111, 336–349.
Pollick, F. E., Maoz, U., Handzel, A. A., Giblin, P. J., Sapiro, G., & Flash, T. (2009). Three-dimensional arm movements at constant equi-affine speed. Cortex, 45, 325–339.
Rudrauf, D., Bennequin, D., & Williford, K. (2018). The moon illusion explained by the projective consciousness model. arXiv:1809.04414 [q-bio]. http://arxiv.org/abs/1809.04414. Accessed 19 Jan 2020.
Sloetjes, H., & Wittenburg, P. (2008). Annotation by category: ELAN and ISO DCR. In LREC. http://lrec-conf.org/proceedings/lrec2008/pdf/208_paper.pdf. Accessed 19 Jan 2020.
Tramus, M. H., Chen, C. Y., Guez, J., Jego, J. F., Batras, D., Boutet, D., Blondel, M., Catteau, F., Vincent, C. (2018). Interaction gestuelle improvisée avec un acteur virtuel dans un théâtre d’ombres bidimensionnelles ou au sein d’un univers virtuel en relief: l’illusion d’un dialogue? In M. Almiron, E. Jacopin & G. Pisano G (dir.), Stéréoscopie et Illusion (pp. 281–299). Lille: Presses universitaires Septentrion.
Tramus, M. H. (2017). La question de l’émergence à travers l’évolution des arts de la participation: ceux de l’interaction, ceux de l’interactivité numérique, ceux de l’immersion, jusqu’à ceux de l’autonomie. In X. Lambert (dir.) Poïèse/autopoïèse: art et systèmes, Coll. Ouverture philosophique, série Arts vivants, (pp. 137–146). Paris: L’Harmattan.
Viviani, P., & Schneider, R. (1991). A developmental study of the relation between geometry and kinematics of drawing movements. Journal of Experimental Psychology (Human Perception), 18, 603–623.
Viviani, P., & Stucchi, N. (1992). Biological movements look uniform: Evidence of motor-perceptual interactions. Journal of Experimental Psychology: Human Perception and Performance, 18(3), 603–623.
Viviani, P., & Flash, T. (1995). Minimum-jerk, two-thirds power law, and isochrony: Converging approaches to movement planning. Journal of Experimental Psychology: Human Perception and Performance, 21, 32–53.
Acknowledgements
We will lean our presentation on the CIGALE project, an interdisciplinary project between digital art, linguistic, and theater on Motion capture and interaction with artistic, co-speech and expressive gestures, granted by the Labex Arts H2H (2012–2015). We particularly thank: Ariel Alonso, Dimitrios Batras, Brigitte Baumié, Marion Blondel, Michel Bret, Fanny Catteau, Clara Chabalier, Julie Châteauvert, Chu-Yin Chen, Sébastien Delacroix, Florine Fouquart, Amélie Gabriel, Nefeli Georgakopoulou, Judith Guez, Patrice Guyot, Chen-Wei Hsieh, Jean-François Jégo, Isabelle Lemaux, Sébastien Lenglet, Marie-Thérèse L’Huillier, Julien Lubek, Xavier Maurel, Guillaume Metais, Anne-Marie Parisot, Philipe Pasquier, Isaac Partouche, Ilaria Renna, Thecla Schiphorst, Jean-François Szlapka, Michel Thion, Coralie Vincent.
Thanks to Dominique Boutet, who has just passed away, for all his rich work: research on co-speech gestures, on sign language and on the relationships between artistic, linguistic and expressive gestures. The publication of this article may serve as a tribute to this researcher who has opened an original way of kinesiological analysis that contributes to our understanding of how meaning and expressiveness emerge from human body gestures.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this chapter
Cite this chapter
Tramus, MH., Boutet, D. (2021). Interaction Between Spectator and Virtual Actor Through Movement: From Child Gestures to Interactive Digital Creation. In: Flash, T., Berthoz, A. (eds) Space-Time Geometries for Motion and Perception in the Brain and the Arts. Lecture Notes in Morphogenesis. Springer, Cham. https://doi.org/10.1007/978-3-030-57227-3_13
Download citation
DOI: https://doi.org/10.1007/978-3-030-57227-3_13
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-57226-6
Online ISBN: 978-3-030-57227-3
eBook Packages: Mathematics and StatisticsMathematics and Statistics (R0)