The LuminUs: Providing Musicians with Visual Feedback on the Gaze and Body Motion of Their Co-performers
This paper describes the LuminUs - a device that we designed in order to explore how new technologies could influence the inter-personal aspects of co-present musical collaborations. The LuminUs uses eye-tracking headsets and small wireless accelerometers to measure the gaze and body motion of each musician. A small light display then provides visual feedback to each musician, based either on the gaze or the body motion of their co-performer. We carried out an experiment with 15 pairs of music students in order to investigate how the LuminUs would influence their musical interactions. Preliminary results suggest that visual feedback provided by the LuminUs led to significantly increased glancing between the two musicians, whilst motion based feedback appeared to lead to a decrease in body motion for both participants.
KeywordsMusical interaction Computer-supported cooperative work Groupware Eye-tracking Social signals Non-verbal communication
This research is supported by the Media and Arts Technology Programme, an RCUK Doctoral Training Centre in the Digital Economy.
- 5.Schutz, A.: Making music together. Collected papers II (1976)Google Scholar
- 7.Vera, B., Chew, E., Healey, P.: A study of ensemble performance under restricted line of sight. In: Proceedings of the International Conference on Music Information Retrieval, Curitiba, Brazil (2013)Google Scholar
- 8.Vertegaal, R.: The GAZE groupware system: mediating joint attention in multiparty communication and collaboration. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems - CHI 1999, pp. 294–301. ACM Press, New York (1999)Google Scholar
- 9.Chanel, G., Bétrancourt, M., Pun, T., Cereghetti, D., Molinari, G.: Assessment of computer-supported collaborative processes using interpersonal physiological and eye-movement coupling. In: Affective Computing and Intelligent Interaction (ACII 2013), Geneva, Switzerland (2013)Google Scholar
- 10.Hornof, A.J.: The prospects for eye-controlled musical performance. In: International Conference on New Interfaces for Musical Expression (NIME 2014), pp. 461–466 (2014)Google Scholar
- 17.Kassner, M., Patera, W., Bulling, A.: Pupil: an open source platform for pervasive eye tracking and mobile gaze-based interaction, April 2014. CoRR abs/1405.0006
- 18.Chartrand, T.L., Lakin, J.L.: The antecedents and consequences of human behavioral mimicry. Annu. Rev. Psychol. September 2012Google Scholar