EmbodiNet: Enriching Distributed Musical Collaboration Through Embodied Interactions

  • Dalia El-ShimyEmail author
  • Jeremy R. Cooperstock
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9297)


This paper presents EmbodiNet, a novel system that augments distributed performance with dynamic, real-time, hands-free control over several aspects of the musicians’ sound, enabling them to seamlessly change volume, affect reverb and adjust their mix. Musical performance is a demanding activity necessitating multiple levels of communication among its participants, as well as a certain degree of creativity, playfulness and spontaneity. As a result, distributed musical performance presents a challenging application area for the “same time/different place” category of Computer-Supported Cooperative Work (CSCW). In fact, musicians wishing to play together over a network are typically limited by tools that differ little from standard videoconferencing. Instead, we propose leveraging the technology inherent to the distributed context towards meaningfully augmenting collaborative performance. In order to do so without introducing new paradigms that may require learning or that may distract musicians from their primary task, we have designed and evaluated embodied controls that capitalize on existing interpersonal interactions. Further designed to restore the spatial properties of sound that are typically absent in the distributed context, and apply the notion of “shared space” found in CSCW research, EmbodiNet also helps confer a greater level of co-presence than standard distributed performance systems. This paper describes the implementation of EmbodiNet, along with the results of a long-term collaboration and experiment with a three-piece band. The long-term collaboration helped illustrate the benefits of augmenting an artistic form of distributed collaboration, and resulted in a system that not only helped enhance our users’ sense of enjoyment and self-expression, but one that they would also likely use in the future.


Musical Performance Shared Space Dynamic Volume Distribute Performance System Shared Workspace 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. 1.
    Ackerman, M.S.: The intellectual challenge of CSCW: the gap between social requirements and technical feasibility. Hum.-Comput. Interact. 15(2), 179–203 (2000)CrossRefGoogle Scholar
  2. 2.
    Adalgeirsson, S.O., Breazeal, C.: MeBot: a robotic platform for socially embodied presence. In: Proceedings of the 5th ACM/IEEE International Conference on Human-Robot Interaction, pp. 15–22 (2010)Google Scholar
  3. 3.
    Àlvaro, B., Kaltenbrunner, M.: Public sound objects: a shared musical space on the web. In: Proceedings of the International Conference on Web Delivering of Music, pp. 9–15. IEEE Computer Society Press (2002)Google Scholar
  4. 4.
    Antle, A.N., Corness, G., Bevans, A.: Springboard: designing image schema based embodied interaction for an abstract domain. In: England, D. (ed.) Whole Body Interaction. Human-Computer Interaction Series, pp. 7–18. Springer, London (2011)CrossRefGoogle Scholar
  5. 5.
    Antle, A.N., Corness, G., Droumeva, M.: Human-Computer-Intuition? Exploring the cognitive basis for intuition in embodied interaction. Int. J. Arts Technol. 2(3), 235–254 (2009)CrossRefGoogle Scholar
  6. 6.
    Bakker, S., Antle, A.N., Van Den Hoven, E.: Embodied metaphors in tangible interaction design. Pers. Ubiquit. Comput. 16(4), 433–449 (2012)CrossRefGoogle Scholar
  7. 7.
    Bannon, L.J., Schmidt, K.: CSCW: four characters in search of a context. In: Bowers, J.M., Benford, S.D. (eds.) Studies in Computer Supported Cooperative Work, pp. 3–16. North-Holland Publishing Co., Amsterdam (1991)Google Scholar
  8. 8.
    Braasch, J., Valente, D.L., Peters, N.: Sharing acoustic spaces over telepresence using virtual microphone control. In: Audio Engineering Society 123rd Convention (2007)Google Scholar
  9. 9.
    Carôt, A., Rebelo, P., Renaud, A.B.: Networked music performance: state of the art. In: Audio Engineering Society Conference 30th International Conference: Intelligent Audio Environments (2007)Google Scholar
  10. 10.
    Carôt, A., Werner Fischinger, C.: Towards a Comprehensive Cognitive Analysis of Delay-Influenced Rhythmical Interaction, pp. 473–476. MPublishing, University of Michigan Library, USA (2009)Google Scholar
  11. 11.
    Carstensen, P.H., Schmidt, K.: Computer supported cooperative work: new challenges to systems design. In: Itoh, K. (ed.) Handbook of Human Factors, pp. 619–636 (1999)Google Scholar
  12. 12.
    Carstensen, P.H., Schmidt, K.: Computer Supported Cooperative Work: New Challenges to Systems Design (1999)Google Scholar
  13. 13.
    Chafe, C., Wilson, S., Leistikow, A., Chisholm, D., Scavone, G.: A simplified approach to high quality music and sound over IP. In: Proceedings of the COST G-6 Conference on Digital Audio Effects, pp. 159–164 (2000)Google Scholar
  14. 14.
    Chew, E., Sawchuk, A., Tanoue, C., Zimmermann, R.: Segmental tempo analysis of performances in performer-centered experiments in the distributed immersive performance project. In: Proceedings of International Conference on Sound and Music Computing (2005)Google Scholar
  15. 15.
    Corness, G., Schiphorst, T.: Performing with a system’s intention: embodied cues in performer-system interaction. In: Proceedings of the 9th ACM Conference on Creativity and Cognition, pp. 156–164 (2013)Google Scholar
  16. 16.
    Dourish, P., Bly, S.: Portholes: supporting awareness in a distributed work group. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 541–547 (1992)Google Scholar
  17. 17.
    Eisert, P.: Immersive 3-D video conferencing: challenges, concepts, and implementations. In: Proceedings of the International Society for Optical Engineering, pp. 69–79 (2003)Google Scholar
  18. 18.
    El-Shimy, D., Hermann, T., Cooperstock, J.R.: A reactive environment for dynamic volume control. In: Proceedings of the International Conference on New Interfaces for Musical Expression (2012)Google Scholar
  19. 19.
    El-Shimy, D.: Exploring user-driven techniques for the design of new musical interfaces through the responsive environment for distributed performance. Ph.D. thesis, McGill University (2014).
  20. 20.
    El-Shimy, D., Cooperstock, J.R.: Reactive environment for network music performance. In: Proceedings of the International Conference on New Interfaces for Musical Expression (2013)Google Scholar
  21. 21.
    Fencott, R., Bryan-Kinns, N.: Computer musicking: HCI, CSCW and collaborative digital musical interaction. In: Holland, S., Wilkie, K., Mulholland, P., Seago, A. (eds.) Music and Human-Computer Interaction. Springer Series on Cultural Computing, pp. 189–205. Springer, London (2013)CrossRefGoogle Scholar
  22. 22.
    Grudin, J.: Why CSCW applications fail: problems in the design and evaluation of organizational interfaces. In: Proceedings of the 1988 ACM Conference on Computer-Supported Cooperative Work, pp. 85–93 (1988)Google Scholar
  23. 23.
    Ishii, H.: TeamWorkStation: towards a seamless shared workspace. In: Proceedings of the 1990 ACM Conference on Computer-supported Cooperative Work, pp. 13–26 (1990)Google Scholar
  24. 24.
    Ishii, H., Kobayashi, M., Grudin, J.: Integration of interpersonal space and shared workspace: clearboard design and experiments. ACM Trans. Inf. Syst. 11(4), 349–375 (1993)CrossRefGoogle Scholar
  25. 25.
    Johansen, R.: GroupWare: Computer Support for Business Teams. The Free Press, New York (1988)Google Scholar
  26. 26.
    Kapur, A., Wang, G., Davidson, P., Cook, P.R.: Interactive network performance: a dream worth dreaming? Organised Sound 10, 209–219 (2005)CrossRefGoogle Scholar
  27. 27.
    Lee, M.K., Takayama, L.: “Now, I Have a Body”: uses and social norms for mobile remote presence in the workplace. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 33–42 (2011)Google Scholar
  28. 28.
    Levisohn, A., Schiphorst, T.: Embodied engagement: supporting movement awareness in ubiquitous computing systems. Ubiqut. Learn.: Int. J. 3(4), 97–112 (2011)Google Scholar
  29. 29.
    Loke, L., Robertson, T.: Design representations of moving bodies for interactive, motion-sensing spaces. Int. J. Hum.-Comput. Stud. 67(4), 394–410 (2009)CrossRefGoogle Scholar
  30. 30.
    Ravasio, P., Guttormsen-Schar, S., Tscherte, V.: The qualitative experiment in HCI: definition, occurrences, value and use. Trans. Comput.-Hum. Interact. 1–24 (2004)Google Scholar
  31. 31.
    Rebelo, P., Renaud, A.B.: The frequencyliator: distributing structures for networked laptop improvisation. In: Proceedings of the International Conference on New Interfaces for Musical Expression, pp. 53–56 (2006)Google Scholar
  32. 32.
    Renaud, A.: Dynamic cues for network music interaction. In: 7th Sound Music and Computing Conference (2010)Google Scholar
  33. 33.
    Rodden, T., Blair, G.: CSCW and distributed systems: the problem of control. In: Bannon, L., Robinson, M., Schmidt, K. (eds.) Proceedings of the Second European Conference on Computer-Supported Cooperative Work, pp. 49–64. Springer, Netherlands (1991)CrossRefGoogle Scholar
  34. 34.
    Schroeder, F., Renaud, A.B., Rebelo, P., Gualda, F.: Addressing the network: performative strategies for playing apart. In: International Computer Music Conference (2007)Google Scholar
  35. 35.
    Schroeder, F., Pedro, R.: Sounding the network: the body as disturbant. Leonardo Electronic Almanac 16(4–5), 1–10 (2009)Google Scholar
  36. 36.
    Schuett, N.: Interconnected musical networks: bringing expression and thoughtfulness to collaborative music making. Ph.D. thesis, Stanford Center for Computer Research in Music and Acoustics (2002).
  37. 37.
    Sellen, A., Buxton, B., Arnott, J.: Using spatial cues to improve videoconferencing. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 651–652 (1992)Google Scholar
  38. 38.
    Sirkin, D., Ju, W.: Consistency in physical and on-screen action improves perceptions of telepresence robots. In: Proceedings of the Seventh Annual ACM/IEEE International Conference on Human-Robot Interaction, HRI 2012, pp. 57–64 (2012)Google Scholar
  39. 39.
    Tanaka, A., Bongers, B.: Global string: a musical instrument for hybrid space. In: Proceedings of Cast 2001: Living in Mixed Realities (2001)Google Scholar

Copyright information

© IFIP International Federation for Information Processing 2015

Authors and Affiliations

  1. 1.Centre for Interdisciplinary Research in Music, Media and TechnologyMcGill UniversityMontrealCanada

Personalised recommendations