Distributed tools for interactive design of heterogeneous signal networks

Abstract

We introduce libmapper, an open source, cross-platform software library for flexibly connecting disparate interactive media control systems at run-time. This library implements a minimal, openly-documented protocol meant to replace and improve on existing schemes for connecting digital musical instruments and other interactive systems, bringing clarified, strong semantics to system messaging and description. We use automated discovery and message translation instead of imposed system-representation standards to approach “plug-and-play” usability without sacrificing design flexibility. System modularity is encouraged, and data are transported between peers without centralized servers.

This is a preview of subscription content, access via your institution.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Notes

  1. 1.

    http://www.arduino.cc/

  2. 2.

    The OSC path refers to the text string identifying the semantics of an OSC message.

  3. 3.

    Note that there do exist many decentralized statistical analysis approaches, such as graph-based techniques that can distribute successive reduction steps throughout several computational nodes [16]. Application of such techniques to libmapper may be possible, and is the subject of future work.

  4. 4.

    http://janroimaging.com/

  5. 5.

    http://idmil.org/projects/prosthetic_instruments

  6. 6.

    http://www.openframeworks.cc/

  7. 7.

    http://libcinder.org/

  8. 8.

    https://www.ableton.com/

  9. 9.

    http://www.music.mcgill.ca/~gary/rtmidi/

  10. 10.

    http://www.arduino.cc/

  11. 11.

    http://firmata.org/wiki/Main_Page

  12. 12.

    https://github.com/IDMIL/firmata-mapper

References

  1. 1.

    Apple (2005) Bonjour printing specifications. Available: https://developer.apple.com/bonjour/printing-specification/bonjourprinting-1.0.2.pdf. Accessed March 2013

  2. 2.

    Baalman MA, Smoak HC, Salter CL, Malloch J, Wanderley MM (2009) Sharing data in collaborative, interactive performances: the senseworld datanetwork. In: Proceedings of the international conference on new interfaces for musical expression. Pittsburgh, pp 131–134

  3. 3.

    Bevilacqua F, Müller R, Schnell N (2005) MnM: a Max/MSP mapping toolbox. In: Proceedings of the international conference on new interfaces for musical expression. University of British Columbia, Vancouver, pp 85–88

  4. 4.

    Bullock J, Frisk H (2011) The Integra framework for rapid modular audio application development. In: Proceedings of the international computer music conference, University of Huddersfield, Huddersfield

  5. 5.

    Cook PR, Scavone G (1999) The synthesis toolkit (STK). In: Proceedings of the international computer music conference, pp 164–166

  6. 6.

    Cronin E, Kurc AR, Filstrup B, Jamin S (2004) An efficient synchronization mechanism for mirrored game architectures. Multimed Tools Appl 23(1):7–30

    Article  Google Scholar 

  7. 7.

    ESTA (2004) ANSI E1.11-2004 Entertainment technology USITT DMX512-A asynchronous serial digital data transmission standard for controlling lighting equipment and accessories

  8. 8.

    ESTA (2011) ANSI E1.17-2010 Architecture for control networks device description language (DDL). Available: http://tsp.plasa.org/tsp/documents/docs/ACN-ddl_2009-1024r1_free.pdf. Accessed 10 June 2012

  9. 9.

    Fiebrink R (2011) Real-time human interaction with supervised learning algorithms for music composition and performance. Ph.D. thesis, Princeton University, Princeton

  10. 10.

    Hollinger A, Wanderley MM (2013) MRI-compatible optically-sensed cello. In: Proceedings of the IEEE sensors. Baltimore, pp 1–4

  11. 11.

    Hunt A (1999) Radical user interfaces for real-time musical control. Ph.D. thesis, University of York, UK

  12. 12.

    Hunt A, Wanderley MM (2002) Mapping performance parameters to synthesis engines. Organised Sound 7(2):97–108

    Article  Google Scholar 

  13. 13.

    IEEE (2007) IEEE Standard for a smart transducer interface for sensors and actuators wireless communication protocols and transducer electronic data sheet (TEDS) formats. IEEE Std 1451.5-2007. doi:10.1109/IEEESTD.2007.4346346

  14. 14.

    Jensenius AR, Kvifte T, Godøy RI (2006) Towards a gesture description interchange format. In: Proceedings of the international conference on new interfaces for musical expression. IRCAM—Centre Pompidou, pp 176–179

  15. 15.

    Kaltenbrunner M, Bovermann T, Bencina R, Costanza E (2005) TUIO - a protocol for table-top tangible user interfaces. In: Proceedings of the 6th international workshop on gesture in human-computer interaction and simulation. Vannes, France

  16. 16.

    Karl H, Willig A (2007) Protocols and architectures for wireless sensor networks. Wiley-Interscience

  17. 17.

    Malloch J, Sinclair S, Wanderley MM (2008) A network-based framework for collaborative development and performance of digital musical instruments. In: Kronland-Martinet R, Ystad S, Jensen K (eds) Computer music modeling and retrieval - sense of sounds, LNCS, vol 4969. Springer-Verlag, Berlin/Heidelberg, pp 401–425

    Google Scholar 

  18. 18.

    Malloch J, Sinclair S, Wanderley MM (2013) Libmapper a library for connecting things. In: Proceedings of the international conference on human factors in computing systems (CHI2013). ACM, New York, pp 3087–3090. Extended abstract

  19. 19.

    Malloch J, Wanderley MM (2007) The T-Stick: from musical interface to musical instrument. In: Proceedings of the international conference on new interfaces for musical expression. New York City

  20. 20.

    McMillen K (1994) ZIPI: origins and motivations. Comput Music J 18(4):47–51

    Article  Google Scholar 

  21. 21.

    MMA (1996) The complete MIDI 1.0 detailed specification: incorporating all recommended practices

  22. 22.

    Moore FR (1988) The dysfunctions of MIDI. Comput Music J 12(1):19–28

    Article  Google Scholar 

  23. 23.

    Muller R (2006) OSCBonjour. Available: http://recherche.ircam.fr/equipes/temps-reel/movement/muller/index.php?entry=entry060616-173626. Accessed March 2013

  24. 24.

    Open Geospatial Consortium (2006) Transducer markup language. Available: http://www.ogcnetwork.net/infomodels/tml. Accessed 12 September 2009

  25. 25.

    Place T, Lossius T (2006) Jamoma: a modular standard for structuring patches in Max. In: Proceedings of the international computer music conference. Tulane University, New Orleans

  26. 26.

    Ressel M, Gunzenhäuser R (1999) Reducing the problems of group undo. In: Proceedings of the international ACM SIGGROUP conference on supporting group work, GROUP ’99. ACM, New York, pp 131–139. doi:10.1145/320297.320312

  27. 27.

    Schiesser S (2009) midOSC: a Gumstix-based MIDI-to-OSC converter. In: Proceedings of the new interfaces for musical expression, pp 165–168

  28. 28.

    Schmeder A (2009) Efficient gesture storage and retrieval for multiple applications using a relational data model of open sound control. In: Proceedings of the international computer music conference

  29. 29.

    Sinclair S, Wanderley MM (2009) A run-time programmable simulator to enable multimodal interaction with rigid body systems. Interact Comput 21(1–2):54–63

    Article  Google Scholar 

  30. 30.

    Soucy RP (2012) IP multicast explained . Available: http://www.soucy.org/network/multicast.php, Accessed March 2013

  31. 31.

    Steiner HC (2009) Firmata: towards making microcontrollers act like extensions of the computer. In: Proceedings of the international conference on new interfaces for musical expression. Carnegie Mellon University, Pittsburgh, pp 125–130

  32. 32.

    Steinmetz R, Wehrle K (2005) Peer-to-peer systems and applications, vol 3485. Springer

  33. 33.

    Taylor, II RM, Hudson TC, Seeger A, Weber H, Juliano J, Helser AT (2001) VRPN: a device-independent, network-transparent vr peripheral system. In: Proceedings of the ACM symposium on virtual reality software and technology. ACM, pp 55–61

  34. 34.

    Wright M (1994) A comparison of MIDI and ZIPI. Comput Music J 18(4):86–91

    Article  Google Scholar 

  35. 35.

    Wright M, Freed A, Momeni A (2003) Opensound control: state of the art 2003. In: Proceedings of the international conference on new interfaces for musical expression. McGill University, Montreal, pp 153–160

Download references

Acknowledgments

Development of libmapper has been supported by funds from the Fonds de recherche sur la société et la culture (FQRSC) of the Quebec government, the Natural Sciences and Engineering Research Council of Canada (NSERC), and the NSERC/Canada Council for the Arts New Media Initiative.

Author information

Affiliations

Authors

Corresponding author

Correspondence to Joseph Malloch.

Rights and permissions

Reprints and Permissions

About this article

Cite this article

Malloch, J., Sinclair, S. & Wanderley, M.M. Distributed tools for interactive design of heterogeneous signal networks. Multimed Tools Appl 74, 5683–5707 (2015). https://doi.org/10.1007/s11042-014-1878-5

Download citation

Keywords

  • Media mapping
  • Networking