Skip to main content

Live Music-Making: A Rich Open Task Requires a Rich Open Interface

  • Chapter
  • First Online:

Part of the book series: Springer Series on Cultural Computing ((SSCC))

Abstract

In live human-computer music-making, how can interfaces successfully support the openness, reinterpretation and rich signification often important in live (especially improvised) musical performance? We argue that the use of design metaphors can lead to interfaces which constrain interactions and militate against reinterpretation, while consistent, grammatical interfaces empower the user to create and apply their own metaphors in developing their performance. These metaphors can be transitory and disposable, yet do not represent wasted learning since the underlying grammar is retained. We illustrate this move with reflections from live coding practice, from recent visual and two-dimensional programming language interfaces, and from musical voice mapping research. We consider the integration of the symbolic and the continuous in the human-computer interaction. We also describe how our perspective is reflected in approaches to system evaluation.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD   109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Notes

  1. 1.

    http://ataut.net/site/Adam-Atau-4-Hands-iPhone.

References

  • Aaron, S., Blackwell, A. F., Hoadley, R., & Regan, T. (2011). A principled approach to developing new languages for live coding. Proceedings of New Interfaces for Musical Expression, 2011, 381–386.

    Google Scholar 

  • Blackwell, A. F. (2006a). Psychological issues in end-user programming. In H. Lieberman, F. Paternò, & V. Wulf (Eds.), End user development (Human-computer interaction series 9th ed., pp. 9–30). Dordrecht: Springer. doi:10.1007/1-4020-5386-X_2. chap 2.

    Chapter  Google Scholar 

  • Blackwell, A. F. (2006b). The reification of metaphor as a design tool. ACM Transactions on Computer-Human Interaction, 13(4), 490–530. doi:10.1145/1188816.1188820.

    Article  Google Scholar 

  • Blackwell, A., & Green, T. (2002). Notational systems – the cognitive dimensions of notations framework. In J. M. Carroll (Ed.), HCI models, theories, and frameworks: Toward a multidisciplinary science (pp. 103–134). San Francisco: Morgan Kaufmann.

    Google Scholar 

  • Carroll, J. M., Mack, R. L., & Kellogg, W. A. (1988). Interface metaphors and user interface design. In M. Helander (Ed.), Handbook of human-computer interaction (pp. 67–85). New York: Elsevier.

    Google Scholar 

  • Collins, N., McLean, A., Rohrhuber, J., & Ward, A. (2004). Live coding in laptop performance. Organised Sound, 8(03), 321–330. doi:10.1017/S135577180300030X.

    Google Scholar 

  • Cross, I., & Tolbert, E. (2008). Music and meaning. In The Oxford handbook of music psychology. Oxford: Oxford University Press.

    Chapter  Google Scholar 

  • Dromey, C., & Bates, E. (2005). Speech interactions with linguistic, cognitive, and visuomotor tasks. Journal of Speech, Language, and Hearing Research, 48(2), 295–305.

    Article  Google Scholar 

  • Dubnov, S., McAdams, S., & Reynolds, R. (2006). Structural and affective aspects of music from statistical audio signal analysis: Special topic section on computational analysis of style. Journal of the American Society for Information Science and Technology, 57(11), 1526–1536. doi:10.1002/asi.v57:11.

    Article  Google Scholar 

  • Henderson, J. (2003). Human gaze control during real-world scene perception. Trends in Cognitive Sciences, 7(11), 498–504. doi:10.1016/j.tics.2003.09.006.

    Article  Google Scholar 

  • Hendry, D. G., & Green, T. R. G. (1994). Creating, comprehending and explaining spreadsheets: A cognitive interpretation of what discretionary users think of the spreadsheet model. International Journal of Human Computer Studies, 40(6), 1033–1066. doi:10.1006/ijhc.1994.1047.

    Article  Google Scholar 

  • Jordà, S., Geiger, G., Alonso, M., & Kaltenbrunner, M. (2007). The reacTable: Exploring the synergy between live music performance and tabletop tangible interfaces. In Proceedings of tangible and embedded interaction (pp. 139–146). doi:10.1145/1226969.1226998.

  • Lakoff, G., & Johnson, M. (1980). Metaphors we live by (2nd ed.). Chicago: University of Chicago Press.

    Google Scholar 

  • Mandryk, R. L., & Atkins, M. S. (2007). A fuzzy physiological approach for continuously modeling emotion during interaction with play technologies. International Journal of Human Computer Studies, 65(4), 329–347. doi:10.1016/j.ijhcs.2006.11.011.

    Article  Google Scholar 

  • Mcilwain, P., Mccormack, J., Lane, A., & Dorin, A. (2006). Composing with nodal networks. In T. Opie & A. Brown (Eds.), Proceedings of the Australasian Computer Music Conference 2006 (pp. 101–107).

    Google Scholar 

  • McLean, A., & Wiggins, G. (2011). Texture: Visual notation for the live coding of pattern. In Proceedings of the International Computer Music Conference 2011 (pp. 612–628). Huddersfield.

    Google Scholar 

  • McLean, A., Griffiths, D., Collins, N., & Wiggins, G. (2010, July 5–7). Visualisation of live code. In Proceedings of Electronic Visualisation and the Arts London 2010 (pp. 26–30). London.

    Google Scholar 

  • Myers, B. (1990). Taxonomies of visual programming and program visualization. Journal of Visual Languages and Computing, 1(1), 97–123. doi:10.1016/S1045-926X(05)80036-9.

    Article  Google Scholar 

  • Paivio, A. (1990). Mental representations: A dual coding approach (Oxford psychology series). USA: Oxford University Press, New York.

    Google Scholar 

  • Patel, A. D. (2007). Music, language, and the brain (1st ed.). USA: Oxford University Press, New York.

    Book  Google Scholar 

  • Puckette, M. (1988). The patcher. In C. Lischka & J. Fritsch (Eds.), Proceedings of the 1988 International Computer Music Conference, Cologne, September 20–25, 1988 (pp. 420–429).

    Google Scholar 

  • Runciman, C., & Thimbleby, H. (1986). Equal opportunity interactive systems. International Journal of Man–machine Studies, 25(4), 439–451. doi:10.1016/S0020-7373(86)80070-0.

    Article  Google Scholar 

  • Stead, A. G. (2011). User configurable machine vision for mobiles. In Proceedings of psychology of programming interest group. York: University of York. http://www.ppig.org/papers/23/15%20Stead.pdf.

  • Stowell, D. (2010). Making music through real-time voice timbre analysis: machine learning and timbral control. PhD thesis, School of Electronic Engineering and Computer Science, Queen Mary University of London. http://www.mcld.co.uk/thesis/.

  • Stowell, D., & Plumbley, M. D. (2010). Delayed decision-making in real-time beatbox percussion classification. Journal of New Music Research, 39(3), 203–213. doi:10.1080/09298215.2010.512979.

    Article  Google Scholar 

  • Stowell, D., & Plumbley, M. D. (2011). Learning timbre analogies from unlabelled data by multivariate tree regression. Journal of New Music Research. doi:10.1080/09298215.2011.596938.

  • Stowell, D., Robertson, A., Bryan-Kinns, N., & Plumbley, M. D. (2009). Evaluation of live human-computer music-making: Quantitative and qualitative approaches. International Journal of Human Computer Studies, 67(11), 960–975. doi:10.1016/j.ijhcs.2009.05.007.

    Article  Google Scholar 

  • Wanderley, M. M., & Orio, N. (2002). Evaluation of input devices for musical expression: Borrowing tools from HCI. Computer Music Journal, 26(3), 62–76. doi:10.1162/014892602320582981.

    Article  Google Scholar 

  • Wilkie, K., Holland, S., & Mulholland, P. (2010). What can the language of musicians tell us about music interaction design? Computer Music Journal, 34(4), 34–48.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding authors

Correspondence to Dan Stowell or Alex McLean .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2013 Springer-Verlag London

About this chapter

Cite this chapter

Stowell, D., McLean, A. (2013). Live Music-Making: A Rich Open Task Requires a Rich Open Interface. In: Holland, S., Wilkie, K., Mulholland, P., Seago, A. (eds) Music and Human-Computer Interaction. Springer Series on Cultural Computing. Springer, London. https://doi.org/10.1007/978-1-4471-2990-5_8

Download citation

  • DOI: https://doi.org/10.1007/978-1-4471-2990-5_8

  • Published:

  • Publisher Name: Springer, London

  • Print ISBN: 978-1-4471-2989-9

  • Online ISBN: 978-1-4471-2990-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics