Skip to main content
SpringerLink
Log in

Placing AI in the Creative Industries: The Case for Intelligent Music Production

  • Conference paper
  • First Online:
HCI International 2021 - Posters (HCII 2021)

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 1419))

Included in the following conference series:

Abstract

The digital transformation of the recording industry is one of the most well-known in recent times, with the Digital Audio Workstation (DAW) making new methods of music production available to amateurs and professionals in almost any setting beyond the traditional recording studio. However, the uptake of AI in this domain is seemingly impeded by DAW software architectures and a need for designers to better understand production practices and workflows. Our research addresses the latter of these challenges and in this extended abstract we present an overview of an ethnographic study that “gets inside” the work of the recording studio and exposes opportunities for the design of automated production tools. From a summary report of this work, we then aim to motivate or provoke novel conversations and future work in this problem space.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Kirby, P.R.: The Evolution and Decline of the Traditional Recording Studio, p. 438. University of Liverpool (2015)

    Google Scholar 

  2. Leyshon, A.: The software slump?: digital music, the democratisation of technology, and the decline of the recording studio sector within the musical economy. Environ. Plan. A. 41, 1309–1331 (2009). https://doi.org/10.1068/a40352

    Article  Google Scholar 

  3. Byrne, D.: How Music Works. Canongate (2013)

    Google Scholar 

  4. Hoare, M., Benford, S., Jones, R., Milic-Frayling, N.: Coming in from the margins: amateur musicians in the online age. In: Proceedings of the 32nd Annual ACM Conference on Human Factors in Computing Systems - CHI ’14, pp. 1295–1304. ACM Press, New York, New York, USA (2014). https://doi.org/10.1145/2556288.2557298

  5. Théberge, P.: The end of the worldas we know it: the changing role of the studio in the internet age. In: Zagorski-Thomas, S. (ed.) The Art of Record Production: An Introductory Reader for a New Academic Field, pp. 77–90. Routledge (2012)

    Google Scholar 

  6. Watson, A.: Cultural production in and beyond the recording studio (2014)

    Google Scholar 

  7. Bromham, G.: How can academic practice inform mix-craft. In: Hepworth-Sawyer, R., Hodgson, J. (eds.) Mixing Music. Perspective on Music Production, pp. 245–56. Taylor & Francis, Oxon (2016)

    Google Scholar 

  8. Moffat, D., Sandler, M.B.: Approaches in intelligent music production. Arts 8, 125 (2019). https://doi.org/10.3390/arts8040125

    Article  Google Scholar 

  9. Hawkins, J. V: Automating Music Production with Music Information Retrieval (2013)

    Google Scholar 

  10. De Man, B., Leonard, B., King, R., Reiss, J.D.: An analysis and evaluation of audio features for multitrack music mixtures. In: 15th International Society for Music Information Retrieval Conference (ISMIR 2014), pp. 137–142 (2014)

    Google Scholar 

  11. De Man, B., Reiss, J.D.: A knowledge-engineered autonomous mixing system. In: Audio Engineering Society Convention, p. 135 (2013)

    Google Scholar 

  12. Pestana, P., Reiss, J.D.: Intelligent audio production strategies informed by best practices. In: AES 53rd International Conference on Semantic Audio, pp. 1–9 (2014)

    Google Scholar 

  13. Pestana, P.: Automatic Mixing Systems Using Adaptive Digital Audio Effects (2013)

    Google Scholar 

  14. Kolozali, S.: A framework for automatic ontology generation based on semantic audio analysis, pp. 1–10 (2014)

    Google Scholar 

  15. Wilmering, T., Fazekas, G., Sandler, M.B.: High-level semantic metadata for the control of multitrack adaptive digital audio effects. In: Proceedings of the 133rd AES Convention (2012)

    Google Scholar 

  16. Kitahara, T., Goto, M., Komatani, K., Ogata, T., Okuno, H.G.: Instrument identification in polyphonic music: feature weighting with mixed sounds, pitch-dependent timbre modeling, and use of musical context. In: Proceedings of the 6th International Society for Music Information Retrieval, pp. 558–563 (2005)

    Google Scholar 

  17. Fazekas, G., Sandler, M.: Structural decomposition of recorded vocal performances and it’s application to intelligent audio editing, pp. 1–20 (2007)

    Google Scholar 

  18. Fazekas, G., Sandler, M.B.: Intelligent editing of studio recordings with the help of automatic music structure extraction. In: Proceedings of the 122nd Convention of the AES (2007)

    Google Scholar 

  19. Hargreaves, S., Klapuri, A., Sandler, M.: Structural segmentation of multitrack audio. IEEE Trans. Audio Speech Lang. Process. 20, 2637–2647 (2012). https://doi.org/10.1109/TASL.2012.2209419

  20. Sandler, M., De Roure, D., Benford, S., Page, K.: Semantic Web Technology for New Experiences Throughout the Music Production-Consumption Chain, pp. 49–55 (2019). https://doi.org/10.1109/mmrp.2019.00017

  21. Barkati, K., Bonardi, A., Vincent, A., Rousseaux, F.: GAMELAN: a knowledge management approach for digital audio production workflows. In: Proceedings of the Artificial Intelligence in Knowledge Management Work. ECAI 2012, pp. 3–8 (2012)

    Google Scholar 

  22. Barkati, K., Rousseaux, F.: Considering music production and culture management as an emerging digital ecosystem. In: Proceedings of the Fifth International Conference on Management of Emergent Digital EcoSystems, pp. 45–53 (2013). https://doi.org/10.1145/2536146.2536151

  23. Barkati, K., Rousseaux, F.: How to understand digital studio outputs: the case of digital music production. Artificial Intelligence for Knowledge Management, pp. 151–169 (2013)

    Google Scholar 

  24. Fazekas, G., Sandler, M.B.: The Studio Ontology Framework. Information Retrieval Boston, pp. 471–476 (2011)

    Google Scholar 

  25. Wilmering, T., Fazekas, G., Sandler, M.B.: The audio effects ontology. In: Proceedings of the 14th international Society for Music Information Retrieval Conference (2013)

    Google Scholar 

  26. Reiss, J.D.: Intelligent systems for mixing multichannel audio. In: 17th DSP 2011 International Conference on Digital Signal Processing, Proceedings (2011). https://doi.org/10.1109/ICDSP.2011.6004988

  27. Palanque, P.: Engineering Automations, pp. 1–2 (2018). https://doi.org/10.1145/3220134.3223044

  28. Thompson, P., Lashua, B.: Getting it on record: issues and strategies for ethnographic practice in recording studios. J. Contemp. Ethnogr. 43, 746–769 (2014). https://doi.org/10.1177/0891241614530158

    Article  Google Scholar 

  29. Ronan, D., Gunes, H., Reiss, J.D.: Analysis of the Subgrouping practices of professional mix engineers. In: 142nd Audio Engineering Society International Convention 2017, AES 2017 (2017)

    Google Scholar 

  30. Crabtree, A., Rouncefield, M., Tolmie, P.: Doing Design Ethnography. Springer London, London (2012). https://doi.org/10.1007/978-1-4471-2726-0

  31. McGarry, G., Tolmie, P., Benford, S., Greenhalgh, C., Chamberlain, A.: They’re all going out to something weird: workflow, legacy and metadata in the music production process. In: Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing - CSCW ’17, pp. 995–1008. ACM Press, New York, New York, USA (2017). https://doi.org/10.1145/2998181.2998325

  32. McGrath, S., Chamberlain, A., Benford, S.: Making music together. In: Proceedings of the Audio Mostly 2016 on - AM ’16, pp. 186–193. ACM Press, New York, New York, USA (2016). https://doi.org/10.1145/2986416.2986432

  33. Brooker, P., Sharrock, W.: Remixing music together : the use and abuse of virtual studio software as a hobby. In: Tolmie, P., Rouncefield, M. (eds.) Ethnomethodology at Play. Directions in Ethnomethodology and Conversation Analysis, pp. 135–155. Ashgate (2013)

    Google Scholar 

  34. McGrath, S., Hazzard, A., Chamberlain, A., Benford, S.: An ethnographic exploration of studio production practice. In: Proceedings of the 2nd AES Workshop on Intelligent Music Production, vol. 13, pp. 4–5 (2016)

    Google Scholar 

  35. McGrath, S.: Breaking the workflow: Design heuristics to support the development of usable digital audio production tools: framing usability heuristics for contemporary purposes. In: ACM’s International Conference Proceedings Series, pp. 130–137 (2020). https://doi.org/10.1145/3411109.3411133

  36. Garfinkel, H., Wieder, D.L.: Two incommensurable, asymmetrically alternate technologies of social analysis. In: Watson, G., Seiler, S.M. (eds.) Text in Context: Contributions to Ethnomethodology, pp. 175–206. Sage (1992)

    Google Scholar 

  37. Pollner, M., Emerson, R.M.: Ethnomethodology and Ethnography. In: Handbook of Ethnography. pp. 119–135 (2001)

    Google Scholar 

  38. McGarry, G.: Studies of the Social Character of Metadata in Modern Music Production (2020). http://eprints.nottingham.ac.uk/60392/

  39. Seipel, F., Lerch, A.: Multi-track crosstalk reduction using spectral subtraction. J. Audio Eng. 145(4), EL329–333 (2018)

    Google Scholar 

Download references

Acknowledgements

This work was supported by the Engineering and Physical Sciences Research Council [grant number EP/L019981/1] project Fusing Semantic and Audio Technologies for Intelligent Music Production and Consumption, and [grant number EP/V00784X/1] UKRI Trustworthy Autonomous Systems Hub (as part of the Creative Industries theme).

Author information

Authors and Affiliations

  1. Mixed Reality Laboratory, School of Computer Science, University of Nottingham, Nottingham, England, UK

    Glenn McGarry, Alan Chamberlain, Andy Crabtree & Christopher Greenhalgh

Authors
  1. Glenn McGarry
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Alan Chamberlain
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Andy Crabtree
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Christopher Greenhalgh
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Glenn McGarry .

Editor information

Editors and Affiliations

  1. University of Crete and Foundation for Research and Technology – Hellas (FORTH), Heraklion, Crete, Greece

    Constantine Stephanidis

  2. Foundation for Research and Technology – Hellas (FORTH), Heraklion, Crete, Greece

    Margherita Antona

  3. Foundation for Research and Technology – Hellas (FORTH), Heraklion, Crete, Greece

    Stavroula Ntoa

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

McGarry, G., Chamberlain, A., Crabtree, A., Greenhalgh, C. (2021). Placing AI in the Creative Industries: The Case for Intelligent Music Production. In: Stephanidis, C., Antona, M., Ntoa, S. (eds) HCI International 2021 - Posters. HCII 2021. Communications in Computer and Information Science, vol 1419. Springer, Cham. https://doi.org/10.1007/978-3-030-78635-9_72

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-78635-9_72

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-78634-2

  • Online ISBN: 978-3-030-78635-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation