Abstract
We present the ongoing research around the design of Sema, a live coding environment aimed at supporting live coding with machine learning in the modern web browser. Sema integrates custom dashboards with code editors, debugging and visualisation tools, reference documentation and interactive tutorials. We analyse survey findings applying the Creativity Support Index, which aimed at understanding how well Sema supports creativity across its subsystems, and discuss how the insights we obtained contributed to inform the following design iteration.
Keywords
- Live coding
- Sound
- Music & performance
- Machine learning
- Creativity support tools
This is a preview of subscription content, access via your institution.
Buying options
Notes
- 1.
Sema: Live Coding With Machine Learning Workshop http://www.emutelab.org/blog/semaworkshop.
References
Bernardo, F., Kiefer, C., Magnusson, T.: A signal engine for a live coding language ecosystem. J. Audio Eng. Soc. 68(10), 756–766 (2020)
Bernardo, F., Kiefer, C., Magnusson, T.: Designing for a pluralist and user-friendly live code language ecosystem with sema. In: Proceedings of International Conference on Live Coding, pp. 41–57 (2020)
Bergmann, J., Sams, A.: Flip your classroom: reach every student in every class every day, pp. 120–190, Washington DC. International Society for Technology in Education (2012)
Carroll, E., Latulipe, C.: Quantifying the creativity support of digital tools through the creativity support index. ACM Trans. Comput. Hum. Interact. 21(4), Article 21, 25 (2014). https://doi.org/10.1145/2617588
McCartney, J.: Rethinking the computer music language: SuperCollider. Comput. Music J. 26, 61–68 (2002). https://doi.org/10.1162/014892602320991383
McLean, A.: Making programming languages to dance to: live coding with tidal. In: Proceedings of the First ACM SIGPLAN Workshop on Functional Art, Music, Modeling - FARM 2014, pp. 63–70 (2014). https://doi.org/10.1145/2633638.2633647
Magnusson, T.: Herding cats: observing live coding in the wild. Comput. Music J. 38, 91–101 (2014). https://doi.org/10.1162/COMJ
Roberts, C., Kuchera-Morin, J.A: Gibber: Live coding audio in the browser. Proc. Int. Comput. Music Conf. 2012, 64–69 (2012)
Shneiderman, B.: Creativity support tools: accelerating discovery and innovation. Commun. ACM 50(12), 20–32 (2007)
Roberts, A., Hawthorne, C., Simon, I.: Magenta.js: a JavaScript API for augmenting creativity with deep learning. In: Proceedings of the 35th Joint Workshop on Machine Learning for Music (ICML) (2018)
Smilkov, D., et al.: TensorFlow.js: machine learning for the web and beyond. In: Proceedings of the 2nd SysML Conference (2019)
Acknowledgements
We would like to thank the workshop participants and our MIMIC project colleagues. This work was supported by two UKRI/AHRC grants: MIMIC-Musically Intelligent Machines Interacting Creatively (ref: AH/R002657/1)-and Innovating Sema-Community-building of Live Coding Language Design and Perfor mance with Machine Learning (ref: AH/V005154/1).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 IFIP International Federation for Information Processing
About this paper
Cite this paper
Bernardo, F., Kiefer, C., Magnusson, T. (2021). Assessing the Support for Creativity of a Playground for Live Coding Machine Learning. In: Baalsrud Hauge, J., C. S. Cardoso, J., Roque, L., Gonzalez-Calero, P.A. (eds) Entertainment Computing – ICEC 2021. ICEC 2021. Lecture Notes in Computer Science(), vol 13056. Springer, Cham. https://doi.org/10.1007/978-3-030-89394-1_38
Download citation
DOI: https://doi.org/10.1007/978-3-030-89394-1_38
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-89393-4
Online ISBN: 978-3-030-89394-1
eBook Packages: Computer ScienceComputer Science (R0)
-
Published in cooperation with
http://www.ifip.org/
