Abstract
Design materials are defined as a combination of what they are, what they do, and the ways they interact with other materials. In this pictorial, we explore the interactions between machine learning (as a design material) and another design material—the human face—in the form of digital portraiture. Employing an exploratory Research through Design approach we consider how machine learning simultaneously enriches and subverts the materiality of the human face. Through a combination of images and text, we offer some considerations and provocations for further research.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Barthes, R.: Camera Lucida: Reflections on Photography. Macmillan (1981)
Benjamin, J.J., Berger, A., Merrill, N., Pierce, J.: Machine learning uncertainty as a design material: a post-phenomenological inquiry. In: Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems, CHI 2021, pp. 1–14. Association for Computing Machinery, New York (2021). https://doi.org/10.1145/3411764.3445481
Budelman, M., Kizelshteyn, M.: Three principles for designing ML-powered products (2019). https://spotify.design/article/three-principles-for-designing-ml-powered-products. Accessed 10 June 2021
Dove, G., Halskov, K., Forlizzi, J., Zimmerman, J.: UX design innovation: challenges for working with machine learning as a design material. In: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI 2017), pp. 278–288. Association for Computing Machinery, New York (2017). https://doi.org/10.1145/3025453.3025739
Fuchsberger, V., Murer, M., Tscheligi, M.: Materials, materiality, and media. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI 2013), pp. 2853–2862. Association for Computing Machinery, New York (2013). https://doi.org/10.1145/2470654.2481395
Fiore, Q., McLuhan, M.: The Medium is the Massage. Random House, New York (1967)
Garcia, M.: Racist in the machine: the disturbing implications of algorithmic bias. World Policy J. 33(4), 111–117 (2016)
Gaver, W.: What should we expect from research through design? In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 937–946. Association for Computing Machinery, New York (2012)
Gellersen, H.: Eye movement as design material. In: Chuang, L., Duchowski, A., Qvarfordt, P., Weiskopf, D. Report from Dagstuhl Seminar 18252, Ubiquitous Gaze Sensing and Interaction, 18–21 June 2018
Ingold, T.: Making: Anthropology, Archaeology, Art and Architecture. Routledge, Milton Park (2013)
Jenkins, H.: The cultural logic of media convergence. Int. J. Cult. Stud. 7(1), 33–43 (2004)
Leahu, L.: Ontological surprises: a relational perspective on machine learning. In: Proceedings of the 2016 ACM Conference on Designing Interactive Systems (DIS 2016), pp. 182–186. Association for Computing Machinery, New York (2016)
Noble, S.U.: Algorithms of Oppression: How Search Engines Reinforce Racism. NYU Press, New York (2018)
Odom, W., Duel, T.: On the design of OLO radio: investigating metadata as a design material. In: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI 2018), Paper 104, pp. 1–9. Association for Computing Machinery, New York (2018). https://doi.org/10.1145/3173574.3173678
Paterson, G., Garner, S.: On making: issues of 3D representations in design education. In: DS 38: Proceedings of E&DPE 2006, the 8th International Conference on Engineering and Product Design Education, Salzburg, Austria, 07–08 September 2006, pp. 273–278 (2006)
Rahimi, A., Recht, B.: Reflections on Random Kitchen Sinks (2017). http://www.argmin.net/2017/12/05/kitchen-sinks/. Accessed 10th June 2021
Redström, J.: On technology as material in design. Des. Philos. Pap. 3, 39–54 (2005). https://doi.org/10.2752/144871305X13966254124275
Sundström, P., Taylor, A.S., O’Hara, K.: Sketching in software and hardware Bluetooth as a design material. In: Proceedings of the 13th International Conference on Human Computer Interaction with Mobile Devices and Services (MobileHCI 2011), pp. 405–414. Association for Computing Machinery, New York (2011). https://doi.org/10.1145/2037373.2037434
Sutton, S.J., Foulkes, P., Kirk, D., Lawson, S.: Voice as a design material: sociophonetic inspired design strategies in human-computer interaction. In: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, Paper 603, pp. 1–14. Association for Computing Machinery, New York (2019). https://doi.org/10.1145/3290605.3300833
Li, Z., Wang, Y., Greuter, S., Mueller, F.: Ingestible sensors as design material for bodily play. In: Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems (CHI EA 2020), pp. 1–8. Association for Computing Machinery, New York (2020). https://doi.org/10.1145/3334480.3382975
Acknowledgments
This work was funded by UK Research and Innovation (grant reference MR/T019220/1). Special thanks to Adrienne Gantenberg for permission to use her artwork, Shame (Fig 6).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Green, D.P., Lindley, J., Mason, Z., Coulton, P. (2022). A Design-Led Exploration of Material Interactions Between Machine Learning and Digital Portraiture. In: Bruyns, G., Wei, H. (eds) [ ] With Design: Reinventing Design Modes. IASDR 2021. Springer, Singapore. https://doi.org/10.1007/978-981-19-4472-7_211
Download citation
DOI: https://doi.org/10.1007/978-981-19-4472-7_211
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-19-4471-0
Online ISBN: 978-981-19-4472-7
eBook Packages: Literature, Cultural and Media StudiesLiterature, Cultural and Media Studies (R0)