Skip to main content

A Design-Led Exploration of Material Interactions Between Machine Learning and Digital Portraiture

  • Conference paper
  • First Online:
[ ] With Design: Reinventing Design Modes (IASDR 2021)

Abstract

Design materials are defined as a combination of what they are, what they do, and the ways they interact with other materials. In this pictorial, we explore the interactions between machine learning (as a design material) and another design material—the human face—in the form of digital portraiture. Employing an exploratory Research through Design approach we consider how machine learning simultaneously enriches and subverts the materiality of the human face. Through a combination of images and text, we offer some considerations and provocations for further research.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 469.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 599.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  • Barthes, R.: Camera Lucida: Reflections on Photography. Macmillan (1981)

    Google Scholar 

  • Benjamin, J.J., Berger, A., Merrill, N., Pierce, J.: Machine learning uncertainty as a design material: a post-phenomenological inquiry. In: Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems, CHI 2021, pp. 1–14. Association for Computing Machinery, New York (2021). https://doi.org/10.1145/3411764.3445481

  • Budelman, M., Kizelshteyn, M.: Three principles for designing ML-powered products (2019). https://spotify.design/article/three-principles-for-designing-ml-powered-products. Accessed 10 June 2021

  • Dove, G., Halskov, K., Forlizzi, J., Zimmerman, J.: UX design innovation: challenges for working with machine learning as a design material. In: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI 2017), pp. 278–288. Association for Computing Machinery, New York (2017). https://doi.org/10.1145/3025453.3025739

  • Fuchsberger, V., Murer, M., Tscheligi, M.: Materials, materiality, and media. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI 2013), pp. 2853–2862. Association for Computing Machinery, New York (2013). https://doi.org/10.1145/2470654.2481395

  • Fiore, Q., McLuhan, M.: The Medium is the Massage. Random House, New York (1967)

    Google Scholar 

  • Garcia, M.: Racist in the machine: the disturbing implications of algorithmic bias. World Policy J. 33(4), 111–117 (2016)

    Article  Google Scholar 

  • Gaver, W.: What should we expect from research through design? In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 937–946. Association for Computing Machinery, New York (2012)

    Google Scholar 

  • Gellersen, H.: Eye movement as design material. In: Chuang, L., Duchowski, A., Qvarfordt, P., Weiskopf, D. Report from Dagstuhl Seminar 18252, Ubiquitous Gaze Sensing and Interaction, 18–21 June 2018

    Google Scholar 

  • Ingold, T.: Making: Anthropology, Archaeology, Art and Architecture. Routledge, Milton Park (2013)

    Book  Google Scholar 

  • Jenkins, H.: The cultural logic of media convergence. Int. J. Cult. Stud. 7(1), 33–43 (2004)

    Article  Google Scholar 

  • Leahu, L.: Ontological surprises: a relational perspective on machine learning. In: Proceedings of the 2016 ACM Conference on Designing Interactive Systems (DIS 2016), pp. 182–186. Association for Computing Machinery, New York (2016)

    Google Scholar 

  • Noble, S.U.: Algorithms of Oppression: How Search Engines Reinforce Racism. NYU Press, New York (2018)

    Book  Google Scholar 

  • Odom, W., Duel, T.: On the design of OLO radio: investigating metadata as a design material. In: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI 2018), Paper 104, pp. 1–9. Association for Computing Machinery, New York (2018). https://doi.org/10.1145/3173574.3173678

  • Paterson, G., Garner, S.: On making: issues of 3D representations in design education. In: DS 38: Proceedings of E&DPE 2006, the 8th International Conference on Engineering and Product Design Education, Salzburg, Austria, 07–08 September 2006, pp. 273–278 (2006)

    Google Scholar 

  • Rahimi, A., Recht, B.: Reflections on Random Kitchen Sinks (2017). http://www.argmin.net/2017/12/05/kitchen-sinks/. Accessed 10th June 2021

  • Redström, J.: On technology as material in design. Des. Philos. Pap. 3, 39–54 (2005). https://doi.org/10.2752/144871305X13966254124275

  • Sundström, P., Taylor, A.S., O’Hara, K.: Sketching in software and hardware Bluetooth as a design material. In: Proceedings of the 13th International Conference on Human Computer Interaction with Mobile Devices and Services (MobileHCI 2011), pp. 405–414. Association for Computing Machinery, New York (2011). https://doi.org/10.1145/2037373.2037434

  • Sutton, S.J., Foulkes, P., Kirk, D., Lawson, S.: Voice as a design material: sociophonetic inspired design strategies in human-computer interaction. In: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, Paper 603, pp. 1–14. Association for Computing Machinery, New York (2019). https://doi.org/10.1145/3290605.3300833

  • Li, Z., Wang, Y., Greuter, S., Mueller, F.: Ingestible sensors as design material for bodily play. In: Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems (CHI EA 2020), pp. 1–8. Association for Computing Machinery, New York (2020). https://doi.org/10.1145/3334480.3382975

Download references

Acknowledgments

This work was funded by UK Research and Innovation (grant reference MR/T019220/1). Special thanks to Adrienne Gantenberg for permission to use her artwork, Shame (Fig 6).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to David Philip Green .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Green, D.P., Lindley, J., Mason, Z., Coulton, P. (2022). A Design-Led Exploration of Material Interactions Between Machine Learning and Digital Portraiture. In: Bruyns, G., Wei, H. (eds) [ ] With Design: Reinventing Design Modes. IASDR 2021. Springer, Singapore. https://doi.org/10.1007/978-981-19-4472-7_211

Download citation

Publish with us

Policies and ethics