Skip to main content
SpringerLink
Log in

Designing Sisters: Creating Audio-Based Narratives to Generate Affective Connections and Material Story Worlds

  • Conference paper
  • First Online:
Interactive Storytelling (ICIDS 2023)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 14383))

Included in the following conference series:

  • 623 Accesses

Abstract

In this paper, we reflect on the design of an interactive audio-based digital narrative experience called Sisters. This work is designed for a single interactor, constructed as a mobile AR experience using graphic illustrations on a deck of player cards in connection with abstract audio activated by trigger images on the cards. An interactor is asked to cluster series of cards together into different abstract environments, based on sounds associated with each card, meant to represent spaces in an interior/exterior domestic site, a house and its immediate surroundings. The work conveys experiences of 4 family members in a complex abusive household, mediating between scenes of normalcy, love, companionship, and violence. The core focus of the work is to explore fragmented and very personal states of being and memories derived from an outsider’s perspective (the interactor), who co-experiences the complexities of the domestic spaces at a ‘safe’ distance, while also gaining empathy and affective connections to the characters. Connecting the content of the work and its fragmentary and elusive material audio and narrative design to our design model, the New Material/Spectral Morphology Model, we share how it may be used for aesthetic composition. Our model is based on feminist new material perspectives and foundational work from electroacoustic production and audio experimentation. Sisters extends our previous work with sound-based narrative, and we demonstrate how this work affirms our design strategies for novel interactive audio experiences.

Trigger Warning: This paper includes descriptions of domestic violence, alcoholism, and mental illness.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 69.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 89.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Holloway-Attaway, L., Fawcus, J.: Making COVID dis-connections: designing intra-active and transdisciplinary sound-based narratives for phenomenal new material worlds. New Rev. Hypermedia Multimedia 28(3–4), 112–142 (2023)

    Google Scholar 

  2. Barad, K.: Meeting the Universe Halfway: Quantum Physics and The Entanglement of Matter and Meaning. Duke University Press, Durham (2007)

    Google Scholar 

  3. Smalley, D.: Spectromorphology: explaining sound shapes. Organised Sound 2(2), 107–126 (1997)

    Article  Google Scholar 

  4. Haraway, D.J.: Staying With the Trouble: Making Kin in the Chthulucene. Duke University Press, Durham (2016)

    Google Scholar 

  5. Holloway-Attaway, L.: Embodying the posthuman subject: digital humanities and permeable material practice. In: Åsberg, C., Braidotti, R. (eds.) A Feminist Companion to the Posthumanities. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-62140-1_8

  6. Fleming, T.M, et al.: Serious games and gamification for mental health: current status and promising directions. Front. Psychiatry 7, 215 (2017)

    Google Scholar 

  7. Andrews, A.: Serious games for psychological health education. In: Shumaker, R. (eds) Virtual and Mixed Reality - Systems and Applications. VMR 2011. LNCS, vol. 6774, pp. 3–10. Springer, Berlin (2011). https://doi.org/10.1007/978-3-642-22024-1_1

  8. Koenitz, H.: Towards a specific theory of interactive narrative. In: H. Koenitz, G.F., Haahr, M., Sezen, D., Sezen, T.I. (eds.). Interactive Digital Narrative: History, Theory, and Practice. Routledge, Milton Park (2015)

    Google Scholar 

  9. Knoller, N.: Complexity and the userly text. In: M. Grishakova, M., Poulaki (eds.). Narrative Complexity: Cognition, Embodiment, Evolution. University of Nebraska Press (2019)

    Google Scholar 

  10. Murray, J. Hamlet on the Holodeck. MIT Press, Cambridge (2017)

    Google Scholar 

  11. Murray, J.H.: Research into interactive digital narrative: a kaleidoscopic view. In: Rouse, R., Koenitz, H., Haahr, M. (eds.) Interactive Storytelling. ICIDS 2018. LNCS, vol. 11318, pp. 3–17. Springer, Cham (2018). https://doi.org/10.1007/978-3-030-04028-4_1

  12. Koentiz, et al.: INDCOR white paper 0: interactive digital narratives (IDNs)—a solution to the challenge of representing complex issues. ArXiv (2023)

    Google Scholar 

  13. Alaimo, S., Hekman. S. (eds.) Material Feminisms. Indiana University Press, Bloomington (2008)

    Google Scholar 

  14. Alaimo, S.: Bodily Natures: Science the Environment and the Material Self. University of Indiana Press, Bloomington (2010)

    Google Scholar 

  15. Grosz, E.: Volatile Bodies: Towards a Corporeal Feminism. Indiana University Press, Bloomington (1994)

    Google Scholar 

  16. Alaimo, S.: Exposed: Environmental Politics and Pleasures in Posthuman Times. University of Minnesota Press, Minneapolis (2017)

    Google Scholar 

  17. Braidotti, R.: The Posthuman. Polity Press, Cambridge (2013)

    Google Scholar 

  18. Hayles, K.: How We Became Posthuman: Virtual Bodies, Cybernetics, Literature and Informatics. University of Chicago Press, Chicago (1997)

    Google Scholar 

  19. Wolfe, C.: What is Posthumanism? University of Minnesota Press, Chicago (2010)

    Google Scholar 

  20. Holloway-Attaway, L., Fawcus, J. Patternings, Apt. 3b. 2021. Sounds as Affective Space for World-Building. In: Reyes, M. Pope, J. (eds). Texts of Discomfort. Interactive Storytelling Art. ETC Press, pp. 282–313 (2022)

    Google Scholar 

  21. Parikka, J. Insect Media: An Archeology of Animals and Technology. University of Minnesota Press, Chicago (2010)

    Google Scholar 

  22. Gregg, M., Seigworth, G. (eds.) The Affect Theory Reader. Duke University Press, Durham (2010)

    Google Scholar 

  23. Arnal, et al.: Human screams occupy a privileged niche in the communication soundscape. Curr. Biol. 25, 2051–2056 (2015)

    Article  Google Scholar 

  24. Christensen, K.: A dynasty of screams: Jamie lee curtis and the reinterpretation of the maternal voice in scream queens. Crit. Stud. Media Commun. 36(3), 272–288 (2019)

    Article  Google Scholar 

  25. Ollivier, R., et al.: Enjoy the violence: is appreciation for extreme music the result of cognitive control over the threat response system? Music. Percept. 37(2), 95–110 (2019)

    Article  Google Scholar 

  26. Chion, M.: The sound object. Organised Sound 21(1), 14–24 (2016)

    Google Scholar 

  27. Thompson, M.: Three screams. In: Thompson, M., Biddle, I. (eds.). Sound, Music, Affect: Theorising Sonic Experience. Bloomsbury. (2013)

    Google Scholar 

  28. Kassabian, A.: Music for sleeping. In: Thompson, M., Biddle, I. (eds.). Sound, Music, Affect: Theorising Sonic Experience. Bloomsbury. (2013)

    Google Scholar 

  29. Clough, T.: My mother’s scream. In Thompson, M., Biddle, I. (eds.). Sound, Music, Affect: Theorising Sonic Experience. Bloomsbury (2013)

    Google Scholar 

  30. Thompson, M., Biddle, I. (eds.). Sound, Music, Affect: Theorising Sonic Experience. Bloomsbury (2013)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. University of Skövde, Skövde, Sweden

    Lissa Holloway-Attaway & Jamie Fawcus

Authors
  1. Lissa Holloway-Attaway
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jamie Fawcus
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Lissa Holloway-Attaway .

Editor information

Editors and Affiliations

  1. University of Skövde, Skövde, Sweden

    Lissa Holloway-Attaway

  2. University of Central Florida, Orlando, FL, USA

    John T. Murray

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Holloway-Attaway, L., Fawcus, J. (2023). Designing Sisters: Creating Audio-Based Narratives to Generate Affective Connections and Material Story Worlds. In: Holloway-Attaway, L., Murray, J.T. (eds) Interactive Storytelling. ICIDS 2023. Lecture Notes in Computer Science, vol 14383. Springer, Cham. https://doi.org/10.1007/978-3-031-47655-6_18

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-47655-6_18

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-47654-9

  • Online ISBN: 978-3-031-47655-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation