Skip to main content
SpringerLink
Log in

Writing with (Digital) Scissors: Designing a Text Editing Tool for Assisted Storytelling Using Crowd-Generated Content

  • Conference paper
  • First Online:
Interactive Storytelling (ICIDS 2022)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 13762))

Included in the following conference series:

Abstract

Digital Storytelling can exploit numerous technologies and sources of information to support the creation, refinement and enhancement of a narrative. Research on text editing tools has created novel interactions that support authors in different stages of the creative process, such as the inclusion of crowd-generated content for writing. While these interactions have the potential to change workflows, integration of these in a way that is useful and matches users’ needs is unclear. In order to investigate the space of Assisted Storytelling, we designed and conducted a study to analyze how users write and edit a story about Cultural Heritage using an auxiliary source like Wikipedia. Through a diffractive analysis of stories, creative processes, and social and cultural contexts, we reflect and derive implications for design. These were applied to develop an AI-supported text editing tool using crowd-sourced content from Wikipedia and Wikidata.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    https://paulobala.github.io/ICIDS2022/.

  2. 2.

    https://elicit.org/.

  3. 3.

    https://vuejs.org/.

  4. 4.

    https://tiptap.dev/.

  5. 5.

    https://prosemirror.net/.

References

  1. Andersen, K., Wakkary, R.: The magic machine workshops: making personal design knowledge. In: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, pp. 1–13 (2019)

    Google Scholar 

  2. Barad, K.M.: Meeting the Universe Halfway: Quantum Physics and the Entanglement of Matter and Meaning. Duke University Press, Durham (2007)

    Book  Google Scholar 

  3. Beaudouin-Lafon, M.: Instrumental interaction: an interaction model for designing post-WIMP user interfaces. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems - CHI 2000, pp. 446–453. ACM Press, The Hague (2000). https://doi.org/10.1145/332040.332473

  4. Bødker, S.: When second wave HCI meets third wave challenges. In: Proceedings of the 4th Nordic Conference on Human-Computer Interaction Changing Roles - NordiCHI 2006, pp. 1–8. ACM Press, Oslo (2006). https://doi.org/10.1145/1182475.1182476

  5. Brown, T.B., et al.: Language models are few-shot learners (2020)

    Google Scholar 

  6. Calderwood, A., Qiu, V., Gero, K., Chilton, L.B.: How novelists use generative language models: an exploratory user study. In: HAI-GEN+user2agentIUI (2020)

    Google Scholar 

  7. Cameron, F.: The future of digital data, heritage and curation in a more-than human world. Routledge, Abingdon, Oxon, New York, NY (2021)

    Google Scholar 

  8. Chen, Z., Xia, H.: CrossData: leveraging text-data connections for authoring data documents. In: CHI Conference on Human Factors in Computing Systems, pp. 1–15. ACM, New Orleans, April 2022. https://doi.org/10.1145/3491102.3517485

  9. Chung, J.J.Y., He, S., Adar, E.: The intersection of users, roles, interactions, and technologies in creativity support tools. In: Designing Interactive Systems Conference 2021, pp. 1817–1833. ACM, Virtual Event, June 2021. https://doi.org/10.1145/3461778.3462050

  10. Chung, J.J.Y., Kim, W., Yoo, K.M., Lee, H., Adar, E., Chang, M.: TaleBrush: visual sketching of story generation with pretrained language models. In: CHI Conference on Human Factors in Computing Systems Extended Abstracts, pp. 1–4. ACM, New Orleans, April 2022. https://doi.org/10.1145/3491101.3519873

  11. Clark, E., Ross, A.S., Tan, C., Ji, Y., Smith, N.A.: Creative writing with a machine in the loop: case studies on slogans and stories. In: 23rd International Conference on Intelligent User Interfaces, pp. 329–340. ACM, Tokyo Japan, March 2018. https://doi.org/10.1145/3172944.3172983

  12. Devendorf, L., Andersen, K., Kelliher, A.: Making design memoirs: understanding and honoring difficult experiences. In: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, pp. 1–12. ACM, Honolulu, April 2020. https://doi.org/10.1145/3313831.3376345

  13. Emerson, L.: Reading writing interfaces: from the digital to the bookbound. No. 44 in Electronic Mediations, University of Minnesota Press, Minneapolis (2014)

    Google Scholar 

  14. Frauenberger, C.: Entanglement HCI the next wave? ACM Trans. Comput.-Hum. Interact. 27(1), 1–27 (2020). https://doi.org/10.1145/3364998

  15. Frich, J., MacDonald Vermeulen, L., Remy, C., Biskjaer, M.M., Dalsgaard, P.: Mapping the landscape of creativity support tools in HCI. In: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, pp. 1–18. ACM, Glasgow, May 2019. https://doi.org/10.1145/3290605.3300619

  16. Gaver, B., Dunne, T., Pacenti, E.: Design: cultural probes. Interactions 6(1), 21–29 (1999). https://doi.org/10.1145/291224.291235

  17. Gero, K.I., Liu, V., Chilton, L.: Sparks: inspiration for science writing using language models. In: Designing Interactive Systems Conference, pp. 1002–1019. ACM, Virtual Event, June 2022. https://doi.org/10.1145/3532106.3533533

  18. Giaccardi, E., Speed, C., Redström, J., Ben Allouch, S., Shklovski, I., Smith, R.C.: AI and the conditions of design: towards a new set of design ideals, Bilbao, Spain, June 2022. https://doi.org/10.21606/drs.2022.1078. https://dl.designresearchsociety.org/drs-conference-papers/drs2022/editorials/27

  19. Green, D., Hargood, C., Charles, F.: Contemporary issues in interactive storytelling authoring systems. In: Rouse, R., Koenitz, H., Haahr, M. (eds.) ICIDS 2018. LNCS, vol. 11318, pp. 501–513. Springer, Cham (2018). https://doi.org/10.1007/978-3-030-04028-4_59

    Chapter  Google Scholar 

  20. Grudin, J.: From tool to partner: The evolution of human-computer interaction. Synthesis Lectures on Human-Centered Interaction 10(1), i–183 (2017)

    Article  Google Scholar 

  21. Han, H.L., Renom, M.A., Mackay, W.E., Beaudouin-Lafon, M.: Textlets: supporting constraints and consistency in text documents. In: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, pp. 1–13. ACM, Honolulu, April 2020. https://doi.org/10.1145/3313831.3376804

  22. Han, H.L., Yu, J., Bournet, R., Ciorascu, A., Mackay, W.E., Beaudouin-Lafon, M.: Passages: interacting with text across documents. In: CHI Conference on Human Factors in Computing Systems, pp. 1–17. ACM, New Orleans, April 2022. https://doi.org/10.1145/3491102.3502052

  23. Homewood, S., Hedemyr, M., Fagerberg Ranten, M., Kozel, S.: Tracing conceptions of the body in HCI: from user to more-than-human. In: Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems, pp. 1–12. ACM, Yokohama, May 2021. https://doi.org/10.1145/3411764.3445656

  24. Hwang, A.H.C.: Too late to be creative? AI-empowered tools in creative processes. In: CHI Conference on Human Factors in Computing Systems Extended Abstracts, pp. 1–9. ACM, New Orleans, April 2022. https://doi.org/10.1145/3491101.3503549

  25. Kuznetsov, A., Novotny, M., Klein, J., Saez-Trumper, D., Kittur, A.: Templates and Trust-o-meters: towards a widely deployable indicator of trust in Wikipedia. In: CHI Conference on Human Factors in Computing Systems, pp. 1–17. ACM, New Orleans, April 2022. https://doi.org/10.1145/3491102.3517523

  26. Lee, M., Liang, P., Yang, Q.: CoAuthor: designing a human-AI collaborative writing dataset for exploring language model capabilities. In: CHI Conference on Human Factors in Computing Systems, pp. 1–19. ACM, New Orleans, April 2022. https://doi.org/10.1145/3491102.3502030

  27. Lee, Y., Chung, J.J.Y., Kim, T.S., Song, J.Y., Kim, J.: Promptiverse: scalable generation of scaffolding prompts through human-AI hybrid knowledge graph annotation. In: CHI Conference on Human Factors in Computing Systems, pp. 1–18. ACM, New Orleans, April 2022. https://doi.org/10.1145/3491102.3502087

  28. Li, J., Sun, A., Han, J., Li, C.: A survey on deep learning for named entity recognition. IEEE Trans. Knowl. Data Eng. 34(1), 50–70 (2022). https://doi.org/10.1109/TKDE.2020.2981314

    Article  Google Scholar 

  29. Logan, R., Liu, N.F., Peters, M.E., Gardner, M., Singh, S.: Barack’s wife hillary: using knowledge graphs for fact-aware language modeling. In: Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pp. 5962–5971. Association for Computational Linguistics, Florence, (2019). https://doi.org/10.18653/v1/P19-1598. https://www.aclweb.org/anthology/P19-1598

  30. Lupton, D., Watson, A.: Towards more-than-human digital data studies: developing research-creation methods. Qual. Res., 146879412093923, July 2020. https://doi.org/10.1177/1468794120939235. http://journals.sagepub.com/doi/10.1177/1468794120939235

  31. Metilli, D., Bartalesi, V., Meghini, C.: A Wikidata-based tool for building and visualising narratives. Int. J. Digit. Libr. 20(4), 417–432 (2019). https://doi.org/10.1007/s00799-019-00266-3

  32. Nicenboim, I., Giaccardi, E., Redström, J.: From explanations to shared understandings of AI. Bilbao, Spain, June 2022. https://doi.org/10.21606/drs.2022.773. https://dl.designresearchsociety.org/drs-conference-papers/drs2022/researchpapers/293

  33. Ochigame, R., Ye, K.: Search Atlas: visualizing divergent search results across geopolitical borders. In: Designing Interactive Systems Conference 2021, pp. 1970–1983. ACM, Virtual Event, June 2021. https://doi.org/10.1145/3461778.3462032

  34. Palani, S., Ledo, D., Fitzmaurice, G., Anderson, F.: “I don’t want to feel like I’m working in a 1960s factory”: the practitioner perspective on creativity support tool adoption. In: CHI Conference on Human Factors in Computing Systems, pp. 1–18. ACM, New Orleans, April 2022. https://doi.org/10.1145/3491102.3501933

  35. Rapp, A.: Autoethnography in human-computer interaction: theory and practice. In: Filimowicz, M., Tzankova, V. (eds.) New Directions in Third Wave Human-Computer Interaction: Volume 2 - Methodologies. HIS, pp. 25–42. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-73374-6_3

    Chapter  Google Scholar 

  36. Ravi, M.P.K., Singh, K., Mulang, I.O., Shekarpour, S., Hoffart, J., Lehmann, J.: Cholan: a modular approach for neural entity linking on wikipedia and wikidata. In: Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: Main Volume, pp. 504–514 (2021)

    Google Scholar 

  37. Remy, C., MacDonald Vermeulen, L., Frich, J., Biskjaer, M.M., Dalsgaard, P.: Evaluating creativity support tools in HCI research. In: Proceedings of the 2020 ACM Designing Interactive Systems Conference, pp. 457–476. ACM, Eindhoven, July 2020. https://doi.org/10.1145/3357236.3395474

  38. Rogers, Y.: HCI theory: classical, modern, and contemporary. Synth. Lect. Hum.-Centered Inf. 5(2), 1–129 (2012). https://doi.org/10.2200/S00418ED1V01Y201205HCI014. http://www.morganclaypool.com/doi/abs/10.2200/S00418ED1V01Y201205HCI014

  39. Romat, H., Marquardt, N., Hinckley, K., Henry Riche, N.: Style Blink: exploring digital inking of structured information via handcrafted styling as a first-class object. In: CHI Conference on Human Factors in Computing Systems, pp. 1–14. ACM, New Orleans, April 2022. https://doi.org/10.1145/3491102.3501988

  40. Sanches, P., Howell, N., Tsaknaki, V., Jenkins, T., Helms, K.: Diffraction-in-action: designerly explorations of agential realism through lived data. In: CHI Conference on Human Factors in Computing Systems, pp. 1–18. ACM, New Orleans, April 2022. https://doi.org/10.1145/3491102.3502029

  41. Schön, D.A.: The reflective practitioner: how professionals think in action. Ashgate, Farnham (2013)

    Google Scholar 

  42. Yang, M., et al.: Dolg: single-stage image retrieval with deep orthogonal fusion of local and global features. In: Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), pp. 11772–11781, October 2021

    Google Scholar 

  43. Yuan, A., Coenen, A., Reif, E., Ippolito, D.: Wordcraft: story writing with large language models. In: 27th International Conference on Intelligent User Interfaces, pp. 841–852. ACM, Helsinki, March 2022. https://doi.org/10.1145/3490099.3511105

  44. Zimmerman, J., Forlizzi, J.: Research through design in HCI. In: Olson, J.S., Kellogg, W.A. (eds.) Ways of Knowing in HCI, pp. 167–189. Springer, New York (2014). https://doi.org/10.1007/978-1-4939-0378-8_8

Download references

Acknowledgements

This research was supported by MEMEX (MEMories and EXperiences for inclusive digital storytelling) project funded by the European Union’s Horizon 2020 research and innovation program under grant agreement No 870743, and by LARSyS (Project UIDB/50009/2020).

Author information

Authors and Affiliations

  1. ITI-LARSyS, Lisbon, Portugal

    Paulo Bala & Valentina Nisi

  2. IST, Universidade de Lisboa, Lisbon, Portugal

    Paulo Bala & Valentina Nisi

  3. Visual Geometry and Modelling (VGM) Lab & Pattern Analysis and Computer Vision (PAVIS), Istituto Italiano di Tecnologia, Genova, Italy

    Stuart James & Alessio Del Bue

Authors
  1. Paulo Bala
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Stuart James
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Alessio Del Bue
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Valentina Nisi
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Paulo Bala .

Editor information

Editors and Affiliations

  1. Amsterdam University of Applied Sciences, Amsterdam, The Netherlands

    Mirjam Vosmeer

  2. University of Skövde, Skövde, Sweden

    Lissa Holloway-Attaway

Rights and permissions

Reprints and permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Bala, P., James, S., Del Bue, A., Nisi, V. (2022). Writing with (Digital) Scissors: Designing a Text Editing Tool for Assisted Storytelling Using Crowd-Generated Content. In: Vosmeer, M., Holloway-Attaway, L. (eds) Interactive Storytelling. ICIDS 2022. Lecture Notes in Computer Science, vol 13762. Springer, Cham. https://doi.org/10.1007/978-3-031-22298-6_9

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-22298-6_9

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-22297-9

  • Online ISBN: 978-3-031-22298-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation