Skip to main content

Visual Summarisations for Computer-Assisted Live Color Casting and Direction in League of Legends

  • Conference paper
  • First Online:
HCI in Games (HCII 2023)


Esports has become a juggernaut in mainstream entertainment. For broadcasting and production stakeholders to establish a foothold in this exploding market, live-streaming broadcasts of matches should become more meaningful for fans, and more attractive to newcomers, ensuring their retention. This work describes an end-to-end solution for enhanced live production and streaming of the popular esport, League of Legends. The solution is based on several interconnected dashboards, which are fed by an inference engine reasoning on events transpiring in the game. Its aim is to lend decision support to directorial and color commentary tasks undertaken by the production crew. Hence, it supports the broadcasting director in using data to create shots of rich visual storytelling, while generating automated running commentary for esports casters to adapt the broadcasting script on-the-fly. Deduced knowledge is linked to custom infographics, that can be used to overlay the stream with visual summarisations of the action. The tools comprising our solution integrate with professional-grade broadcasting software, leveraging established workflows, and enabling complex management of multiple scenes and graphics from a single point of access. Our solution’s usability has been evaluated by esports experts through a cognitive walkthrough, verifying the approach.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
USD 69.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 89.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions


  1. Apostolakis, K.C., Zioulis, N., Doumanoglou, A., Alexiadis, D.S., Zarpalas, D., Daras, P.: Beyond online multiplayer: sharing and augmenting tele-immersive 3D game experiences with multiple geographically distributed users. IEEE COMSOC MMTC Commun. - Front. 12(1), 11–15 (2017)

    Google Scholar 

  2. Block, F., et al.: Narrative Bytes: data-driven content production in esports. In: Proceedings of the 2018 ACM International Conference on Interactive Experiences for TV and Online Video, pp. 29–41. Association for Computing Machinery, New York, NY, USA (2018).

  3. van den Broek, W., Wallner, G., Bernhaupt, R.: Modata - improving dota 2 experience and spectatorship through tangible gameplay visualization. In: Extended Abstracts of the Annual Symposium on Computer-Human Interaction in Play Companion Extended Abstracts, pp. 723–730. Association for Computing Machinery, New York, NY, USA (2019).

  4. Chandra, Y., Shang, L.: Inductive Coding. In: Qualitative Research Using R: A Systematic Approach, pp. 91–106. Springer Singapore (2019).

  5. Charleer, S., Gerling, K., Gutiérrez, F., Cauwenbergh, H., Luycx, B., Verbert, K.: Real-time dashboards to support esports spectating. In: Proceedings of the 2018 Annual Symposium on Computer-Human Interaction in Play, pp. 59–71. Association for Computing Machinery, New York, NY, USA (2018).

  6. Cranmer, E.E., Han, D.I.D., van Gisbergen, M., Jung, T.: Esports matrix: structuring the esports research agenda. Comput. Hum. Behav. 117, 106671 (2021).

    Article  Google Scholar 

  7. Degen, H., Ntoa, S.: From a workshop to a framework for human-centered artificial intelligence. In: Degen, H., Ntoa, S. (eds.) Artificial Intelligence in HCI, pp. 166–184. Springer International Publishing, Cham (2021).

  8. Grix, J., Brannagan, P.M., Grimes, H., Neville, R.: The impact of COVID-19 on sport. Int. J. Sport Policy Politics 13(1), 1–12 (2021).

    Article  Google Scholar 

  9. Keiper, M.C., Manning, R.D., Jenny, S., Olrich, T., Croft, C.: No reason to LoL at LoL: the addition of esports to intercollegiate athletic departments. J. Study Sports Athletes Educ. 11(2), 143–160 (2017).

    Article  Google Scholar 

  10. Kempe-Cook, L., Sher, S.T.H., Su, N.M.: Behind the voices: the practice and challenges of esports casters. In: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, pp. 1–12. Association for Computing Machinery, New York, NY, USA (2019)

    Google Scholar 

  11. Kim, D., Ko, Y.J.: The impact of virtual reality (VR) technology on sport spectators’ flow experience and satisfaction. Comput. Hum. Behav. 93, 346–356 (2019).

    Article  Google Scholar 

  12. Kleinman, E., El-Nasr, M.S.: Using data to “Git Gud”: a push for a player-centric approach to the use of data in esports. In: EHPHCI: Esports and High-Performance HCI Workshop, 2021 CHI Conference on Human Factors in Computing Systems. OSF Preprints, April 2021.

  13. Kleinman, E., Preetham, N., Teng, Z., Bryant, A., Seif El-Nasr, M.: “What Happened Here!?” a taxonomy for user interaction with spatio-temporal game data visualization. Proc. ACM Hum.-Comput. Interact. 5(CHI PLAY) (October 2021).

  14. Kleinman, E., et al.: “And Then They Died”: using action sequences for data driven, context aware gameplay analysis. In: International Conference on the Foundations of Digital Games. Association for Computing Machinery, New York, NY, USA (2020).

  15. Kokkinakis, A., et al.: Metagaming and metagames in esports. Int. J. Esports 1(1) (2021)

    Google Scholar 

  16. Kokkinakis, A.V., et al.: DAX: data-driven audience experiences in esports. In: ACM International Conference on Interactive Media Experiences, pp. 94–105. Association for Computing Machinery, New York, NY, USA (2020).

  17. Ludwig, S., Lachmann, K., Papenbrock, J., Mesonero, S.: Let’s Play! 2021 The European esports market. Report, Deloitte Insights (2021)

    Google Scholar 

  18. Mahatody, T., Sagar, M., Kolski, C.: State of the art on the cognitive walkthrough method, its variants and evolutions. Int. J. Hum. -Comput. Interact. 26(8), 741–785 (2010).

    Article  Google Scholar 

  19. Margetis, G., Ntoa, S., Antona, M., Stephanidis, C.: Human-centered design of artificial intelligence. In: Handbook of Human Factors and Ergonomics, Chap. 42, pp. 1085–1106. Wiley. (2021).

  20. Matheson, D., Wahl-Jorgensen, K.: The epistemology of live blogging. New Media Soc. 22(2), 300–316 (2020).

    Article  Google Scholar 

  21. Maymin, P.Z.: Smart kills and worthless deaths: esports analytics for league of legends. J.Quant. Anal. Sports 17(1), 11–27 (2021).

    Article  Google Scholar 

  22. Ntoa, S., et al.: UX design of a Big Data visualization application supporting gesture-based interaction with a large display. In: Yamamoto, S. (ed.) HIMI 2017. LNCS, vol. 10273, pp. 248–265. Springer, Cham (2017).

    Chapter  Google Scholar 

  23. Olarewaju, O., et al.: Automatic generation of text for match recaps using esport caster commentaries. In: 6th International Conference on Computer Science, Engineering And Applications, vol. 10. AIRCC Publishing Corporation (2020).

  24. Pizzo, A.D., Kunkel, T., Jones, G.J., Baker, B.J., Funk, D.C.: The strategic advantage of mature-stage firms: digitalization and the diversification of professional sport into esports. J. Bus. Res. 139, 257–266 (2022).

    Article  Google Scholar 

  25. Pizzo, A.D., Na, S., Baker, B.J., Lee, M.A., Kim, D., Funk, D.C.: eSport vs Sport: a comparison of spectator motives. Sport Mark. Q. 27(2), 108–123 (2018).

  26. Riot Games: League of legends (version 11.23). Video game (2009)

    Google Scholar 

  27. Riot Games: Riot developer portal (2013).

  28. Robertson, J., et al.: Wait, but why?: assessing behavior explanation strategies for real-time strategy games. In: 26th International Conference on Intelligent User Interfaces, pp. 32–42. Association for Computing Machinery, New York, NY, USA (2021)

    Google Scholar 

  29. Scholz, T.M.: Deciphering the world of esports. Int. J. Media Manag. 22(1), 1–12 (2020).

    Article  MathSciNet  Google Scholar 

  30. Sifa, R., et al.: Archetypal analysis based anomaly detection for improved storytelling in multiplayer online battle arena games. In: 2021 Australasian Computer Science Week Multiconference. Association for Computing Machinery, New York, NY, USA (2021).

  31. Tot, M., et al.: What are you looking at? Team fight prediction through player camera. In: 2021 IEEE Conference on Games (CoG), pp. 1–8 (2021).

  32. Vinyals, O., et al.: Grandmaster level in Starcraft II using multi-agent reinforcement learning. Nature 575(7782), 350–354 (2019).

    Article  Google Scholar 

  33. Werder, K.: Esport. business & information. Syst. Eng. 64(3), 393–399 (2022).

    Article  Google Scholar 

  34. Witkowski, E.: Doing/undoing gender with the girl gamer in high-performance play. In: Gray, K.L., Voorhees, G., Vossen, E. (eds.) Feminism in Play, pp. 185–203. Springer International Publishing, Cham (2018).

  35. Xu, J.H., Fang, Z., Chen, Q., Ohno, S., Paliyawan, P.: Fighting game commentator with pitch and loudness adjustment utilizing highlight cues. In: 2021 IEEE 10th Global Conference on Consumer Electronics (GCCE), pp. 366–370 (2021).

  36. Zhu, J., El-Nasr, M.S.: Open player modeling: empowering players through data transparency. arXiv preprint arXiv:2110.05810 (2021). 10.48550/ARXIV.2110.05810

  37. Zidianakis, E., et al.: The invisible museum: a user-centric platform for creating virtual 3D exhibitions with VR support. Electronics 10(3) (2021).

Download references


This work has received funding from the EU’s Horizon 2020 innovation action program under Grant agreement No 957059 (COPA EUROPE). This paper reflects only the authors’ view and the Commission is not responsible for any use that may be made of the information it contains. The authors also wish to thank all study participants for partaking in our co-creation workshop and increasing our understanding of the esports landscape through their insightful comments.

Author information

Authors and Affiliations


Corresponding author

Correspondence to George Margetis .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Margetis, G. et al. (2023). Visual Summarisations for Computer-Assisted Live Color Casting and Direction in League of Legends. In: Fang, X. (eds) HCI in Games. HCII 2023. Lecture Notes in Computer Science, vol 14046. Springer, Cham.

Download citation

  • DOI:

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-35929-3

  • Online ISBN: 978-3-031-35930-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics