Supporting Students Through Notifications About Importance in Academic Lectures

  • Jörg Cassens
  • Rebekah Wegener
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11249)


Identifying and extracting important information from monologic interaction is a difficult task for humans and modelling this for an intelligent system is a big challenge. In our work, we have previously used models that are grounded in semiotic, linguistic and psychological theories of multi-modal interaction. Here, we concentrate on academic lectures as a specific form of monologic interaction. Our goal is to support students through a system alerting them to important aspects of a lecture. In this paper, we outline the requirements that went into an early implementation of the system. We discuss a rich contextual model and what this entails for modelling requirements and system implementation. We provide an overview of the system and discuss our notion and role of context within the application domain.


Modelling context awareness Ambient intelligence education Multimodal human-computer interaction 


  1. 1.
    Aarts, E., De Ruyter, B.: New research perspectives on ambient intelligence. J. Ambient. Intell. Smart Environ. 1(1), 5–14 (2009)Google Scholar
  2. 2.
    Al-Musalli, A.M.: Taxonomy of lecture note-taking skills and subskills. Int. J. List. 29(3), 134–147 (2015)CrossRefGoogle Scholar
  3. 3.
    Baumann, S.: The importance of tonal cues for untrained listeners in judging prominence. In: Proceedings of the 10th International Seminar on Speech Production (ISSP), pp. 21–24 (2014)Google Scholar
  4. 4.
    Boch, F., Piolat, A.: Note taking and learning a summary of research. WAC J. 16, 101–113 (2005). (Writing Across the Curriculum)Google Scholar
  5. 5.
    Butt, D., Wegener, R., Cassens, J.: Modelling behaviour semantically. In: Brézillon, P., Blackburn, P., Dapoigny, R. (eds.) Proceedings of CONTEXT 2013. LNCS, vol. 8175, pp. 343–349. Springer, France (2013). Scholar
  6. 6.
    Evangelopoulos, G., Zlatintsi, A., Potamianos, A., Maragos, P., Rapantzikos, K., Skoumas, G., Avrithis, Y.: Multimodal saliency and fusion for movie summarization based on aural, visual, and textual attention. IEEE Trans. Multimed. 15(7), 1553–1568 (2013)CrossRefGoogle Scholar
  7. 7.
    Hasan, R.: Situation and the definition of genre. In: Grimshaw, A. (ed.) What’s going on here? Complementary Analysis of Professional Talk: Volume 2 of the Multiple Analysis Project. Ablex, Norwood (1994)Google Scholar
  8. 8.
    Hasan, R.: Dynamic view of context in language. In: Cloran, C., Butt, D., Williams, G. (eds.) Ways of Saying Ways of Speaking. Open Linguistic Series, Casell (1996)Google Scholar
  9. 9.
    Mittelberg, I.: Making grammar visible: the use of metaphoric gestures to represent grammatical categories and structures. In: Proceedings of the First Congress of the International Society for Gesture Studies: Gesture - The Living Medium, University of Texas at Austin (2003)Google Scholar
  10. 10.
    Schüller, B.: Understanding the identification of important information in academic lectures: linguistic and cognitive approaches. Bachelor thesis, RWTH Aachen University (2018)Google Scholar
  11. 11.
    Stacy, E.M., Cain, J.: Note-taking and handouts in the digital age. Am. J. Pharm. Educ. 79(7), 107 (2015)CrossRefGoogle Scholar
  12. 12.
    Ude, J., Schüller, B., Wegener, R., Cassens, J.: A pipeline for extracting multi-modal markers for meaning in lectures. In: Cassens, J., Wegener, R., Kofod-Petersen, A. (eds.) Proceedings of the Tenth International Workshop on Modelling and Reasoning in Context, vol. 2134, pp. 16–21. CEUR Workshop Proceedings, Aachen (2018).
  13. 13.
    Wegener, R., Cassens, J.: Multi-modal markers for meaning: using behavioural, acoustic and textual cues for automatic, context dependent summarization of lectures. In: Cassens, J., Wegener, R., Kofod-Petersen, A. (eds.) Proceedings of the Eighth International Workshop on Modelling and Reasoning in Context (2016).
  14. 14.
    Wegener, R., Schüller, B., Cassens, J.: Needing and wanting in academic lectures: profiling the academic lecture across context. In: Chappell, P., Knox, J.S. (eds.) Transforming Contexts: Papers from the 44th International Systemic Functional Congress, Wollongong, Australia (2017).

Copyright information

© Springer Nature Switzerland AG 2018

Authors and Affiliations

  1. 1.University of HildesheimHildesheimGermany
  2. 2.RWTH Aachen UniversityAachenGermany
  3. 3.Paris Lodron University of SalzburgSalzburgAustria

Personalised recommendations