Skip to main content

Characterizing Comment Types and Levels of Engagement in Video-Based Learning as a Basis for Adaptive Nudging

  • Conference paper
  • First Online:
Transforming Learning with Meaningful Technologies (EC-TEL 2019)

Abstract

Video is frequently used as a learning medium in a variety of educational settings, including large online courses as well as informal learning scenarios. To foster learner engagement around instructional videos, our learning scenario facilitates interactive note taking and commenting similar to popular social video-sharing platforms. This approach has recently been enriched by introducing nudging mechanisms, which raises questions about ensuing learning effects. To better understand the nature of these effects, we take a closer look at the content of the comments. Our study is based on an ex post analysis of a larger data set from a recent study. As a first step of analysis, video comments are clustered based on a feature set that captures the temporal and semantic alignment of comments with the videos. Based on the ensuing typology of comments, learners are characterized through the types of comments that they have contributed. The results will allow for a better targeting of nudges to improve video-based learning.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Agrawal, A., Venkatraman, J., Leonard, S., Paepcke, A.: YouEDU: addressing confusion in MOOC discussion forums by recommending instructional video clips (2015)

    Google Scholar 

  2. Anderson, A., Huttenlocher, D., Kleinberg, J., Leskovec, J.: Engaging with massive online courses. In: Proceedings of the 23rd International Conference on World Wide Web, pp. 687–698. ACM (2014)

    Google Scholar 

  3. Atapattu, T., Falkner, K.: Impact of lecturer’s discourse for student video interactions: video learning analytics case study of MOOCs. J. Learn. Anal. 5(3), 182–197 (2018)

    Article  Google Scholar 

  4. Baker, R.S.J., Mitrović, A., Mathews, M.: Detecting gaming the system in constraint-based tutors. In: De Bra, P., Kobsa, A., Chin, D. (eds.) UMAP 2010. LNCS, vol. 6075, pp. 267–278. Springer, Heidelberg (2010). https://doi.org/10.1007/978-3-642-13470-8_25

    Chapter  Google Scholar 

  5. Bixler, R., D’Mello, S.: Automatic gaze-based user-independent detection of mind wandering during computerized reading. User Model. User-Adap. Inter. 26(1), 33–68 (2016)

    Article  Google Scholar 

  6. Brooks, C., Thompson, C., Teasley, S.: A time series interaction analysis method for building predictive models of learners using log data. In: Proceedings of 5th Conference on Learning Analytics and Knowledge, pp. 126–135. ACM (2015)

    Google Scholar 

  7. Chatti, M.A., et al.: Video annotation and analytics in coursemapper. Smart Learn. Environ. 3(1), 10 (2016)

    Article  MathSciNet  Google Scholar 

  8. Chi, M.T., Wylie, R.: The ICAP framework: linking cognitive engagement to active learning outcomes. Educ. Psychol. 49(4), 219–243 (2014)

    Article  Google Scholar 

  9. Cocea, M., Weibelzahl, S.: Disengagement detection in online learning: validation studies and perspectives. IEEE Trans. Learn. Technol. 4(2), 114–124 (2011)

    Article  Google Scholar 

  10. Daems, O., Erkens, M., Malzahn, N., Hoppe, H.U.: Using content analysis and domain ontologies to check learners’ understanding of science concepts. J. Comput. Educ. 1(2), 113–131 (2014)

    Article  Google Scholar 

  11. Dimitrova, V., Mitrovic, A., Piotrkowicz, A., Lau, L., Weerasinghe, A.: Using learning analytics to devise interactive personalised nudges for active video watching. In: Proceedings of the 25th Conference on User Modeling, Adaptation and Personalization, pp. 22–31. ACM (2017)

    Google Scholar 

  12. Drummond, J., Litman, D.: In the zone: towards detecting student zoning out using supervised machine learning. In: Aleven, V., Kay, J., Mostow, J. (eds.) ITS 2010. LNCS, vol. 6095, pp. 306–308. Springer, Heidelberg (2010). https://doi.org/10.1007/978-3-642-13437-1_53

    Chapter  Google Scholar 

  13. Giannakos, M.N., Chorianopoulos, K., Chrisochoides, N.: Making sense of video analytics: lessons learned from clickstream interactions, attitudes, and learning outcome in a video-assisted course. Int. Rev. Res. Open Distrib. Learn. 16(1), 260–283 (2015)

    Google Scholar 

  14. Hecking, T., Chounta, I.A., Hoppe, H.U.: Role modelling in MOOC discussion forums. J. Learn. Anal. 4(1), 85–116 (2017)

    Article  Google Scholar 

  15. Hecking, T., Dimitrova, V., Mitrovic, A., Ulrich Hoppe, U.: Using network-text analysis to characterise learner engagement in active video watching. In: ICCE 2017 Main Conference Proceedings, pp. 326–335. Asia-Pacific Society for Computers in Education (2017)

    Google Scholar 

  16. Hong, J.K., Mitrovic, A., Neshatian, K.: Predicting quitting behaviour in SQL-tutor. In: Proceedings of the 23th International Conference on Computers in Education, pp. 37–45. APSCE (2015)

    Google Scholar 

  17. Kaltura Inc.: The state of video in education (2017)

    Google Scholar 

  18. Koedinger, K.R., Kim, J., Jia, J.Z., McLaughlin, E.A., Bier, N.L.: Learning is not a spectator sport: doing is better than watching for learning from a MOOC. In: Proceedings of 2nd ACM Conference on Learning@Scale, pp. 111–120 (2015)

    Google Scholar 

  19. Kovacs, G.: Effects of in-video quizzes on MOOC lecture viewing. In: Proceedings of the 3rd ACM Conference on Learning@ Scale, pp. 31–40. ACM (2016)

    Google Scholar 

  20. Mills, C., Bosch, N., Graesser, A., D’Mello, S.: To quit or not to quit: predicting future behavioral disengagement from reading patterns. In: Trausan-Matu, S., Boyer, K.E., Crosby, M., Panourgia, K. (eds.) ITS 2014. LNCS, vol. 8474, pp. 19–28. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-07221-0_3

    Chapter  Google Scholar 

  21. Mitrovic, A., Dimitrova, V., Lau, L., Weerasinghe, A., Mathews, M.: Supporting constructive video-based learning: requirements elicitation from exploratory studies. In: André, E., Baker, R., Hu, X., Rodrigo, M.M.T., du Boulay, B. (eds.) AIED 2017. LNCS (LNAI), vol. 10331, pp. 224–237. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-61425-0_19

    Chapter  Google Scholar 

  22. Mitrovic, A., Gordon, M., Piotrkowicz, A., Dimitrova, V.: Investigating the effect of adding nudges to increase engagement in active video watching. In: Isotani, S., Millán, E., Ogan, A., Hastings, P., McLaren, B., Luckin, R. (eds.) Artificial Intelligence in Education. LNCS, pp. 320–332. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-23204-7_27

    Chapter  Google Scholar 

  23. Pintrich, P.R., et al.: A manual for the use of the motivated strategies for learning questionnaire (MSLQ). (1991)

    Google Scholar 

  24. Rousseeuw, P.J.: Silhouettes: a graphical aid to the interpretation and validation of cluster analysis. J. Comput. Appl. Math. 20, 53–65 (1987)

    Article  Google Scholar 

  25. Steinberg, D., Colla, P.: CART: classification and regression trees. Top Ten Algorithms Data Min. 9, 179 (2009)

    Article  Google Scholar 

  26. Vail, A.K., Wiggins, J.B., Grafsgaard, J.F., Boyer, K.E., Wiebe, E.N., Lester, J.C.: The affective impact of tutor questions: predicting frustration and engagement. In: International Educational Data Mining Society (2016)

    Google Scholar 

  27. Wang, X., Wen, M., Rosé, C.P.: Towards triggering higher-order thinking behaviors in MOOCs. In: Proceedings of the 6th International Conference on Learning Analytics & Knowledge, pp. 398–407. ACM (2016)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Yassin Taskin .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Taskin, Y., Hecking, T., Hoppe, H.U., Dimitrova, V., Mitrovic, A. (2019). Characterizing Comment Types and Levels of Engagement in Video-Based Learning as a Basis for Adaptive Nudging. In: Scheffel, M., Broisin, J., Pammer-Schindler, V., Ioannou, A., Schneider, J. (eds) Transforming Learning with Meaningful Technologies. EC-TEL 2019. Lecture Notes in Computer Science(), vol 11722. Springer, Cham. https://doi.org/10.1007/978-3-030-29736-7_27

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-29736-7_27

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-29735-0

  • Online ISBN: 978-3-030-29736-7

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics