Abstract
Oftentimes learners are unable to engage in effective self-regulated learning (SRL) strategies while learning about complex topics. To combat this, intelligent tutoring systems (ITSs) incorporate pedagogical agents to guide learners in understanding how to engage in several SRL strategies effectively and efficiently throughout learning. To identify how ITSs can best support learners’ SRL strategy usage, data from 105 undergraduate students across several North American public universities were collected as they learned with MetaTutor, a hypermedia-based ITS about the human circulatory system. Participants were randomly assigned to two conditions – a prompt and feedback condition in which pedagogical agents prompted learners to engage in specific cognitive and metacognitive SRL strategies and provided feedback to performance in addition to learners’ self-initiated SRL strategy usage, and the control condition in which learners were not prompted nor were provided feedback on their performance of self-initiated SRL strategies. Results found that learners receiving external support from pedagogical agents had greater learning gains and deployed a greater number of both cognitive and metacognitive SRL strategies than learners who only self-initiated strategies. While probabilities obtained from a Markov model did not find differences between conditions in learners’ sequential transitions between SRL strategies, metrics from auto-recurrence quantification analysis found that learners receiving external support enacted less repetitive interactions of SRL strategies throughout their entire time interacting with MetaTutor. Implications of these results encourage the use of pedagogical agents in prompting more novel SRL strategies to increase learning within ITSs.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Winne, P.H.: Cognition and metacognition within self-regulated learning. In: Schunk, D.H., Greene, J.A. (eds.) Educational Psychology Handbook Series, Handbook of Self-Regulation of Learning and Performance, pp. 36–48. Routledge/Taylor & Francis Group (2018)
Azevedo, R., Dever, D.: Multimedia learning and metacognitive strategies. In: Mayer, R.E., Fiorella, L. (eds.) The Cambridge Handbook of Multimedia Learning, vol. 3. Cambridge University Press, Cambridge (in press)
Munshi, A., Biswas, G.: Personalization in OELEs: developing a data-driven framework to model and scaffold SRL processes. In: Isotani, S., Millán, E., Ogan, A., Hastings, P., McLaren, B., Luckin, R. (eds.) Artificial Intelligence in Education. Lecture Notes in Computer Science, vol. 11626, pp. 354–358. Springer, Cham (2019)
Schunk, D.H., Greene, J.A.: Handbook of Self-regulation of Learning and Performance, 2nd edn. Routledge/Taylor & Francis Group, New York (2018)
Aguirre, H.R.O.: Pedagogical agents as virtual tutors: applications and future trends in intelligent tutoring systems and virtual learning environments. In: Negrón, A.P.P, López, G.L., Aguirre, H.R.O. (eds.) Virtual Reality Designs, 1st edn., pp. 118–150. CRC Press, Boca Raton (2020)
Baker, R.S.: Stupid tutoring systems, intelligent humans. Int. J. Artif. Intell. Educ. 26(2), 600–614 (2016)
Greene, J.A., Azevedo, R.: A theoretical review of Winne and Hadwin’s model of self-regulated learning: new perspectives and directions. Rev. Educ. Res. 77(3), 334–372 (2007)
Johnson, W.L., Lester, J.C.: Pedagogical agents: back to the future. AI Mag. 39(2), 33–44 (2018)
Azevedo, R., Taub, M., Mudrick, N.V.: Understanding and reasoning about real- time cognitive, affective, and metacognitive processes to foster self-regulation with advanced learning technologies. In: Alexander, P.A., Schunk, D.H., Greene, J.A. (eds.) Handbook of Self-Regulation of Learning and Performance, 2nd edn., pp. 254–270. Routledge, New York (2018)
Azevedo, R., Martin, S.A., Taub, M., Mudrick, N.V., Millar, G.C., Grafsgaard, J.F.: Are pedagogical agents’ external regulation effective in fostering learning with intelligent tutoring systems? In: Micarelli, A., Stamper, J., Panourgia, K. (eds.) ITS 2016. LNCS, vol. 9684, pp. 197–207. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-39583-8_19
Lippert, A., Shubeck, K., Morgan, B., Hampton, A., Graesser, A.: Multiple agent designs in conversational intelligent tutoring systems. Technol. Knowl. Learn. 25, 443–463 (2020)
Biswas, G., Segedy, J.R., Bunchongchit, K.: From design to implementation to practice a learning by teaching system: Betty’s Brain. Int. J. Artif. Intell. Educ. 26, 350–364 (2016)
Desai, S., Chin, J.: An explorative analysis of the feasibility of implementing metacognitive strategies in self-regulated learning with the conversational agents. In: Proceedings of the Human Factors and Ergonomics Society Annual Meeting, vol. 64, no. 1, pp. 495–499. SAGE Publications, Los Angeles (2020)
Graesser, A., McNamara, D.: Self-regulated learning in learning environments with pedagogical agents that interact in natural language. Educ. Psychol. 45(4), 234–244 (2010)
Dever, D.A., Amon, M.J., Vrzakova, H., Wiedbusch, M.D., Cloude, E.B., Azevedo, R.: Capturing sequences of learners’ self-regulatory interactions with instructional material during game-based learning using auto-recurrence quantification analysis. Frontiers (2022)
Bouchet, F., Harley, J.M., Azevedo, R.: Evaluating adaptive pedagogical agents’ prompting strategies effect on students’ emotions. In: Nkambou, R., Azevedo, R., Vassileva, J. (eds.) ITS 2018. LNCS, vol. 10858, pp. 33–43. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-91464-0_4
Cloude, E.B., Wortha, F., Dever, D.A., Azevedo, R.: Negative emotional dynamics shape cognition and performance with MetaTutor: toward building affect-aware systems. In: 9th International Conference on Affective Computing and Intelligent Interaction (ACII), pp. 1–8. IEEE (2021)
Harley, J.M., Bouchet, F., Hussain, S., Azevedo, R., Calvo, R.: A multi-componential analysis of emotions during complex learning with an intelligent multi-agent system. Comput. Hum. Behav. 48, 615–625 (2015)
Lallé, S., Murali, R., Conati, C., Azevedo, R.: Predicting co-occurring emotions from eye-tracking and interaction data in MetaTutor. In: Roll, I., McNamara, D., Sosnovsky, S., Luckin, R., Dimitrova, V. (eds.) AIED 2021. LNCS (LNAI), vol. 12748, pp. 241–254. Springer, Cham (2021). https://doi.org/10.1007/978-3-030-78292-4_20
Sinclair, J., Jang, E.E., Azevedo, R., Lau, C., Taub, M., Mudrick, N.V.: Changes in emotion and their relationship with learning gains in the context of MetaTutor. In: Nkambou, R., Azevedo, R., Vassileva, J. (eds.) ITS 2018. LNCS, vol. 10858, pp. 202–211. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-91464-0_20
Duffy, M.C., Azevedo, R.: Motivation matters: interactions between achievement goals and agent scaffolding for self-regulated learning within an intelligent tutoring system. Comput. Hum. Behav. 52, 338–348 (2015)
Martha, A.S.D., Santoso, H.B.: Investigation of motivation theory on pedagogical agents design in the online learning environment. In: Proceedings of the 10th International Conference on Education Technology and Computers (ICETC 2018), pp. 217–222. Association for Computing Machinery, New York, October 2018
Dever, D.A., Wortha, F., Wiedbusch, M.D., Azevedo, R.: Effectiveness of system-facilitated monitoring strategies on learning in an intelligent tutoring system. In: Zaphiris, P., Ioannou, A. (eds.) HCII 2021. LNCS, vol. 12784, pp. 250–263. Springer, Cham (2021). https://doi.org/10.1007/978-3-030-77889-7_17
Taub, M., Azevedo, R.: How does prior knowledge influence eye fixations and sequences of cognitive and metacognitive SRL processes during learning with an intelligent tutoring system? Int. J. Artif. Intell. Educ. 29(1), 1–28 (2018). https://doi.org/10.1007/s40593-018-0165-4
Wiedbusch, M., Dever, D., Wortha, F., Cloude, E.B., Azevedo, R.: Revealing data feature differences between system- and learner-initiated self-regulated learning processes within hypermedia. In: Sottilare, R.A., Schwarz, J. (eds.) HCII 2021. LNCS, vol. 12792, pp. 481–495. Springer, Cham (2021). https://doi.org/10.1007/978-3-030-77857-6_34
Kramarski, B., Heaysman, O.: A conceptual framework and a professional development model for supporting teachers “triple SRL–SRT processes” and promoting students’ academic outcomes. Educ. Psychol. 56(4), 298–311 (2021)
Karlen, Y., Hertel, S., Hirt, C.: Teachers’ professional competences in self-regulated learning: an approach to integrate teachers’ competences as self-regulated learners and as agents of self-regulated learning in a holistic manner. Front. Educ. 5, 159 (2020)
Johnson, A.M., Azevedo, R., D’Mello, S.K.: The temporal and dynamic nature of self-regulatory processes during independent and externally assisted hypermedia learning. Cogn. Instr. 29(4), 471–504 (2011)
Lindquist, T.M., Olsen, L.M.: How much help, is too much help? An experimental investigation of the use of check figures and completed solutions in teaching intermediate accounting. J. Account. Educ. 25, 103–117 (2007)
Greene, J.A., Azevedo, R.: A macro-level analysis of SRL processes and their relations to the acquisition of a sophisticated mental model of a complex system. Contemp. Educ. Psychol. 34(1), 18–29 (2009)
Mudrick, N., Azevedo, R., Taub, M., Bouchet, F.: Does the frequency of pedagogical agent intervention relate to learners’ self-reported boredom while using multi-agent intelligent tutoring systems? In: Noelle, D.C., et al. (eds.) 37th Annual Meeting of the Cognitive Science Society, pp. 1661–1666. Cognitive Science Society, Austin, July 2015
Marx, J.D., Cummings, K.: Normalized change. Am. J. Phys. 75, 87–91 (2007)
Webber, C.L., Jr., Zbilut, J.P.: Recurrence quantification analysis of nonlinear dynamical systems. In: Riley, M.A., Van Orden, G.C. (eds.) Tutorials in Contemporary Nonlinear Methods for the Behavioral Sciences, vol. 94, pp. 26–94 (2005)
Wallot, S., Roepstorff, A., Mønster, D.: Multidimensional recurrence quantification analysis (MdRQA) for the analysis of multidimensional time-series: a software implementation in MATLAB and its application to group-level data in joint action. Front. Psychol. 7, 1835 (2016)
du Boulay, B., Luckin, R.: Modelling human teaching tactics and strategies for tutoring systems: 14 years on. Int. J. Artif. Intell. Educ. 26, 393–404 (2016)
Acknowledgement
This research was funded by the National Science Foundation (DRL #1916417). The authors would like to thanks the members of UCF’s SMART Lab for their numerous contributions.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 Springer Nature Switzerland AG
About this paper
Cite this paper
Dever, D.A., Sonnenfeld, N.A., Wiedbusch, M.D., Azevedo, R. (2022). Pedagogical Agent Support and Its Relationship to Learners’ Self-regulated Learning Strategy Use with an Intelligent Tutoring System. In: Rodrigo, M.M., Matsuda, N., Cristea, A.I., Dimitrova, V. (eds) Artificial Intelligence in Education. AIED 2022. Lecture Notes in Computer Science, vol 13355. Springer, Cham. https://doi.org/10.1007/978-3-031-11644-5_27
Download citation
DOI: https://doi.org/10.1007/978-3-031-11644-5_27
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-11643-8
Online ISBN: 978-3-031-11644-5
eBook Packages: Computer ScienceComputer Science (R0)