Abstract
This study examined how task complexity affected the temporal characteristics of self-regulated learning (SRL) behaviours in clinical reasoning. Eight-eight (N = 88) medical students participated in this study. They were required to diagnose two virtual patients of varying complexity in BioWorld, an intelligent tutoring system (ITS) designed to promote medical students’ clinical reasoning skills. Students’ diagnostic behaviours were automatically recorded in the system log files, based on which we coded students’ SRL behaviours. We used a clustering technique to classify students into high- and low-performing groups for each task. Afterward, we applied the Fuzzy Miner algorithm to generate SRL process maps for each performance group. We found that all students used an analytical reasoning approach to diagnose the complex patient case, whereas low performers relied on a non-analytical approach to solve the simple task. Moreover, students switched between the SRL behaviours of help-seeking and execution in the complex task but not in the simple one. Furthermore, the SRL processes of high performers were cyclically sustained in the complex task. In addition to its theoretical contribution, this study informs the design of ITS regarding providing adaptive scaffoldings and prompts in SRL.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Adams, N. E. (2015). Bloom’s taxonomy of cognitive learning objectives. Journal of the Medical Library Association, 103(3), 152–153. https://doi.org/10.3163/1536-5050.103.3.010.
Artino, A. R., & Jones, I. I., K. D (2012). Exploring the complex relations between achievement emotions and self-regulated learning behaviors in online learning. The Internet and Higher Education, 15(3), 170–175. https://doi.org/10.1016/j.iheduc.2012.01.006.
Artino, A. R., Cleary, T. J., Dong, T., Hemmer, P. A., & Durning, S. J. (2014). Exploring clinical reasoning in novices: A self-regulated learning microanalytic assessment approach. Medical Education, 48(3), 280–291. https://doi.org/10.1111/medu.12303.
Azevedo, R. (2018). Using hypermedia as a metacognitive tool for enhancing student learning? The role of self-regulated learning. In R. Azevedo (Ed.), Educational psychologist (pp. 199–209). Routledge.
Azevedo, R., & Gašević, D. (2019). Analyzing multimodal multichannel data about self-regulated learning with advanced learning technologies: Issues and challenges. Computers in Human Behavior, 96, 207–210. https://doi.org/10.1016/j.chb.2019.03.025.
Azevedo, R., Moos, D. C., Greene, J. A., Winters, F. I., & Cromley, J. G. (2008). Why is externally-facilitated regulated learning more effective than self-regulated learning with hypermedia? Educational Technology Research and Development, 56(1), 45–72. https://doi.org/10.1007/s11423-007-9067-0.
Azevedo, R., Moos, D. C., Johnson, A. M., & Chauncey, A. D. (2010). Measuring cognitive and metacognitive regulatory processes during hypermedia learning: Issues and challenges. Educational Psychologist, 45(4), 210–223. https://doi.org/10.1080/00461520.2010.515934.
Baddeley, A. (1992). Working memory. Science, 255(5044), 556–559. https://doi.org/10.1126/science.1736359.
Bannert, M., Reimann, P., & Sonnenberg, C. (2014). Process mining techniques for analysing patterns and strategies in students’ self-regulated learning. Metacognition and Learning, 9(2), 161–185. https://doi.org/10.1007/s11409-013-9107-6.
Bettman, J. R., Johnson, E. J., & Payne, J. W. (1990). A componential analysis of cognitive effort in choice. Organizational Behavior and Human Decision Processes, 45(1), 111–139. https://doi.org/10.1016/0749-5978(90)90007-V.
Boekaerts, M. (2017). Cognitive load and self-regulation: Attempts to build a bridge. Learning and Instruction, 51, 90–97. https://doi.org/10.1016/j.learninstruc.2017.07.001.
Bogarín, A., Cerezo, R., & Romero, C. (2018). Discovering learning processes using inductive miner: A case study with learning management systems (LMSs). Psicothema, 30(3), 322–329. https://doi.org/10.7334/psicothema2018.116.
Bonner, S. E. (1994). A model of the effects of audit task complexity. Accounting Organizations and Society, 19(3), 213–234. https://doi.org/10.1016/0361-3682(94)90033-7.
Bruso, J., Stefaniak, J., & Bol, L. (2020). An examination of personality traits as a predictor of the use of self-regulated learning strategies and considerations for online instruction. Educational Technology Research and Development, 68(5), 2659–2683. https://doi.org/10.1007/s11423-020-09797-y.
Brydges, R., & Butler, D. (2012). A reflective analysis of medical education research on self-regulation in learning and practice. Medical Education, 46(1), 71–79. https://doi.org/10.1111/j.1365-2923.2011.04100.x.
Byström, K., & Järvelin, K. (1995). Task complexity affects information seeking and use. Information Processing and Management, 31(2), 191–213. https://doi.org/10.1016/0306-4573(95)80035-R.
Campbell, D. J. (1988). Task complexity: A review and analysis. Academy of Management Review, 13(1), 40–52. https://doi.org/10.5465/amr.1988.4306775.
Cerezo, R., Bogarín, A., Esteban, M., & Romero, C. (2020). Process mining for self-regulated learning assessment in e-learning. Journal of Computing in Higher Education, 32(1), 74–88. https://doi.org/10.1007/s12528-019-09225-y.
Cleary, T. J., Durning, S. J., & Artino, A. R. (2016). Microanalytic Assessment of Self-Regulated learning during clinical reasoning tasks: Recent developments and next steps. Academic Medicine, 91(11), 1516–1521. https://doi.org/10.1097/ACM.0000000000001228.
de Bruin, A. B., & van Merriënboer, J. J. (2017). Bridging cognitive load and self-regulated learning research: A complementary approach to contemporary issues in educational research. Learning and Instruction, 51, 1–9. https://doi.org/10.1016/j.learninstruc.2017.06.001.
Duffy, M. C., & Azevedo, R. (2015). Motivation matters: Interactions between achievement goals and agent scaffolding for self-regulated learning within an intelligent tutoring system. Computers in Human Behavior, 52, 338–348. https://doi.org/10.1016/j.chb.2015.05.041.
Durning, S. J., Dong, T., Artino, A. R., van der Vleuten, C., Holmboe, E., & Schuwirth, L. (2015). Dual processing theory and expertsʼ reasoning: Exploring thinking on national multiple-choice questions. Perspectives on Medical Education, 4(4), 168–175. https://doi.org/10.1007/s40037-015-0196-6.
Ebner, M., Holzinger, A., & Maurer, H. (2007). Web 2.0 technology: Future interfaces for technology enhanced learning? In C. Stephanidis (Ed.), Universal access to applications and services, lecture notes in computer science (LNCS 4556) (pp. 559–568). Springer. https://doi.org/10.1007/978-3-540-73283-9_62
Ericsson, K. A., Krampe, R. T., & Tesch-Römer, C. (1993). The role of deliberate practice in the acquisition of expert performance. Psychological Review, 100(3), 363–406. https://doi.org/10.1037/0033-295x.100.3.363.
Ericsson, K. A., & Simon, H. A. (1998). How to study thinking in everyday life: Contrasting think-aloud protocols with descriptions and explanations of thinking. Mind Culture and Activity, 5(3), 178–186. https://doi.org/10.1207/s15327884mca0503_3.
Greene, J. A., & Azevedo, R. (2007). A theoretical review of Winne and Hadwin’s model of self-regulated learning: New perspectives and directions. Review of Educational Research, 77(3), 334–372. https://doi.org/10.3102/003465430303953.
Günther, C. W., & Van Der Aalst, W. M. (2007, September). Fuzzy mining–adaptive process simplification based on multi-perspective metrics. In International conference on business process management (pp. 328–343). Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-75183-0_24
Haerem, T., & Rau, D. (2007). The influence of degree of expertise and bbjective task complexity on perceived task complexity and performance. Journal of Applied Psychology, 92(5), 1320–1331. https://doi.org/10.1037/0021-9010.92.5.1320.
Heirweg, S., De Smul, M., Devos, G., & Van Keer, H. (2019). Profiling upper primary school students’ self-regulated learning through self-report questionnaires and think-aloud protocol analysis. Learning and Individual Differences, 70, 155–168. https://doi.org/10.1016/j.lindif.2019.02.001.
Hoegerle, S., Nitzsche, E., Altehoefer, C., Ghanem, N., Manz, T., Brink, I., & Neumann, H. P. (2002). Pheochromocytomas: Detection with 18F DOPA whole-body PET—initial results. Radiology, 222(2), 507–512.
Holzinger, A. (2004). Rapid prototyping for a virtual medical campus interface. IEEE Software, 21(1), 92–99. https://doi.org/10.1109/MS.2004.1259241.
Holzinger, A., & Mueller, H. (2021). Toward human-AI interfaces to support explainability and causability in medical AI. Computer, 54(10), 78–86. https://doi.org/10.1109/MC.2021.3092610.
Järvelä, S., Malmberg, J., Haataja, E., Sobocinski, M., & Kirschner, P. A. (2021). What multimodal data can tell us about the students’ regulation of their learning process? Learning and Instruction. https://doi.org/10.1016/j.learninstruc.2019.04.004
Kim, N. J., Belland, B. R., & Walker, A. E. (2018). Effectiveness of computer-based scaffolding in the context of problem-based learning for STEM education: Bayesian meta-analysis. Educational Psychology Review, 30(2), 397–429. https://doi.org/10.1007/s10648-017-9419-1.
Kuiper, R. A. (2013). Integration of innovative clinical reasoning pedagogies into a baccalaureate nursing curriculum. Creative Nursing, 19(3), 128–139. https://doi.org/10.1891/1078-4535.19.3.128.
Kuiper, R. A., & Pesut, D. J. (2004). Promoting cognitive and metacognitive reflective reasoning skills in nursing practice: Self-regulated learning theory. Journal of Advanced Nursing, 45(4), 381–391. https://doi.org/10.1046/j.1365-2648.2003.02921.x.
Lajoie, S. P. (2003). Transitions and trajectories for studies of expertise. Educational Researcher, 32(8), 21–25.
Lajoie, S. P. (2009). Developing professional expertise with a cognitive apprenticeship model: Examples from avionics and medicine. In K. A. Ericsson (Ed.), Development of professional expertise: Toward measurement of expert performance and design of optimal learning environments (pp. 61–83). Cambridge University Press.
Lajoie, S. P., & Azevedo, R. (2006). Teaching and learning in technology-rich environments. In P. A. Alexander & P. H. Winne (Eds.), Handbook of Educational psychology (pp. 803–821). Lawrence Erlbaum Associates Publishers.
Lajoie, S. P., & Lu, J. (2012). Supporting collaboration with technology: Does shared cognition lead to co-regulation in medicine? Metacognition and Learning, 7(1), 45–62.
Lajoie, S. P., Zheng, J., Li, S., Jarrell, A., & Gube, M. (2021). Examining the interplay of affect and self-regulation in the context of clinical reasoning. Learning and Instruction, 72, 101219. https://doi.org/10.1016/j.learninstruc.2019.101219.
Magno, C. (2011). Validating the academic self-regulated learning scale with the motivated strategies for learning questionnaire (MSLQ) and learning and study strategies inventory (LASSI). The International Journal of Educational and Psychological Assessment, 7(2), 18.
Molenaar, I., & Järvelä, S. (2014). Sequential and temporal characteristics of self and socially regulated learning. Metacognition and Learning, 9(2), 75–85. https://doi.org/10.1007/s11409-014-9114-2.
Musso, M. F., Boekaerts, M., Segers, M., & Cascallar, E. C. (2019). Individual differences in basic cognitive processes and self-regulated learning: Their interaction effects on math performance. Learning and individual Differences, 71, 58–70. https://doi.org/10.1016/j.lindif.2019.03.003.
Norman, G. (2009). Dual processing and diagnostic errors. Advances in Health Sciences Education, 14(1), 37–49. https://doi.org/10.1007/s10459-009-9179-x.
Nückles, M., Roelle, J., Glogger-Frey, I., Waldeyer, J., & Renkl, A. (2020). The self-regulation-view in writing-to-learn: Using journal writing to optimize cognitive load in self-regulated learning. Educational Psychology Review. https://doi.org/10.1007/s10648-020-09541-1
Öztürk, M., & Çakıroğlu, Ü. (2021). Flipped learning design in EFL classrooms: Implementing self-regulated learning strategies to develop language skills. Smart Learning Environments, 8(1), 1–20. https://doi.org/10.1186/s40561-021-00146-x.
Panadero, E. (2017). A review of self-regulated learning: Six models and four directions for research. Frontiers in Psychology. https://doi.org/10.3389/fpsyg.2017.00422
Pieschl, S., Stahl, E., & Bromme, R. (2013). Adaptation to context as core component of self-regulated learning: The Example of Complexity and Epistemic beliefs. In R. Azevedo & V. Aleven (Eds.), International handbook of metacognition and learning technologies (pp. 53–65). Springer.
Pintrich, P. R. (1991). A manual for the use of the Motivated Strategies for Learning Questionnaire (MSLQ).
Pintrich, P. R. (2000). The role of goal orientation in self-regulated learning. In M. Boekaert, P. R. Pintrich, & M. Zerdner (Eds.), Handbook of self-regulation (1st ed., pp. 451–502). Academic Press. https://doi.org/10.1016/b978-012109890-2/50043-3
Pintrich, P. R. (2004). A conceptual framework for assessing motivation and self-regulated learning in college students. Educational Psychology Review, 16(4), 385–407. https://doi.org/10.1007/s10648-004-0006-x.
Pionera, M., Degeng, I., Widiati, U., & Setyosari, P. (2020). Instructional methods and self-regulated learning in writing. International Journal of Instruction, 13(3), 43–60.
Reimann, P., & Yacef, K. (2013). Using process mining for understanding learning. In R. Luckin, S. Puntambekar, P. Goodyear, B. L. Grabowski, J. Underwood, & N. Winters (Eds.), Handbook of design in educational technology (1st ed., pp. 484–493). Routledge.
Reiser, B. J. (2004). Scaffolding complex learning: The mechanisms of structuring and problematizing student work. Journal of the Learning Sciences, 13(3), 273–304. https://doi.org/10.1207/s15327809jls1303_2.
Robinson, P. (2001). Task complexity, task difficulty, and task production: Exploring interactions in a componential framework. Applied Linguistics, 22(1), 27–57. https://doi.org/10.1093/applin/22.1.27.
Robinson, P., & Gilabert, R. (2007). Task complexity, the cognition hypothesis and second language learning and performance. International Review of Applied Linguistics in Language Teaching, 45(3), 161–176. https://doi.org/10.1515/iral.2007.007.
Saint, J., Fan, Y., Singh, S., Gasevic, D., & Pardo, A. (2021, April). Using process mining to analyse self-regulated learning: a systematic analysis of four algorithms. Proceedings of LAK21: 11th international learning analytics and knowledge conference (pp. 333–343). https://doi.org/10.1145/3448139.3448171
Saint, J., Whitelock-Wainwright, A., Gašević, D., & Pardo, A. (2020). Trace-SRL: A framework for analysis of microlevel processes of self-regulated learning from trace data. Proceedings of IEEE Transactions on Learning Technologies, 13(4), 861–877. https://doi.org/10.1109/TLT.2020.3027496
Schunk, D. H. (2005). Self-regulated learning: The educational legacy of Paul R. Pintrich. Educational Psychologist, 40(2), 85–94. https://doi.org/10.1207/s15326985ep4002_3.
Seufert, T. (2018). The interplay between self-regulation in learning and cognitive load. Educational Research Review, 24, 116–129. https://doi.org/10.1016/j.edurev.2018.03.004.
Seufert, T. (2020). Building bridges between self-regulation and cognitive load—an invitation for a broad and differentiated attempt. Educational Psychology Review. https://doi.org/10.1007/s10648-020-09574-6
Siadaty, M., Gasevic, D., & Hatala, M. (2016). Trace-based micro-analytic measurement of self-regulated learning processes. Journal of Learning Analytics, 3(1), 183–214. https://doi.org/10.18608/jla.2016.31.11.
Stahl, E., & Bromme, R. (2009). Not everybody needs help to seek help: Surprising effects of metacognitive instructions to foster help-seeking in an online-learning environment. Computers & Education, 53(4), 1020–1028. https://doi.org/10.1016/j.compedu.2008.10.004.
Stahl, E., Pieschl, S., & Bromme, R. (2006). Task complexity, epistemological beliefs and metacognitive calibration: An exploratory study. Journal of Educational Computing Research, 35(4), 319–338. https://doi.org/10.2190/1266-0413-387K-7J51.
Steenbergan-Hu, S., & Cooper, H. (2014). A meta-analysis of the effectiveness of intelligent tutoring systems on college students’ academic learning. Journal of Educational Psychology, 106(2), 331. https://doi.org/10.1037/a0034752.
Sweller, J. (1988). Cognitive load during problem solving: Effects on learning. Cognitive Science, 12(2), 257–285. https://doi.org/10.1016/0364-0213(88)90023-7
Sweller, J. (2011) Cognitive load theory. In: JP Mestre, BH Ross (Eds.) Psychology of Learning and Motivation. Academic Press, New York. https://doi.org/10.1016/B978-0-12-387691-1.00002-8
Tacoma, S., Drijvers, P., & Jeuring, J. (2021). Combined inner and outer loop feedback in an intelligent tutoring system for statistics in higher education. Journal of Computer Assisted Learning, 37(2), 319–332. https://doi.org/10.1111/jcal.12491.
Tang, H. (2021). Person-centered analysis of self-regulated learner profiles in MOOCs: A cultural perspective. Educational Technology Research and Development, 69(2), 1247–1269. https://doi.org/10.1007/s11423-021-09939-w.
Teng, L. S. (2021). Individual differences in self-regulated learning: Exploring the nexus of motivational beliefs, self-efficacy, and SRL strategies in EFL writing. Language Teaching Research. https://doi.org/10.1177/1362168821100688
Van der Aalst, W., Weijters, T., & Maruster, L. (2004). Workflow mining: Discovering process models from event logs. IEEE Transactions on Knowledge and Data Engineering, 16(9), 1128–1142. https://doi.org/10.1109/TKDE.2004.47.
Van Gog, T., Kester, L., & Paas, F. (2011). Effects of concurrent monitoring on cognitive load and performance as a function of task complexity. Applied Cognitive Psychology, 25(4), 584–587. https://doi.org/10.1002/acp.1726.
Winne, P. H. (1996). A metacognitive view of individual differences in self-regulated learning. Learning and individual differences, 8(4), 327–353. https://doi.org/10.1016/S1041-6080(96)90022-9.
Winne, P. H. (2014). Issues in researching self-regulated learning as patterns of events. Metacognition and Learning, 9(2), 229–237. https://doi.org/10.1007/s11409-014-9113-3.
Winne, P. H. (2001). Self-regulated learning viewed from models of information Self-regulated learning viewed from models of information processing. In B. J. Zimmerman & D. H. Schunk (Eds.), Self-regulated learning and academic achievement: Theoretical perspectives (pp. 145–178). Routledge.
Winne, P. H. (2018). Theorizing and researching levels of processing in self-regulated learning. British Journal of Educational Psychology, 88(1), 9–20. https://doi.org/10.1111/bjep.12173.
Winne, P. H., & Hadwin, A. F. (2008). The weave of motivation and self-regulated learning. In D. Schunk & B. J. Zimmerman (Eds.), Motivation and self-regulated learning: Theory, research, and applications (pp. 297–314). Erlbaum.
Winne, P. H., & Perry, N. E. (2000). Measuring self-regulated learning. In M. Boekaert, P. R. Pintrich, & M. Zerdner (Eds.), Handbook of self-regulation (1st ed., pp. 531–566). Academic Press. https://doi.org/10.1016/B978-012109890-2/50045-7
Wu, X., Lowyck, J., Sercu, L., & Elen, J. (2012). Self-efficacy, task complexity and task performance: Exploring interactions in two versions of vocabulary learning tasks. Learning Environments Research, 15(1), 17–35. https://doi.org/10.1007/s10984-012-9098-2.
Zimmerman, B. J. (1989). A social cognitive view of self-regulated academic learning. Journal of Educational Psychology, 81(3), 329. https://doi.org/10.1037/0022-0663.81.3.329.
Zimmerman, B. J. (2000). Attaining self-regulation: A social cognitive perspective. In M. Boekaert, P. R. Pintrich, & M. Zerdner (Eds.), Handbook of self-regulation (1st ed., pp. 13–39). Berlin: Academic Press. https://doi.org/10.1016/b978-012109890-2/50031-7
Funding
This research was made possible by the Social Sciences and Humanities Research Council of Canada (SSHRC) and the China Scholarship Council (CSC).
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Competing interest
The authors declare that they have no competing interests.
Ethical approval
This study was approved by the Research Ethics Board of McGill University.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Wang, T., Li, S., Huang, X. et al. Task complexity affects temporal characteristics of self-regulated learning behaviours in an intelligent tutoring system. Education Tech Research Dev 71, 991–1011 (2023). https://doi.org/10.1007/s11423-023-10222-3
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11423-023-10222-3