Skip to main content

The Role of Metacognition and Self-regulation on Clinical Reasoning: Leveraging Multimodal Learning Analytics to Transform Medical Education

  • Chapter
  • First Online:
The Multimodal Learning Analytics Handbook

Abstract

Medical errors are defined as preventable adverse effects of health care that often result from faulty clinical reasoning processes. Moreover, studies find that medical errors have been linked to failures in clinical-reasoning strategies and medical education, suggesting a need to transform curricula that prioritizes the knowledge, skills, and abilities [KSBs] needed for effective clinical-reasoning practices. In this chapter, first we discuss the need to incorporate metacognition, the process of monitoring and evaluating one’s own clinical reasoning, and self-regulation, the ability to adapt one’s clinical-reasoning strategies to address these significant issues within medical education. However, challenges exist within medical education because most educational programs rely on ‘snapshots’ of students’ performance (e.g., pre/post) to define competency using standardized assessments and self-report methodologies, missing information on [KSBs] during training activities. Next, we introduce multimodal learning analytics as a novel research approach for studying the role of metacognition and self-regulation on clinical-reasoning processes as they unfold using multiple streams of time series data, such as eye movements, facial expressions, concurrent verbalizations, physiological data, and many others, during medical education and training with emerging technologies with a specific focus on the socio-cognitive cyclic model of self-regulated learning by Zimmerman and Moylan (Self-regulation: Where metacognition and motivation intersect. In Handbook of metacognition in education. Routledge, London, pp. 311–328, 2009). Finally, we discuss implications for utilizing multimodal learning analytics to transform the KSAs needed for the next generation of medical professionals.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 149.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 199.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 199.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

Notes

  1. 1.

    Not all the same data sources will provide relevant information in all of the three phases of the SCT model, and the rate and way in which data are fused should change based on the research questions, experimental design, theoretical framework, nature of the task, etc.

References

  • Accreditation Council of Graduate Medical Education (ACGME) (2021). Common program requirements (residency). https://www.acgme.org/What-We-Do/Accreditation/Common-Program-Requirements/. Last accessed on 01 July 2021.

  • Connor, D.-M., Durning, S.-J., & Rencic, J.-J. (2020). Clinical reasoning as a core competency. Academic Medicine, 95(8), 1166–1171.

    Article  Google Scholar 

  • Azevedo, R. (2020). Reflections on the field of metacognition: Issues, challenges, and opportunities. Metacognition and Learning, 15, 91–98.

    Article  Google Scholar 

  • Ahmidi, N., Ishii, M., Fichtinger, G., Gallia, G.-L., & Hager, G.-D. (2012). An objective and automated method for assessing surgical skill in endoscopic sinus surgery using eye-tracking and tool-motion data. In International forum of allergy & rhinology (Vol. 2, No. 6, pp. 507–515). Hoboken: Wiley Subscription Services, Inc., A Wiley Company.

    Google Scholar 

  • Artino Jr, A.-R., Cleary, T.-J., Dong, T., Hemmer, P.-A., & Durning, S.-J. (2014). Exploring clinical reasoning in novices: A self-regulated learning microanalytic assessment approach. Medical Education, 48(3), 280–291.

    Article  Google Scholar 

  • Ashraf, H., Sodergren, M.-H., Merali, N., Mylonas, G., Singh, H., & Darzi, A. (2018). Eye-tracking technology in medical education: A systematic review. Medical Teacher, 40(1), 62–69.

    Article  Google Scholar 

  • Azevedo, R., & Gašević, D. (2019). Analyzing multimodal multichannel data about self-regulated learning with advanced learning technologies: Issues and challenges. Computers in Human Behavior, 96, 207–210.

    Article  Google Scholar 

  • Azevedo, R., & Lajoie, S.-P. (1998). The cognitive basis for the design of a mammography interpretation tutor. International Journal of Artificial Intelligence in Education, 9, 32–44.

    Google Scholar 

  • Azevedo, R., Taub, M., & Mudrick, N.-V. (2018). Using multi-channel trace data to infer and foster self-regulated learning between humans and advanced learning technologies. In D. Schunk & J. A. Greene (Eds.), Handbook of self-regulation of learning and performance (2nd ed., pp. 254–270). New York City, New York: Routledge.

    Google Scholar 

  • Baltrušaitis, T., Ahuja, C., Morency, L.-P.: Multimodal machine learning: A survey and taxonomy. IEEE Transactions on Pattern Analysis and Machine Intelligence, 41(2), 423–443 (2018).

    Article  Google Scholar 

  • Batalden, P., Leach, D., Swing, S., Dreyfus, H., & Dreyfus, S. (2002). General competencies and accreditation in graduate medical education. Health Affairs, 21(5), 103–111.

    Article  Google Scholar 

  • Birt, J., Moore, E., & Cowling, M. (2017). Improving paramedic distance education through mobile mixed reality simulation. Australasian Journal of Educational Technology, 33(6), 69–83.

    Article  Google Scholar 

  • Blikstein, P., Worsley, M., Piech, C., Sahami, M., Cooper, S., & Koller, D. (2014). Programming pluralism: Using learning analytics to detect patterns in the learning of computer programming. Journal of the Learning Sciences, 23(4), 561–599.

    Article  Google Scholar 

  • Blumenthal-Barby, J.-S., & Krieger, H. (2015). Cognitive biases and heuristics in medical decision making: A critical review using a systematic search strategy. Medical Decision Making, 35(4), 539–557.

    Article  Google Scholar 

  • Boulet, J.-R., & Durning, S.-J. (2019). What we measure-and what we should measure in medical education. Medical Education, 53(1), 86–94.

    Article  Google Scholar 

  • Bric, J.-D., Lumbard, D.-C., Frelich, M.-J., & Gould, J.-C. (2016). Current state of virtual reality simulation in robotic surgery training: A review. Surgical Endoscopy, 30(6), 2169–2178.

    Article  Google Scholar 

  • Cleary, T.-J., Konopasky, A., LaRochelle, J.-S., et al. (2019). First-year medical students’ calibration bias and accuracy across clinical reasoning activities. Advances in Health Science Education, 24, 767–781.

    Article  Google Scholar 

  • Cleary, T.-J., Durning, S.-J., & Artino, A.-R. (2016). Microanalytic assessment of self-regulated learning during clinical reasoning tasks: Recent developments and next steps. Academic Medicine, 91(11), 1516–1521.

    Article  Google Scholar 

  • Chan, T., Sebok-Syer, S., Thoma, B., Wise, A., Sherbino, J., & Pusic, M. (2018). Learning analytics in medical education assessment: The past, the present, and the future. AEM Education and Training, 2(2), 178–187.

    Article  Google Scholar 

  • Chetwood, A.-S., Kwok, K.-W., Sun, L.-W., Mylonas, G.-P., Clark, J., Darzi, A., & Yang, G.-Z. (2012). Collaborative eye tracking: A potential training tool in laparoscopic surgery. Surgical Endoscopy, 26(7), 2003–2009.

    Article  Google Scholar 

  • Cloude, E.-B., Ballelos, N.-A.-M., Azevedo, R., Castiglioni, A., LaRochelle, J., Andrews, A., & Hernandez, C. (2021). Designing intelligent systems to support medical diagnostic reasoning using process data. In I. Roll, D. McNamara, S. Sosnovsky, R. Luckin, & V. Dimitrova (Eds.), International Conference on Artificial Intelligence in Education 2021. Lecture Notes in Computer Science (Vol. 12749, pp. 109–113). New York: Springer.

    Google Scholar 

  • Cloude, E.-B., Dever, D.-A., Wiedbusch, M.-D., & Azevedo, R. (2020). Quantifying scientific thinking using multichannel data with crystal island: Implications for individualized game-learning analytics. Frontiers in Education, 5, 572546.

    Article  Google Scholar 

  • Cook, D.-A., Hatala, R., Brydges, R., et al. (2011). Technology-enhanced simulation for health professions education: A systematic review and meta-analysis. Journal of the American Medical Association, 306(9), 978–988.

    Google Scholar 

  • Cook, D.-A., Andriole, D.-A., Durning, S.-J., Roberts, N.-K., & Triola, M.-M. (2010). Longitudinal research databases in medical education: Facilitating the study of educational outcomes over time and across institutions. Academic Medicine, 85(8), 1340–1346.

    Article  Google Scholar 

  • Custers, E.-J. (2015). Thirty years of illness scripts: Theoretical origins and practical applications. Medical Teacher, 37(5), 457–462.

    Article  Google Scholar 

  • D’Mello, S. (2017). Emotional learning analytics. In C. Lang, G. Siemens, A. Wise, & D. Gasevic (Eds.), Handbook of learning analytics (pp. 115–127). Beaumont: Society for Learning Analytics Research.

    Chapter  Google Scholar 

  • Dawson, S., Joksimovic, S., Poquet, O., & Siemens, G. (2019). Increasing the impact of learning analytics. In 9th International Conference on Learning Analytics & Knowledge (pp. 446–455). New York: ACM.

    Chapter  Google Scholar 

  • Deng, M., & Gu, X. (2021). Information acquisition, emotion experience and behaviour intention during online shopping: An eye-tracking study. Behaviour & Information Technology, 40(7), 635–645.

    Article  Google Scholar 

  • Dyre, L., & Tolsgaard, M.-G. (2018). The gap in transfer research. Medical Education, 52(6), 580–582. https://doi.org/10.1111/medu.13591

    Article  Google Scholar 

  • Duffy, M., Azevedo, R., Sun, N.-Z., Griscom, S., Stead, V., Dhillon, I., Crelinsten, L., Wiseman, J., Maniatis, T., & Lachapelle, K. (2015). Team regulation in a simulated medical emergency: A in-depth analysis of the cognitive, metacognitive, and affective processes. Instructional Science, 43, 401–426.

    Article  Google Scholar 

  • Dunlosky, J., & Tauber, S.-U.-K. (Eds.) (2016). The Oxford handbook of metamemory. Oxford: Oxford University Press.

    Google Scholar 

  • Emara, M., Hutchins, N.-M., Grover, S., Snyder, C., & Biswas, G. (2021). Examining students’ regulation of collaborative, computational, problem-solving processes in open-ended learning environments. Journal of Learning Analytics, 8, 49–74.

    Article  Google Scholar 

  • Ericsson, K.-A. (2015). Acquisition and maintenance of medical expertise: A perspective from the expert-performance approach with deliberate practice. Academic Medicine, 90(11), 1471–1486.

    Article  Google Scholar 

  • Ericsson, K.-A. (2007). An expert-performance perspective of research on medical expertise: The study of clinical performance. Medical Education, 41(12), 1124–1130.

    Article  Google Scholar 

  • Ericsson, K.-A., Patel, V., & Kintsch, W. (1998). How experts’ adaptations to representative task demands account for the expertise effect in memory recall: Comment on Vicente and Wang (1998). Psychological Review, 107(3), 578–592.

    Article  Google Scholar 

  • Ericsson, K.-A., Hoffman, R.-R., Kozbelt, A., & Williams, A.-M. (Eds.) (2018). The Cambridge handbook of expertise and expert performance. Cambridge: Cambridge University Press.

    Google Scholar 

  • Erridge, S., Ashraf, H., Purkayastha, S., Darzi, A., & Sodergren, M.-H. (2018). Comparison of gaze behaviour of trainee and experienced surgeons during laparoscopic gastric bypass. Journal of British Surgery, 105(3), 287–294.

    Article  Google Scholar 

  • Fard, M.-J., Ameri, S., Darin Ellis, R., Chinnam, R.-B., Pandya, A.-K., & Klein, M.-D. (2018). Automated robot-assisted surgical skill evaluation: Predictive analytics approach. The International Journal of Medical Robotics and Computer Assisted Surgery, 14(1), e1850.

    Article  Google Scholar 

  • Feltovich, P.-J., Prietula, M.-J., & Ericsson, K.-A. (2018). Studies of expertise from psychological perspectives: Historical foundations and recurrent themes. In K.-A. Ericsson, R.-R. Hoffman, A. Kozbelt, & A.-M. Williams (Eds.), The Cambridge handbook of expertise and expert performance (pp. 59–83). Cambridge: Cambridge University Press. https://doi.org/10.1017/9781316480748.006

    Chapter  Google Scholar 

  • Feyzi-Behnagh, R., Azevedo, R., Legowski, E., Reitmeyer, K., Tseytlin, E., & Crowley, R. (2014). Metacognitive scaffolds improve self-judgments of accuracy in a medical intelligent tutoring system. Instructional Science, 42, 159–181.

    Article  Google Scholar 

  • Forsberg, E., Ziegert, K., Hult, H., & Fors, U. (2014). Clinical reasoning in nursing, a think-aloud study using virtual patients-A base for an innovative assessment. Nurse Education Today, 34(4), 538–542.

    Article  Google Scholar 

  • Fox, S.-E., & Faulkner-Jones, B. E. (2017). Eye-tracking in the study of visual expertise: Methodology and approaches in medicine. Frontline Learning Research, 5(3), 29–40.

    Article  Google Scholar 

  • Hall, J.-C., Ellis, C., & Hamdorf, J. (2003). Surgeons and cognitive processes. Journal of British Surgery, 90(1), 10–16.

    Article  Google Scholar 

  • Henneman, E.-A., Cunningham, H., Fisher, D.-L., Plotkin, K., Nathanson, B.-H., Roche, J.-P., ... Henneman, P.-L. (2014). Eye tracking as a debriefing mechanism in the simulated setting improves patient safety practices. Dimensions of Critical Care Nursing, 33(3), 129–135.

    Google Scholar 

  • Hermens, F., Flin, R., & Ahmed, I. (2013). Eye movements in surgery: A literature review. Journal of Eye Movement Research, 6(4), 1–11.

    Article  Google Scholar 

  • Hofer, T.-P., Kerr, E.-A., & Hayward, R.-A. (2000). What is an error? Effective Clinical Practice, 3(6), 261–269.

    Google Scholar 

  • Institute of Medicine (2001). Crossing the quality chasm: A new health system for the 21st century. Washington: National Academy Press. https://doi.org/10.17226/1

  • Institute of Medicine (2000). To err is human: Building a safer health system. Washington: National Academy Press. https://doi.org/10.17226/9728

  • Institute of Medicine (2004). Patient safety: Achieving a new standard for care. Washington: National Academy Press. https://doi.org/10.17226/10863

  • Järvelä, S., Malmberg, J., Haataja, E., Sobosincki, M., & Kirschner, P. (2019). What multimodal data can tell us about the self-regulated learning process? Learning and Instruction. https://doi.org/10.1016/j.learninstruc.2019.04.004

  • Joksimović, S., Kovanović, V., & Dawson, S. (2019). The Journey of Learning Analytics. HERDSA Review of Higher Education, 6, 27–63.

    Google Scholar 

  • Josephsen, J.-M. (2017). A qualitative analysis of metacognition in simulation. Journal of Nursing Education, 56, 675–678.

    Article  Google Scholar 

  • Kahol, K., Vankipuram, M., & Smith, M.-L. (2009). Cognitive simulators for medical education and training. Journal of Biomedical Informatics, 42(4), 593–604.

    Article  Google Scholar 

  • Kamarudin, G., Penm, J., Chaar, B., & Moles, R. (2013). Educational interventions to improve prescribing competency: A systematic review. BMJ Open, 3(8), e003291.

    Article  Google Scholar 

  • Keiser, N. L., & Arthur, W. (2021). A meta-analysis of the effectiveness of the after-action review (or debrief) and factors that influence its effectiveness. Journal of Applied Psychology, 106(7), 1007–1032. https://doi.org/10.1037/apl0000821. Epub 2020 Aug 27. PMID: 32852990.

    Article  Google Scholar 

  • Kok, E.-M., & Jarodzka, H. (2017). Before your very eyes: The value and limitations of eye tracking in medical education. Medical Education, 51(1), 114–122.

    Article  Google Scholar 

  • Koochaki, F., & Najafizadeh, L. (2021). A data-driven framework for intention prediction via eye movement with applications to assistive systems. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 29, 974–984.

    Article  Google Scholar 

  • Krupat, E. (2018). Critical thoughts about the core entrustable professional activities in undergraduate medical education. Academic Medicine, 93(3), 371–376.

    Article  Google Scholar 

  • Krupinski, E.-A., Tillack, A.-A., Richter, L., Henderson, J.-T., Bhattacharyya, A.-K., Scott, K.-M., ... Weinstein, R.-S. (2006). Eye-movement study and human performance using telepathology virtual slides. Implications for medical education and differences with experience. Human Pathology, 37(12), 1543–1556.

    Google Scholar 

  • Kuehn, B.-M. (2018). Virtual and augmented reality put a twist on medical education. Journal of the American Medical Association, 319(8), 756–758.

    Article  Google Scholar 

  • Lajoie, S.-P., Li, S., & Zheng, J. (2021). The functional roles of metacognitive judgement and emotion in predicting clinical reasoning performance with a computer simulated environment. Interactive Learning Environments, 1–12. https://doi.org/10.1080/10494820.2021.1931347

  • Lajoie, S.-P., Poitras, E.-G., Doleck, T., & Jarrell, A. (2015). Modeling metacognitive activities in medical problem-solving with BioWorld. In A. Peña-Ayala, (Ed.), Metacognition: Fundaments, applications, and trends (pp. 323–343). New York: Springer.

    Google Scholar 

  • Lajoie, S.-P., Pekrun, R., Azevedo, R., & Leighton, J.-P. (2020). Understanding and measuring emotions in technology-rich learning environments. Learning and Instruction, 70, 101272.

    Article  Google Scholar 

  • Lang, C., Siemens, G., Wise, A., & Gasevic, D. (Eds.) (2017). Handbook of learning analytics. New York, NY: SOLAR, Society for Learning Analytics and Research.

    Google Scholar 

  • Lewis, K.-O., & Baker, R.-C. (2007). The development of an electronic educational portfolio: An outline for medical education professionals. Teaching and Learning in Medicine, 19(2), 139–147.

    Article  Google Scholar 

  • Lodge, J.-M., Panadero, E., Broadbent, J., & de Barba, P.-G. (2018). Supporting self-regulated learning with learning analytics. In Learning analytics in the classroom (pp. 45–55). New York City, NY: Routledge.

    Chapter  Google Scholar 

  • Lu, S., Perdomo, Y.-P.-S., Jiang, X., & Zheng, B. (2020). Integrating eye-tracking to augmented reality system for surgical training. Journal of Medical Systems, 44(11), 1–7. https://doi.org/10.1007/s10916-020-01656-w

    Article  Google Scholar 

  • Menekse Dalveren, G.-G., & Cagiltay, N.-E. (2020). Distinguishing intermediate and novice surgeons by eye movements. Frontiers in Psychology, 11, 2330.

    Article  Google Scholar 

  • Meyers, L., Mahoney, B., Schaffernocker, T., Way, D., Winfield, S., Uribe, A., ... & Lipps, J. (2020). The effect of supplemental high Fidelity simulation training in medical students. BMC Medical Education, 20(1), 1–7.

    Google Scholar 

  • Mosadeghrad, A.-M., & Woldemichael, A. (2017). Application of quality management in promoting patient safety and preventing medical errors. In M. Riga, (Ed.), Impact of medical errors and malpractice on health economics, quality, and patient safety (pp. 91–112). Hershey: IGI Global.

    Chapter  Google Scholar 

  • Mourad, A., Jurjus, A., & Hussein, I.-H. (2016). The what or the how: A review of teaching tools and methods in medical education. Medical Science Educator, 26(4), 723–728. https://doi.org/10.1007/s40670-016-0323-y

    Article  Google Scholar 

  • Mudrick, N.-V., Azevedo, R., & Taub, M. (2019). Integrating metacognitive judgments and eye movements using sequential pattern mining to understand processes underlying multimedia learning. Computers in Human Behavior, 96, 223–234.

    Article  Google Scholar 

  • Nelson, T.-O., & Narens, L. (1994). Why investigate metacognition. In J. Metcalfe & A.-P.Shimamura (Eds.), Metacognition: Knowing about knowing (pp. 1–25). Cambridge: MIT Press.

    Google Scholar 

  • Norman, G.-R., Grierson, L.-E.-M., Sherbino, J., Hamstra, S.-J., Schmidt, H. G., & Mamede, S. (2018). Expertise in medicine and surgery. In K.-A. Ericsson, R.-R. Hoffman, A. Kozbelt, A.-M. Williams (Eds.), The Cambridge handbook of expertise and expert performance (pp. 331–355). Cambridge: Cambridge University Press. https://doi.org/10.1017/9781316480748.019

    Chapter  Google Scholar 

  • Noroozi, O., Alikhani, I., Järvelä, S., Kirschner, P.-A., Juuso, I., & Seppänen, T. (2019). Multimodal data to design visual learning analytics for understanding regulation of learning. Computers in Human Behavior, 100, 298–304.

    Article  Google Scholar 

  • Norris, M., & Gimber, P. (2013). Developing nursing students’ metacognitive skills using social technology. Teaching and Learning in Nursing, 8(1), 17–21.

    Article  Google Scholar 

  • Ochoa, X. (2017). Multimodal learning analytics. In C. Lang, G. Siemens, A. Wise, & D. Gašević (Eds.), The handbook of learning analytics (pp. 129–141). Vancouver, BC: Society for Learning Analytics Research.

    Chapter  Google Scholar 

  • Orlosky, J., Itoh, Y., Ranchet, M., Kiyokawa, K., Morgan, J., & Devos, H. (2017). Emulation of physician tasks in eye-tracked virtual reality for remote diagnosis of neurodegenerative disease. IEEE Transactions on Visualization and Computer Graphics, 23(4), 1302–1311.

    Article  Google Scholar 

  • Paas, F., & van Merriënboer, J. (2020). Cognitive-load theory: Methods to manage working memory load in the learning of complex tasks. Current Directions in Psychological Science, 29, 394–398.

    Article  Google Scholar 

  • Patel, R., Green, W., Shahzad, M.-W., Church, H., & Sandars, J. (2020). Using a self-regulated learning-enhanced video feedback educational intervention to improve junior doctor prescribing. Medical Teacher, 42(8), 886–895.

    Article  Google Scholar 

  • Patel, V.-L., Arocha, J.-F., & Zhang, J. (2012). Medical reasoning and thinking. In K. J. Holyoak & R. G. Morrison (Eds.), The Oxford handbook of thinking and reasoning (pp. 736–754). Oxford: Oxford University Press.

    Chapter  Google Scholar 

  • Patel, V.-L., Glaser, R., & Arocha, J.-F. (2000). Cognition and expertise: Acquisition of medical competence. Clinical and Investigative Medicine, 23(4), 256–260.

    Google Scholar 

  • Patel, V.-L., Kaufman, D.-R., & Kannampallil, T.-G. (2019). Diagnostic reasoning and expertise in health care. In P. Ward, J. M. Schraagen, J. Gore, & E. M. Roth (Eds.), The Oxford handbook of expertise (1st ed., pp. 618–641). Oxford: Oxford University Press.

    Chapter  Google Scholar 

  • Petrizzo, M.-C., Barilla-LaBarca, M.-L., Lim, Y.-S., Jongco, A.-M., Cassara, M., Anglim, J., & Stern, J.-N. (2019). Utilization of high-fidelity simulation to address challenges with the basic science immunology education of preclinical medical students. BMC Medical Education, 19(1), 1–8.

    Google Scholar 

  • Raij, A.-B., & Lok, B.-C. (2008). Ipsviz: An after-action review tool for human-virtual human experiences. In 2008 IEEE Virtual Reality Conference (pp. 91–98). New York: IEEE.

    Chapter  Google Scholar 

  • Richie, M., & Josephson, S.-A. (2018). Quantifying heuristic bias: Anchoring, availability, and representativeness. Teaching and Learning in Medicine, 30(1), 67–75. https://doi.org/10.1080/10401334.2017.1332631

    Article  Google Scholar 

  • Richstone, L., Schwartz, M.-J., Seideman, C., Cadeddu, J., Marshall, S., & Kavoussi, L.-R. (2010). Eye metrics as an objective assessment of surgical skill. Annals of Surgery, 252(1), 177–182.

    Article  Google Scholar 

  • Rooney, M.-K., Zhu, F., Gillespie, E.-F., Gunther, J.-R., McKillip, R.-P., Lineberry, M., ... Golden, D.-W. (2018). Simulation as more than a treatment-planning tool: A systematic review of the literature on radiation oncology simulation-based medical education. International Journal of Radiation Oncology Biology Physics, 102(2), 257–283.

    Google Scholar 

  • Schunk, D., & Greene, J.-A. (Eds.) (2018). Handbook of self-regulation of learning and performance (2nd ed.). New York City, NY: Routledge.

    Google Scholar 

  • Sharma, K., & Giannakos, M. (2020). Multimodal data capabilities for learning: What can multimodal data tell us about learning? British Journal of Educational Technology, 51(5), 1450–1484.

    Article  Google Scholar 

  • Shinnick, M.-A. (2016). Validating eye tracking as an objective assessment tool in simulation. Clinical Simulation in Nursing, 12(10), 438–446.

    Article  Google Scholar 

  • Tien, T., Pucher, P.-H., Sodergren, M.-H., Sriskandarajah, K., Yang, G.-Z., & Darzi, A. (2014). Eye tracking for skills assessment and training: A systematic review. Journal of Surgical Research, 191(1), 169–178.

    Article  Google Scholar 

  • Rencic, J., Trowbridge, R.-L., Fagan, M. Szauter, K., & Durning, S. (2017). Clinical reasoning education at US medical schools: Results from a national survey of internal medicine clerkship directors. Journal of General Internal Medicine, 32(11), 1242–1246. https://doi.org/10.1007/s11606-017-415

    Article  Google Scholar 

  • Wesiak, G., Steiner, C.-M., Moore, A., Dagger, D., Power, G., Berthold, M., ... Conlan, O. (2014). Iterative augmentation of a medical training simulator: Effects of affective metacognitive scaffolding. Computers & Education, 76, 13–29.

    Google Scholar 

  • Wiedbusch, M.-D., & Azevedo, R. (2020). Modeling metacomprehension monitoring accuracy with eye gaze on informational content in a multimedia learning environment. In S. N. Spencer, (Ed.), Proceedings of ETRA’20: International ACM Symposium on Eye Tracking Research and Applications (pp. 1–9).

    Google Scholar 

  • Whitcomb, M.-E. (2016). Transforming medical education: Is competency-based medical education the right approach? Academic Medicine, 91(5), 618–620

    Article  Google Scholar 

  • Winne, P.-H. (2019). Paradigmatic dimensions of instrumentation and analytic methods in research on self-regulated learning. Computers in Human Behavior, 96, 285–289.

    Article  Google Scholar 

  • Winkler-Schwartz, A., Bissonnette, V., Mirchi, N., Ponnudurai, N., Yilmaz, R., Ledwos, N., ... Del Maestro, R.-F. (2019). Artificial intelligence in medical education: Best practices using machine learning to assess surgical expertise in virtual reality simulation. Journal of Surgical Education, 76(6), 1681–1690.

    Google Scholar 

  • Winner, J., & Millwater, T.-L. (2019). Evaluating human patient simulation fidelity and effectiveness for combat-medical training. In Proceedings of the International Symposium on Human Factors and Ergonomics in Health Care (pp. 176–180). Thousand Oaks: SAGE Publications.

    Google Scholar 

  • Wood, T.-J., & Pugh, D. (2020). Are rating scales really better than checklists for measuring increasing levels of expertise? Medical Teacher, 42(1), 46–51.

    Article  Google Scholar 

  • Worsley, M., & Blikstein, P. (2015). Leveraging multimodal learning analytics to differentiate student learning strategies. In Proceedings of LAK’15: 5th International Conference on Learning Analytics and Knowledge (pp. 360–367). New York: ACM. http://dx.doi.org/10.1145/2723576.2723624

    Chapter  Google Scholar 

  • Zheng, B., & Zhang, Y. (2020). Self-regulated learning: The effect on medical student learning outcomes in a flipped classroom environment. BMC Medical Education, 20 (2020). https://doi.org/10.1186/s12909-020-02023-6

  • Zimmerman, B.-J., & Moylan, A.-R. (2009). Self-regulation: Where metacognition and motivation intersect. In Handbook of metacognition in education (pp. 311–328). London: Routledge.

    Google Scholar 

Download references

Acknowledgements

This research was supported by the Department of Internal Medicine within College of Medicine at the University of Central Florida and the National Science Foundation (BCS#2128684). The authors would also like to thank members of the SMART Lab at UCF for their contributions.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Elizabeth B. Cloude .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Cloude, E.B., Wiedbusch, M.D., Dever, D.A., Torre, D., Azevedo, R. (2022). The Role of Metacognition and Self-regulation on Clinical Reasoning: Leveraging Multimodal Learning Analytics to Transform Medical Education. In: Giannakos, M., Spikol, D., Di Mitri, D., Sharma, K., Ochoa, X., Hammad, R. (eds) The Multimodal Learning Analytics Handbook. Springer, Cham. https://doi.org/10.1007/978-3-031-08076-0_5

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-08076-0_5

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-08075-3

  • Online ISBN: 978-3-031-08076-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics