Skip to main content

Advertisement

Log in

Towards effective evaluation and reform in medical education: a cognitive and learning sciences perspective

  • Reflections
  • Published:
Advances in Health Sciences Education Aims and scope Submit manuscript

Abstract

Health professions education is dealing with major transformations in light of the changing nature of the health care delivery system, including the use of technology for “just in time” delivery of care, evidence-based practice, personalized medical care and learning, as health professionals strive to integrate biomedical advances and clinical practice. This has forced the medical education community to reassess the current teaching and learning practices and more importantly, the evaluation of the medical education process. There have been recent advances in cognitive and learning sciences theories, some of which can inform medical educators about best teaching and learning practices and their impact on the evaluation process. An understanding of these theories provides a sound rationale for choosing specific instructional strategies and choosing evaluation measures that assess the curricular objectives. The review begins with an overview of evaluation and assessment in education, followed by an overview of major theories from the cognitive and learning sciences. Next, the role of cognitive and learning sciences theories in informing the process of medical education evaluation is discussed, including its impact on student learning, performance and professional competence, as well as recommendations for reform of medical curricula based on such theories. The paper continues with the elaboration of current trends in health sciences education, particularly medical education, and available evidence for the impact on student learning and performance as well as areas where more research is needed.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

Notes

  1. A curriculum is a set of intentions and expectations (Posner and Rudnitsky 1982) or a “formal and informal content and process by which learners gain knowledge and understanding, develop skills, and alter attitudes, appreciations, and values under the auspices of that school” (Doll 1996).

References

  • AAMC (2004). Educating doctors to provide high quality medical care: A vision for medical education in the United States. Report of the Ad Hoc Committee of Deans. Washington, DC.

  • AAMC (2005a). Recommendations for clinical skills curricula for undergraduate medical education. Retrieved April 16, 2007, from https://services.aamc.org/Publications/index.cfm?fuseaction=Product.displayForm&prd_id=141&prv_id=165

  • AAMC (2005b). Cultural competence education for medical students. Retrieved April 12, 2007, from http://www.aamc.org/meded/tacct/start.htm

  • AAMC (2006). Implementing the vision: Group on educational affairs responds to the IIME Dean’s Committee report. Washington, DC.

  • ACGME (1999). ACGME outcome project. General competencies. Retrieved May 3, 2007, from http://www.acgme.org/outcome/comp/compFull.asp

  • Anderson, J. R. (1983). The architecture of cognition. Cambridge, MA: Harvard University Press.

    Google Scholar 

  • Anderson, J. R. (1993). Rules of the mind. Hillsdale, NJ: Lawrence Erlbaum Associates.

    Google Scholar 

  • Anderson, J. R. (1996). ACT: A simple theory of complex cognition. American Psychologist, 51, 355–365.

    Article  Google Scholar 

  • Anderson, L., & Krathwohl, D. (Eds.) (2001). A taxonomy for learning, teaching, and assessing: A revision of Bloom’s taxonomy of educational objectives. New York: Longman.

    Google Scholar 

  • Anderson, J., Reder, L., & Simon, H. (1996). Situated learning and education. Educational Researcher, 25(4), 5–11.

    Google Scholar 

  • Anderson, J. R., & Schunn, C. D. (2000). Implications of the ACT-R learning theory: No magic bullets. In R. Glaser (Ed.), Advances in instructional psychology: Educational design and cognitive science (Vol. 5, pp. 1–34). Mahwah, NJ: Lawrence Erlbaum Associates.

    Google Scholar 

  • Baker, E. L. (2007). Moving to the next generation system design: Integrating cognition, assessment, and learning. CSE Report 706. National Center for Research on Evaluation, Standards, and Student Testing, University of California, Los Angeles.

  • Baker, D. P., Gustafson, S., Beaubien, J. M., Salas, E., & Barach, P. (2005). Medical team training programs in health care. In Advances in patient safety: From research to implementation (Vol. 4). Rockville, MD: Agency for Healthcare Research and Quality. http://www.ahrq.gov/qual/advances/

  • Bereiter, C., & Scardamalia, M. (1996). Rethinking learning. In D. R. Olson & N. Torrance (Eds.), The handbook of education and human development: New models of learning, teaching and schooling (pp. 485–513). Cambridge, MA: Basil Blackwell.

    Google Scholar 

  • Betancourt, J. R. (2003). Cross-cultural medical education: Conceptual approaches and frameworks for evaluation. Academic Medicine, 78, 560–569.

    Article  Google Scholar 

  • Blaskiewicz, R. J., Park, R. S., Chibnall, J. T., & Powell, J. K. (2004). The influence of testing context and clinical rotation order on students’ OSCE performance. Academic Medicine, 79, 597–601.

    Article  Google Scholar 

  • Bloom, B. S. (1956). The taxonomy of educational objectives. London: Longman.

    Google Scholar 

  • Bond, W. F., Lammers, R. L., Spillane, L. L., Smith-Coggins, R., Fernandez, R., Reznek, M. A., et al. (2007). The use of simulation in emergency medicine: A research agenda. Academic Emergency Medicine, 14, 353–363.

    Article  Google Scholar 

  • Bransford, J., Brown, A., & Cocking, R. (2000). How people learn: Brain, mind, experience, and school (Expanded ed.). Washington, DC: Commission on Behavioral and Social Sciences and Education/National Academy Press.

  • Bransford, J. D., & Schwartz, D. L. (1999). Rethinking transfer: A simple proposal with multiple implications. Review of Research in Education, 24, 61–100.

    Google Scholar 

  • Chatterji, M. (2005). Evidence on “what works”: An argument for extended-term mixed-method (ETMM) evaluation designs. Educational Researcher, 34, 14–24.

    Article  Google Scholar 

  • Clark, R. C., & Mayer, R. E. (2007). E-learning and the science of instruction (2nd ed.). San Francisco: Jossey-Bass.

    Google Scholar 

  • Cooper, H., Carlisle, C., Gibbs, T., & Watkins, C. (2001). Developing an evidence base for interdisciplinary learning: A systematic review. Journal of Advanced Nursing, 35, 228–237.

    Article  Google Scholar 

  • Detterman, D. K., & Sternberg, R. J. (1993). Transfer on trial: Intelligence, cognition, and instruction. Norwood, NJ: Ablex.

    Google Scholar 

  • Devitt, J. H., Kurrek, M. M., Cohen, M. M., Fish, K., Fish, P., Noel, A., et al. (1998). Testing internal consistency and construct validity during evaluation of performance in a patient simulator. Anesthesia & Analgesia, 86, 1160–1164.

    Article  Google Scholar 

  • Doll, R. C. (1996). Curriculum improvement (Rev. ed.). Boston, MA: Allyn and Bacon.

  • Dutta, S., Gaba, D., & Krummel, T. M. (2006). To simulate or not to simulate: What is the question? Annals of Surgery, 243, 301–303.

    Article  Google Scholar 

  • Epstein, R. M. (2007). Assessment in medical education. New England Journal of Medicine, 356(4), 387–396.

    Article  Google Scholar 

  • Ericsson, K. A. (2004). Deliberate practice and the acquisition and maintenance of expert performance in medicine and related domains. Academic Medicine, 79(10 Suppl), S70–S81.

    Article  Google Scholar 

  • Ericsson, K. A., Charness, N., Feltovich, P. J., & Hoffman, R. R. (2006). The Cambridge handbook of expertise and expert performance. New York: Cambridge University Press.

    Google Scholar 

  • Eva, K. W., Cunnington, J. P. W., Reiter, H. I., Keane, D. R., & Norman, G. R. (2004). How can I know what I don’t know? Poor self assessment in a well-defined domain. Advances in Health Sciences Education, 9, 211–224.

    Article  Google Scholar 

  • Eva, K. W., Neville, A. J., & Norman, G. R. (1998). Exploring the etiology of content specificity: Factors influencing analogic transfer and problem solving. Academic Medicine, 73(10 Suppl), S1–S5.

    Google Scholar 

  • Feltovich, P. J., Spiro, R. J., & Coulson, R. L. (1993). Learning, teaching, and testing for complex conceptual understanding. In N. Frederiksen, R. J. Mislevy, & I. I. Bejar (Eds.), Test theory for a new generation of tests (pp. 181–217). Hillsdale, NJ: Lawrence Erlbaum Associates.

    Google Scholar 

  • Fried, G. M., Feldman, L. S., Vassiliou, M. C., Fraser, S. A., Stanbridge, D., Ghitulescu, G., et al. (2004). Proving the value of simulation in laparoscopic surgery. Annals of Surgery, 240, 518–528.

    Article  Google Scholar 

  • Friedrich, M. (2002). Risk-free medical training with patient simulators. Journal of the American Medical Association, 288, 2808–2812.

    Article  Google Scholar 

  • Gaba, D. M. (2004). The future vision of simulation in health care. Quality and Safety in Health Care, 13, i2–i10.

    Article  Google Scholar 

  • Gallagher, A. G., & Cates, C. U. (2004). Approval of virtual reality training for carotid stenting: What this means for procedural-based medicine. Journal of the American Medical Association, 292, 3024–3026.

    Article  Google Scholar 

  • Garg, A. X., Adhikari, N. K. J., McDonald, H., Rosas-Arellano, M. P., Devereaux, P. J., Beyene, J., et al. (2005). Effects of computerized clinical decision support systems on practitioner performance and patient outcomes: A systematic review. Journal of the American Medical Association, 293, 1223–1238.

    Article  Google Scholar 

  • Gelman, R., & Greeno, J. G. (1989). On the nature of competence: Principles of understanding in a domain. In L. B. Resnick (Ed.), Knowing, learning and instructing: Essays in honor of Robert Glaser (pp. 125–186). Hillsdale, NJ: Lawrence Erlbaum Associates.

    Google Scholar 

  • Gentner, D., Loewenstein, J., & Thompson, L. (2003). Learning and transfer: A general role for analogical encoding. Journal of Educational Psychology, 95, 393–408.

    Article  Google Scholar 

  • Gick, M. L., & Holyoak, K. J. (1983). Schema induction and analogical transfer. Cognitive Psychology, 15, 1–38.

    Article  Google Scholar 

  • Gordon, J. A., Brown, D. F. M., & Armstrong, E. G. (2006). Can a simulated critical care encounter accelerate basic science learning among preclinical medical students? A pilot study. Simulation in Healthcare, 1, 13–17.

    Google Scholar 

  • Gordon, J., Shaffer, D., Raemer, D., Pawlowski, J., Hurford, W., & Cooper, J. (2006). A randomized controlled trial of simulation-based teaching versus traditional instruction in medicine: A pilot study among clinical medical students. Advances in Health Sciences Education, 11, 33–39.

    Article  Google Scholar 

  • Greeno, J. G. (1998). The situativity of knowing, learning, and research. American Psychologist, 53(1), 5–26.

    Article  Google Scholar 

  • Greeno, J. G. (2006). Learning in activity. In R. K. Sawyer (Ed.), The Cambridge handbook of the learning sciences (pp. 79–96). New York: Cambridge University Press.

    Google Scholar 

  • Gregg, J., & Saha, S. (2006). Losing culture on the way to competence: The use and misuse of culture in medical education. Academic Medicine, 81, 542–547.

    Article  Google Scholar 

  • Griffith, C. H., Wilson, J. F., Haist, S. A., & Ramsbottom-Lucier, M. (1997). Relationships of how well attending physicians teach to their students’ performances and residency choices. Academic Medicine, 72, S118–S120.

    Article  Google Scholar 

  • Griffith, C. H., Wilson, J. F., Haist, S., & Ramsbottom-Lucier, M. (1998). Do students who work with better housestaff in their medicine clerkships learn more. Academic Medicine, 73, S57–S59.

    Google Scholar 

  • Guest, C., Regehr, G., & Tiberius, R. (2001). The life long challenge of expertise. Medical Education, 35, 78–81.

    Article  Google Scholar 

  • Hamdy, H., Prasad, K., Anderson, M. B., Scherpbier, A., Williams, R., Zwierstra, R., et al. (2006). BEME systematic review: Predictive values of measurements obtained in medical schools and future performance in medical practice. Medical Teacher, 28, 103–116.

    Article  Google Scholar 

  • Hamstra, S. J., Dubrowski, A., & Backstein, D. (2006). Teaching technical skills to surgical residents: A survey of empirical research. Clinical Orthopaedics and Related Research, 449, 108–115.

    Google Scholar 

  • Hawkes, S., & Santhya, K. G. (2002). Diverse realities: Sexually transmitted infections and HIV in India. Sexually Transmitted Infections, 78, 31–39.

    Article  Google Scholar 

  • Hobgood, C., Sawning, S., Bowen, J., & Savage, K. (2006). Teaching culturally appropriate care: A review of educational models and methods. Academic Emergency Medicine, 13, 1288–1295.

    Article  Google Scholar 

  • Holyoak, K. J. (2005). Analogy. In K. J. Holyoak & R. G. Morrison (Eds.), The Cambridge handbook of thinking and reasoning (pp. 117–142). New York: Cambridge University Press.

    Google Scholar 

  • Howley, L. D. (2004). Performance assessment in medical education: Where we’ve been and where we’re going. Evaluation in the Health Professions, 27, 285–303.

    Article  Google Scholar 

  • Issenberg, S., McGaghie, W., & Petrusa, E. (2005). Features and uses of high fidelity medical simulations that lead to effective learning: A BEME systematic review. Medical Teacher, 27, 10–28.

    Article  Google Scholar 

  • Jolly, B. C., Jones, A., Dacre, J. E., Elzubier, M., Kopelman, P., & Hitman, G. (1996). Relationships between students’ clinical experiences in introductory clinical courses and their performance on an objective structured clinical examination (OSCE). Academic Medicine, 71, 909–916.

    Article  Google Scholar 

  • Junger, J., Schafer, S., Roth, C., Schellberg, D., Friedman Ben-David, M., & Nikendei, C. (2005). Effects of basic clinical skills training on objective structured clinical examination performance. Medical Education, 39, 1015–1020.

    Article  Google Scholar 

  • Kapur, P., & Steadman, R. (1998). Patient simulator competency testing: Ready for takeoff? Anesthesia and Analgesia, 86, 1157–1158.

    Article  Google Scholar 

  • Kaufman, D. (2003). Applying educational theory in practice. British Medical Journal, 326, 213–216.

    Article  Google Scholar 

  • Krathwohl, D. R. (2002). A revision of bloom’s taxonomy: An overview. Theory into practice, 41, 212–218.

    Article  Google Scholar 

  • Lave, J. (1988). Cognition in practice: Mind, mathematics, and culture in everyday life. Cambridge: Cambridge University Press.

    Google Scholar 

  • Lave, J., & Wenger, E. (1991). Situated cognition: Legitimate peripheral participation. Cambridge: Cambridge University Press.

    Google Scholar 

  • Magee, M. (2006). State of the field review: Simulation in education. A final report. Calgary, AB: Alberta Online Learning Consortium.

    Google Scholar 

  • Mayer, R. E., Heiser, J., & Lonn, S. (2001). Cognitive constraints on multimedia learning: When presenting more material results in less understanding. Journal of Educational Psychology, 93, 187–198.

    Article  Google Scholar 

  • Mayer, R. E., & Moreno, R. (2003). Nine ways to reduce cognitive load in multimedia learning. Educational Psychologist, 38(1), 43–52.

    Article  Google Scholar 

  • McLaughlin, S. A., Bond, W., Promes, S., & Spillane, L. (2006). The status of human simulation training in emergency medicine residency programs. Simulation in Healthcare, 1, 18–21.

    Google Scholar 

  • McLaughlin, S. A., Doezema, D., & Sklar, D. P. (2002). Human simulation in emergency medicine training: A model curriculum. Academic Emergency Medicine, 9, 1310–1318.

    Article  Google Scholar 

  • Metheny, W. P., Espey, E. L., Bienstock, J., Cox, S. M., Erickson, S. S., Goepfert, A. R., et al. (2005). To the point: Medical education reviews evaluation in context: Assessing learners, teachers, and training programs. American Journal of Obstetrics and Gynecology, 192, 34–37.

    Article  Google Scholar 

  • Morgan, P., & Cleave-Hogg, D. (2002). A worldwide survey of the use of simulation in anesthesia. Canadian Journal of Anaesthesia, 49, 659–662.

    Article  Google Scholar 

  • Norcini, J. J., Lipner, R. S., & Kimball, H. R. (2002). Certifying examination performance and patient outcomes following acute myocardial infarction. Medical Education, 36, 853–859.

    Article  Google Scholar 

  • Norcini, J. J., & Mckinley, D. W. (2007). Assessment methods in medical education. Teaching and Teacher Education, 23, 239–250.

    Article  Google Scholar 

  • Norman, G. R. (2005a). Editorial – Inverting the pyramid. Advances in Health Sciences Education, 10, 85–88.

    Article  Google Scholar 

  • Norman, G. R. (2005b). Editorial – Beyond PBL. Advances in Health Sciences Education, 9, 257–260.

    Google Scholar 

  • Norman, G., & Feightner, J. (1981). A comparison of behavior on simulated patients and patient management problems. Medical Education, 15, 26–32.

    Article  Google Scholar 

  • Patel, V. L., Arocha, J. F., Diermeier, M., How, J., & Mottur-Pilson, C. (2001). Cognitive psychological studies of representation and use of clinical practice guidelines. International Journal of Medical Informatics, 63(3), 147–167.

    Article  Google Scholar 

  • Patel, V. L., & Dauphinee, W. D. (1984). Return to basic sciences after clinical experience in undergraduate medical training. Medical Education, 18(4), 244–248.

    Article  Google Scholar 

  • Patel, V. L., Evans, D. A., & Groen, G. J. (1989). Biomedical knowledge and clinical reasoning. In D. A. Evans & V. L. Patel (Eds.), Cognitive science in medicine: Biomedical modeling (pp. 53–112). Cambridge, MA: The MIT Press.

    Google Scholar 

  • Patel, V. L., Glaser, R., & Arocha, J. F. (2000a). Cognition and expertise: Acquisition of medical competence. Clinical and Investigative Medicine, 23(4), 256–260.

    Google Scholar 

  • Patel, V. L., Groen, G. J., & Norman, G. R. (1993). Reasoning and instruction in medical curricula. Cognition and Instruction, 10(4), 335–378.

    Article  Google Scholar 

  • Patel, V. L., Kaufman, D. R., & Arocha, J. F. (2000b). Conceptual change in the biomedical, health sciences domain. In R. Glaser (Ed.), Advances in instructional psychology: Educational design and cognitive science (Vol. 5, pp. 329–392). Mahwah, NJ: Lawrence Erlbaum Associates.

    Google Scholar 

  • Patel, V. L., Kaufman, D. R., & Magder, S. A. (1991). Causal reasoning about complex physiological concepts in cardiovascular physiology by medical students. International Journal of Science Education, 13, 171–185.

    Article  Google Scholar 

  • Pellegrini, C. A. (2006). Surgical education in the United States: Navigating the white waters. Annals of Surgery, 244, 335–342.

    Article  Google Scholar 

  • Posner, G. J., & Rudnitsky, A. D. (1982). Course design (2nd ed.). New York: Longman.

    Google Scholar 

  • Salomon, G., & Perkins, D. N. (1989). Rocky roads to transfer: Rethinking mechanism of a neglected phenomenon. Educational Psychologist, 24, 113–142.

    Article  Google Scholar 

  • Schmidt, H. G., Norman, G. R., & Boshuizen, H. P. A. (1990). A cognitive perspective on medical expertise: Theory and implications. Academic Medicine, 65, 611–621.

    Article  Google Scholar 

  • Seymour, N. E., Gallagher, A. G., Roman, S. A., O’Brien, M. K., Bansal, V. K., Andersen, D. K., et al. (2002). Virtual reality training improves operating room performance: Results of a randomized, double-blinded study. Annals of Surgery, 236, 458–464.

    Article  Google Scholar 

  • Shapiro, M. J., Morey, J. C., Small, S. D., Langford, V., Kaylor, C. J., Jagminas, L., et al. (2004). Simulation based teamwork training for emergency department staff: does it improve clinical team performance when added to an existing didactic teamwork curriculum? Quality and Safety in Health Care, 13, 417–421.

    Article  Google Scholar 

  • Shumway, J., & Harden, R. (2003). AMEE Guide No. 25: The assessment of learning outcomes for the competent and reflective physician. Medical Teacher, 25, 569–584.

    Article  Google Scholar 

  • Snell, L., Tallett, S., Haist, S., Hays, R., Norcini, J., Prince, K., et al. (2000). A review of the evaluation of clinical teaching: New perspectives and challenges. Medical Education, 34, 862–870.

    Article  Google Scholar 

  • Spiro, R. J., Feltovich, P. J., Jacobson, M., & Coulson, R. L. (1991). Cognitive flexibility, constructivism, and hypertext: Advanced knowledge acquisition in ill-structured domains. Educational Technology, 31(5), 24–33.

    Google Scholar 

  • Steadman, R. H., Coates, W. C., Huang, Y. M., Matevosian, R., Larmon, B. R., McCullough, L., et al. (2006). Simulation-based training is superior to problem-based learning for the acquisition of critical assessment and management skills. Critical Care Medicine, 34, 151–157.

    Article  Google Scholar 

  • Suchman, L. A. (1985). Plans and situated action: The problem of human-machine communication. Cambridge: Cambridge University Press.

    Google Scholar 

  • Sutherland, L. M., Middleton, P. F., Anthony, A., Hamdorf, J., Cregan, P., Scott, D., et al. (2006). Surgical simulation: A systematic review. Annals of Surgery, 243, 291–300.

    Article  Google Scholar 

  • Sweller, J., van Merrienboer, J. J., & Paas, F. G. (1998). Cognitive architecture and instructional design. Educational Psychology Review, 10(3), 251–296.

    Article  Google Scholar 

  • Tang, T. S., Fantone, J. C., Bozynski, M. E. A., & Adams, B. S. (2002). Implementation and evaluation of an undergraduate sociocultural medicine program. Academic Medicine, 77, 578–585.

    Google Scholar 

  • Tervalon, M. (2003). Components of culture in health for medical students’ education. Academic Medicine, 78, 570–576.

    Article  Google Scholar 

  • van der Vleuten, C. P. M. (1996). The assessment of professional competence: Developments, research and practical implications. Advances in Health Science Education, 1, 41–67.

    Article  Google Scholar 

  • Veloski, J., Boex, J. R., Grasberger, M. J., Evans, A., & Wolfson, D. B. (2006). Systematic review of the literature on assessment, feedback and physicians’ clinical performance: BEME Guide No. 7. Medical Teacher, 28, 117–128.

    Article  Google Scholar 

  • Wallin, C., Meurling, L., Hedman, L., Hedegård, J., & Felländer-Tsai, L. (2007). Target-focused medical emergency team training using a human patient simulator: Effects on behaviour and attitude. Medical Education, 41, 173–180.

    Article  Google Scholar 

  • Wang, E. E., & Vozenilek, J. A. (2005). Addressing the systems-based practice core competency: A simulation-based curriculum. Academic Emergency Medicine, 12, 1191–1194.

    Article  Google Scholar 

  • Weinberger, S., & Whitcomb, M. (2003). The clinical education of medical students: Report on millennium conferences I & II. Retrieved April 12, 2007, from http://www.aamc.org/meded/clinicalskills/

Download references

Acknowledgements

The writing of this manuscript was supported in part by funds from the College of Medicine, University of Arizona, Phoenix, in Partnership with Arizona State University.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Vimla L. Patel.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Patel, V.L., Yoskowitz, N.A. & Arocha, J.F. Towards effective evaluation and reform in medical education: a cognitive and learning sciences perspective. Adv in Health Sci Educ 14, 791–812 (2009). https://doi.org/10.1007/s10459-007-9091-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10459-007-9091-1

Keywords

Navigation