Abstract
In the past 50 years, the original McMaster PBL model has been implemented, experimented, revised, and modified, and is still evolving. Yet, the development of PBL is not a series of success stories, but rather a journey of experiments, failures and lessons learned. In this paper, we analyzed the meta-analyses and systematic reviews on PBL from 1992 to present as they provide a focused lens on the PBL research in the past 5 decades. We identified three major waves in the PBL research development, analyzed their impact on PBL research and practice, and offered suggestions of research gaps and future directions for the field. The first wave of PBL research (polarization: 1990–mid 2000) focused on answering the question “Does PBL work?” and the outcomes. The results were conflicting. The researchers took polarizing positions and debated over the merits of PBL throughout this wave. However, the contradictory results and the debates in fact pushed the researchers to look harder for new directions to solve the puzzle. These efforts resulted in the second wave (from outcomes to process: mid 2000–mid 2010) that focused on the question “How does PBL work?” The second wave of PBL research targeted at investigating the effects of implementation constituents, such as assessment formats or single versus curriculum wide implementations. The third wave (specialization: mid 2010 and onward) of PBL research focused on “How does PBL work in different specific contexts?” These research widened our perspectives by expanding our understanding of how PBL manifests itself in different contexts. Given the diversification of PBL and more hybrid PBL models, we suggest “Why does PBL with particular implementation characteristics for specific outcomes work or not work in the condition where it is implemented?” to be the question to answer in the next wave of PBL research.
Similar content being viewed by others
References
The references with an asterisk are the meta-analyses or systematic reviews included in this review.
*Al-Azri, H., & Ratnapalan, S. (2014). Problem-based learning in continuing medical education: Review of randomized controlled trials. Canadian Family Physician,60, 157–165.
*Albanese, M. A., & Dast, L. (2014). Problem-based learning: Outcomes evidence from the health professions. Journal on Excellence in College Teaching,25(3&4), 239–252.
*Albanese, M. A., & Mitchell, S. (1993). Problem-based learning: A review of literature on its outcomes and implementation issues. Academic Medicine,68, 52–81.
*Azer, S. A., & Azer, D. (2015). Group interaction in problem-based learning tutorials: A systematic review. European Journal of Dental Education,19, 194–208. https://doi.org/10.1111/eje.12121.
Barrows, H. S. (1986). A taxonomy of problem-based learning methods. Medical Education, 20(6), 481–486.
Barrows, H. S. (1996). Problem-based learning in medicine and beyond: A brief overview. In L. Wilkerson & W. H. Gijselaers (Eds.), Bring problem-based learning to higher education: Theory and practice. New directions for teaching and learning (Vol. 68, pp. 3–12). San Francisco: Jossey-Bass.
Barrows, H. S., & Tamblyn, R. (1980). Problem-based learning: An approach to medical education. New York: Springer.
*Belland, B., French, B., & Ertmer, P. A. (2009). Validity and problem-based learning research: A review of instruments used to assess intended learning outcomes. The Interdisciplinary Journal of Problem-Based Learning,3(1), 59–89.
*Berkson, L. (1993). Problem-based learning: Have the expectations been met? Academic Medicine,68, S79–S88.
*Car, L. T., Kyaw, B. M., Dunleavy, G., Smart, N. A., Semwal, M., Rotgans, J. I., et al. (2019). Digital problem-based learning in health professions: Systematic review and meta-analysis by the digital health education collaboration. Journal of Medical Internet Research,21(2), e12945. https://doi.org/10.2196/12945.
Ciancolo, A. T., & Regehr, G. (2019). Learning theory and educational intervention: Producing meaningful evidence of impact through layered analysis. Academic Medicine,94, 789–794.
*Colliver, J. A. (2000). Effectiveness of problem-based learning curricula: Research and theory. Academic Medicine,75(3), 259–266.
Cook, D. A., Bordage, G., & Schmidt, H. G. (2008). Description, justification and clarification: A framework for classifying the purposes of research in medical education. Medical Education,42, 128–133.
Cook, D. J., Mulrow, C. D., & Haynes, R. B. (1997). Systematic reviews: Synthesis of best evidence for clinical decisions. Annals of Internal Medicine,126(5), 376–380. https://doi.org/10.7326/0003-4819-126-5-199703010-00006.
Czabanowska, K., Moust, J. H., Meijer, A., Schröder-Bäck, P., & Roebertsen, H. (2012). Problem-based learning revisited, introduction of active and self-directed learning to reduce fatigue among students. Journal of University Teaching & Learning Practice,9(1), 6.
*Demirel, M., & Dagyar, M. (2016). Effects of problem-based learning on attitude: A meta-analysis study. Eurasia Journal of Mathematics, Science & Technology Education,12(8), 2115–2137. https://doi.org/10.12973/eurasia.2016.1293a.
*Dochy, F., Segers, M., Van den Bossche, P., & Gijbels, D. (2003). Effects of problem-based learning: A meta-analysis. Learning and Instruction,13, 533–568.
*Dolmans, D. H. J. M., Loyens, S. M. M., Marcq, H., & Gijbels, D. (2016). Deep and surface learning in problem-based learning: A review of the literature. Advances in Health Science Education,21, 1087–1112. https://doi.org/10.1007/s10459-015-9645-6.
Engeström, Y. (1987). Learning by expanding: An activity theoretical approach to developmental research. Helsinki: Orienta-Konsultit.
*Eslami, E., Bassir, S. H., & Sadr-Eshkevari, P. (2014). Current state of the effectiveness of problem-based learning in prosthodontics: A systematic review. Journal of Dental Education,78(5), 723–734.
Fonteijn, H. T. H., & Dolmans, D. H. J. M. (2019). Group work and group dynamics in PBL. In M. Moallem, W. Hung, & N. Baddagh (Eds.), The Wiley handbook of problem-based learning (pp. 199–219). Hoboken, NJ: Wiley.
Francom, G. M. (2017). Principles for task-centered instruction. In C. M. Reigeluth, B. J. Beatty, & R. D. Myers (Eds.), Instructional design theories and models: The learner-centered paradigm of education (Vol. 4, pp. 65–91). New York: Routledge.
*Galvao, T. F., Silva, M. T., Neiva, C. S., Ribeiro, L. M., & Pereira, M. G. (2014). Problem-based learning in pharmaceutical education: A systematic review and meta-analysis. The Scientific World Journal. https://doi.org/10.1155/2014/578382.
*Gao, X., Luo, S., Mu, D., Xiong, Y., Guanjian, L., & Wan, C. (2016). Effects of problem-based learning in paediatric education in China: A meta-analysis. Journal of Evidence-Based Medicine,9, 136–143.
*Gavgani, V. Z., Hazrati, H., & Ghojazadeh, M. (2015). The efficacy of digital case scenario versus paper case scenario on clinical reasoning in problem-based learning: A systematic review and meta-analysis. Research and Development in Medical Education,4(1), 17–22.
*Gijbels, D., Dochy, F., van den Bossche, P., & Segers, M. (2005). Effects of problem-based learning: A meta-analysis from the angle of assessment. Review of Educational Research,75(1), 27–61.
Gordon, M., Daniel, M., & Patricio, M. (2018). What do we mean by ‘systematic’ in health education systematic reviews and why it matters! Medical Teacher. https://doi.org/10.1080/0142159x.2018.1504164.
Grant, M. J., & Booth, A. (2009). A typology of reviews: an analysis of 14 review types and associated methodologies. Health Information & Libraries Journal,26(2), 91–108.
*Hartling, L., Spooner, C., Tjosvold, L., & Oswald, A. (2010). Problem-based learning in pre-clinical medical education: 22 years of outcome research. Medical Teacher,32, 28–35.
Hmelo-Silver, C. E., Duncan, R. G., & Chinn, C. A. (2007). Scaffolding and achievement in problem-based and inquiry learning: A response to Kirschner, Sweller, and Clark (2006). Educational Psychologist,42(2), 99–107.
*Huang, B., Zheng, L., Li, C., Li, L., & Yu, H. (2013). Effectiveness of problem-based learning in Chinese dental education: A meta-analysis. Journal of Dental Education,77(3), 377–383.
Hung, W., & Loyens, S. M. M. (2012). Global development of problem-based learning: Adoption, adaptation, and advancement. Interdisciplinary Journal of Problem-Based Learning,6(1), 4–9.
*Jerzembek, G., & Murphy, S. (2013). A narrative review of problem-based learning with school-aged children: Implementation and outcomes. Educational Review,65(2), 206–218.
*Jia, X., Zeng, W., & Zeng, Q. (2018). Combined administration of problem- and lecture-based learning teaching models in medical education in China: A meta-analysis of randomized controlled trials. Medicine,97, 43.
Jonassen, D. H. (2000). Toward a design theory of problem solving. ETR&D,48(4), 63–85.
*Kalaian, H. A., Mullan, P. B., & Kasim, R. M. (1999). What can studies of problem-based learning tell us? Synthesizing and modeling PBL effects on National Board of Medical Examination performance: Hierarchical linear modeling meta-analytic approach. Advances in Health Sciences Education,4, 209–221.
Kelley, H. H. (1973). The process of causal attribution. American Psychologist,28, 107–128.
*Kim, N. J., Belland, B. R., & Walker, A. E. (2018). Effectiveness of computer-based scaffolding in the context of problem-based learning for Stem education: Bayesian meta-analysis. Educational Psychology Review,30, 397–429.
Kirschner, P. A., Sweller, J., & Clark, R. (2006). Why minimal guidance during instruction does not work: An analysis of the failure of constructivist, discovery, problem-based, experiential, and inquiry-based teaching. Educational Psychologist,41(2), 75–86.
*Koh, G. C.-H., Khoo, H. E., Wong, M. L., & Koh, D. (2008). The effects of problem-based learning during medical school on physician competency: A systematic review. Canadian Medical Association Journal,178(1), 34–41.
*Kong, L.-N., Qin, B., Zhou, Y.-Q., Mou, S.-Y., & Gao, H.-M. (2014). The effectiveness of problem-based learning on development of nursing students’ critical thinking: A systematic review and meta-analysis. International Journal of Nursing Studies,51, 458–469.
*Leary, H., Walker, A., Shelton, B. E., & Fitt, M. H. (2013). Exploring the relationships between tutor background, tutor training, and student learning: A problem-based learning meta-analysis. The Interdisciplinary Journal of Problem-Based Learning,7(1), 44–66.
*Liu, L., Du, X., Zhang, Z., & Zhou, J. (2019). Effect of problem-based learning in pharmacology education: A meta-analysis. Studies in Educational Evaluation,60, 43–58.
Loyens, S., & Rikers, R. (2011). Instruction based on inquiry. In R. Mayer & P. Alexander (Eds.), Handbook of research on learning and instruction (pp. 361–381). New York, NY: Routledge.
*Ma, Y., & Lu, X. (2019). The effectiveness of problem-based learning in pediatric medical education in China: A meta-analysis of randomized controlled trials. Medicine,98, 2.
*Neville, A. J. (2009). Problem-based learning and medical education forth years on. Medical Principles and Practice,18, 1–9.
*Newman, M. (2003). A pilot systematic review and meta-analysis on the effectiveness of problem-based learning. Special report 2. London: Middlesex University. Retrieved 14 May 2019, from https://eric.ed.gov/?id=ED476146.
*Norman, G. R., & Schmidt, H. G. (1992). The psychological basis of problem-based learning: A review of the evidence. Academic Medicine,67, 557–565.
Pawson, R., Greenhalgh, T., Harvey, G., & Walshe, K. (2005). Realist review: A new method of systematic review designed for complex policy interventions. Journal of Health Services Research & Policy,10(Suppl 1), 21–34.
*Polyzois, I., Claffey, N., & Mattheos, N. (2010). Problem-based learning in academic health education: A systematic literature review. European Journal of Dental Education,14, 55–64.
*Qin, Y., Wang, Y., & Floden, R. E. (2016). The effect of problem-based learning on improvement of the medical educational environment: A systematic review and meta-analysis. Medical Principles and Practice,25, 525–532. https://doi.org/10.1159/000449036.
*Sayyah, M., Shirbandi, K., Saki-Malehi, A., & Rahim, F. (2017). Use of a problem-based learning teaching model for undergraduate medical and nursing education: A systematic review and meta-analysis. Advances in Medical Education and Practice,8, 691–700.
Servant-Miklos, V. F. C., Norman, G. R., & Schmidt, H. G. (2019). A short intellectual history of problem-based learning. In M. Moallem, W. Hung, & N. Dabbagh (Eds.), The Wiley handbook of Problem-based Learning (pp. 3–24). Hoboken, NJ: Wiley-Blackwell.
Schmidt, H. G. (1983). Problem-based learning: Rationale and description. Medical Education,17, 11–16.
Schmidt, H. G., Loyen, S. M. M., van Gog, T., & Paas, F. (2007). Problem-based learning is compatible with human cognitive architecture: Commentary on Kirschner, Sweller, and Clark (2006). Educational Psychologist,42(2), 91–97.
*Schmidt, H. G., van der Molen, H. T., te Winkel, W. W. R., & Wijnen, W. H. F. W. (2009). Constructivist, problem-based learning does work: A meta-analysis of curriculum comparisons involving a single medical school. Educational Psychologist,44(4), 227–249.
*Shin, I.-S., & Kim, J.-H. (2013). The effect of problem-based learning in nursing education: A meta-analysis. Advances in Health Science Education,18, 1103–1120. https://doi.org/10.1007/s10459-012-9436-2.
*Strobel, J., & van Barneveld, A. (2009). When is PBL more effective? A meta-synthesis of meta-analyses comparing PBL to conventional classrooms. Interdisciplinary Journal of Problem-Based Learning,3(1), 44–58.
Tawfik, A. A., Hung, W., & Giabbanelli, P. J. Comparing how different inquiry-based approaches impact learning outcomes. Interdisciplinary Journal of Problem-Based Learning(in press).
Thagard, P. (2000). Explaining disease: Correlations, causes, and mechanisms. In F. C. Keil & R. A. Wilson (Eds.), Explanation and cognition (pp. 254–276). Cambridge, MA: MIT Press.
*Tsai, C.-W., & Chiang, Y.-C. (2013). Research trends in problem-based learning (PBL) research in e-learning and online education environments: A review of publications in SSCI-indexed journals from 2004 to 2012. British Journal of Educational Technology,44(6), E185–E190. https://doi.org/10.1111/bjet.12038.
*Tsigarides, J., Wingfield, L. R., & Kulendran, M. (2017). Does a PBL-based medical curriculum predispose training in specific career paths: A systematic review of the literature. BMC Research Notes,10, 24. https://doi.org/10.1186/s13104-016-2348-0.
van Merriënboer, J. J. G. (2013). Perspectives on problem solving and instruction. Computers & Education,64, 153–160.
van Merrienboer, J. J. G., & Kirschner, P. A. (2018). Ten steps to complex learning: A systematic approach to four-component instructional design (3rd ed.). New York: Routledge.
Vardi, I., & Ciccarelli, M. (2008). Overcoming problems in problem-based learning: A trial of strategies in an undergraduate unit. Innovations in Education and Teaching International,45(4), 345–354.
*Vernon, D. T. A., & Blake, R. L. (1993). Does problem-based learning work: A meta-analysis of evaluative research. Academic Medicine,68, 550–563.
*Walker, A., & Leary, H. (2009). A problem based learning meta analysis: Differences across problem types, implementation types, disciplines, and assessment levels. Interdisciplinary Journal of Problem-Based Learning, 3(1). Retrieved 14 May 2019, from http://docs.lib.purdue.edu/ijpbl/vol3/iss1/3.
Wijnia, L., Loyens, S. M. M., & Rikers, R. M. J. P. (2019). The problem-based learning process: An overview of different models. In M. Moallem, W. Hung, & N. Baddagh (Eds.), The Wiley handbook of problem-based learning (pp. 273–294). Hoboken, NJ: Wiley.
*Wilder, S. (2015). Impact of problem-based learning on academic achievement in high school: A systematic review. Educational Review,67(4), 414–435. https://doi.org/10.1080/00131911.2014.974511.
*Wolf, F. M. (1993). Problem-based learning and meta-analysis: Can we see the forest through the trees? Academic Medicine,68(7), 542–544.
*Wosinski, J., Belcher, A. E., Durrenberger, Y., Allin, A.-C., Stormacq, C., & Gerson, L. (2018). Facilitating problem-based learning among undergraduate nursing students: A qualitative systematic review. Nurse Education Today,60, 67–74.
*Zhang, S., Xu, J., Wang, H., Zhang, D., Zhang, Q., & Zou, L. (2018). Effects of problem-based learning in Chinese radiology education: A systeamtic review and meta-analysis. Medicine,97, 9.
*Zhang, Y., Zhou, L., Liu, X., Liu, L., Wu, Y., Zhao, Z., et al. (2015). The effectiveness of the problem-based learning teaching model for use in introductory Chinese undergraduate medical courses: A systematic review and meta-Analysis. PLoS ONE,10(3), e0120884. https://doi.org/10.1371/journal.pone.0120884.
*Zhou, J., Zhou, S., Huang, C., Xu, R., Zhang, Z., Zeng, S., et al. (2016). Effectiveness of problem-based learning in China pharmacy education: A meta-analysis. BMC Medical Education,16, 23. https://doi.org/10.1186/s12909-016-0546-z.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Hung, W., Dolmans, D.H.J.M. & van Merriënboer, J.J.G. A review to identify key perspectives in PBL meta-analyses and reviews: trends, gaps and future research directions. Adv in Health Sci Educ 24, 943–957 (2019). https://doi.org/10.1007/s10459-019-09945-x
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10459-019-09945-x