Abstract
To determine the direction and extent to which medical student scores (as observed by small-group tutors) on four problem-based-learning-related domains change over nine consecutive blocks during a two-year period (Domains: Problem Solving/Use of Information/Group Process/Professionalism). Latent growth curve modeling is used to analyze performance trajectories in each domain of two cohorts of 1st and 2nd year students (n = 296). Slopes of the growth trajectories show similar linear increments in the first three domains. Further analysis revealed relative strong individual variability in initial scores but not in their later increments. Professionalism, on the other hand, shows low variability and has very small, insignificant slope increments. In this study, we showed that the learning domains (Problem Solving, Use of Information, and Group Process) observed during PBL tutorials are not only related to each other but also develop cumulatively over time. Professionalism, in contrast to the other domains studied, is less affected by the curriculum suggesting that this represents a stable characteristic. The observation that the PBL tutorial has an equal benefit to all students is noteworthy and needs further investigation.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Albanese, M. A., & Mitchell, S. (1993). Problem-based learning: A review of literature on its outcomes and implementation issues. Academic Medicine, 68(1), 52–81.
Barrows, H. S., & Tamblyn, R. M. (1980). Problem-based learning: An approach to medical education. New York: Springer.
Bentler, P. M. (2003). EQS (Version 6.1 Beta) [computer software]. Encino, CA: Multivariate Software, Inc.
Byrne, B. M. (2006). Structural equation modeling with EQS: Basic concepts, applications, and programming (2nd ed.). MahWah, NJ: Lawrence Erlbaum Associates.
Colliver, J. A. (2000). Effectiveness of problem-based learning curricula: Research and theory. Academic Medicine, 75(3).
Dochy, F., Segers, M., Van den Bossche, P., & Gijbels, D. (2003). Effects of problembased learning: A meta-analysis. Learning and Instruction, 13, 533–568.
Dolmans, D. H. J. M., De Grave, W., Wolfhagen, I. H. A. P., & Van Der Vleuten, C. P. M. (2005). Problem-based learning: Future challenges for educational practice and research. Medical Education, 39(7), 732–741.
Duncan, T. E., & Duncan, S. C. (2009). The ABC’s of LGM: An introductory guide to latent variable growth curve modeling. Social and Personality Psychology Compass, 3(6), 979–991.
Gijbels, D., Dochy, F., Van den Bossche, P., & Segers, M. (2005). Effects of problembased learning: A meta-analysis from the angle of assessment. Review of Educational Research, 75(1), 27–61.
Grave, W. S., Boshuizen, H. P. A., & Schmidt, H. G. (1996). Problem based learning: Cognitive and metacognitive processes during problem analysis. Instructional Science, 24(5), 321–341.
Hak, T., & Maguire, P. (2000). Group process: The black box of studies on problem-based learning. Academic Medicine, 75(7), 769–772.
Hu, L. T., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6(1), 1–31.
Kilroy, D. A. (2004). Problem based learning. Emergency Medicine Journal, 21(4), 411–413.
Kline, R. B. (2004). Principles and practice of structural equation modeling (2nd ed.). New York, NY: The Guilford Press.
Lee, M., & Wimmers, P. F. (2014, April 3–7). How reliable and valid is the assessment of problem-based learning performance? In Paper presented at the annual meeting of the American Educational Research Association (AERA), Philadelphia, PA.
Meredith, W., & Tisak, J. (1990). Latent curve analysis. Psychometrika, 55, 107–122.
Nendaz, M. R., & Tekian, A. (1999). Assessment in problem-based learning medical schools: A literature review. Teaching and Learning in Medicine, 11(4), 232–243.
Newman, M. J. (2005). Problem Based Learning: An Introduction and Overview of the Key Features of the Approach. JVME, 32(1), 12–20.
Norman, G. R., & Schmidt, H. G. (1992). The psychological basis of problem-based learning: A review of the evidence. Academic Medicine, 67(9), 557–565.
Nouns, Z., Schauber, S., Witt, C., Kingreen, H., & Schüttpelz-Brauns, K. (2012). Development of knowledge in basic sciences: A comparison of two medical curricula. Medical Education, 46(12), 1206–1214.
Schmidt, H. G. (1993). Problem-based learning: Rationale and description. Medical Education, 17, 11–16.
Schmidt, H. G., de Volder, M. L., de Grave, W. S., Moust, J. H. C., & Patel, V. L. (1989). Explanatory models in the processing of science text: The role of prior knowledge activation through small-group discussion. Journal of Educational Psychology, 81(4), 610–619.
Schmidt, H. G., & Moust, J. H. (1995). What makes a tutor effective? A structural-equations modeling approach to learning in problem-based curricula. Academic Medicine, 70(8), 708–714.
Schmidt, H. G., Rotgans, J. I., & Yew, E. H. J. (2011). The process of problem-based learning: What works and why. Medical Education, 45(8), 792–806.
Segers, M., & Dochy, F. (2001). New Assessment Forms in Problem-based Learning: The value-added of the students’ perspective. Studies in Higher Education, 26(3), 327–343.
Smith, R. M. (1993). The triple-jump examination as an assessment tool in the problem-based medical curriculum at the University of Hawaii. Academic Medicine, 68(5), 366–372.
Stoel, R. D., van den Wittenboer, G., & Hox, J. (2004). Methodological issues in the application of the latent growth curve model. In K. van Montfort, et al. (Eds.), Recent developments on structutral equation models (pp. 241–261). Dordrecht: Kluwer.
Strobel, J., & van Barneveld, A. (2009). When is PBL more effective? A meta-synthesis of Meta-analyses comparing PBL to conventional classrooms. Interdisciplinary Journal of Problem-Based Learning, 3(1).
Verhoeven, B. H., Verwijnen, G. M., Scherpbier, A. J. J. A., & Van Der Vleuten, C. P. M. (2002). Growth of medical knowledge. Medical Education, 36(8), 711–717.
Vernon, D. T., & Blake, R. L. (1993). Does problem-based learning work? A meta-analysis of evaluative research. Academic Medicine, 68(7), 550–563.
Vleuten, C. P. M. V. D., Verwijnen, G. M., & Wijnen, W. H. F. W. (1996). Fifteen years of experience with progress testing in a problem-based learning curriculum. Medical Teacher, 18(2), 103–109.
Walker, A., & Leary, H. (2009). A Problem Based Learning Meta Analysis: Differences Across Problem Types, Implementation Types, Disciplines, and Assessment Levels.. Interdisciplinary Journal of Problem-based Learning, 3(1).
Walton, H. J., & Matthews, M. B. (1989). Essentials of problem-based learning. Medical Education, 23(6), 542–558.
Webb, N. M. (1980). A process-outcome analysis of learning in group and individual settings. Educational Psychologist, 15(2), 69–83.
Webb, N. M. (1982). Student interaction and learning in small groups. Review of Educational Research, 52(3), 421–445.
Webb, N. M. (1983). Predicting learning from student interaction: Defining the interaction variables. Educational Psychologist, 18(1), 33–41.
Willett, J. B., & Sayer, A. G. (1994). Using covariance structure analysis to detect correlates and predictors of individual change over time. Psychological Bulletin, 116(2), 363–381.
Wood, D. F. (2003). ABC of learning and teaching in medicine problem based learning. BMJ, 326(7384), 328–330.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Wimmers, P.F., Lee, M. Identifying longitudinal growth trajectories of learning domains in problem-based learning: a latent growth curve modeling approach using SEM. Adv in Health Sci Educ 20, 467–478 (2015). https://doi.org/10.1007/s10459-014-9541-5
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10459-014-9541-5