Advances in Health Sciences Education

, Volume 11, Issue 3, pp 245–266

Modeling the Problem-based Learning Preferences of McMaster University Undergraduate Medical Students Using a Discrete Choice Conjoint Experiment

  • Charles E. Cunningham
  • Ken Deal
  • Alan Neville
  • Heather Rimas
  • Lynne Lohfeld


Objectives: To use methods from the field of marketing research to involve students in the redesign of McMaster University’s small group, problem-based undergraduate medical education program. Methods: We used themes from a focus group conducted in an electronic decision support lab to compose 14 four-level educational attributes. Undergraduate medical students completed a discrete choice experiment composed of 15 web-administered, partial-profile, conjoint-choice tasks. Results: Latent class analysis revealed two segments with different preferences. Segment 1, (86% of students), preferred a problem-based approach with more small group tutorial sessions led by expert tutors who facilitated the tutorial process without teaching didactically. Segment 2, (14% of students), preferred more large group lectures, explicit learning objectives, expert tutors who taught didactically, and streaming options based on learning preferences. Although Segment 1 preferred smaller tutorial groups, simulations predicted these students would trade increases in tutorial group size for a conceptually integrated program that included tutorial problems based on core curriculum concepts, greater integration of the content of clinical skills training sessions and the tutorial curriculum, and a link between clerkship patient selection and the program’s curriculum. A majority of both segments would accept a more conceptually integrated program if the savings associated with increases in tutorial group size was reinvested in web-enhanced tutorial processes and computer-simulated health care problems. Conclusions: Most students preferred a small group, web-supported, problem-based learning approach led by content experts who facilitated group process. Students favored a program in which tutorial group problems, clinical skills training sessions and the patients selected for clerkship activities were more closely linked to core curriculum concepts.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. Allenby, G.M., Arora, N., Ginter, J.L. 1995Incorporating prior knowledge in the analysis of conjoint studiesJournal of Marketing Research32152162CrossRefGoogle Scholar
  2. Arora, N., Allenby, G., Ginter, J.L. 1998A hierarchical Bayes mode of primary and secondary demandMarketing Science172944Google Scholar
  3. Arulampalam, W., Naylor, R., Smith, J. 2004Factors affecting the probability of first year medical students dropout in the UK: A logistic analysis for the intake cohorts of 1980–92Medical Education38492503CrossRefGoogle Scholar
  4. Barbour, R.S. 1999The case for combining qualitative and quantitative approaches in health services researchJournal of Health Services & Research Policy43943Google Scholar
  5. Bearman, M., Cesnik, B., Liddell, M. 2001Random comparison of ‘virtual patient’ models in the context of teaching clinical communication skillsMedical Education35824832CrossRefGoogle Scholar
  6. Colliver, J.A. 2000Effectiveness of problem-based learning curricula: Research and theoryAcademic Medicine75259266CrossRefGoogle Scholar
  7. Das, M., Mpofu, D.J.S., Hasan, M.Y., Stewart, T.S. 2002Student perceptions of tutor skills in problem-based learning tutorialsMedical Education36272278CrossRefGoogle Scholar
  8. DeGrave, W.S., Dolmans, D.H.J.M., Vleuten, C.P.M. 1999Profiles of effective tutors in problem-based learning: Scaffolding student learningMedical Education33901906CrossRefGoogle Scholar
  9. DeSarbo, W.S., Ramaswamy, V., Cohen, S.H. 1995Market segmentation with choice based conjoint analysisMarketing Letters637148CrossRefGoogle Scholar
  10. Dev, P., Montgomery, K., Senger, S., Heinrichs, W.L., Srivastava, S., Waldron, K. 2002Simulated medical learning environments on the internetJournal of the American Medical Informatics Association9437447CrossRefGoogle Scholar
  11. Dhalla, I.A., Kwong, J.C., Streiner, D.L., Baddour, R.E., Waddell, A.E., Johnson, I.L. 2002Characteristics of first-year students in Canadian medical schoolsCanadian Medical Association Journal16610291035Google Scholar
  12. Dolmans, D.H.J.M., Gijselaers, W.H., Moust, J.H.C., Grave, W.S., Wolfhagen, I.H.A.P., Vleuten, C.P.M. 2002Trends in research on the tutor in problem-based learning: Conclusions and implications for educational practice and researchMedical Teacher24173180CrossRefGoogle Scholar
  13. Dolmans, D.H.J.M., Wolfhagen, I.H.A.P., Scherpbier, A.J.J.A., Vleuten, C.P.M. 2001Relationship of tutors’ group-dynamics skills to their performance ratings in problem-based learningAcademic Medicine76473476CrossRefGoogle Scholar
  14. Eva, K., Reiter, H.J., Rosenfeld, J., Norman, G. 2004The relationship between interviewers’ characteristics and ratings assigned during a multiple mini-interviewAcademic Medicine79602609CrossRefGoogle Scholar
  15. Farrow, R., Norman, G.R. 2003The effectiveness of PBL: The debate continues. Is meta-analysis helpful?Medical Education3711611132CrossRefGoogle Scholar
  16. Hendry, G.D., Ryan, G., Harris, J. 2003Group problems in problem-based learningMedical Teaching25609616CrossRefGoogle Scholar
  17. Holmes, D.B., Kaufman, D.M. 1994Tutoring in problem-based learning: A teacher development processMedical Education28275283Google Scholar
  18. Houldon, R.L., Collier, C.P., Frid, P.J., John, S.L. & Pross, H. (2001). Problems identified by tutors in a hybrid problem-based learning curriculum. Academic Medicine 76: 81Google Scholar
  19. Hubal, R.C., Kizakevich, P.N., Guinn, C.I., Merino, K.D., West, S.L. 2000The virtual standardized patient. Simulated patient-practitioner dialog for patient interview trainingStudies in Health Information Technology70133138Google Scholar
  20. Huber, J. & Miller, R. (1999). Dealing with product similarity in conjoint simulations. Sawtooth Software Research Paper Series. Retrieved November 1, 2004, from
  21. Hudson, J.N. 2004Computer-aided learning in the real world of medical education: Does the quality of interaction with the computer affect student learning?Medical Education38887895CrossRefGoogle Scholar
  22. Khoo, H.E. 2003Implementation of problem-based learning in Asian medical schools and student’s perceptions of their experienceMedical Education37401409CrossRefGoogle Scholar
  23. Kulatunga-Moruzi, C., Norman, G.R. 2002Validity of admissions measures in predicting performance outcomes: The contribution of cognitive and non-cognitive dimensionsTeaching and Learning Medicine143442CrossRefGoogle Scholar
  24. Lenk, P.K., DeSarbo, W.S., Green, P.E., Young, M.R. 1996Hierarchical Bayes conjoint analysis: recovery of partworth heterogeneity in reduced experimental designsMarketing Science15173191Google Scholar
  25. Lohfeld, L., Neville, A., Norman, G. 2005PBL in undergraduate medical education: A qualitative study of the views of Canadian residentsAdvances in Health Sciences Education10189214CrossRefGoogle Scholar
  26. Maudsley, G. 1999Roles and responsibilities of the problem based learning tutor in the undergraduate medical curriculumBritish Medical Journal318657661Google Scholar
  27. Moffat, K.J., McConnachie, A., Ross, S., Morrison, J.M. 2004First year medical student stress and coping in a problem-based learning medical curriculumMedical Education38482491CrossRefGoogle Scholar
  28. Morgan, A., Shackley, P., Pickin, M., Brazier, J. 2000Quantifying patient preferences for out-of-ours primary careJournal of Health Services Service, Research and Policy5214218Google Scholar
  29. Neufeld, V.R., Woodward, C.A., MacLeod, S.M. 1989The McMaster MD program: A case study of renewal in medical educationAcademic Medicine64423432CrossRefGoogle Scholar
  30. Neville, A.J. 1999The problem-based learning tutor: Teacher? Facilitator? Evaluator?Medical Teacher21393401CrossRefGoogle Scholar
  31. Newman, M. & The Pilot Review Group (2003). A Pilot Systematic Review and Meta-analysis on the Effectiveness of Problem-based Learning. Newcastle: Learning and Teaching Subject Network for Medicine, Dentistry, and Veterinary Medicine. Scholar
  32. Norman, G.R., Schmidt, H.G. 1992The psychological basis of problem-based learning: A review of the evidenceAcademic Medicine76215216Google Scholar
  33. Norman, G.R., Schmidt, H.G. 2000Effectiveness of problem-based learning curricula: Theory, practice and paper dartsMedical Education34721728CrossRefGoogle Scholar
  34. Orme, B.K. 2006Getting Started with Conjoint Analysis: Strategies for Product Design and Pricing ResearchResearch PublishersMadisonGoogle Scholar
  35. Osman, L.M., Mckenzie, L., Cairns, J., Friend, J.A., Godden, D.J., Legge, J.S. & Douglas, J.G. (2001). Patient weighting of importance of asthma symptoms. Thorax 56: 138–142Google Scholar
  36. Patterson, M. 2003Partial Profile Discrete Choice: What’s the Optimal Number of Attributes. Sawtooth Software Conference ProceedingsSawtooth SoftwareSequimGoogle Scholar
  37. Payne, J.W., Bettman, J.R., Johnson, E.J. 1993The Use of Multiple Strategies in Judgment and ChoiceLawrence Erlbaum AssociatesHillsdale, NJ, EnglandGoogle Scholar
  38. Phillips, K.A., Johnson, R., Maddala, T. 2002Measuring what people value: A comparison of “attitude” and “preference” surveysJournal of Health Services Research3716591679CrossRefGoogle Scholar
  39. Reznich, C.B. & Werner, B. (2004). Facilitators’ influence on student PBL small group session on line information resource use: A survey. Downloaded from BMC Medical Education Google Scholar
  40. Riesenberg, L.A., Biddle, B.W., Erney, S.L. 2001Medical student and faculty perceptions of desirable primary care teaching site characteristicsMedical Education35660665CrossRefGoogle Scholar
  41. Ryan, G., Dolling, T., Barnet, S. 2004Supporting the problem-based learning process in the clinical years: evaluation of an online Clinical Reasoning GuideMedical Education38638645CrossRefGoogle Scholar
  42. Ryan, M., Gerard, K. 2003Using discrete choice experiments to value health care: Current practice and future prospectsApplied Health Economics and Policy Analysis25564Google Scholar
  43. Ryan, M., Scott, D.A., Reeves, C., Bate, A., Teijlingen, E.R., Russell, E.M., Napper, M., Robb, C.M. 2001Eliciting public preferences for healthcare: A systematic review of techniquesHealth Technology Assessment51186Google Scholar
  44. Salkeld, G., Ryan, M., Short, L. 2000The veil of experience: Do consumers prefer what they know best?Health Economics9267270CrossRefGoogle Scholar
  45. Sawtooth Software Inc (2004a). The CBC Latent Class Technical Paper (version 3). Retrieved November 1, 2004, from Scholar
  46. Sawtooth Software Inc (2004b). The CBC/HB System for Hierarchical Bayes estimation (version 3.2). Sawtooth Software Technical Paper Series. Retrieved November 1, 2004, from Scholar
  47. Schmidt, H.G. 1993Foundations of problem-based learning: some explanatory notesMedical Education27422432CrossRefGoogle Scholar
  48. Schmidt, H.G. 1994Resolving inconsistencies in tutor expertise research: does lack of structure cause students to seek tutor guidance?Academic Medicine69652662CrossRefGoogle Scholar
  49. Stanek, E.J., Oates, M.B., McGhan, W.F., Denofrio, D., Loh, E. 2000Preferences for treatment outcomes in patients with heart failure: Symptoms versus survivalJournal of Cardiac Failure6225232CrossRefGoogle Scholar
  50. Stark, P. 2003Teaching and learning in the clinical setting: A qualitative study of the perceptions of students and teachersMedical Education37975982CrossRefGoogle Scholar
  51. Streiner, D.L., Norman, G. 2003Health Measurement Scales: A Practical Guide to their Development and UseOxford Medical PublicationsNew YorkGoogle Scholar
  52. Stromso, H., Grottum, P., Lycke, K.H. 2004Changes in student approaches to learning with the introduction of computer-supported problem-based learningMedical Education38390400CrossRefGoogle Scholar
  53. Svoboda, T., Henry, B., Shulman, L., Kennedy, E., Rea, E., Ng, W., Wallington, T., Yaffe, B., Gournis, E., Vicencil, E., Asrur, S., Glazier, R.H. 2004Public health measures to control the spread of the severe acute respiratory syndrome during the outbreak in TorontoThe New England Journal of Medicine35023522361CrossRefGoogle Scholar
  54. Tabachnik, B.G., Fidell, L.S. 2001Using Multivariate StatisticsFourthHarper Collins College PublishersNew YorkGoogle Scholar
  55. Willis, S.C., Jones, A., Bundy, C., Burdett, K., Whitehouse, C.R., O’Neill, P.A. 2002Small-group work and assessment in a PBL curriculum: A qualitative and quantitative evaluation of student perceptions of the process of working in small groups and its assessmentMedical Teacher24495501CrossRefGoogle Scholar
  56. Woodward, C.A., Ferrier, B.M. 1982Perspectives of graduates two or five years after graduation from a three-year medical schoolJournal of Medical Education57294302Google Scholar

Copyright information

© Springer 2006

Authors and Affiliations

  • Charles E. Cunningham
    • 1
  • Ken Deal
    • 2
  • Alan Neville
    • 3
  • Heather Rimas
    • 4
  • Lynne Lohfeld
    • 5
  1. 1.Department of Psychiatry and Behavioural NeurosciencesMcMaster UniversityHamiltonCanada
  2. 2.DeGroote School of BusinessMcMaster UniversityHamiltonCanada
  3. 3.Department of MedicineMcMaster UniversityHamiltonCanada
  4. 4.Patient-Centered Service Research UnitMcMaster UniversityHamiltonCanada
  5. 5.Department of Clinical Epidemiology and Biostatistics, and Program for Educational Research and DevelopmentMcMaster UniversityHamiltonCanada

Personalised recommendations