Avoid common mistakes on your manuscript.
Research and scholarship in medical education have had a poor press, perhaps deservedly so. Our work had been criticized as too often atheoretical, [1] methodologically weak, [1–4] irrelevant [4] and inaccessible to educators at the coal face [2]. It is too often underfunded, [1, 2, 5, 6] and we have been described as institutionally and professionally insular [1, 4]. In many ways our response to these charges has been admirable. We have had clearly articulated calls to enhance the quality of our outputs from leaders in the field, [7] trenchant debate [3, 8–10] and measured contributions as to exactly what ‘quality’ in research into medical education might be [11, 12].
And what advice do we, the older or more experienced members of the medical education community, now give those who seek to replace us? Or perhaps, we should ask what do they hear? I believe, to paraphrase the adage from the 1850s ‘Go west young man, go west and grow up with the country’, that what they hear is ‘Go qualitative new colleague, go qualitative!’ Like the advice given in ninteenth century North America, this has much to commend it: we have wide prairies to explore and understand and populate with ideas and room in which to make a reputation. And this is happening. A search of MEDLINE shows that, since 2000, the number of papers with ‘qualitative’ but not ‘quantitative’ in their title and abstract in Medical Education, Medical Teacher, BMC Medical Education and Academic Medicine outnumbered whose with the obverse (‘quantitative’ and not ‘qualitative’ in the title and abstract) by 6.5–1. The research of many of our superstars is strongly (albeit not exclusively) qualitative. Of the last five winners of the ASME young researcher awards, four have been qualitative or strongly qualitative in nature, the other was action research with a strong qualitative component.
I worry, however, that the pendulum has swung too far and others may share aspects of my concerns [13]. Yes, we are building theory but the value of a good theory is that it enables predictions which can be tested. Some of that testing requires measurement. We need research which seeks to quantify whether a theory-based intervention has the effects which were predicted and whether that difference is worth the candle. We need to know whether our theory building actually makes differences which matter to educators on the ground, to our learners who have entrusted us with their future, and to their patients in the future. As Yogi Berra may have said, ‘In theory there is no difference between theory and practice. In practice there is.’
The current predominance of qualitative research in medical education contrasts with the discourse in medical research though the 1990s. Then, those who championed qualitative research were working to establish the credibility of their chosen paradigm and to shift the perception that their work was unscientific and lacking in rigour [14, 15]. They were riding a wave: influential guidelines were soon published [16, 17] and since updated [18]. Now mixed methods research combining qualitative and quantitative approaches is commonplace in health technology assessment and health services research and few research programmes can expect funding unless they bring the gaze of both to the problem being examined.
Quantitative research in medical education is important and will continue to be important. The descriptive work of Papadakis [19] and Tamblyn [20−22] has been hugely influential. These enormously painstaking pieces of ground breaking work hint at the potential that lies within the enormous datasets being assembled by our governments, administrators and regulators. These datasets are ripe for the application of ‘big data’ research techniques. Such approaches are being used to inform clinical care and we need to learn to use them to answer questions in education and training. For example, national licensing examination scores are associated with indices of care provided by doctors [22]. Can we identify doctors at increased risk of error and intervene to reduce harm to patients? This will be difficult: we will need to develop new skills to link datasets and validate data, to master new study designs and to understand how our results may be confounded and whether we can account for it.
We also need to find out whether aspects of our curricula make a difference. This will need multi-institutional research which will require building trust, identifying worthwhile questions which we can answer and finding outcome measures which, although imperfect, will provide useful information. For example does the Conscientiousness Index [23] have cross-institutional validity and predict graduates at higher risk of suboptimal practice? Is the answer important? Should an affirmative answer change educational practice? I would argue ‘Yes it is’ and ‘It must’. Are we developing the people who can answer questions such as these? I fear we are not.
If we have the courage to explore these tough questions, we may find answers that are unexpected or even distressing. But these answers are the gold dust of science; to understand them fully, we will need mixed methods research that blends the strengths of both traditions.
Goldszmidt et al., [24] in their reply to the letter from Van Merrienboer, [13] argue that the dichotomy between objectivity and subjectivity is false. I agree that these words are often not useful, but my argument is subtly different: research which seeks to explain and understand should not be separated from that which enumerates and describes. They are complementary and will provide better answers when used together.
Has the pendulum swung too far? Perhaps it has; at the very least, it is time to rethink the balance between quantitative and qualitative inquiry. One is not the dark and the other the light side but rather the yin and the yang: one without the other is insufficient. We need to learn from the health services research and health technology assessment communities and invest in the skills required for both.
References
Albert M, Hodges B, Regehr G. Research in medical education: balancing service and science. Adv Heal Sci Educ. 2007;12(1):103–15. doi:10.1007/s10459-006-9026-2.
Petersen S. Time for evidence based medical education. BMJ. 1999;318(7193):1223–4.
Todres M, Stephenson A, Jones R. Medical education research remains the poor relation. BMJ 2007;335(8):333–5.
Schuwirth LWT, van der Vleuten CPM. Challenges for educationalists. BMJ. 2006;333(7567):544–6. doi:10.1136/bmj.38952.701875.94.
Reed DA, Kern DE, Levine RB, Wright SM. Costs and funding for published medical education research. JAMA. 2005;294(9):1052–7. doi:10.1001/jama.294.9.1052.
Davis MH, Ponnamperuma GG. Medical education research at the crossroads. Lancet. 2006;367(9508):377–8. doi:10.1016/S0140-6736(06)68116-6.
Wood D, Bligh J. Medical education comes of age. Med Educ. 2000;34:82–3.
Stephenson A, Todres M, Jones R. Reply to Dornan et al.’s ‘On evidence’. Med Educ. 2009;43(4):390–1. doi:10.1111/j.1365-2923.2009.03306.x.
Dornan T, Peile E, Spencer J. In defence of the existing strengths of medical education research. Med Educ. 2009;43(4):391. doi:10.1111/j.1365-2923.2009.03305.x.
Dornan T, Peile E, Spencer J. On ‘evidence’. Med Educ. 2008;42(3):232–4. doi:10.1111/j.1365-2923.2007.02997.x.
Norman G. Editorial – how bad is medical education research anyway? Adv Health Sci Educ Theory Pract. 2007;12(1):1–5. doi:10.1007/s10459-006-9047-x.
Eva KW. Broadening the debate about quality in medical education research. Med Educ. 2009;43(4):294–6. doi:10.1111/j.1365-2923.2009.03342.x.
Van Merrienboer JJG. What people say # what people do. Perspect Med Educ. 2015. doi:10.1007/s40037-015-0163-2
Green J, Britten N. Qualitative research and evidence based medicine. BMJ. 1998;316(7139):1230–2. doi:http://dx.doi.org/10.1136/bmj.316.7139.1230.
Mays N, Pope C. Qualitative research: rigour and qualitative research. BMJ. 1995;311(6997):109–12. doi:http://dx.doi.org/10.1136/bmj.311.6997.109.
Bradley F, Wiles R, Kinmonth AL, Mant D, Gantley M. Development and evaluation of complex interventions in health services research: case study of the Southampton heart integrated care project (SHIP). The SHIP Collaborative Group. BMJ. 1999;318(7185):711–5.
Campbell M, Fitzpatrick R, Haines A, et al. Framework for design and evaluation of complex interventions to improve health. BMJ. 2000;321(7262):694–6.
Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M. Developing and Evaluating Complex Interventions: New Guidance. London; 2008. http://eprints.ucl.ac.uk/103060/. Accessed 5 Nov. 2014.
Papadakis MA, Teherani A, Banach MA, et al. Disciplinary action by medical boards and prior behavior in medical school. N Engl J Med. 2005;353(25):2673–82.
Tamblyn R, Abrahamowicz M, Dauphinee WD, et al. Association between licensure examination scores and practice in primary care. JAMA. 2002;288(23):3019–26.
Tamblyn R, Abrahamowicz M, Dauphinee D, et al. Physician scores on a national clinical skills examination as predictors of complaints to medical regulatory authorities. JAMA. 2007;298(9):993–1001.
Tamblyn R, Abrahamowicz M, Brailovsky C, et al. Association between licensing examination scores and resource use and quality of care in primary care practice. JAMA. 1998;280(11):989–96.
McLachlan JC, Finn G, Macnaughton J. The conscientiousness index: a novel tool to explore students’ professionalism. Acad Med. 2009;84(5):559–65. doi:10.1097/ACM.0b013e31819fb7ff.
Goldszmidt M, Chahine S, Cristancho S, Watling C, Lingard L. On the value of the ‘subjective’ in studies of human behaviour and cognition. Perspect Med Educ. 2015. doi:10.1007/s40037-015-0154-3
Acknowledgement
I would like to thank my colleagues and critical friends Maggie Bartlett, Simon Gay and Janet Lefroy, and the reviewer, for their advice on previous drafts of this this editorial.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution Noncommercial License which permits any noncommercial use, distribution, and reproduction in any medium, provided the original author(s) and source are credited.
About this article
Cite this article
McKinley, R. Qualitative and quantitative: the yin and the yang or the light and the dark sides of medical education?. Perspect Med Educ 4, 1–3 (2015). https://doi.org/10.1007/s40037-015-0162-3
Published:
Issue Date:
DOI: https://doi.org/10.1007/s40037-015-0162-3