Abstract
Context: A major goal of any evaluation is to demonstrate content validity, which considers both curricular content as well as the ability expected of learners. Whether evaluation blueprints should be published and the degree of blueprint transparency is controversial. Objectives: To examine the effect of blueprint publication on students’ perceptions of the validity of the evaluation process. Methods: This study examined students’ attitudes towards the Renal Course evaluation before and after blueprint publication. There was no significant change in the course objectives, blueprint or evaluation between the two time periods. Students’ attitudes were evaluated using a questionnaire containing four items related to evaluation. Also collected were the overall course ratings, minimum performance level (MPL) for evaluations and students’ performance on each exam. Results: There were no significant differences in the MPL or evaluation scores between the two time periods. A significantly greater proportion of students perceived that the Renal Course evaluation was a fair test and was reflective of both important subject matter and the delivered curriculum. The increased satisfaction process did not appear to be a reflection of their overall satisfaction with the course as there was a trend towards reduced overall satisfaction with the course. Conclusions: Publication of the evaluation blueprint appears to improve students’ perceptions of the validity of the evaluation process. Further studies are required to identify the reasons for this attitude change. We propose that blueprint transparency drives both instructors teaching and student learning towards key educational elements.
Similar content being viewed by others
References
G. Bordage (1995) ArticleTitleContent validation of key features on a national examination of clinical decision-making skills Academic Medicine 70 276–281 Occurrence Handle1:STN:280:ByqB3svhtFA%3D Occurrence Handle7718059
K. Hopkins (1988) Educational and Psychological Measurement and Evaluation Allyn and Bacon Needham Heights, MA
H. Mandin (1995) ArticleTitleDeveloping a “clinical presentation” curriculum at the university of Calgary Academic Medicine 70 186–193 Occurrence Handle1:STN:280:ByqC2sjoslw%3D Occurrence Handle7873005
F. Marton (1976) ArticleTitleOn qualitative differences in learning: II – Outcome as a function of the learner’s conception of the task British Journal of Educational Psychology 46 115–127
McLaughlin K. (2004). Examination blueprinting – what, why, who and how? Meducator, (in press)
D.I. Newble (1986) ArticleTitleLearning styles and approaches: Implications for medical education Medical Education 20 162–175 Occurrence Handle1:STN:280:BimB2MnmvVU%3D Occurrence Handle3724571
D. Newble (1994) ArticleTitleGuidelines for assessing clinical competence Teaching and Learning in Medicine 6 213–220
P. Tombleson (2000) ArticleTitleDefining the content for the objective structured clinical examination component of the professional and linguistic assessments board examination: Development of a blueprint Medical Education 34 566–572 Occurrence Handle10.1046/j.1365-2923.2000.00553.x Occurrence Handle1:STN:280:DC%2BD3czpvVSjuw%3D%3D Occurrence Handle10886640
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
McLaughlin, K., Coderre, S., Woloschuk, W. et al. Does Blueprint Publication Affect Students’ Perception of Validity of the Evaluation Process?. Adv Health Sci Educ Theory Pract 10, 15–22 (2005). https://doi.org/10.1007/s10459-004-8740-x
Received:
Accepted:
Issue Date:
DOI: https://doi.org/10.1007/s10459-004-8740-x