Abstract
Background
Surgical technological advances in the past three decades have led to dramatic reductions in the morbidity associated with abdominal procedures and permanently altered the surgical practice landscape. Significant changes continue apace including surgical robotics, natural orifice-based surgery, and single-incision approaches. These disruptive technologies have on occasion been injurious to patients, and high-stakes assessment before adoption of new technologies would be reasonable.
Methods
We reviewed the drivers for well-established psychometric techniques available for the standards-setting process.
Results
We present a series of examples that are relevant in the surgical domain including standards setting for knowledge and skills assessments.
Conclusions
Defensible standards for knowledge and procedural skills will likely become part of surgical clinical practice. Understanding the methodology for determining standards should position the surgical community to assist in the process and lead within their clinical settings as standards are considered that may affect patient safety and physician credentialing.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Southgate L, Hays RB, Norcini J, Mulholland H, Ayers B, Woolliscroft J, Cusimano M, McAvoy P, Ainsworth M, Haist S, Campbell M (2001) Setting performance standards for medical practice: a theoretical framework. Med Educ 35:474–481
Darzi A, Smith S, Taffinder N (1999) Assessing operative skill needs to become more objective. BMJ 318:887–888
Taffinder N, Sutton C, Fishwick RJ, McManus IC, Darzi A (1998) Validation of virtual reality to teach and assess psychomotor skills in laparoscopic surgery: results from randomised controlled studies using the MIST VR laparoscopic simulator. Stud Health Technol Inf 50:124–130
van Hove PD, Tuijthof GJ, Verdaasdonk EG, Stassen LP, Dankelman J (2010) Objective assessment of technical surgical skills. Br J Surg 97:972–987
Searle J (2000) Defining competence—the role of standard setting. Med Educ 34:363–366
Marriott J, Purdie H, Crossley J, Beard JD (2011) Evaluation of procedure-based assessment for assessing trainees’ skills in the operating theatre. Br J Surg 98:450–457
Crossley J, Marriott J, Purdie H, Beard JD (2011) Prospective observataional study to evaluate NOTSS (non-technical skills for surgeons) for assessing trainees’ non-technical performance in the operating theatre. Br J Surg 98:1010–1020
Brennan (1964) Jacobellis v Ohio. Tomson-Reuters. http://caselaw.lp.findlaw.com/scripts/getcase.pl?court=us&vol=378&invol=184
Zieky M (ed) (2001) So much has changed: how the setting of cutscores has evolved since the 1980s. Lawrence Erlbaum Associates, Mahwah
Hambleton RK, Brennan RL, Brown W, Dodd B, Forsyth RA, Mehrens WA, Nellhaus J, Reckase M, Rindone D, van der Linden WJ, Zwick R (2000) A response to “Setting reasonable and useful performance standards in the National Academy of Sciences’ Grading the Nation’s Report Card”. Educ Measure Issues Pract 19(2):5–13
Downing SM, Tekian A, Yudkowsky R (2006) Procedures for establishing defensible absolute passing scores on performance examinations in health professions education. Teach Learn Med 18(1):50–57
Cusimano M (1996) Standard setting in medical education. Acad Med 71(10):S112–S120
Cusimano MD, Rothman AI (2003) The effect of incorporating normative data into a criterion-referenced standard setting in medical education. Acad Med 78(10):S88–S90
Hofstee W (1983) The case for compromise in educational selection and grading. Jossey-Bass, San Francisco
DeGruijter D (1985) Compromise models for establishing examination standards. J Educ Measure 22:263–269
Gormley G (2011) Summative OSCEs in undergraduate medical education. Ulster Med J 80(3):127–132
von Websky MW, Vitz M, Raptis DA, Rosenthal R, Clavien PA, Hahnloser D (2012) Basic laparoscopic training using the Simbionix LAP Mentor: setting the standards in the novice group. J Surg Educ 69(4):459–467
Disclosures
Drs. Cendan, Wier, and Behrns have no conflicts of interest or financial ties to disclose.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Cendan, J., Wier, D. & Behrns, K. A primer on standards setting as it applies to surgical education and credentialing. Surg Endosc 27, 2631–2637 (2013). https://doi.org/10.1007/s00464-012-2771-9
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00464-012-2771-9