The Role of a Computerised Case-based Testing Procedure in Practice Performance Assessment
Rent the article at a discountRent now
* Final gross prices may vary according to local VAT.Get Access
Introduction: For postgraduate training of doctors there is a need for valid and reliable instruments to assess their daily performance. Various instruments have been suggested, some of which use incognito simulated patients (SPs). These methods are resource intensive. Computerised Case-based testing (CCT) is logistically simpler and may still predict performance well. The research question was to evaluate the predictive validity of CCT for performance.
Methods: Seventeen rheumatologists were each visited by eight incognito SPs presenting various rheumatological complaints, and scoring the performance of the rheumatologists using a predefined checklist. From this checklist a panel of experts identified essential items. In addition the rheumatologists sat a CCT test containing 55 cases with a total of 121 items.
Results: Negative correlations were found between the SP scores and the CCT scores. This was unexpected. Therefore, background variables on experience were used to compare both methods. The correlation between these and CCT were high and positive and with the SP scores high and negative. This pattern did not differ when using the essential items of the checklist. Reliabilities of the SP scores were markedly high.
Discussion: Although CCT was not predictive of SP scores, it was related to working experience. There are good reasons to assume that although SP-scores were more authentic, they were less valid than CCT scores, mainly because they focussed more on thoroughness than on efficiency in data gathering. The results underpin the assumption that for valid performance assessment the most important issue is what information about the candidate is collected and now how authentic the method is.
- The Role of a Computerised Case-based Testing Procedure in Practice Performance Assessment
Advances in Health Sciences Education
Volume 10, Issue 2 , pp 145-155
- Cover Date
- Print ISSN
- Online ISSN
- Kluwer Academic Publishers
- Additional Links
- authentic assessment
- incognito simulated patients
- performance assessment
- Industry Sectors
- Author Affiliations
- 1. Department of Educational Development and Research, Maastricht University, PO Box 616, 6200, MD, The Netherlands
- 7. Department of Educational Development and Research, Maastricht University, The Netherlands
- 3. Department of Rheumatology, Academic Hospital Maastricht, The Netherlands
- 4. Skills laboratory, Maastricht University, The Netherlands
- 5. Department of Rheumatology, General Hospital of Heerlen, The Netherlands
- 6. Educational bureau, Faculty of Medicine, Maastricht University, The Netherlands