Advertisement

Journal of General Internal Medicine

, Volume 23, Issue 7, pp 979–984 | Cite as

Automatic Capture of Student Notes to Augment Mentor Feedback and Student Performance on Patient Write-Ups

  • Anderson Spickard III
  • Joseph Gigante
  • Glenn Stein
  • Joshua C. Denny
Original Article

Abstract

Objective

To determine whether the integration of an automated electronic clinical portfolio into clinical clerkships can improve the quality of feedback given to students on their patient write-ups and the quality of students’ write-ups.

Design

The authors conducted a single-blinded, randomized controlled study of an electronic clinical portfolio that automatically collects all students’ clinical notes and notifies their teachers (attending and resident physicians) via e-mail. Third-year medical students were randomized to use the electronic portfolio or traditional paper means. Teachers in the portfolio group provided feedback directly on the student’s write-up using a web-based application. Teachers in the control group provided feedback directly on the student’s write-up by writing in the margins of the paper. Outcomes were teacher and student assessment of the frequency and quality of feedback on write-ups, expert assessment of the quality of student write-ups at the end of the clerkship, and participant assessment of the value of the electronic portfolio system.

Results

Teachers reported giving more frequent and detailed feedback using the portfolio system (p = 0.01). Seventy percent of students who used the portfolio system, versus 39% of students in the control group (p = 0.001), reported receiving feedback on more than half of their write-ups. Write-ups of portfolio students were rated of similar quality to write-ups of control students. Teachers and students agreed that the system was a valuable teaching tool and easy to use.

Conclusions

An electronic clinical portfolio that automatically collects students’ clinical notes is associated with improved teacher feedback on write-ups and similar quality of write-ups.

KEY WORDS

portfolio feedback medical education 

Notes

Acknowledgements

This work was funded in part by a grant from the National Library of Medicine (LM007450-04).

Conflict of Interest

None disclosed.

References

  1. 1.
    Association of American Medical Colleges. Learning Objectives for Medical Student Education: Guidelines for Medical Schools (MSOP Report). Washington, DC: Association of American Medical Colleges; 1998.Google Scholar
  2. 2.
    McLeod PJ. Assessing the value of student case write-ups and write-up evaluations. Acad Med. 1989;64:273–4.CrossRefPubMedGoogle Scholar
  3. 3.
    Woolliscroft JO, Calhoun JG, Beauchamp C, Wolf FM, Maxim BR. Evaluating the medical history: observation versus write-up review. J Med Educ. 1984;59:19–23.PubMedGoogle Scholar
  4. 4.
    Torre DM, Simpson D, Sebastian JL, Elnicki DM. Learning/feedback activities and high-quality teaching: perceptions of third-year medical students during an inpatient rotation. Acad Med. 2005;80:950–4.CrossRefPubMedGoogle Scholar
  5. 5.
    Daelmans HE, Overmeer RM, van der Hem-Stokroos HH, Scherpbier AJ, Stehouwer CD, van der Vleuten CP. In-training assessment: qualitative study of effects on supervision and feedback in an undergraduate clinical rotation. Med Educ. 2006;40:51–8.CrossRefPubMedGoogle Scholar
  6. 6.
    Kogan JR, Bellini LM, Shea JA. Have you had your feedback today. Acad Med. 2000;75:1041.CrossRefPubMedGoogle Scholar
  7. 7.
    Schum TR, Krippendorf RL, Biernat KA. Simple feedback notes enhance specificity of feedback to learners. Ambul Pediatr. 2003;3:9–11.CrossRefPubMedGoogle Scholar
  8. 8.
    Bardes CL, Wenderoth S, Lemise R, Ortanez P, Storey-Johnson C. Specifying student–patient encounters, web-based case logs, and meeting standards of the liaison committee on medical education. Acad Med. 2005;80:1127–32.CrossRefPubMedGoogle Scholar
  9. 9.
    Kogan JR, Shea JA. Psychometric characteristics of a write-up assessment form in a medicine core clerkship. Teach Learn Med. 2005;17:101–6.CrossRefPubMedGoogle Scholar
  10. 10.
    Brenner H, Kliebsch U. Dependence of weighted Kappa coefficients on the number of categories. Epidemiology. 1996;7:199–202.PubMedCrossRefGoogle Scholar
  11. 11.
    Paukert JL, Richards ML, Olney C. An encounter card system for increasing feedback to students. Am J Surg. 2002;183:300–4.CrossRefPubMedGoogle Scholar
  12. 12.
    Lye PS, Biernat KA, Bragg DS, Simpson DE. A pleasure to work with—an analysis of written comments on student evaluations. Ambul Pediatr. 2001;1:128–31.CrossRefPubMedGoogle Scholar
  13. 13.
    Supiano MA, Fantone JC, Grum C. A Web-based geriatrics portfolio to document medical students’ learning outcomes. Acad Med. 2002;77:937–8.CrossRefPubMedGoogle Scholar
  14. 14.
    Corbett EC, Whitcomb M. The AAMC Project on the Clinical Education of Medical Students: Clinical Skills Education. Washington, DC: Association of American Medical Colleges; 2004.Google Scholar

Copyright information

© Society of General Internal Medicine 2008

Authors and Affiliations

  • Anderson Spickard III
    • 1
    • 3
    • 4
  • Joseph Gigante
    • 2
  • Glenn Stein
    • 3
  • Joshua C. Denny
    • 1
    • 3
  1. 1.Department of MedicineVanderbilt University Medical CenterNashvilleUSA
  2. 2.Department of PediatricsVanderbilt University Medical CenterNashvilleUSA
  3. 3.Department of Biomedical InformaticsVanderbilt University Medical CenterNashvilleUSA
  4. 4.Vanderbilt School of MedicineNashvilleUSA

Personalised recommendations