Skip to main content

Advertisement

SpringerLink
Log in

Competency Testing for Pediatric Cardiology Fellows Learning Transthoracic Echocardiography: Implementation, Fellow Experience, and Lessons Learned

  • Original Article
  • Published:
Pediatric Cardiology Aims and scope Submit manuscript

Abstract

There is currently great interest in measuring trainee competency at all levels of medical education. In 2007, we implemented a system for assessing cardiology fellows’ progress in attaining imaging skills. This paradigm could be adapted for use by other cardiology programs. Methods: Evaluation consisted of a two-part exercise performed after years 1 and 2 of pediatric cardiology training. Part 1: a directly observed evaluation of technical skills as fellows imaged a normal subject (year 1) and a patient with complex heart disease (year 2). Part 2: fellows interpreted and wrote reports for two echocardiograms illustrating congenital heart disease. These were graded for accuracy and facility with communicating pertinent data. After 5 years of testing, fellows were surveyed about their experience. In 5 years, 40 fellows were tested at least once. Testing identified four fellows who underperformed on the technical portion and four on the interpretive portion. Surveys were completed by 33 fellows (83 %). Most (67 %) felt that intermittent observation by faculty was inadequate for assessing skills and that procedural volume was a poor surrogate for competency (58 %). Posttest feedback was constructive and valuable for 90, and 70 % felt the process helped them set goals for skill improvement. Overall, fellows felt this testing was fair and should continue. Fellow performance and responses identified programmatic issues that were creating barriers to learning. We describe a practical test to assess competency for cardiology fellows learning echocardiography. This paradigm is feasible, has excellent acceptance among trainees, and identifies trainees who need support. Materials developed could be easily adapted to help track upcoming ACGME-mandated metrics.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3

Similar content being viewed by others

References

  1. Amin MR, Friedmann DR (2013) Simulation-based training in advanced airway skills in an otolaryngology residency program. Laryngoscope 123:629–634

    Article  PubMed  Google Scholar 

  2. Atesok K, Mabrey JD, Jazrawi LM, Egol KA (2012) Surgical simulation in orthopaedic skills training. J Am Acad Orthop Surg 20:410–422

    Article  PubMed  Google Scholar 

  3. Borman KR, Jones AT, Shea JA (2012) Duty hours, quality of care, and patient safety: general surgery resident perceptions. J Am Coll Surg 215: 70–77 (discussion 77–79)

    Article  PubMed Central  PubMed  Google Scholar 

  4. Chisholm CB, Dodge WR, Balise RR, Williams SR, Gharahbaghian L, Beraud AS (2013) Focused cardiac ultrasound training: how much is enough? J Emerg Med 44:818–822

    Article  PubMed  Google Scholar 

  5. Cook DA, Brydges R, Zendejas B, Hamstra SJ, Hatala R (2013) Mastery learning for health professionals using technology-enhanced simulation: a systematic review and meta-analysis. Acad Med 88:1178–1186

    Article  PubMed  Google Scholar 

  6. Damp J, Anthony R, Davidson MA, Mendes L (2013) Effects of transesophageal echocardiography simulator training on learning and performance in cardiovascular medicine fellows. J Am Soc Echocardiogr 26(1450–1456):e1452

    Google Scholar 

  7. Dehmer JJ, Amos KD, Farrell TM, Meyer AA, Newton WP, Meyers MO (2013) Competence and confidence with basic procedural skills: the experience and opinions of fourth-year medical students at a single institution. Acad Med 88:682–687

    Article  PubMed  Google Scholar 

  8. Drolet BC, Soh IY, Shultz PA, Fischer SA (2012) A thematic review of resident commentary on duty hours and supervision regulations. J Grad Med Educ 4:454–459

    Article  PubMed Central  PubMed  Google Scholar 

  9. Flores RL, Havlik RJ, Choi M, Heidelman JF, Bennett JD, Tholpady S (2013) Measuring surgical competency in facial trauma: the arch bar placement assessment scale. Ann Plast Surg

  10. Gearhart SL, Wang MH, Gilson MM, Chen B, Kern DE (2012) Teaching and assessing technical proficiency in surgical subspecialty fellowships. J Surg Educ 69:521–528

    Article  PubMed  Google Scholar 

  11. Golnik KC, Motley WW, Atilla H, Pilling R, Reddy A, Sharma P, Yadarola MB, Zhao K (2012) The ophthalmology surgical competency assessment rubric for strabismus surgery. J AAPOS 16:318–321

    Article  PubMed  Google Scholar 

  12. Grant EC, Grant VJ, Bhanji F, Duff JP, Cheng A, Lockyer JM (2012) The development and assessment of an evaluation tool for pediatric resident competence in leading simulated pediatric resuscitations. Resuscitation 83:887–893

    Article  PubMed  Google Scholar 

  13. Greenhouse DG, Grossi EA, Dellis S, Park J, Yaffee DW, DeAnda A Jr, Galloway AC, Balsam LB (2013) Assessment of a mitral valve replacement skills trainer: a simplified, low-cost approach. J Thorac Cardiovasc Surg 145: 54–59, 59 e51

  14. Hao M, Ippisch HM, Cook RS, Perry DJ, Gottliebson WM, Hirsch R, Kimball TR (2007) Implementation of an objective testing system in noninvasive cardiac imaging for evaluation of pediatric cardiology fellows. J Am Soc Echocardiogr 20:1211–1218

    Article  PubMed  Google Scholar 

  15. Harden RM, Gleeson FA (1979) Assessment of clinical competence using an objective structured clinical examination (OSCE). Med Educ 13:41–54

    CAS  PubMed  Google Scholar 

  16. Hauer KE, Soni K, Cornett P, Kohlwes J, Hollander H, Ranji SR, Ten Cate O, Widera E, Calton B, O’Sullivan PS (2013) Developing entrustable professional activities as the basis for assessment of competence in an internal medicine residency: a feasibility study. J Gen Intern Med 28:1110–1114

    Article  PubMed Central  PubMed  Google Scholar 

  17. Jang TB, Coates WC, Liu YT (2012) The competency-based mandate for emergency bedside sonography training and a tale of two residency programs. J Ultrasound Med 31:515–521

    PubMed  Google Scholar 

  18. Kerfoot BP, Fu Y, Baker H, Connelly D, Ritchey ML, Genega EM (2010) Online spaced education generates transfer and improves long-term retention of diagnostic skills: a randomized controlled trial. J Am Coll Surg 211(3):331–337

    Article  PubMed  Google Scholar 

  19. Kirton OC, Reilly P, Staff I, Burns K (2012) Development and implementation of an interactive, objective, and simulation-based curriculum for general surgery residents. J Surg Educ 69:718–723

    Article  PubMed  Google Scholar 

  20. Kuvin JT (2011) Training present and future cardiologists. Am J Cardiol 108:1508–1512

    Article  PubMed  Google Scholar 

  21. Li ST, Tancredi DJ, Burke AE, Guillot A, Guralnick S, Trimm RF, Mahan JD (2012) Self-assessment on the competencies and reported improvement priorities for pediatrics residents. J Grad Med Educ 4:445–453

    Article  PubMed Central  PubMed  Google Scholar 

  22. Marcus H, Vakharia V, Kirkman MA, Murphy M, Nandi D (2013) Practice makes perfect? The role of simulation-based deliberate practice and script-based mental rehearsal in the acquisition and maintenance of operative neurosurgical skills. Neurosurgery 72(Suppl 1):124–130

    Article  PubMed  Google Scholar 

  23. Mathes EF, Frieden IJ, Cho CS, Boscardin CK (2014) Randomized controlled trial of spaced education for pediatric residency education. J Grad Med Educ 6:270–274

    Article  PubMed Central  PubMed  Google Scholar 

  24. Mavis BE, Wagner DP, Henry RC, Carravallah L, Gold J, Maurer J, Mohmand A, Osuch J, Roskos S, Saxe A, Sousa A, Prins VW (2013) Documenting clinical performance problems among medical students: feedback for learner remediation and curriculum enhancement. Med Educ 18:20598

    Google Scholar 

  25. Mookherjee S, Chang A, Boscardin CK, Hauer KE (2013) How to develop a competency-based examination blueprint for longitudinal standardized patient clinical skills assessments. Med Teach 35:883–890

    Article  PubMed  Google Scholar 

  26. Nair P, Siu SC, Sloggett CE, Biclar L, Sidhu RS, Yu EH (2006) The assessment of technical and interpretative proficiency in echocardiography. J Am Soc Echocardiogr 19:924–931

    Article  PubMed  Google Scholar 

  27. Nitsche JF, Brost BC (2013) The use of simulation in maternal-fetal medicine procedure training. Semin Perinatol 37:189–198

    Article  PubMed  Google Scholar 

  28. Northup PG, Argo CK, Muir AJ, Decross AJ, Coyle WJ, Oxentenko AS (2013) Procedural competency of gastroenterology trainees: from apprenticeship to milestones. Gastroenterology 144:677–680

    Article  PubMed  Google Scholar 

  29. Nugent E, Shirilla N, Hafeez A, O’Riordain DS, Traynor O, Harrison AM, Neary P (2013) Development and evaluation of a simulator-based laparoscopic training program for surgical novices. Surg Endosc 27:214–221

    Article  PubMed  Google Scholar 

  30. Quinones MA, Douglas PS, Foster E, Gorcsan J 3rd, Lewis JF, Pearlman AS, Rychik J, Salcedo EE, Seward JB, Stevenson JG, Thys DM, Weitz HH, Zoghbi WA, Creager MA, Winters WL Jr, Elnicki M, Hirshfeld JW Jr, Lorell BH, Rodgers GP, Tracy CM, Weitz HH, American Society of E, Society of Cardiovascular A, Society of Pediatric E (2003) ACC/AHA clinical competence statement on echocardiography: a report of the American College of Cardiology/American Heart Association/American College of Physicians-American Society of Internal Medicine Task Force on clinical competence. J Am Soc Echocardiogr 16:379–402

    Article  PubMed  Google Scholar 

  31. Sanders SP, Colan SD, Cordes TM, Donofrio MT, Ensing GJ, Geva T, Kimball TR, Sahn DJ, Silverman NH, Sklansky MS, Weinberg PM, American Society of E, Society of Pediatric E, American College of Cardiology F, American Heart A, American College of Physicians Task Force on Clinical C (2005) ACCF/AHA/AAP recommendations for training in pediatric cardiology. Task force 2: pediatric training guidelines for noninvasive cardiac imaging endorsed by the American Society of Echocardiography and the Society of Pediatric Echocardiography. J Am Coll Cardiol 46:1384–1388

    Article  PubMed  Google Scholar 

  32. Selvasekar CR, Holubar SD, Pendlimari R, Kennedy GD, Harmsen WS, Harrington JR, Nelson H (2012) Assessment of screening colonoscopy competency in colon and rectal surgery fellows: a single institution experience. J Surg Res 174:e17–e23

    Article  PubMed  Google Scholar 

  33. Srivastava S, Printz BF, Geva T, Shirali GS, Weinberg P, Wong PC, Lang P (2015) Task force 2: pediatric cardiology fellowship training in noninvasive cardiac imaging. J Am Coll Cardiol. doi10.1016/j.jacc.2015.03.010

  34. Stroud L, Cavalcanti RB (2013) Hybrid simulation for knee arthrocentesis: improving fidelity in procedures training. J Gen Intern Med 28:723–727

    Article  PubMed Central  PubMed  Google Scholar 

  35. Wade TJ, Webb TP (2013) Tackling technical skills competency: a surgical skills rating tool. J Surg Res 181:1–5

    Article  PubMed  Google Scholar 

  36. Wayne DB, Hauer KE (2012) Counting quality, not hours: understanding the impact of duty hour reform on internal medicine residency education. J Gen Intern Med 27:1400–1401

    Article  PubMed Central  PubMed  Google Scholar 

  37. Yarmus L, Feller-Kopman D, Imad M, Kim S, Lee HJ (2013) Procedural volume and structure of interventional pulmonary fellowships: a survey of fellows and fellowship program directors. Chest 144:935–939

    Article  PubMed  Google Scholar 

Download references

Acknowledgments

This study was supported by the Higgins Family Noninvasive Cardiac Imaging Research Funds

Author information

Authors and Affiliations

  1. Department of Cardiology, Boston Children’s Hospital, 300 Longwood Ave, Boston, MA, 02115, USA

    Jami C. Levine, Tal Geva & David W. Brown

  2. Department of Pediatrics, Harvard Medical School, Boston, MA, USA

    Jami C. Levine, Tal Geva & David W. Brown

Authors
  1. Jami C. Levine
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Tal Geva
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. David W. Brown
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jami C. Levine.

Ethics declarations

Conflict of interest

Participating authors have no conflict of interests to disclose.

Appendix

Appendix

figure afigure a

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Levine, J.C., Geva, T. & Brown, D.W. Competency Testing for Pediatric Cardiology Fellows Learning Transthoracic Echocardiography: Implementation, Fellow Experience, and Lessons Learned. Pediatr Cardiol 36, 1700–1711 (2015). https://doi.org/10.1007/s00246-015-1220-7

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00246-015-1220-7

Keywords

Search

Navigation