Skip to main content

Advertisement

Log in

Peer learning in abdominal radiology: iterative process improvements over a 20-year experience

  • Practice
  • Published:
Abdominal Radiology Aims and scope Submit manuscript

Abstract

Purpose

After a slow and challenging transition period, peer learning and improvement (PLI) is now being more widely adopted by practices as an option for continuous personal and practice performance improvement. In addition to gaps that exist in the understanding of what PLI is and how it should be practiced, wide variation exists in how the process is implemented, administered, how outcomes are measured, and what strategies are employed to engage radiologists. This report aims to describe lessons learned from our 20-year experience with the design, implementation, and continuous improvements of a PLI program in a large academic program.

Methods

Since initial implementation in 2004, an oversight team prospectively documented iterative process improvements and data submission trends in our PLI process. Process data included strategies for engaging radiologists in the PLI process (fostering case submission, PLI meeting participation), steps for achieving regulatory compliance, and template content for facilitating the value and impact of PLI meetings (case analysis, review of contributing factors, identification of improvement opportunities).

Results

Submission trends, submitted case content, and improvement opportunities varied by clinical section. Process improvements that fostered engagement included closing the loop with participants, expanding criteria for case submission beyond interpretive disagreements (e.g., great pickups, near misses), minimizing impacts to workflow, and using evidence-based templates for case and contributor categorization, bias analysis, and identification of improvement opportunities.

Conclusion

Implementing an effective PLI program requires sustained communication, education, and continuous process improvement. While PLI can certainly lead to process and individual performance improvement, the program requires trained champions, designated time, effort, resources, education, and patience to be effectively implemented.

Graphical abstract

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

References

  1. Sharpe RE Jr, Tarrant MJ, Brook OR, Chatfield M, Chaudhry H, City RB, Donnelly LF, Goldberg-Stein S, Hernandez D, Hwang GL, Kunst MM, Lee R, Moriarity AK, Pahade JK, Patel S, Broder JC. Current State of Peer Learning in Radiology: A Survey of ACR Members. J Am Coll Radiol. 2023 May 23: S1546-1440(23)00342-3. https://doi.org/10.1016/j.jacr.2023.03.018. Epub ahead of print. PMID: 37230234.

  2. Kruskal JB, Eisenberg RL, Brook O, Siewert B (2016) Transitioning from peer review to peer learning for abdominal radiologists. Abdom Radiol N Y 41:416–428

    Article  Google Scholar 

  3. Donnelly LF, Larson DB, Heller REIII, Kruskal JB (2018) Practical suggestions on how to move from peer review to peer learning. AJR Am J Roentgenol 210:578–582

    Article  PubMed  Google Scholar 

  4. Schmidt E, Lo HS, Saghir A. Peer learning in emergency radiology: effects on learning, error identification, and radiologist experience. Emerg Radiol. 2022 Aug;29(4):655-661. https://doi.org/10.1007/s10140-022-02040-6. Epub 2022 Apr 7. PMID: 35391565.

    Article  PubMed  Google Scholar 

  5. Sayyouh MMH, Sella EC, Shankar PR, Marshall GE, Quint LE, Agarwal PP. Lessons Learned from Peer Learning Conference in Cardiothoracic Radiology. Radiographics. 2022 Mar-Apr;42(2):579-593. https://doi.org/10.1148/rg.210125. Epub 2022 Feb 11. PMID: 35148241.

  6. Sharpe RE Jr, Huffman RI, Congdon RG, Plunkett LA, Tschumper BA, Stewart DT, Bode EK. Implementation of a Peer Learning Program Replacing Score-Based Peer Review in a Multispecialty Integrated Practice. AJR Am J Roentgenol. 2018 Nov;211(5):949-956. https://doi.org/10.2214/AJR.18.19891. Epub 2018 Sep 12. PMID: 30207788.

    Article  PubMed  Google Scholar 

  7. Bowman AW, Tan N, Adamo DA, Chen F, Venkatesh SK, Baumgarten DA. Implementation of peer learning conferences throughout a multi-site abdominal radiology practice. Abdom Radiol (NY). 2021 Dec;46(12):5489-5499. https://doi.org/10.1007/s00261-021-03114-8. Epub 2021 May 17. Erratum in: Abdom Radiol (NY). 2021 Jun 11: PMID: 33999282.

  8. Chow RA, Tan N, Henry TS, Kanne JP, Sekhar A. Peer Learning Through Multi- Institutional Case Conferences: Abdominal and Cardiothoracic Radiology Experience. Acad Radiol. 2021 Feb;28(2):255-260. https://doi.org/10.1016/j.acra.2020.01.015. Epub 2020 Feb 13. PMID: 32061469

    Article  PubMed  Google Scholar 

  9. Andrew K Moriarty, Karen Cedeno-Kelly, Tanya Hioe. Private Practice Radiologists' Perceptions of Peer Learning. J Am Coll Radiol 2020 Nov;17(11): 1509-1514.https://doi.org/10.1016/j.jacr.2020.07.014. Epub 2020 Aug 6.

  10. Peer Learning Resources | American College of Radiology (acr.org) and Bringing Peer Learning to Accreditation | American College of Radiology (acr.org)

  11. Larson DB, Broder JC, Bhargavan-Chatfield M, Donnelly LF, Kadom N, Khorasani R, Sharpe RE Jr, Pahade JK, Moriarity AK, Tan N, Siewert B, Kruskal JB. Transitioning From Peer Review to Peer Learning: Report of the 2020 Peer Learning Summit. J Am Coll Radiol. 2020 Nov;17(11):1499-1508. https://doi.org/10.1016/j.jacr.2020.07.016. Epub 2020 Aug 6. PMID: 32771491.

    Article  PubMed  Google Scholar 

  12. Donnelly LF, Larson DB, Heller RE III, Kruskal JB. Practical Suggestions on How to Move From Peer Review to Peer Learning. AJR Am J Roentgenol. 2018 Mar;210(3):578-582. https://doi.org/10.2214/AJR.17.18660. Epub 2018 Jan 11. PMID: 29323555.

    Article  PubMed  Google Scholar 

  13. Donnelly LF, Dorfman SR, Jones J, Bisset GS 3rd. Transition from Peer Review to Peer Learning: Experience in a Radiology Department. J Am Coll Radiol. 2018 Aug;15(8):1143-1149. https://doi.org/10.1016/j.jacr.2017.08.023. Epub 2017 Oct 19. PMID: 29055610.

    Article  PubMed  Google Scholar 

  14. Broder JC, Scheirey CD, Wald C. Step by Step: A Structured Approach for Proposing, Developing and Implementing a Radiology Peer Learning Program. Curr Probl Diagn Radiol. 2021 Jul-Aug;50(4):457-460. https://doi.org/10.1067/j.cpradiol.2021.02.007. Epub 2021 Feb 7. PMID: 33663894.

  15. Ludwig DR, Strand BS, Bierhals AJ, Mellnick VM. Implementation of a peer- learning program in an academic abdominal radiology practice and comparison with a traditional peer-review system. Abdom Radiol (NY). 2022 Jul;47(7):2509-2519. https://doi.org/10.1007/s00261-022-03523-3. Epub 2022 Apr 28. PMID: 35482105

    Article  PubMed  Google Scholar 

  16. Ngo AV, Stanescu AL, Swenson DW, Moore MM, Sze RW, Iyer RS. Practical considerations when implementing peer learning conferences. Pediatr Radiol. 2019 Apr;49(4):526-530. https://doi.org/10.1007/s00247-018-4305-7. Epub 2019 Mar 29. PMID: 30923885.

    Article  PubMed  Google Scholar 

  17. Parrot EH, Saeedipour S, Walker CM, Best SR, Harn NR, Ash RM. Transition from peer review to peer learning: lessons learned. Cur Problem Diag Radiol 2023; 52: 223 - 229

    Article  Google Scholar 

  18. Khader A, Ali S, Wald C, Wortman J, Broder J. Abdominal peer learning: advantages and lessons learned. Abdom Radiol (NY). 2023 Apr;48(4):1526-1535. https://doi.org/10.1007/s00261-023-03846-9. Epub 2023 Feb 18. PMID: 36801958.

    Article  PubMed  Google Scholar 

  19. Luo M, Berkowitz S, Nguyen Q, et al. Electronic IR Group Peer Review and Learning Performed during Daily Clinical Rounds. J Vasc Interv Radiol. 2019 Apr;30(4):594-600. https://doi.org/10.1016/j.jvir.2018.09.005. Epub 2019 Feb 27.

    Article  PubMed  Google Scholar 

  20. Kruskal JB, Yam CS, Sosna J, Hallett D, Milliman Y, Kressel HY. Implementation of an online radiology quality assurance reporting system for performance improvement – initial evaluation. Radiology 2006;241:518-527

    Article  PubMed  Google Scholar 

  21. Science of Improvement: Testing Changes | IHI - Institute for Healthcare Improvement

  22. Eisenberg RL, Kruskal JB, et al. Survey of faculty perceptions regarding a peer review system. J Am Coll Radiol. 2013 Oct 19. doi:pii: S1546-1440(13)00489-4. https://doi.org/10.1016/j.jacr.2013.08.011. [Epub ahead of print] PMID:24144835

  23. Kruskal JB, Eisenberg RL, Ahmed M, Siewert B. Ongoing professional practice evaluation of radiologists: strategies and tools for simplifying a complex process. RadioGraphics 2018;38(6):1593-1608

    Article  PubMed  Google Scholar 

  24. Peer-Learning-Program-Checklist-for-ACR-accredited-facilities.pdf

  25. The Incident Decision Tree: Guidelines for Action Following Patient Safety Incidents (ahrq.gov)

  26. AHRQ Harm Scale (army.mil)

  27. Borgstede JP, Lewis RS, Bhargavan M, Sunshine JH. RADPEER quality assurance program: a multifacility study of interpretive disagreements rates (2004). J Am Coll Radiol 1: 59-65.

    Article  PubMed  Google Scholar 

  28. Abujudeh H, Pyatt RS, Bruno MA et al. RADPEER peer review: relevance, use, concerns, challenmges and direction forward. J Am Coll Radiol. 2014 Sep;11(9):899-904. https://doi.org/10.1016/j.jacr.2014.02.004. Epub 2014 May 16.

    Article  PubMed  Google Scholar 

  29. Brook OR, Romero J, Brook A, et al. (2015) The complementary nature of peer review and quality assurance data collection. Radiology 274(1):221–229

    Article  PubMed  Google Scholar 

  30. Grenville J, Doucette-Preville D, Vlachou PA et al (2016) Peer review in radiology: a resident and fellow perspective. J Am Coll Radiol 13:217–221.e3

    Article  PubMed  Google Scholar 

  31. Liao M, Tan N. Collective Intelligence of Peer Learning: Promoting Culture of Learning and Improvement Among Radiologists. Curr Probl Diagn Radiol. 2021 Nov-Dec;50(6):761-763. https://doi.org/10.1067/j.cpradiol.2020.09.017. Epub 2020 Oct 5. PMID: 33032854.

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Jonathan B. Kruskal.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Siewert, B., Brook, O.R. & Kruskal, J.B. Peer learning in abdominal radiology: iterative process improvements over a 20-year experience. Abdom Radiol 49, 662–677 (2024). https://doi.org/10.1007/s00261-023-04118-2

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00261-023-04118-2

Keywords

Navigation