Abstract
Purpose
After a slow and challenging transition period, peer learning and improvement (PLI) is now being more widely adopted by practices as an option for continuous personal and practice performance improvement. In addition to gaps that exist in the understanding of what PLI is and how it should be practiced, wide variation exists in how the process is implemented, administered, how outcomes are measured, and what strategies are employed to engage radiologists. This report aims to describe lessons learned from our 20-year experience with the design, implementation, and continuous improvements of a PLI program in a large academic program.
Methods
Since initial implementation in 2004, an oversight team prospectively documented iterative process improvements and data submission trends in our PLI process. Process data included strategies for engaging radiologists in the PLI process (fostering case submission, PLI meeting participation), steps for achieving regulatory compliance, and template content for facilitating the value and impact of PLI meetings (case analysis, review of contributing factors, identification of improvement opportunities).
Results
Submission trends, submitted case content, and improvement opportunities varied by clinical section. Process improvements that fostered engagement included closing the loop with participants, expanding criteria for case submission beyond interpretive disagreements (e.g., great pickups, near misses), minimizing impacts to workflow, and using evidence-based templates for case and contributor categorization, bias analysis, and identification of improvement opportunities.
Conclusion
Implementing an effective PLI program requires sustained communication, education, and continuous process improvement. While PLI can certainly lead to process and individual performance improvement, the program requires trained champions, designated time, effort, resources, education, and patience to be effectively implemented.
Graphical abstract
![](http://media.springernature.com/lw685/springer-static/image/art%3A10.1007%2Fs00261-023-04118-2/MediaObjects/261_2023_4118_Figa_HTML.png)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs00261-023-04118-2/MediaObjects/261_2023_4118_Fig1_HTML.png)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs00261-023-04118-2/MediaObjects/261_2023_4118_Fig2_HTML.png)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs00261-023-04118-2/MediaObjects/261_2023_4118_Fig3_HTML.png)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs00261-023-04118-2/MediaObjects/261_2023_4118_Fig4_HTML.png)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs00261-023-04118-2/MediaObjects/261_2023_4118_Fig5_HTML.png)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs00261-023-04118-2/MediaObjects/261_2023_4118_Fig6_HTML.png)
Similar content being viewed by others
References
Sharpe RE Jr, Tarrant MJ, Brook OR, Chatfield M, Chaudhry H, City RB, Donnelly LF, Goldberg-Stein S, Hernandez D, Hwang GL, Kunst MM, Lee R, Moriarity AK, Pahade JK, Patel S, Broder JC. Current State of Peer Learning in Radiology: A Survey of ACR Members. J Am Coll Radiol. 2023 May 23: S1546-1440(23)00342-3. https://doi.org/10.1016/j.jacr.2023.03.018. Epub ahead of print. PMID: 37230234.
Kruskal JB, Eisenberg RL, Brook O, Siewert B (2016) Transitioning from peer review to peer learning for abdominal radiologists. Abdom Radiol N Y 41:416–428
Donnelly LF, Larson DB, Heller REIII, Kruskal JB (2018) Practical suggestions on how to move from peer review to peer learning. AJR Am J Roentgenol 210:578–582
Schmidt E, Lo HS, Saghir A. Peer learning in emergency radiology: effects on learning, error identification, and radiologist experience. Emerg Radiol. 2022 Aug;29(4):655-661. https://doi.org/10.1007/s10140-022-02040-6. Epub 2022 Apr 7. PMID: 35391565.
Sayyouh MMH, Sella EC, Shankar PR, Marshall GE, Quint LE, Agarwal PP. Lessons Learned from Peer Learning Conference in Cardiothoracic Radiology. Radiographics. 2022 Mar-Apr;42(2):579-593. https://doi.org/10.1148/rg.210125. Epub 2022 Feb 11. PMID: 35148241.
Sharpe RE Jr, Huffman RI, Congdon RG, Plunkett LA, Tschumper BA, Stewart DT, Bode EK. Implementation of a Peer Learning Program Replacing Score-Based Peer Review in a Multispecialty Integrated Practice. AJR Am J Roentgenol. 2018 Nov;211(5):949-956. https://doi.org/10.2214/AJR.18.19891. Epub 2018 Sep 12. PMID: 30207788.
Bowman AW, Tan N, Adamo DA, Chen F, Venkatesh SK, Baumgarten DA. Implementation of peer learning conferences throughout a multi-site abdominal radiology practice. Abdom Radiol (NY). 2021 Dec;46(12):5489-5499. https://doi.org/10.1007/s00261-021-03114-8. Epub 2021 May 17. Erratum in: Abdom Radiol (NY). 2021 Jun 11: PMID: 33999282.
Chow RA, Tan N, Henry TS, Kanne JP, Sekhar A. Peer Learning Through Multi- Institutional Case Conferences: Abdominal and Cardiothoracic Radiology Experience. Acad Radiol. 2021 Feb;28(2):255-260. https://doi.org/10.1016/j.acra.2020.01.015. Epub 2020 Feb 13. PMID: 32061469
Andrew K Moriarty, Karen Cedeno-Kelly, Tanya Hioe. Private Practice Radiologists' Perceptions of Peer Learning. J Am Coll Radiol 2020 Nov;17(11): 1509-1514.https://doi.org/10.1016/j.jacr.2020.07.014. Epub 2020 Aug 6.
Peer Learning Resources | American College of Radiology (acr.org) and Bringing Peer Learning to Accreditation | American College of Radiology (acr.org)
Larson DB, Broder JC, Bhargavan-Chatfield M, Donnelly LF, Kadom N, Khorasani R, Sharpe RE Jr, Pahade JK, Moriarity AK, Tan N, Siewert B, Kruskal JB. Transitioning From Peer Review to Peer Learning: Report of the 2020 Peer Learning Summit. J Am Coll Radiol. 2020 Nov;17(11):1499-1508. https://doi.org/10.1016/j.jacr.2020.07.016. Epub 2020 Aug 6. PMID: 32771491.
Donnelly LF, Larson DB, Heller RE III, Kruskal JB. Practical Suggestions on How to Move From Peer Review to Peer Learning. AJR Am J Roentgenol. 2018 Mar;210(3):578-582. https://doi.org/10.2214/AJR.17.18660. Epub 2018 Jan 11. PMID: 29323555.
Donnelly LF, Dorfman SR, Jones J, Bisset GS 3rd. Transition from Peer Review to Peer Learning: Experience in a Radiology Department. J Am Coll Radiol. 2018 Aug;15(8):1143-1149. https://doi.org/10.1016/j.jacr.2017.08.023. Epub 2017 Oct 19. PMID: 29055610.
Broder JC, Scheirey CD, Wald C. Step by Step: A Structured Approach for Proposing, Developing and Implementing a Radiology Peer Learning Program. Curr Probl Diagn Radiol. 2021 Jul-Aug;50(4):457-460. https://doi.org/10.1067/j.cpradiol.2021.02.007. Epub 2021 Feb 7. PMID: 33663894.
Ludwig DR, Strand BS, Bierhals AJ, Mellnick VM. Implementation of a peer- learning program in an academic abdominal radiology practice and comparison with a traditional peer-review system. Abdom Radiol (NY). 2022 Jul;47(7):2509-2519. https://doi.org/10.1007/s00261-022-03523-3. Epub 2022 Apr 28. PMID: 35482105
Ngo AV, Stanescu AL, Swenson DW, Moore MM, Sze RW, Iyer RS. Practical considerations when implementing peer learning conferences. Pediatr Radiol. 2019 Apr;49(4):526-530. https://doi.org/10.1007/s00247-018-4305-7. Epub 2019 Mar 29. PMID: 30923885.
Parrot EH, Saeedipour S, Walker CM, Best SR, Harn NR, Ash RM. Transition from peer review to peer learning: lessons learned. Cur Problem Diag Radiol 2023; 52: 223 - 229
Khader A, Ali S, Wald C, Wortman J, Broder J. Abdominal peer learning: advantages and lessons learned. Abdom Radiol (NY). 2023 Apr;48(4):1526-1535. https://doi.org/10.1007/s00261-023-03846-9. Epub 2023 Feb 18. PMID: 36801958.
Luo M, Berkowitz S, Nguyen Q, et al. Electronic IR Group Peer Review and Learning Performed during Daily Clinical Rounds. J Vasc Interv Radiol. 2019 Apr;30(4):594-600. https://doi.org/10.1016/j.jvir.2018.09.005. Epub 2019 Feb 27.
Kruskal JB, Yam CS, Sosna J, Hallett D, Milliman Y, Kressel HY. Implementation of an online radiology quality assurance reporting system for performance improvement – initial evaluation. Radiology 2006;241:518-527
Science of Improvement: Testing Changes | IHI - Institute for Healthcare Improvement
Eisenberg RL, Kruskal JB, et al. Survey of faculty perceptions regarding a peer review system. J Am Coll Radiol. 2013 Oct 19. doi:pii: S1546-1440(13)00489-4. https://doi.org/10.1016/j.jacr.2013.08.011. [Epub ahead of print] PMID:24144835
Kruskal JB, Eisenberg RL, Ahmed M, Siewert B. Ongoing professional practice evaluation of radiologists: strategies and tools for simplifying a complex process. RadioGraphics 2018;38(6):1593-1608
Peer-Learning-Program-Checklist-for-ACR-accredited-facilities.pdf
The Incident Decision Tree: Guidelines for Action Following Patient Safety Incidents (ahrq.gov)
AHRQ Harm Scale (army.mil)
Borgstede JP, Lewis RS, Bhargavan M, Sunshine JH. RADPEER quality assurance program: a multifacility study of interpretive disagreements rates (2004). J Am Coll Radiol 1: 59-65.
Abujudeh H, Pyatt RS, Bruno MA et al. RADPEER peer review: relevance, use, concerns, challenmges and direction forward. J Am Coll Radiol. 2014 Sep;11(9):899-904. https://doi.org/10.1016/j.jacr.2014.02.004. Epub 2014 May 16.
Brook OR, Romero J, Brook A, et al. (2015) The complementary nature of peer review and quality assurance data collection. Radiology 274(1):221–229
Grenville J, Doucette-Preville D, Vlachou PA et al (2016) Peer review in radiology: a resident and fellow perspective. J Am Coll Radiol 13:217–221.e3
Liao M, Tan N. Collective Intelligence of Peer Learning: Promoting Culture of Learning and Improvement Among Radiologists. Curr Probl Diagn Radiol. 2021 Nov-Dec;50(6):761-763. https://doi.org/10.1067/j.cpradiol.2020.09.017. Epub 2020 Oct 5. PMID: 33032854.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Siewert, B., Brook, O.R. & Kruskal, J.B. Peer learning in abdominal radiology: iterative process improvements over a 20-year experience. Abdom Radiol 49, 662–677 (2024). https://doi.org/10.1007/s00261-023-04118-2
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00261-023-04118-2