Skip to main content
Log in

Automatically Correlating Clinical Findings and Body Locations in Radiology Reports Using MedLEE

  • Published:
Journal of Digital Imaging Aims and scope Submit manuscript

Abstract

In this paper, we describe and evaluate a system that extracts clinical findings and body locations from radiology reports and correlates them. The system uses Medical Language Extraction and Encoding System (MedLEE) to map the reports’ free text to structured semantic representations of their content. A lightweight reasoning engine extracts the clinical findings and body locations from MedLEE’s semantic representation and correlates them. Our study is illustrative for research in which existing natural language processing software is embedded in a larger system. We manually created a standard reference based on a corpus of neuro and breast radiology reports. The standard reference was used to evaluate the precision and recall of the proposed system and its modules. Our results indicate that the precision of our system is considerably better than its recall (82.32–91.37% vs. 35.67–45.91%). We conducted an error analysis and discuss here the practical usability of the system given its recall and precision performance.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Notes

  1. opennlp.sourceforge.net.

  2. gate.ac.uk.

  3. www.nlpapplications.com.

  4. www.nlm.nih.gov/research/umls.

References

  1. Reiner BI: The challenges, opportunities, and imperative of structured reporting in medical imaging. J Digit Imaging 22:562–568, 2009

    Article  PubMed  Google Scholar 

  2. Reiner BI: Uncovering and improving upon the inherent deficiencies of radiology reporting through data mining. J Digit Imaging 23:109–118, 2010

    Article  PubMed  Google Scholar 

  3. Reiner BI: Customization of medical report data. J Digit Imaging 23:363–373, 2010

    Article  PubMed  Google Scholar 

  4. American College of Radiology: Breast Imaging Reporting and Data System Atlas. American College of Radiology, Reston, 2003

    Google Scholar 

  5. Dunnick NR, Langlotz CP: The radiology report of the future: a summary of the 2007 Intersociety Conference. J Am Coll Radiol 5:626–629, 2008

    Article  PubMed  Google Scholar 

  6. Weiss DL, Langlotz CP: Structured reporting: patient care enhancement or productivity nightmare? Radiology 249:739–747, 2008

    Article  PubMed  Google Scholar 

  7. Friedman C, Alderson PO, et al: A general natural-language text processor for clinical radiology. J Am Med Inform Assoc 1:161–174, 1994

    Article  PubMed  CAS  Google Scholar 

  8. Friedman C, Hripcsak G, et al: Representing information in patient reports using natural language processing and the extensible markup language. J Am Med Inform Assoc 6:76–87, 1999

    Article  PubMed  CAS  Google Scholar 

  9. Savova GK, Masanz JJ, et al: Mayo clinical Text Analysis and Knowledge Extraction System (cTAKES): architecture, component evaluation and applications. J Am Med Inform Assoc 17:507–513, 2010

    Article  PubMed  Google Scholar 

  10. Hripcsak G, Austin JHM, et al: Use of natural language processing to translate clinical information from a database of 889,921 chest radiographic reports. Radiology 224:157–163, 2002

    Article  PubMed  Google Scholar 

  11. Melton GB, Hripcsak G: Automated detection of adverse events using natural language processing of discharge summaries. J Am Med Inform Assoc 12:448–457, 2005

    Article  PubMed  Google Scholar 

  12. Chen ES, Hripcsak G, et al: Automated acquisition of disease drug knowledge from biomedical and clinical documents: an initial study. J Am Med Inform Assoc 15:87–98, 2008

    Article  PubMed  Google Scholar 

  13. McCormick PJ, Elhadad N, et al: Use of semantic features to classify patient smoking status. AMIA Annual Symposium, pp. 450–454, 2008

  14. Sevenster M, van Ommering R, Qian Y: Bridging the text-image gap: a decision support tool for real-time PACS browsing. J Digit Imaging doi:10.1007/s10278-011-9414-x, in press

  15. Sinha U, Dai B, et al: Interactive software for generation and visualization of structured findings in radiology reports. AJR Am J Roentgenol 175:609–612, 2000

    PubMed  CAS  Google Scholar 

  16. Johnson DB, Taira RK, et al: Hyperad: augmenting and visualizing free text radiology reports. Radiographics 18:507–515, 1998

    PubMed  CAS  Google Scholar 

  17. Cohen J: A coefficient of agreement for nominal scales. Educational and Psychological Measurement 20:37–46, 1960

    Article  Google Scholar 

  18. Jain NL, Knirsch CA, et al: Identification of suspected tuberculosis patients based on natural language processing of chest radiograph reports. AMIA Annual Symposium, pp. 542–6, 1996

  19. Chapman WW, Savova GK, et al: Characteristics of Anaphoric Reference in Clinical Reports. AMIA Annual Symposium, pp. 1007, 2010

  20. Feldman R, Sanger J: The Text Mining Handbook: Advanced Approaches in Analyzing Unstructured Data. Cambridge University Press, Cambridge, 2006

    Book  Google Scholar 

  21. Savova GK, Chapman WW, Zheng J, et al: Anaphoric relations in the clinical narrative: corpus creation. J Am Med Inform Assoc 18:459–465, 2011

    Article  PubMed  Google Scholar 

  22. Aronson AR, Lang FM: An overview of MetaMap: historical perspective and recent advances. J Am Med Inform Assoc 17:229–236, 2010

    PubMed  Google Scholar 

  23. Hripcsak G, Friedman C, et al: Unlocking clinical data from narrative reports: a study of natural language processing. Ann Intern Med 122:681–688, 1995

    PubMed  CAS  Google Scholar 

Download references

Acknowledgments

The authors gratefully acknowledge Marco Janssen for creating the benchmark annotation and the reviewers for their excellent comments and suggestions, which improved the paper considerably.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Merlijn Sevenster.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Sevenster, M., van Ommering, R. & Qian, Y. Automatically Correlating Clinical Findings and Body Locations in Radiology Reports Using MedLEE. J Digit Imaging 25, 240–249 (2012). https://doi.org/10.1007/s10278-011-9411-0

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10278-011-9411-0

Keywords

Navigation