Abstract
In this paper, we describe and evaluate a system that extracts clinical findings and body locations from radiology reports and correlates them. The system uses Medical Language Extraction and Encoding System (MedLEE) to map the reports’ free text to structured semantic representations of their content. A lightweight reasoning engine extracts the clinical findings and body locations from MedLEE’s semantic representation and correlates them. Our study is illustrative for research in which existing natural language processing software is embedded in a larger system. We manually created a standard reference based on a corpus of neuro and breast radiology reports. The standard reference was used to evaluate the precision and recall of the proposed system and its modules. Our results indicate that the precision of our system is considerably better than its recall (82.32–91.37% vs. 35.67–45.91%). We conducted an error analysis and discuss here the practical usability of the system given its recall and precision performance.
References
Reiner BI: The challenges, opportunities, and imperative of structured reporting in medical imaging. J Digit Imaging 22:562–568, 2009
Reiner BI: Uncovering and improving upon the inherent deficiencies of radiology reporting through data mining. J Digit Imaging 23:109–118, 2010
Reiner BI: Customization of medical report data. J Digit Imaging 23:363–373, 2010
American College of Radiology: Breast Imaging Reporting and Data System Atlas. American College of Radiology, Reston, 2003
Dunnick NR, Langlotz CP: The radiology report of the future: a summary of the 2007 Intersociety Conference. J Am Coll Radiol 5:626–629, 2008
Weiss DL, Langlotz CP: Structured reporting: patient care enhancement or productivity nightmare? Radiology 249:739–747, 2008
Friedman C, Alderson PO, et al: A general natural-language text processor for clinical radiology. J Am Med Inform Assoc 1:161–174, 1994
Friedman C, Hripcsak G, et al: Representing information in patient reports using natural language processing and the extensible markup language. J Am Med Inform Assoc 6:76–87, 1999
Savova GK, Masanz JJ, et al: Mayo clinical Text Analysis and Knowledge Extraction System (cTAKES): architecture, component evaluation and applications. J Am Med Inform Assoc 17:507–513, 2010
Hripcsak G, Austin JHM, et al: Use of natural language processing to translate clinical information from a database of 889,921 chest radiographic reports. Radiology 224:157–163, 2002
Melton GB, Hripcsak G: Automated detection of adverse events using natural language processing of discharge summaries. J Am Med Inform Assoc 12:448–457, 2005
Chen ES, Hripcsak G, et al: Automated acquisition of disease drug knowledge from biomedical and clinical documents: an initial study. J Am Med Inform Assoc 15:87–98, 2008
McCormick PJ, Elhadad N, et al: Use of semantic features to classify patient smoking status. AMIA Annual Symposium, pp. 450–454, 2008
Sevenster M, van Ommering R, Qian Y: Bridging the text-image gap: a decision support tool for real-time PACS browsing. J Digit Imaging doi:10.1007/s10278-011-9414-x, in press
Sinha U, Dai B, et al: Interactive software for generation and visualization of structured findings in radiology reports. AJR Am J Roentgenol 175:609–612, 2000
Johnson DB, Taira RK, et al: Hyperad: augmenting and visualizing free text radiology reports. Radiographics 18:507–515, 1998
Cohen J: A coefficient of agreement for nominal scales. Educational and Psychological Measurement 20:37–46, 1960
Jain NL, Knirsch CA, et al: Identification of suspected tuberculosis patients based on natural language processing of chest radiograph reports. AMIA Annual Symposium, pp. 542–6, 1996
Chapman WW, Savova GK, et al: Characteristics of Anaphoric Reference in Clinical Reports. AMIA Annual Symposium, pp. 1007, 2010
Feldman R, Sanger J: The Text Mining Handbook: Advanced Approaches in Analyzing Unstructured Data. Cambridge University Press, Cambridge, 2006
Savova GK, Chapman WW, Zheng J, et al: Anaphoric relations in the clinical narrative: corpus creation. J Am Med Inform Assoc 18:459–465, 2011
Aronson AR, Lang FM: An overview of MetaMap: historical perspective and recent advances. J Am Med Inform Assoc 17:229–236, 2010
Hripcsak G, Friedman C, et al: Unlocking clinical data from narrative reports: a study of natural language processing. Ann Intern Med 122:681–688, 1995
Acknowledgments
The authors gratefully acknowledge Marco Janssen for creating the benchmark annotation and the reviewers for their excellent comments and suggestions, which improved the paper considerably.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Sevenster, M., van Ommering, R. & Qian, Y. Automatically Correlating Clinical Findings and Body Locations in Radiology Reports Using MedLEE. J Digit Imaging 25, 240–249 (2012). https://doi.org/10.1007/s10278-011-9411-0
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10278-011-9411-0