Skip to main content
SpringerLink
Log in

Unsupervised Topic Modeling in a Large Free Text Radiology Report Repository

  • Published:
Journal of Digital Imaging Aims and scope Submit manuscript

Abstract

Radiology report narrative contains a large amount of information about the patient’s health and the radiologist’s interpretation of medical findings. Most of this critical information is entered in free text format, even when structured radiology report templates are used. The radiology report narrative varies in use of terminology and language among different radiologists and organizations. The free text format and the subtlety and variations of natural language hinder the extraction of reusable information from radiology reports for decision support, quality improvement, and biomedical research. Therefore, as the first step to organize and extract the information content in a large multi-institutional free text radiology report repository, we have designed and developed an unsupervised machine learning approach to capture the main concepts in a radiology report repository and partition the reports based on their main foci. In this approach, radiology reports are modeled in a vector space and compared to each other through a cosine similarity measure. This similarity is used to cluster radiology reports and identify the repository’s underlying topics. We applied our approach on a repository of 1,899,482 radiology reports from three major healthcare organizations. Our method identified 19 major radiology report topics in the repository and clustered the reports accordingly to these topics. Our results are verified by a domain expert radiologist and successfully explain the repository’s primary topics and extract the corresponding reports. The results of our system provide a target-based corpus and framework for information extraction and retrieval systems for radiology reports.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Sobel JL, Pearson ML, Gross K, Desmond KA, Harrison ER, Rubenstein LV, Rogers WH, Kahn KL: Information content and clarity of radiologists’ reports for chest radiography. Acad Radiol 3(9):709–17, 1996

    Article  CAS  PubMed  Google Scholar 

  2. Khorasani R, Bates DW, Teeger S, Rothschild JM, Adams DF, Seltzer SE: Is terminology used effectively to convey diagnostic certainty in radiology reports? Acad Radiol 10(6):685–8, 2003

    Article  PubMed  Google Scholar 

  3. Dreyer KJ, Kalra MK, Maher MM, Hurier AM, Asfaw BA, Schultz T, Halpern EF, Thrall JH: Application of recently developed computer algorithm for automatic classification of unstructured radiology reports: validation study. Radiology 234(2):323–9, 2005

    Article  PubMed  Google Scholar 

  4. Dreyer KJ: Information theory entropy reduction program. U.S. Patent 8,756,234, 2014

    Google Scholar 

  5. Yetisgen-Yildiz M, Gunn ML, Xia F, Payne TH: A text processing pipeline to extract recommendations from radiology reports. J Biomed Inform 46(2):354–62, 2013

    Article  PubMed  Google Scholar 

  6. Friedman C, Hripcsak G, DuMouchel W, Johnson SB, Clayton PD: Natural language processing in an operational clinical information system. Nat Lang Eng 1(01):83–108, 1995

    Article  Google Scholar 

  7. Hripcsak G, Austin JHM, Alderson PO, Friedman C: Use of natural language processing to translate clinical information from a database of 889,921 chest radiographic reports. Radiology 224(1):157–63, 2002

    Article  PubMed  Google Scholar 

  8. Hripcsak G, Kuperman GJ, Friedman C, Heitjan DF: A reliability study for evaluating information extraction from radiology reports. J Am Med Informatics Assoc 6(2):143–50, 1999

    Article  CAS  Google Scholar 

  9. Elkins JS, Friedman C, Boden-Albala B, Sacco RL, Hripcsak G: Coding neuroradiology reports for the Northern Manhattan Stroke Study: a comparison of natural language processing and manual review. Comput Biomed Res 33(1):1–10, 2000

    Article  CAS  PubMed  Google Scholar 

  10. Johnson DB, Taira RK, Cardenas AF, Aberle DR: Extracting information from free text radiology reports. Int J Digit Libr 1(3):297–308, 1997

    Article  Google Scholar 

  11. Savova GK, Masanz JJ, Ogren PV, Zheng J, Sohn S, Kipper-Schuler KC, Chute CG: Mayo clinical Text Analysis and Knowledge Extraction System (cTAKES): architecture, component evaluation and applications. J Am Med Informatics Assoc 17(5):507–13, 2010

    Article  Google Scholar 

  12. Goryachev S, Sordo M, Zeng QT: A suite of natural language processing tools developed for the I2B2 project. In: AMIA Annual Symposium Proceedings, 2006, p 931

    Google Scholar 

  13. Aronson AR: Effective mapping of biomedical text to the UMLS Metathesaurus: the MetaMap program. In: Proceedings of the AMIA Symposium, 2001, p 17

    Google Scholar 

  14. Taira RK, Soderland SG: A statistical natural language processor for medical reports. In: Proceedings of the AMIA Symposium, 1999, p 970

    Google Scholar 

  15. Taira RK, Soderland SG, Jakobovits RM: Automatic structuring of radiology free-text reports. Radiographics 21(1):237–45, 2001

    Article  CAS  PubMed  Google Scholar 

  16. Haug P, Koehler S, Lau LM, Wang P, Rocha R, Huff S: A natural language understanding system combining syntactic and semantic techniques. In: Proceedings of the Annual Symposium on Computer Application in Medical Care, 1994, p 247

    Google Scholar 

  17. Haug PJ, Koehler S, Lau LM, Wang P, Rocha R, Huff SM: Experience with a mixed semantic/syntactic parser. In: Proceedings of the Annual Symposium on Computer Application in Medical Care, 1995, p 284

    Google Scholar 

  18. Christensen LM, Haug PJ, Fiszman M: MPLUS: a probabilistic medical language understanding system. In: Proceedings of the ACL-02 workshop on Natural language processing in the biomedical domain, vol. 3, 2002, pp 29–36

    Chapter  Google Scholar 

  19. Friedman C, Rindflesch TC, Corn M: Natural language processing: state of the art and prospects for significant progress, a workshop sponsored by the National Library of Medicine. J Biomed Inform 46(5):765–773, 2013

    Article  PubMed  Google Scholar 

  20. Apache Mahout. Available at http://mahout.apache.org. Accessed 24 March 2015

  21. Apache Hadoop. Available at https://hadoop.apache.org. Accessed 24 March 2015

  22. Dean J, Ghemawat S: MapReduce: simplified data processing on large clusters. Commun ACM 51(1):107–13, 2008

    Article  Google Scholar 

  23. Manning CD, Raghavan P, Schutze H: Scoring, term weighting, and the vector space model. Introduction to Information Retrieval. Cambridge University Press, New York, NY, USA, 2008, p 100

    Book  Google Scholar 

  24. Kaufman L, Rousseeuw PJ: Finding groups in data: an introduction to cluster analysis. John Wiley & Sons, New York, 2009

    Google Scholar 

  25. Lloyd S: Least squares quantization in PCM. Inf Theory, IEEE Trans 28(2):129–37, 1982

    Article  Google Scholar 

  26. Singhal A: Modern information retrieval: A brief overview. IEEE Data Eng Bull 24(4):35–43, 2001

    Google Scholar 

Download references

Acknowledgments

The authors would like to thank Chuck Kahn, Kevin McEnery, and Brad Erickson for their work on compiling RadCore database and Daniel Rubin for his contribution to RadCore and providing access to this database.

Author information

Authors and Affiliations

  1. Department of Radiology, Stanford University, 300 Pasteur Drive, Stanford, CA, 94305, USA

    Saeed Hassanpour & Curtis P. Langlotz

Authors
  1. Saeed Hassanpour
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Curtis P. Langlotz
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Saeed Hassanpour.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Hassanpour, S., Langlotz, C.P. Unsupervised Topic Modeling in a Large Free Text Radiology Report Repository. J Digit Imaging 29, 59–62 (2016). https://doi.org/10.1007/s10278-015-9823-3

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10278-015-9823-3

Keywords

Search

Navigation