Journal of Digital Imaging

, Volume 29, Issue 1, pp 59–62 | Cite as

Unsupervised Topic Modeling in a Large Free Text Radiology Report Repository

  • Saeed HassanpourEmail author
  • Curtis P. Langlotz


Radiology report narrative contains a large amount of information about the patient’s health and the radiologist’s interpretation of medical findings. Most of this critical information is entered in free text format, even when structured radiology report templates are used. The radiology report narrative varies in use of terminology and language among different radiologists and organizations. The free text format and the subtlety and variations of natural language hinder the extraction of reusable information from radiology reports for decision support, quality improvement, and biomedical research. Therefore, as the first step to organize and extract the information content in a large multi-institutional free text radiology report repository, we have designed and developed an unsupervised machine learning approach to capture the main concepts in a radiology report repository and partition the reports based on their main foci. In this approach, radiology reports are modeled in a vector space and compared to each other through a cosine similarity measure. This similarity is used to cluster radiology reports and identify the repository’s underlying topics. We applied our approach on a repository of 1,899,482 radiology reports from three major healthcare organizations. Our method identified 19 major radiology report topics in the repository and clustered the reports accordingly to these topics. Our results are verified by a domain expert radiologist and successfully explain the repository’s primary topics and extract the corresponding reports. The results of our system provide a target-based corpus and framework for information extraction and retrieval systems for radiology reports.


Topic modeling Radiology report narrative Clustering Text mining Natural language processing 



The authors would like to thank Chuck Kahn, Kevin McEnery, and Brad Erickson for their work on compiling RadCore database and Daniel Rubin for his contribution to RadCore and providing access to this database.


  1. 1.
    Sobel JL, Pearson ML, Gross K, Desmond KA, Harrison ER, Rubenstein LV, Rogers WH, Kahn KL: Information content and clarity of radiologists’ reports for chest radiography. Acad Radiol 3(9):709–17, 1996CrossRefPubMedGoogle Scholar
  2. 2.
    Khorasani R, Bates DW, Teeger S, Rothschild JM, Adams DF, Seltzer SE: Is terminology used effectively to convey diagnostic certainty in radiology reports? Acad Radiol 10(6):685–8, 2003CrossRefPubMedGoogle Scholar
  3. 3.
    Dreyer KJ, Kalra MK, Maher MM, Hurier AM, Asfaw BA, Schultz T, Halpern EF, Thrall JH: Application of recently developed computer algorithm for automatic classification of unstructured radiology reports: validation study. Radiology 234(2):323–9, 2005CrossRefPubMedGoogle Scholar
  4. 4.
    Dreyer KJ: Information theory entropy reduction program. U.S. Patent 8,756,234, 2014Google Scholar
  5. 5.
    Yetisgen-Yildiz M, Gunn ML, Xia F, Payne TH: A text processing pipeline to extract recommendations from radiology reports. J Biomed Inform 46(2):354–62, 2013CrossRefPubMedGoogle Scholar
  6. 6.
    Friedman C, Hripcsak G, DuMouchel W, Johnson SB, Clayton PD: Natural language processing in an operational clinical information system. Nat Lang Eng 1(01):83–108, 1995CrossRefGoogle Scholar
  7. 7.
    Hripcsak G, Austin JHM, Alderson PO, Friedman C: Use of natural language processing to translate clinical information from a database of 889,921 chest radiographic reports. Radiology 224(1):157–63, 2002CrossRefPubMedGoogle Scholar
  8. 8.
    Hripcsak G, Kuperman GJ, Friedman C, Heitjan DF: A reliability study for evaluating information extraction from radiology reports. J Am Med Informatics Assoc 6(2):143–50, 1999CrossRefGoogle Scholar
  9. 9.
    Elkins JS, Friedman C, Boden-Albala B, Sacco RL, Hripcsak G: Coding neuroradiology reports for the Northern Manhattan Stroke Study: a comparison of natural language processing and manual review. Comput Biomed Res 33(1):1–10, 2000CrossRefPubMedGoogle Scholar
  10. 10.
    Johnson DB, Taira RK, Cardenas AF, Aberle DR: Extracting information from free text radiology reports. Int J Digit Libr 1(3):297–308, 1997CrossRefGoogle Scholar
  11. 11.
    Savova GK, Masanz JJ, Ogren PV, Zheng J, Sohn S, Kipper-Schuler KC, Chute CG: Mayo clinical Text Analysis and Knowledge Extraction System (cTAKES): architecture, component evaluation and applications. J Am Med Informatics Assoc 17(5):507–13, 2010CrossRefGoogle Scholar
  12. 12.
    Goryachev S, Sordo M, Zeng QT: A suite of natural language processing tools developed for the I2B2 project. In: AMIA Annual Symposium Proceedings, 2006, p 931Google Scholar
  13. 13.
    Aronson AR: Effective mapping of biomedical text to the UMLS Metathesaurus: the MetaMap program. In: Proceedings of the AMIA Symposium, 2001, p 17Google Scholar
  14. 14.
    Taira RK, Soderland SG: A statistical natural language processor for medical reports. In: Proceedings of the AMIA Symposium, 1999, p 970Google Scholar
  15. 15.
    Taira RK, Soderland SG, Jakobovits RM: Automatic structuring of radiology free-text reports. Radiographics 21(1):237–45, 2001CrossRefPubMedGoogle Scholar
  16. 16.
    Haug P, Koehler S, Lau LM, Wang P, Rocha R, Huff S: A natural language understanding system combining syntactic and semantic techniques. In: Proceedings of the Annual Symposium on Computer Application in Medical Care, 1994, p 247Google Scholar
  17. 17.
    Haug PJ, Koehler S, Lau LM, Wang P, Rocha R, Huff SM: Experience with a mixed semantic/syntactic parser. In: Proceedings of the Annual Symposium on Computer Application in Medical Care, 1995, p 284Google Scholar
  18. 18.
    Christensen LM, Haug PJ, Fiszman M: MPLUS: a probabilistic medical language understanding system. In: Proceedings of the ACL-02 workshop on Natural language processing in the biomedical domain, vol. 3, 2002, pp 29–36CrossRefGoogle Scholar
  19. 19.
    Friedman C, Rindflesch TC, Corn M: Natural language processing: state of the art and prospects for significant progress, a workshop sponsored by the National Library of Medicine. J Biomed Inform 46(5):765–773, 2013CrossRefPubMedGoogle Scholar
  20. 20.
    Apache Mahout. Available at Accessed 24 March 2015
  21. 21.
    Apache Hadoop. Available at Accessed 24 March 2015
  22. 22.
    Dean J, Ghemawat S: MapReduce: simplified data processing on large clusters. Commun ACM 51(1):107–13, 2008CrossRefGoogle Scholar
  23. 23.
    Manning CD, Raghavan P, Schutze H: Scoring, term weighting, and the vector space model. Introduction to Information Retrieval. Cambridge University Press, New York, NY, USA, 2008, p 100CrossRefGoogle Scholar
  24. 24.
    Kaufman L, Rousseeuw PJ: Finding groups in data: an introduction to cluster analysis. John Wiley & Sons, New York, 2009Google Scholar
  25. 25.
    Lloyd S: Least squares quantization in PCM. Inf Theory, IEEE Trans 28(2):129–37, 1982CrossRefGoogle Scholar
  26. 26.
    Singhal A: Modern information retrieval: A brief overview. IEEE Data Eng Bull 24(4):35–43, 2001Google Scholar

Copyright information

© Society for Imaging Informatics in Medicine 2015

Authors and Affiliations

  1. 1.Department of RadiologyStanford UniversityStanfordUSA

Personalised recommendations