ETL Framework for Real-Time Business Intelligence over Medical Imaging Repositories
In the last decades, the amount of medical imaging studies and associated metadata has been rapidly increasing. Despite being mostly used for supporting medical diagnosis and treatment, many recent initiatives claim the use of medical imaging studies in clinical research scenarios but also to improve the business practices of medical institutions. However, the continuous production of medical imaging studies coupled with the tremendous amount of associated data, makes the real-time analysis of medical imaging repositories difficult using conventional tools and methodologies. Those archives contain not only the image data itself but also a wide range of valuable metadata describing all the stakeholders involved in the examination. The exploration of such technologies will increase the efficiency and quality of medical practice. In major centers, it represents a big data scenario where Business Intelligence (BI) and Data Analytics (DA) are rare and implemented through data warehousing approaches. This article proposes an Extract, Transform, Load (ETL) framework for medical imaging repositories able to feed, in real-time, a developed BI (Business Intelligence) application. The solution was designed to provide the necessary environment for leading research on top of live institutional repositories without requesting the creation of a data warehouse. It features an extensible dashboard with customizable charts and reports, with an intuitive web-based interface that empowers the usage of novel data mining techniques, namely, a variety of data cleansing tools, filters, and clustering functions. Therefore, the user is not required to master the programming skills commonly needed for data analysts and scientists, such as Python and R.
KeywordsPACS Business Intelligence DICOM Data Analytics Cloud Big data
Tiago Marques Godinho is funded by Fundação para a Ciência e Tecnologia (FCT) under grant agreement SFRH/BD/104647/2014. Rui Lebre received support by the Integrated Programme of SR&TD “SOCA” (Ref.CENTRO-01-0145-FEDER-000010), co-funded by Centro 2020 program, Portugal 2020, European Union, through the European Regional Development Fund. This work has received support from the ERDF European Regional Development Fund through the Operational Programme for Competitiveness and Internationalization, COMPETE 2020 Programme, and by National Funds through the FCT, Fundação para a Ciência e a Tecnologia within the project PTDC/EEI-ESS/6815/2014.
- 1.Hamilton B: Big data is the future of healthcare. Teaneck: Cognizant, 2012Google Scholar
- 3.Santos M, Bastiao L, Costa C, Silva A, Rocha N: “Clinical Data Mining in Small Hospital PACS: Contributions for Radiology Department Improvement,” in Information Systems and Technologies for Enhancing Health and Social Care. Hershey: IGI Global, 2013, pp. 236–251Google Scholar
- 5.Digital Imaging and Communications in Medicine (DICOM) Part 3: Information object definitions, NEMA, Standard, 2017.Google Scholar
- 6.Digital Imaging and Communications in Medicine (DICOM) Part 7: Message Exchange, NEMA, Standard, 2017.Google Scholar
- 7.Pianykh OS: Digital Imaging and Communications in Medicine (DICOM): a practical introduction and survival guide, Vol. 26. Berlin: Springer Science & Business Media, 2009, 424 ppGoogle Scholar
- 8.Wang S, Pavlicek W, Roberts CC, Langer SG, Zhang M, Hu M, Morin RL, Schueler BA, Wellnitz CV, Wu T: An automated DICOM database capable of arbitrary data mining (including radiation dose indicators) for quality monitoring. J Digit Imaging 24(2):223–233, 2011. https://doi.org/10.1007/s10278-010-9329-y CrossRefPubMedGoogle Scholar
- 20.Valente F, Silva LAB, Godinho TM, Costa C: Anatomy of an extensible open source PACS. J Digit Imaging, 2015. https://doi.org/10.1007/s10278-015-9834-0
- 22.Bastiao L, Santos M, Costa C, Silva A, Rocha N: Dicoogle statistics: Analyzing efficiency and service quality of digital imaging laboratories. Heildelberg: Springer, 2013Google Scholar
- 23.Santos M, Bastiao L, Costa C, Silva A, Rocha N: Dicom and clinical data mining in a small hospital pacs: A pilot study. In: International Conference on ENTERprise Information Systems. Berlin: Springer, 2011, pp. 254–263Google Scholar