Abstract
Integrating the information coming from biological samples with digital data, such as medical images, has gained prominence with the advent of precision medicine. Research in this field faces an ever-increasing amount of data to manage and, as a consequence, the need to structure these data in a functional and standardized fashion to promote and facilitate cooperation among institutions. Inspired by the Minimum Information About BIobank data Sharing (MIABIS), we propose an extended data model which aims to standardize data collections where both biological and digital samples are involved. In the proposed model, strong emphasis is given to the cause-effect relationships among factors as these are frequently encountered in clinical workflows. To test the data model in a realistic context, we consider the Continuous Observation of SMOking Subjects (COSMOS) dataset as case study, consisting of 10 consecutive years of lung cancer screening and follow-up on more than 5000 subjects. The structure of the COSMOS database, implemented to facilitate the process of data retrieval, is therefore presented along with a description of data that we hope to share in a public repository for lung cancer screening research.
Similar content being viewed by others
Explore related subjects
Find the latest articles, discoveries, and news in related topics.Avoid common mistakes on your manuscript.
Introduction
The term “biomarker” [1, 2] has become a central concept in the era of precision medicine, with a broad definition encompassing information from molecular, histologic or physiologic characteristics, as well as quantitative parameters extracted from medical imaging. In large part however, these fields have evolved independently leading to heterogeneity of data and isolation of datasets. Integrating so-called -omics data across types and sources in order to facilitate clinical trials [3, 4] and support discovery and validation of findings, argues strongly for the establishment of structured repositories.
Progress has been made in the area of non-digital biological samples through initiatives such as the BBMRI-ERIC (“Biobanking and BioMolecular Re-sources Research Infrastructure-European Research Infra- structure Consortium”) dedicated to support European biobanks [5]. BBMRI-ERIC have created guidelines to facilitate biological data exchange among institutions, which have resulted in the Minimum Information About BIobank data Sharing (MIABIS) [6]. In its most recent extension, MIABIS generalizes the concept of biobanks to provide recommendations on how to describe a wider range of datasets in terms of the nature of the samples, the sample donors, scientific research on samples, and the associated data [7]. These recommendations cover a wide range of fields, distinguishing MIABIS from other more focus-specific initiatives such as the International Classification of Disease for Oncology [8], which proposed an ontology of oncologic pathologies, or the Systematized Nomenclature of Medicine Clinical Terms (SNOMED CT) [9], which is aimed at standardizing clinical terms to report findings, symptoms, diagnoses and procedures. These initiatives tend to focus on a lower-level description of the data with respect to the general view provided by the MIABIS data model. In addition, MIABIS is moving to accommodate the concept of digital biological imaging samples and data-driven biobanks, according to the need for data integration in structured repositories.
In parallel with the growing use of biological and clinical imaging is their quantitative analysis via computer assisted diagnosis (CAD) systems exploiting radiomics [10, 11] and artificial intelligence (AI) [12] approaches to support time-consuming and error-prone research and clinical procedures [13, 14]. A critical component in developing applications based on these new technologies is the availability of labelled data in sufficiently large cohorts to identify and validate correlations between radiological imaging and the pathological substrate or patient prognosis [15, 16]. In this context, a small number of public imaging archives have been established to allow sharing imaging data among institutions [17], that are often used to externally validate derived imaging biomarkers.
Data sharing, therefore, has a fundamental role in advancing both research and clinical analyses [18,19,20]. Apart from some indications reported by Castro et al. [16] and Finke et al. [21] however, there are limited guidelines in the literature [21] on documenting imaging acquisitions and associating images to other clinical information. Thus, the possible definition of queries remains limited, and the transition between datasets is not straightforward. These limits on sharing data are even more evident when dealing with large datasets where thousands of images are collected, such as the case of lung cancer screening studies [22]. With lung cancer being one of the leading causes of cancer-related death, multiple institutions have carried out screening programs [23,24,25] based on low-dose Computerized Tomography (LDCT) to understand the potential of the prevention program, and subsequently define strategies for pulmonary nodule management. Among the different lung cancer screening programs, the Continuous observation of SMOking Subjects (COSMOS) study conducted at the European Institute of Oncology (IEO, Milano, Italy) is one of the largest for number of patients involved (> 5000) and length of follow-up period (10 years)[26].
In this work, we propose an extension of the MIABIS to digital imaging samples with the aim to integrate heterogeneous data, such as biological samples and digital imaging samples, in a structured database in favour of multicentric studies in precision medicine. To demonstrate the feasibility of this extension, we adopted the COSMOS lung cancer screening program as a case study, where radiological imaging and biological findings were collected. The structured database designed, here connects longitudinal LDCT imaging data to lesion-specific radiological features as well as to pathological results coming from non-digital biological samples. Following a general overview of the COSMOS database, the implementation of the proposed extension of MIABIS is put forward as a model for similar image-based datasets to foster research studies on lung cancer management.
Materials and Methods
The proposed extension of MIABIS data model to digital imaging samples was defined through clarifications on pre-existing MIABIS relationships but especially reducing the minimum list of attributes needed to describe a Sample component. This allows for a generalizable Sample component to non-digital biological samples and digital imaging samples of different nature (e.g., biological imaging samples and/or radiological imaging samples). Implication and Sub-event components are also introduced as solutions to connect heterogeneous data. The extended data model was then applied to the COSMOS study.
MIABIS Extension to Digital Imaging Samples
The extension of MIABIS proposed in this section retains the definitions of Sample, Sample Donor and Event given by Eklund N. (2020), which are the fundamental components considered by MIABIS:
-
Sample Donor is a person who is a source of either a biological material or a digital representation of a biological entity such as an image.
-
A Sample is a portion or quantity of biological material that is collected from a Sample Donor, or which is a digital representation of a biological entity of the Sample Donor, such as an image.
-
An Event is something that happens in a given place and time and is related to the Sample and/or Sample Donor.
The link between Sample and Event is defined through an explicit connection represented as:
-
a \(\mathrm{many}-\mathrm{zero}\) (Sample – Event) relation or,
-
a \(\mathrm{one}-\mathrm{zero}\) (Sample -Event) relation.
since multiple samples can be acquired through the same event and, consistent with the above definition of Event (“and/or”), the existence of an event can also be independent from a sample and a Sample may or may not be associated with an Event.
With respect to the original attributes associated to MIABIS data model components, a change introduced for the extension of the MIABIS data model, was to reduce the number of attributes of the Sample component, making it generalizable to both non-digital biological and digital imaging samples. To make feasible the inclusion of radiological imaging samples, we removed attributes that were relevant exclusively to biological samples (e.g. the storage temperature). Such modality-specific attributes of samples can be contained in characteristics of specific sample variants (Fig. 1).
Two components were also introduced in the extension, specifically the Implication and the Sub-event components, defined respectively as follows:
-
An Implication is a supportive component, which connects Events that are linked by a cause-effect relationship; this component indicates the presence of two Events where the first has a causal function towards the second Event, i.e. the Event is an effect.
-
A Sub-event is an event that can be considered as part or product of a parent Event.
As both, Implications and Sub-events, depend on the Event component, the proposed extension of MIABIS impacts most on the place of events in the data model. Specifically, Events and Implications can be linked through.
-
a \(\mathrm{many}-\mathrm{one}\) (Event-Implication) relation or,
-
a \(\mathrm{many}-\mathrm{zero}\) (Event-Implication) relation
since the presence of an Implication has to assume the existence of at least one causal and one effect Event, but an Event can also not be associated to an Implication (an Event has not necessarily the property of being a cause or an effect).
As a generic example of the extended MIABIS data model, Fig. 1 illustrates two Sample components that are members of a biological (red) and digital imaging (blue) collection (Example A), respectively. Similarly, a connection between two Events mediated by an Implication is shown (Example B subfigure), wherein the Imaging Analysis Event (e.g. suspicion of disease based on the evidence of a radiological digital image) represents the cause that motivates the Biological Sample Event as effect (e.g. a more advanced clinical investigation).
COSMOS as Case Study
The COSMOS Study Protocol
Between 2004 and 2015 a total of 5206 patients were recruited for the Continuous Observation of SMOking Subjects (COSMOS) non-randomized Lung Cancer Screening Study carried out at the European Institute of Oncology (IEO). The local ethical committee approved the study, and all participants provided signed informed consent for the study. The volunteers underwent annual LDCT scan for ten years [25, 26]. Eligibility criteria were to be at high risk of lung cancer occurrence: current or former heavy smokers (> = 20 pack years), and to be at least 50 years of age. The management of indeterminate pulmonary nodules through non-invasive procedures was one of the major aims of the protocol tested during the COSMOS study. Specifically, pulmonary nodules in the range 5–8 mm were scheduled to repeat LDCT after 3 or 6 months, whereas lesions above 8 mm or fast-growing lesions (i.e. volume doubling time between 30 and 400 days) were scheduled for a combined CT- positron emission tomography (CT-PET). Lesions with high probability of malignancy according to PET or growth rate, were further analysed through biopsies or other invasive procedures which, according to the adopted protocol, were minimized in favour of further diagnostic imaging acquisitions. In this study, only the LDCT images were incorporated as imaging samples into the structured database along with events of biological sampling, because the latter were collected without any form of digitalization.
Description of Deidentification and Annotation Collection Procedure
Prior to creation of the imaging repository with the extended MIABIS structure, radiological LDCT data were subjected to “pseudonymization” according to the European general data protection regulation (GDPR) [27], to facilitate research use within our institution and in collaboration with other institutions [28]. The LDCT scans were transferred from the hospital PACS (Picture Archiving and Communication System), into an Orthanc PACS [29]. Inside the Orthanc PACS a de-identification procedure was applied creating for each image an instance pseudonymized copy. Specifically, the institutional patient ID as well as the patient’s name were replaced with a pseudonym specific to the subject; the date of birth was indirectly masked including a patient age range while private tags were removed. Screenshots, dose reports and other DICOM files containing "burned-in" data were removed from the dataset. The entire procedure was managed through a python script.
The pseudonymized images were exported to patient-specific folders separated into subfolders for each study date, and sub-subfolders specific for each DICOM series. Each series was therefore associated with a specific path, which was then recorded into the structured database, along with the related DICOM fields as an instance of the table related to digital sample collection.
As the segmentation of the lesion is necessary for many analyses and for validation of CAD systems, we considered the availability and storage of labelled data fundamental in the creation of the repository. Once exams exportation was finalized, for annotation of lung nodules, a customized GUI was used for semi-automatic lesion segmentation with the possibility of a manual adjustment of the contour [30]. Each segmentation was stored as a DICOM structured reporting (DICOM-SR) file which allows encoding measurements referred to in the region of interest as well as information related to the DICOM series used to create the contours, where the latter are defined through a DICOM segmentation object (DICOM-SEG) linked to the DICOM-SR [31]. The DICOM-SR files were created taking advantage of an open source library implemented to store post-processed information of lesions (i.e. texture information) as DICOM tags [32]. As for the DICOM series, tags of the DICOM-SR were mapped in the structured database as attributes of the Sub-event.
COSMOS Structured Database Architecture
The structured database for the COSMOS data was defined following the proposed extension of the MIABIS data model reported in “MIABIS Extension to Digital Imaging Samples”. The simplified relational diagram shown in Fig. 2 gives an overview of the relations among Sample Donors, Samples and Events for the COSMOS case study.
Two sample collections were defined: a Biological Sample Collection, which includes non-digital biological samples acquired through invasive procedures, and an Imaging Sample Collection consisting of LDCT scans. The two collections share the Sample Donor (Table S9, Supplementary Material, section A) from the patients recruited for the COSMOS study.
In defining the samples in the Imaging Sample Collection, we adopted the DICOM Series Sample, built upon the DICOM format [33], which is the international standard to transmit, store, retrieve, print, process, and display medical imaging information; as such, most of the well-defined DICOM fields were considered as attributes to define the imaging sample component (Table S1, supplementary materials, section A).
For the COSMOS case study, two events were directly connected to the DICOM Series Sample:
-
the Image Acquisition Event (Table S2, supplementary materials, section A), which holds the information needed to contextualize the radiological imaging sample into the medical history of the Sample Donor, e.g. whether the acquisition is the first (“baseline”) of the longitudinal series or if it is located at a subsequent time-point (“routine or monitoring follow-up”).
-
the Imaging Analysis Event, which represents the products derived from the radiological imaging sample, consisting of clinical findings or reports as well as digital data obtained by processing the imaging sample. Products of the same category were grouped into the same Sub-event of the Imaging Analysis Event. Specifically, the following three Sub-events were defined as products of the Imaging Analysis Event:
-
the Pulmonary Nodule Identification Sub-event (Table S3, supplementary materials, section A), to collect radiological findings specific for pulmonary nodules. For this Sub-event, attributes were established according to Lung-RADS [34], i.e. clinical guidelines defined by the American College of Radiology (ACR) to manage indeterminate pulmonary nodules. Additional attributes were included to allow localizing the referenced lesion, i.e. the Lesion coordinates considering the patient position as reference frame.
-
the Other Finding Identification Sub-event (Table S4, supplementary materials, section A), to include radiological findings that cannot be categorized as pulmonary nodules. This component contributed to documenting the presence of inflammatory conditions such as densifications, emphysema, lymph nodes abnormalities or others collateral pathological conditions.
-
The Post-processing Sub-event (Table S5, supplementary materials, section A), to describe a specific anatomical part whose contours are defined by a DICOM-SEG object. The attributes of this Sub-event, are mapped to a structured report file (DICOM-SR).
-
As per the schema in Fig. 2, an Image Acquisition Event, can be an effect of two different Implications represented by the following causal Events, respectively: the Recruitment Event, which holds information related to the eligibility of the Sample Donor into the COSMOS study (Table S11, supplementary materials, section A), or an Imaging Analysis Event, defined above. When connected only to the Recruitment Event, an Image Acquisition Event is simply due to the adopted protocol (baseline LDCT exam or routine annual follow-up) in case of no suspected clinical findings in an earlier Imaging Analysis Event. Conversely, due to the protocol rules that suspected clinical findings lead to additional medical imaging investigations (monitoring follow-up), in this case an Imaging Analysis Event is the causal event that leads via an Implication to an Image Acquisition Event.
A suspected clinical finding in an Imaging Analysis Event can also form the causal event of an Implication that leads to a Biological Sampling Event with resulting Biological Sample. The particulars of the Biological Sampling Event, includes attributes related to the invasive procedure applied to collect the biological sample (Table S7, supplementary materials, section A), whilst the Biological Sample Analysis Event, contains the Pathological result derived from the sample (Table S8, supplementary materials). Currently, the COSMOS dataset does not include digital biological imaging samples as DICOM pathology image, but if these would have been available, the Biological Sampling Event and Biological Sample Analysis Event would be replaced or integrated with an Image Acquisition Event and an Imaging Analysis Event respectively, where the latter would store the Pathological result.
In addition to the Recruitment Event, two Events were defined that are directly connected to the Sample Donor, yet independent from specific sample collections:
-
The Patient History Event (Table S10, supplementary materials, section A), which involves information related to Sample Donor’s life-style (e.g. smoking exposure), symptoms (e.g. respiratory disorders) as well as pre-existing or past-pathologies (e.g. past oncologic pathologies); since many of these factors were considered among the eligibility criteria of the COSMOS study, we considered the Recruitment Event as an Implication of the Patient History Event.
-
The Diagnosis Event, which aims at integrating findings derived from the Imaging Analysis Event with those of the Biological Sample Analysis Event to reach a unified diagnosis; indeed, in our case study, evidence derived from a digital radiological imaging can be confirmed through the analysis of a biological sample. In case of malignant lesion diagnosis, the Grade of the disease was documented and considered as a Diagnosis Event attribute (Table S12, supplementary materials, section A).
In supplementary materials, a full example of the possible clinical workflow (Figures S1 and S2, section B) in the lung cancer screening context is reported to clearly demonstrate some of relationships described in this section and to support a step-by-step evaluation of the structured database.
Results
We have created a structured database in which specific and unambiguous queries are feasible and should allow for a comprehensive description of the COSMOS repository to be exploited for research in image processing and analysis, including radiomics and artificial intelligence, and generally, in fostering research on lung cancer management. In this section, we provide an overview of the data documented in the COSMOS structured database, considering both the biological sample and the radiological imaging sample collection.
Imaging Sample Collection and Patient History Event
DICOM Series Samples in the COSMOS cohort were directly associated with two main events: an acquisition (Image Acquisition Event) and an analysis (Imaging Analysis Event) event.
All the DICOM Series Samples consisted of LDCT scans, with the most frequent combination of acquisition parameters being a 30 mA X-ray tube current and 120 or 140 kVp of voltage (Fig. 3a) [35]. From 43,000 patient studies, 73,000 DICOM series (scans) were found (Fig. 3b) due to reconstructions with both standard and lung Convolution kernels being performed in the early years of the COSMOS study (Fig. 3c). In the later years of the study, only the standard kernel was used. Similarly, during the first year of the study, all reconstructions were performed with 2.5 mm slice thickness, whereas LDCT with a reduced slice thickness (1.25 mm) were also reconstructed from year 2007 (Fig. 3d).
Events Connected Directly and Indirectly to the DICOM Series Sample
Of the main events connected to the DICOM Series Sample, the Image Acquisition Event aims to contextualize the screening exam via an Exam Type attribute defined to express the role of each exam, distinguishing baseline exams (i.e. first LDCT scan acquisition of the longitudinal series) from routine or monitoring follow-ups. Specifically, routine follow-ups correspond to the annual acquisitions foreseen by the prevention program in case of absence of suspicious lesions, whereas monitoring follow-ups correspond to auxiliary acquisitions scheduled 3–6 months after a baseline or a routine follow-up where an abnormality was noted. Some 1463 of the 5206 patients underwent one or more monitoring follow-up. Thus, this Exam Type represents 5.3% of the DICOM studies, whereas 82.4% were routine follow-ups.
As already mentioned, the Image Acquisition Event can be an effect of a Recruitment Event. This depends itself on the Patient History Events component, where several habits and medical history factors that can influence the occurrence of lung cancer were included. To distinguish different risk factors, the Risk Type attribute was included (Table S6, Supplementary Materials, section A). Specifically, respiratory disorders and oncologic history were included as Risk Types related to the patient’s medical history, while smoking history and chemical exposure were included as external risk factors. Particular attention was given to smoking history, which was the main eligibility criteria of the COSMOS study along with patient age. The mean (std) of the Duration of the smoking exposure attribute was 37.9 (6.1) and 39.9 (6.4) years for women and men, respectively. As an Exposure Entity attribute, the number of cigarettes smoked per day was of 24.9 (10.29).
The second main event directly connected to the DICOM Series Sample is the Imaging Analysis Event which includes the products derived from the imaging samples grouped into the following three Sub-events: Pulmonary Nodule Identification, Post-processing Sub-event and Other Finding Identification Sub-event.
The Pulmonary Nodule Identification Sub-event was dedicated to findings annotated by radiologists according to the Lung-RADS guidelines. Among its main attributes, lesion Type – texture related (solid, part-solid and non-solid) as well as the lesion Diameter are defined. To document the nodule location, image number and the lung lobe recorded during the COSMOS study were documented as Lobe attribute. Further attributes related to lesion localization (Lesion coordinates, Type – Location related) have been included only for a subset COSMOS so far, as the integration of this information is on-going.
Among the 5206 Sample Donors involved in the study, those associated with a Pulmonary Nodule identification Sub-event gave rise to a set of 15,879 lesions, which appear in multiple exams. The distribution of nodules sizes according to Diameter attribute (Fig. 4a) showed most of the lesions (50.7%) to be below 4 mm, followed by 45.3% of lesions in the range 4–10 mm. As recorded in the Type – texture related attribute, solid nodules were more frequent (82.5%) than part-solid (11.9%) or non-solid nodules (5.6%), in agreement with published reports that solid lesions tend to be more frequent (Fig. 4b). The distribution of nodules between the lobes of the lungs (Lobe attribute), was relatively homogeneous (Fig. 4c), with the superior part of the right lobe being slightly predominant with respect to other locations.
The Post-processing Sub-event holds information derived from a DICOM-SEG object which defines the mask of a specific pulmonary nodule; therefore, it coexists with Pulmonary Nodules Identification Sub-event. The ROI Generation Algorithm within this component allows documenting whether segmentations were performed through manual or automatic contouring. The lesion Volume, present among Lung-RADS features, was included as attribute of the Post-processing Sub-event. Table 1 shows the main characteristics (Volume, ROI Generation Algorithm and numerosity) of the collected lesions’ contours subdivided by Type – texture related and Lobe attributes. Of 2008 lesions contoured to date, 472 were manually segmented, whereas 2747 were collected through a semi-automatic segmentation tool.
Finally, the Other Finding Identification Sub-event was defined to annotate radiological findings that are not pulmonary nodules and hence not covered by the Pulmonary Nodule Identification Sub-event. Specifically, the possible documented findings are: emphysema, lymphadenopathy, apical scar, pleural thickening, pneumothorax and pneumonia. Findings related to lesions localized in proximity of the lungs, e.g. thymus, were also recorded as Other Finding Identification Sub-event.
Biological Sample Collection and Diagnosis Event
In the current repository, events connected to biological samples are available only, as particulars of the biological samples themselves or digital data through DICOM pathology samples have not yet been included in the COSMOS repository. Considering the Biological Sampling Events, 391 samples were recorded across 350 subjects (Sample Donors) with some having undergone two (33 subjects) or more (4 subjects) invasive procedures. As can be noted from Fig. 5a, Biological Sampling Event was more common during the first five years of the COSMOS study (2005–2010). The Collection procedure attribute was available for 380 samples (Fig. 5b). For almost all samples (386), the Pathological result attribute was known. As can be seen in Fig. 5c, 16% of the analysed samples were associated to a benign lesion.
Among the 386 Diagnosis Events generated as effect of the Biological Sample Analysis Event and from the Imaging Analysis Event, 300 were associated with lung lesions considered as pulmonary nodules (Pulmonary Nodule Identification Sub-event) and are therefore associated to radiological features according to Lung-RADS standards. Fifty-six cases were instead associated to inflammatory status of the lung or other abnormal conditions (Other Finding Identification Event). Because of a lack of reported radiological characteristics the remaining result derived just from the Biological Sample Analysis Event.
Discussions
The standardization of information, well established for biobank data sharing, is becoming an important consideration in the field of medical imaging, driven by its role in precision medicine and CAD applications. The main aim of MIABIS lays in the definition of a standard data structure, which can facilitate both data collection and sharing. Although MIABIS has mainly referred to biological samples data, in their recent publication Eklund and colleagues (2020) stated their intent to extend the data model to biological imaging samples. In preparation for the creation of a public repository of longitudinal observations LDCT scans acquired during the COSMOS study, we have proposed an extension to MIABIS and demonstrated its use in defining a standard database structure in which to include radiological imaging data along with biological information.
Starting from the last published version of the MIABIS data model, we have proposed a series of changes to improve its generalizability. For this purpose, the list of attributes needed to define a Sample component was limited enlarging its field of inclusion to non-digital biological samples and digital imaging samples of a different nature (e.g. biological imaging samples and/or radiological imaging samples). While the proposed data model keeps Sample Donor, Sample and Event as the three main components of a data collection, we introduced the need of having multiple events with the possibility to define intra-collection links as well as inter-connections between heterogeneous Events. Specifically, we defined an Implication component, which establishes the role of one event in relation to another event (i.e. whether the event is a cause or effect of the implication). In our case-study, such relationships can be found within the Diagnosis Event where non-digital pathological and digital radiological outcomes are integrated. We believe the inclusion of such relationships strengthens the usability and interpretability of the repository. Indeed, among the most common aims of artificial intelligence applications, there is the prediction, from non-invasive diagnostic imaging, of target outcomes that are typically obtained through invasive procedures.
We have also proposed the possibility to have child components, i.e. Sub-events, of Events. For example, according to the presented case-study, the Imaging Analysis Event was associated with the Pulmonary Nodule Identification Sub-event, the Post-processing Sub-event and the Other Finding Identification Sub-event components, that are different products derived from the CT image. The inclusion of multiple Sub-events components linked to a parent Event makes the inclusion of lesions contours or other type of annotations more tractable. As such, the main advantage of the presented data model can be addressed to the consequent simplification of data retrieve procedure despite the large number of queryable attributes.
We used the COSMOS study as a case study consisting of patient history, LDCT imaging scans acquired over ten consecutive years, non-digital pathology results and a substantial set of labelled data that is in the process of preparation. As suggested by Eklund (2020), already existent well-defined standards were considered when available. Specifically, a subset of standard DICOM fields was adopted as attributes associated to radiological LDCT imaging samples. In this regard, the compatibility of the general data model to other imaging standards (e.g. the Brain Imaging Data Structure, BIDS, increasingly used in the field of neuroimaging experiments) needs to be evaluated in the future. Currently, digital biological samples have not yet been collected in the COSMOS study which just include Biological Sample Analysis events; if and when digital biological data in the form of DICOM pathology images will be available, these can be treated as non-invasive radiological DICOM images and thus considered as Imaging Acquisition Event. We do not expect difficulties with attributes definition as differences in DICOM tags are present also between different imaging modalities (e.g. Computerized Tomography vs. Positron Emission Tomography).
As part of the COSMOS study, pulmonary nodules were documented referring to Lung-RADS [34], which aimed to standardize the framework of lung cancer screening CT data management. Therefore, all radiological features mentioned in the Lung-RADS were included as queryable attributes in the Pulmonary Nodule Identification Sub-event (Table S3), with exception of Volume, which was included as an attribute of the Post-processing Sub-event being dependent on the contoured region defined by the DICOM-SEG object. Lesion coordinates were also included among the fundamental attributes of the Pulmonary Nodule Identification Sub-event to account for lesion description as pointed out also by Kostopoulos et al. (2017). As mentioned in the method section, the DICOM-SEG object was linked to a DICOM-SR with the aim of defining a structured repository where additional products related to the segmentation object can be collected, as products of radiomics-based or AI studies [31, 32]. Regarding DICOM-SEG object, DICOM RT-struct files which describe a region of interest as a list of points can be considered as an alternative way to encode segmentations despite it is considered specific to the radiotherapy field.
Comparing our data model with the information reported by Clark et al. (2009) for the NLST data collection, a larger set of queryable attributes is now available for the COSMOS data model (Supplementary Material, section D), and across a wider span of the data (imaging parameters, implications, pathological findings, lesion locations etc.). A further extension is foreseen for the COSMOS repository, consisting in the inclusion of PET-CT scans acquired according to the protocol reported in the dedicated section “The COSMOS Study Protocol”. Additionally, to allow database sharing, the deidentification process will be repeated to reach an anonymous state of the database which satisfies the GDPR definition. The radiological and biological findings associated to the COSMOS dataset had already been collected in a spreadsheet and database structures that were relatively straightforward to translate to the unified database in the demonstrated test case. Both the DICOM images, which required export from our hospital PACS, and the lesion contours being generated via dedicated software [30] are held in files that are referenced from the database. In other study contexts, it will likely be useful to integrate data from procedural reports and other clinical records, necessitating their extraction from hospital information systems and likely further refinement in order to be incorporated into the database. Our results suggest that such preparation is feasible and should not impinge the ability to integrate the derived data into the data model, though considerable initial effort may be required to ensure data integrity, completeness and appropriate definition of Implications between events. The transition to structured reporting and the storage of content, rather than document storage, will mark a step towards more efficient incorporation of clinical data. The growing list of imaging reporting standards for multiple anatomical sites, such as those promoted by the American College of Radiology (BI-RADS for breast cancer [36], PI-RADS for prostate cancer [37] and so on), are well-suited for incorporation into the proposed data model, and should allow easy translation to planned medical image-based studies in precision medicine. For demonstrative purposes, a second scenario related to prostate cancer diagnosis is reported in supplementary materials (section E).
Conclusions
We proposed an extension of the MIABIS data model, previously defined to standardize biobanks description. With this work we aim to encourage the integration of different sources of data in a structured fashion driven by well-defined cause-effect relationships that reflect real clinical workflows. Adopting this structure should facilitate the research progress on precision medicine, which is often limited by the differences in database description.
As case study, the COSMOS database was considered and from the reported results an overview of the information that can be retrieved was given.
Availability of Data and Material
Data still not public available.
Code Availability
Code still not public available.
Change history
21 July 2022
The original version of this paper was updated to reflect the funding information.
References
European Medicine Agency. https://www.ema.europa.eu/en/glossary/biomarker. Accessed 1 May 2021.
O’Connor JPB, Aboagye EO, Adams JE, Aerts HJWL, Barrington SF, Beer AJ, et al. Imaging biomarker roadmap for cancer studies. Nat Rev Clin Oncol 2017;14:169–86. https://doi.org/10.1038/nrclinonc.2016.162.
European Society of Radiology. https://www.myesr.org/eu-international-affairs/esr-action-plan-medical-imaging. Accessed 1 June 2021.
Haendel MA, Chute CG, Robinson PN. Classification, Ontology, and Precision Medicine. N Engl J Med 2018;379:1452–62. https://doi.org/10.1056/nejmra1615014.
Holub P, Swertz M, Reihs R, Van Enckevort D, Müller H, Litton JE. BBMRI-ERIC Directory: 515 Biobanks with over 60 Million Biological Samples. Biopreserv Biobank 2016;14:559–62. https://doi.org/10.1089/bio.2016.0088.
Merino-Martinez R, Norlin L, Van Enckevort D, Anton G, Schuffenhauer S, Silander K, et al. Toward Global Biobank Integration by Implementation of the Minimum Information about BIobank Data Sharing (MIABIS 2.0 Core). Biopreserv Biobank 2016;14:298–306. https://doi.org/10.1089/bio.2015.0070.
Eklund N, Andrianarisoa NH, van Enckevort E, Anton G, Debucquoy A, Müller H, et al. Extending the Minimum Information About BIobank Data Sharing Terminology to Describe Samples, Sample Donors, and Events. Biopreserv Biobank 2020;18:155–64. https://doi.org/10.1089/bio.2019.0129.
Fritz A, Percy C, Jack A, Shanmugaratnam K, Sobin L, Parkin DM, et al. International Classification of Diseases for Oncology. Third edition. World Health Organization. Reprinted 2001 .
Gaudet-Blavignac C, Foufi V, Bjelogrlic M, Lovis C. Use of the systematized nomenclature of medicine clinical terms (snomed ct) for processing free text in health care: Systematic scoping review. J Med Internet Res 2021;23:1–18. https://doi.org/10.2196/24594.
Sanduleanu S, Woodruff HC, de Jong EEC, van Timmeren JE, Jochems A, Dubois L, et al. Tracking tumor biology with radiomics: A systematic review utilizing a radiomics quality score. Radiother Oncol 2018;127:349–60. https://doi.org/10.1016/j.radonc.2018.03.033.
Garau N, Paganelli C, Summers P, Choi W, Alam S, Lu W, et al. External validation of radiomics-based predictive models in low-dose CT screening for early lung cancer diagnosis. Med Phys 2020;47:4125–36. https://doi.org/10.1002/mp.14308.
El Naqa I, Haider MA, Giger ML, Ten Haken RK. Artificial intelligence: Reshaping the practice of radiological sciences in the 21st century. Br J Radiol 2020;93. https://doi.org/10.1259/bjr.20190855.
Mun SK, Wong KH, Lo SCB, Li Y, Bayarsaikhan S. Artificial Intelligence for the Future Radiology Diagnostic Service. Front Mol Biosci 2021;7:1–9. https://doi.org/10.3389/fmolb.2020.614258.
Ciompi F, Chung K, Van Riel SJ, Setio AAA, Gerke PK, Jacobs C, et al. Towards automatic pulmonary nodule management in lung cancer screening with deep learning. Sci Rep 2017;7:1–10. https://doi.org/10.1038/srep46479.
Holzinger A, Haibe-Kains B, Jurisica I. Why imaging data alone is not enough: AI-based integration of imaging, omics, and clinical data. Eur J Nucl Med Mol Imaging 2019;46:2722–30. https://doi.org/10.1007/s00259-019-04382-9.
Castro DC, Walker I, Glocker B. Causality matters in medical imaging. Nat Commun 2020;11:1–10. https://doi.org/10.1038/s41467-020-17478-w.
Cancer Imaging Archive. https://www.cancerimagingarchive.net/. Accessed 1 July 2021.
Kostopoulos S, Ravazoula P, Asvestas P, Kalatzis I, Xenogiannopoulos G, Cavouras D, et al. Development of a Reference Image Collection Library for Histopathology Image Processing, Analysis and Decision Support Systems Research. J Digit Imaging 2017;30:287–95. https://doi.org/10.1007/s10278-017-9947-8.
Wang X, Peng Y, Lu L, Lu Z, Bagheri M, Summers RM. ChestX-ray8: Hospital-scale chest X-ray database and benchmarks on weakly-supervised classification and localization of common thorax diseases. Proc - 30th IEEE Conf Comput Vis Pattern Recognition, CVPR 2017 2017;2017-Janua:3462–71. https://doi.org/10.1109/CVPR.2017.369.
Stadler CB, Lindvall M, Lundström C, Bodén A, Lindman K, Rose J, et al. Proactive Construction of an Annotated Imaging Database for Artificial Intelligence Training. J Digit Imaging 2021;34:105–15. https://doi.org/10.1007/s10278-020-00384-4.
Finke MT, Filice RW, Kahn CE. Integrating ontologies of human diseases, phenotypes, and radiological diagnosis. J Am Med Informatics Assoc 2019;26:149–54. https://doi.org/10.1093/jamia/ocy161.
Clark KW, Gierada DS, Marquez G, Moore SM, Maffitt DR, Moulton JD, et al. Collecting 48,000 CT exams for the lung screening study of the national lung screening trial. J Digit Imaging 2009;22:667–80. https://doi.org/10.1007/s10278-008-9145-9.
The National Lung Screening Trial Research Team. Reduced Lung-Cancer Mortality with Low-Dose Computed Tomographic Screening. N Engl J Med 2011;365:395–409. https://doi.org/10.1056/NEJMoa1102873.
Zhao YR, Xie X, De Koning HJ, Mali WP, Vliegenthart R, Oudkerk M. NELSON lung cancer screening study. Cancer Imaging 2011;11:79–84. https://doi.org/10.1102/1470-7330.2011.9020.
Veronesi G, Maisonneuve P, Spaggiari L, Rampinelli C, Pardolesi A, Bertolotti R, et al. Diagnostic performance of low-dose computed tomography screening for lung cancer over five years. J Thorac Oncol 2014;9:935–9. https://doi.org/10.1097/JTO.0000000000000200.
Maisonneuve P, Bagnardi V, Bellomi M, Spaggiari L, Pelosi G, Rampinelli C, et al. Lung cancer risk prediction to select smokers for screening CT - A model based on the Italian COSMOS trial. Cancer Prev Res 2011;4:1778–89. https://doi.org/10.1158/1940-6207.CAPR-11-0026.
European Comission. Adequacy decisions. https://ec.europa.eu/info/law/law-topic/data-protection/international-dimension-data-protection/adequacy-decisions_en. n.d.
Hedlund J, Eklund A, Lundström C. Key insights in the AIDA community policy on sharing of clinical imaging data for research in Sweden. Sci Data 2020;7:1–6. https://doi.org/10.1038/s41597-020-00674-0.
Jodogne S. The Orthanc Ecosystem for Medical Imaging. J Digit Imaging 2018;31:341–52. https://doi.org/10.1007/s10278-018-0082-y.
Garau N, Paganelli C, Summers P, Bassis D, Lanza C, Minotti M, et al. A segmentation tool for pulmonary nodules in lung cancer screening: Testing and clinical usage. Phys Medica 2021;90:23–9. https://doi.org/10.1016/j.ejmp.2021.08.011.
Fedorov A, Clunie D, Ulrich E, Bauer C, Wahle A, Brown B, et al. DICOM for quantitative imaging biomarker development: A standards based approach to sharing clinical data and structured PET/CT analysis results in head and neck cancer research. PeerJ 2016;2016. https://doi.org/10.7717/peerj.2057.
Herz C, Fillion-Robin JC, Onken M, Riesmeier J, Lasso A, Pinter C, et al. dcmqi: An open source library for standardized communication of quantitative image analysis results using DICOM. Cancer Res 2017;77:e87–90. https://doi.org/10.1158/0008-5472.CAN-17-0336.
Kahn CE, Carrino JA, Flynn MJ, Peck DJ, Horii SC. DICOM and Radiology: Past, Present, and Future. J Am Coll Radiol 2007;4:652–7. https://doi.org/10.1016/j.jacr.2007.06.004.
American College of Radiology Committee on Lung-RADS. Lung-RADS Assessment Categories version1.1. https://www.acr.org/-/media/ACR/Files/RADS/Lung-RADS/LungRADSAssessmentCategoriesv1-1.pdf (accessed January 1, 2020).
Rampinelli C, Origgi D, Bellomi M. Low-dose CT: technique, reading methods and image interpretation. Cancer Imaging 2013;12:548–56. https://doi.org/10.1102/1470-7330.2012.0049.
ACR BI-RADS Atlas — Reporting System. https://www.acr.org/Clinical-Resources/Reporting-and-Data-Systems/Bi-Rads. Accessed 1 Apr 2021.
PI-RADS Atlas. https://www.acr.org/Clinical-Resources/Reporting-and-Data-Systems/PI-RADS. Accessed 1 Apr 2021.
Funding
Open access funding provided by Politecnico di Milano within the CRUI-CARE Agreement. The work was supported by AIRC (Associazione Italiana per la Ricerca contro il Cancro, grant number IG2018 – 21701).
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Ethics Approval
The local ethical committee approved the study.
Consent to Participate
All participants provided signed informed consent for the study.
Consent for Publication
All participants provided signed informed consent for publication.
Conflict of Interest
The authors declare no conflict of interests.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Below is the link to the electronic supplementary material.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Garau, N., Orro, A., Summers, P. et al. Integrating Biological and Radiological Data in a Structured Repository: a Data Model Applied to the COSMOS Case Study. J Digit Imaging 35, 970–982 (2022). https://doi.org/10.1007/s10278-022-00615-w
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10278-022-00615-w