To compare the visibility of anatomical structures and overall quality of the attenuation images obtained with a dark-field X-ray radiography prototype with those from a commercial radiography system.
Each of the 65 patients recruited for this study obtained a thorax radiograph at the prototype and a reference radiograph at the commercial system. Five radiologists independently assessed the visibility of anatomical structures, the level of motion artifacts, and the overall image quality of all attenuation images on a five-point scale, with 5 points being the highest rating. The average scores were compared between the two image types. The differences were evaluated using an area under the curve (AUC) based z-test with a significance level of p ≤ 0.05. To assess the variability among the images, the distributions of the average scores per image were compared between the systems.
The overall image quality was rated high for both devices, 4.2 for the prototype and 4.6 for the commercial system. The rating scores varied only slightly between both image types, especially for structures relevant to lung assessment, where the images from the commercial system were graded slightly higher. The differences were statistically significant for all criteria except for the bronchial structures, the cardiophrenic recess, and the carina.
The attenuation images acquired with the prototype were assigned a high diagnostic quality despite a lower resolution and the presence of motion artifacts. Thus, the attenuation-based radiographs from the prototype can be used for diagnosis, eliminating the need for an additional conventional radiograph.
• Despite a low tube voltage (70 kVp) and comparably long acquisition time, the attenuation images from the dark-field chest radiography system achieved diagnostic quality for lung assessment.
• Commercial chest radiographs obtained a mean rating score regarding their diagnostic quality of 4.6 out of 5, and the grating-based images had a slightly lower mean rating score of 4.2 out of 5.
• The difference in rating scores for anatomical structures relevant to lung assessment is below 5%.
Dark-field radiography is a new imaging modality that is currently being investigated in clinical trials. The underlying image formation is based on ultra-small angle X-ray scattering  and is sensitive to structural changes in the lung . It is therefore a promising approach to the early diagnosis of respiratory diseases. The alveolar structure of the healthy lung and associated air-tissue interfaces cause diffuse refraction and produce a distinct dark-field signal. Pathological changes in pulmonary parenchyma are generally accompanied by an alteration of these air-tissue interfaces, affecting the signal accordingly. Studies on several disease models have demonstrated the diagnostic potential of the dark-field modality in small animal and porcine models [2,3,4,5,6,7,8]. After a feasibility study, where the first dark-field radiographs of a human lung in a deceased body had been presented , the first experimental system for grating-based chest radiography on humans was constructed and commissioned. The potential benefits are evaluated as part of a clinical study investigating the diagnostic value of chronic obstructive pulmonary disease (COPD). It was shown that the technique can detect and quantify emphysema [10, 11] and that the dark-field signal is independent of demographic factors .
Due to the inherent properties of grating-based X-ray imaging , the prototype is capable of acquiring both a dark-field image and an attenuation image simultaneously. Chest radiography is generally used for the initial assessment of the lung, as the associated radiation dose is comparatively low and the examination procedure is fast and simple. Additionally, it plays a significant role in COPD diagnosis because it is often used to exclude other pathologies with similar symptoms to COPD . Therefore, a high image quality of both modalities is necessary for diagnostic accuracy. The aim of this study was to evaluate the diagnostic quality of the attenuation images. As a reference measure, we used images acquired at a commercial chest radiography system, since they fulfill the current clinical standard in the diagnosis of respiratory diseases.
Materials and methods
Dark-field chest radiography prototype
The prototype consists of a conventional radiography setup in combination with a three-grating-interferometer. Due to the presently limited grating size, the prototype uses a slot-scanning technique where the illumination is restricted to the grating area, which is scanned vertically along the patient to achieve the full field of view of 37 × 37 cm2 at the patient, producing a sequence of overlapping images. This leads to a local exposure time per pixel of about 1 s and a total acquisition time of about 7 s. More details can be found in [10, 12].
The clinical study was approved by the institutional review board and the national radiation protection agency. Between October 2018 and April 2019, 65 patients with and without diagnosed COPD were recruited from the radiology and pulmonology departments. All patients gave written informed consent prior to participation.
Of the included patient collective, smaller cohorts have already been reported in previous work, albeit with different primary outcomes as follows: a total of 27 participants were previously studied by , who evaluated the characteristics of dark-field chest radiography in healthy humans; a total of 59 participants were studied by , evaluating the characteristics of dark-field chest radiography in patients with pulmonary emphysema; a total of 57 participants were also described by , who assessed the diagnostic accuracy of dark-field imaging for emphysema diagnosis. The current study evaluates the diagnostic value of the attenuation chest X-rays obtained with the dark-field prototype, which has not been investigated in these previous studies.
As part of the clinical study, for each patient, a chest X-ray in posterior-anterior view was obtained consecutively at a commercial radiography system (DigitalDiagnost, Royal Philips) and at the clinical prototype. In the commercial system, a tube voltage of 125 kVp was used in accordance with the clinical routine . The nominal pixel size of the flat-panel detector was 148 µm.
To allow a fair comparison between the commercial system and the prototype setup, similar post-processing algorithms (UNIQUE, Royal Philips) were applied, as routinely used in commercial chest X-ray systems .
The dose for both the attenuation and the darkfield chest radiograph (for the 73 kg reference person) is 35.1 µSv . The corresponding value for a radiograph in the commercial system is 17.6 µSv. We calculated the effective dose for image acquisition at the prototype from the dose area product with a conversion coefficient of 1.5 µSv/(µGy∙m2), determined in cooperation with the national radiation protection agency. The corresponding conversion coefficient for the commercial system was measured to be 2.1 µSv/(µGy∙m2).
Due to the prolonged total acquisition time of 7 s due to the scanning process, the patients are asked to hold their breath during image acquisition to minimize the probability of motion artifacts. The effectiveness depends on the ability of the patient to hold their breath and can be limited for patients with a more advanced stage of COPD. All patients in this study reported that they felt confident with holding their breath. However, a blurring of the heart contours cannot be avoided, as at least one heartbeat is captured by the local exposure of 1 s.
Five radiologists with 12, 12, 5, 5, and < 1 year of experience independently assessed the attenuation images of both systems. A total number of 130 images were rated. An annotation tool integrated into the clinical database system was used for the readings, with the images shown individually and in random order. It was not indicated with which system the presented image was acquired. The readers were allowed to revise their previous rating in retrospect and stop a reading session at any point. There were no time constraints during the sessions. Based on a previous study by Uffmann et al, a list of the following anatomical structures was created : lung parenchyma, bronchial structures, perihilar vessels, peripheral vessels, costophrenic recess, cardiophrenic recess, retrocardiac area, carina, heart contours, and osseous structures. Their visibility was rated on a five-point scale adapted from the same work:
5: excellent visibility
4: good visibility
3: moderate visibility
2: poor visibility
1: unacceptable image
Additionally, the overall image quality and the level of motion artifacts, caused by the prolonged image acquisition time of 7 s, were evaluated. In the case of the latter, a score of 5 indicated that the motion artifacts did not decrease the visibility at all with the lower ratings following correspondingly. The readers were also asked to select which system they thought the image was acquired on.
The scales used for the feature grading were considered interval-scaled, in order to obtain refinement between the ratings by calculating the mean overall readers . The statistical difference between the images from the prototype and the commercial system was determined using an area under the curve (AUC) based z-test. The AUC was calculated for each criterion with the Obuchowski method . If there is no statistical difference between the two systems, the AUC values are expected to be close to 0.5. Based on the standard error of the AUC values the p values were calculated to determine statistical significance, which was considered if p ≤ 0.05.
The patient demographics are presented in Table 1. We included 65 patients (64 ± 12 years), among which 42 were male and 23 were female. In total, 11 of them were categorized as COPD patients and 51 as patients without COPD. For 3 patients, the available spirometry data was incomplete, prohibiting a classification. The mean age in the collective was 64 years with a standard deviation of 12 years.
The mean effective dose for the whole patient collective was determined to be (43.8 ± 26.4) µSv for our prototype, resulting in two images of different modalities and (16.4 ± 6.2) µSv for the commercial system. The values are given as mean ± standard deviation.
Figures 1 and 2 show example images of two patients, one without lung impairment and one with COPD (GOLD III). Visually, a higher contrast can be observed in the images acquired with the grating-based system. Moreover, the lung vessels are not obscured by the ribcage despite the lower tube voltage. Motion artifacts are found as blurring of the heart contours and the diaphragm in the images from the prototype.
The system identification by the readers was correct for 93% of the images. The resulting scores for the anatomical structures averaged over the five readers and their distributions are shown in Fig. 3. The grating-based images obtained a mean score of 4.2 for overall image quality, which is approximately 9% lower than the corresponding mean score of 4.6 for the commercial images. The mean visibility scores were high for both image types, but the ratings were higher for the commercial system for the majority of criteria except for the osseous structures, the carina, and the retrocardiac area. The osseous structures in the grating-based images obtained a mean score of 4.7, which is approximately 13% higher than the corresponding rating of 4.1 for the images of the commercial system. For the majority of criteria, the AUC was close to 0.5 with a p value ≤ 0.05, demonstrating that there is no statistical difference between the images from our prototype and the commercial system (Table 2). The ratings for the carina, the cardiophrenic recess, and the bronchial structures resulted in a p value > 0.05 with corresponding AUCs in the range between 0.505 and 0.530 and therefore not statistically significant. The AUC for the heart contours, level of motion artifacts, osseous structures, and overall image quality are considerably larger than 0.5.
For the assessment of motion artifacts, the images from the commercial system achieved a mean rating of 4.9, whereas the grating-based images scored 4.1 on average, accounting for a difference of 16%. The spread in visibility score is considerably higher for the grating-based images. However, at the costophrenic recess and the heart contours—areas where motion artifacts are most likely to occur —the difference in image ratings is not as pronounced, both when investigating the spread and the mean values. The grating-based images received mean ratings which were only 4% and 7% lower for the costophrenic recess and the heart contours, respectively.
We were especially interested in the differences between both systems for the costophrenic recess, the bronchial structures, the perihilar, and the peripheral vessels due to their diagnostic relevance in chest radiography . For these anatomical structures, the differences in visibility scores were low (≤ 5%). In general, there is a wider spread in the ratings of the grating-based images with more outliers than in the commercial images. There is a wide spread of the ratings in the level of motion artifacts at the prototype and the corresponding AUC is larger than 0.5. For the osseous structures on the other hand, the prototype consistently receives high ratings, while those for the commercial system vary, also leading to a large AUC.
In this study, we investigated the diagnostic quality of attenuation chest X-ray images acquired with the first clinical dark-field radiography prototype and compared it to corresponding images obtained with a commercial system in a reader study. We found that the visibility of relevant anatomical structures and the overall image quality were rated high for both systems. The presence of motion artifacts in the grating-based images decreased the visibility only slightly.
The improved visibility of the osseous structures in the grating-based images, indicated by a significant difference with a high AUC, is most likely achieved by the lower tube voltage used in the prototype. This confirms the results of Uffmann et al where higher image quality was shown for lower tube voltages . At lower X-ray energies, the photoelectric effect dominates the attenuation cross-section leading to increased absorption and structural contrast. At the same time, Compton scattering is decreased, further improving image quality. The applied image processing enhances the visibility of the lung parenchyma despite the enhanced contrast from the ribcage.
The comparatively high difference in the dispersion of the rating for the peripheral vessels could be due to the lower spatial resolution of the prototype. Additionally, the visibility of these vessels is influenced by involuntary movement due to prolonged image acquisition.
As a result of the short acquisition time in the order of milliseconds in clinical radiography, motion artifacts are not a common problem, which is consistent with the high mean rating score and narrow distribution of ratings for the commercial system in the corresponding criterion. However, they can be an issue in the prototype due to the slot-scanning technique and thus longer acquisition time. Image quality reduction due to these motion artifacts should be reflected in a respectively lower grading in the visibility of the heart contours and the costophrenic recess, which corresponds to the assessment of the diaphragm. Indeed, the commercial images show less variability in the ratings, but the difference between the mean ratings is comparatively small. The variability in the grating-based images is likely caused by single patients that moved during the acquisition. A motion correction algorithm has been developed  that automatically detects image locations affected by motion. It can help minimize motion artifacts, reducing the local illumination time to 0.22 s.
Despite the increased presence of motion artifacts and slightly lower average scores in the majority of the criteria, the overall image quality was rated high for the images obtained with our prototype. The difference in image variability for this criterion could be caused by images rated lower due to an increased presence of motion artifacts.
Recent studies on grating-based chest radiography on a deceased human body have shown that the optimal tube voltage for this imaging modality is around 60 to 70 kVp as a compromise between dark-field and attenuation image quality [24, 25]. Moreover, there are several studies indicating that the image quality of attenuation radiographs increases when using lower tube voltages [26,27,28,29,30]. Our reader study results confirm these findings.
The reason for the higher dose in the prototype can be found in its inherent grating configuration, which allows for the extraction of two complementary images instead of one contrast modality only. Nevertheless, the dose is within clinically acceptable ranges .
The prolonged acquisition time of our prototype and the need for a 7-s breath-hold poses a significant limitation for clinical practice. Additionally, our study is limited by the small number of patients with COPD. The main aim of this work was to compare the image quality between our prototype and the commercial system. Future studies should investigate the diagnostic value of dark-field radiography for COPD detection which involves a larger population of COPD patients with detailed documentation of their respiratory status.
Overall, our results show that the attenuation images acquired with our prototype are of comparable diagnostic quality to the commercial images. This could potentially simplify the implementation of the system into clinical workflow, as it yields both a dark field and an attenuation image and no additional attenuation X-ray would be required. Moreover, it offers the possibility of perfect registration of both complementary images, providing further potential diagnostic benefits.
Area under the curve
Chronic obstructive pulmonary disease
Pfeiffer F, Bech M, Bunk O et al (2008) Hard-X-ray dark-field imaging using a grating interferometer. Nat Mater 7:134–137. https://doi.org/10.1038/nmat2096
Hellbach K, Yaroshenko A, Meinel FG et al (2015) In vivo dark-field radiography for early diagnosis and staging of pulmonary emphysema. Invest Radiol 50:430–435. https://doi.org/10.1097/RLI.0000000000000147
Hellbach K, Yaroshenko A, Willer K et al (2016) Facilitated diagnosis of pneumothoraces in newborn mice using X-ray dark-field radiography. Invest Radiol 51:597–601. https://doi.org/10.1097/RLI.0000000000000285
Yaroshenko A, Pritzke T, Koschlig M et al (2016) Visualization of neonatal lung injury associated with mechanical ventilation using x-ray dark-field radiography. Sci Rep 6:1–8. https://doi.org/10.1038/srep24269
Scherer K, Yaroshenko A, Bölükbas DA et al (2017) X-ray dark-field radiography - in-vivo diagnosis of lung cancer in mice. Sci Rep 7:1–9. https://doi.org/10.1038/s41598-017-00489-x
Gromann LB, Scherer K, Yaroshenko A et al (2017) First experiences with in-vivo x-ray dark-field imaging of lung cancer in mice. In: Medical imaging 2017: physics of medical imaging. SPIE, p 101325L. https://doi.org/10.1117/12.2255714
Hellbach K, Meinel FG, Conlon TM et al (2018) X-Ray Dark-field imaging to depict acute lung inflammation in mice. Sci Rep 8:1–9. https://doi.org/10.1038/s41598-018-20193-8
Gromann LB, De Marco F, Willer K et al (2017) In-vivo X-ray dark-field chest radiography of a pig. Sci Rep 7:4807. https://doi.org/10.1038/s41598-017-05101-w
Willer K, Fingerle AA, Gromann LB et al (2018) X-ray dark-field imaging of the human lung - a feasibility study on a deceased body. PLoS One 13:e0204565. https://doi.org/10.1371/journal.pone.0204565
Willer K, Fingerle AA, Noichl W et al (2021) X-ray dark-field chest imaging for detection and quantification of emphysema in patients with chronic obstructive pulmonary disease: a diagnostic accuracy study. Lancet Digit Health 3:e733–e744. https://doi.org/10.1016/s2589-7500(21)00146-1
Urban T, Gassert FT, Frank M et al (2022) Qualitative and quantitative assessment of emphysema using dark-field. Radiology 303:119–127. https://doi.org/10.1148/radiol.212025
Gassert FT, Urban T, Frank M et al (2021) X-ray dark-field chest imaging: qualitative and quantitative results in healthy humans. Radiology 301:389–395. https://doi.org/10.1148/radiol.2021210963
Global Initiative for Chronic Obstructive Lung Disease (GOLD) (2020) Global strategy for the diagnosis, management, and prevention of chronic obstructive pulmonary disease
Willer K, Fingerle A, Noichl W et al (2021) X-ray dark-field chest imaging for detection and quantification of emphysema in patients with chronic obstructive pulmonary disease: a diagnostic accuracy study. Lancet Digit Health 3:e733–e744. https://doi.org/10.1016/s2589-7500(21)00146-1
Saure D (2008) Qualitätssicherung in der Röntgendiagnostik und in der Computertomografie: aktualisierte Leitlinien der deutschen Bundesärztekammer. Radiopraxis 1:99–100. https://doi.org/10.1055/S-0028-1086069
Stahl M, Aach T, Dippel S (2000) Digital radiography enhancement by nonlinear multiscale processing. Med Phys 27:56–65. https://doi.org/10.1118/1.598857
Frank M, Urban T, Willer K et al (2021) Dosimetry on first clinical dark-field chest radiography. Med Phys 48:6152–6159. https://doi.org/10.1002/mp.15132
Uffmann M, Neitzel U, Prokop M et al (2005) Flat-panel-detector chest radiography: effect of tube voltage on image quality. Radiology 235:642–650. https://doi.org/10.1148/radiol.2352031730
Likert R (1932) A technique for the measurements of attitudes. Arch Psychol 140:5–55
Obuchowski NA (1997) Nonparametric analysis of clustered ROC curve data. Biometrics 53:567. https://doi.org/10.2307/2533958
Ritchie CJ, Godwin JD, Crawford CR, Stanford W, Anno H, Kim Y (1992) Minimum scan speeds for suppression of motion artifacts in CT. Radiology 185(1):37–42
European Commission (2000) European guidelines on quality criteria for diagnostic radiographic images. Publications Office of the European Union
Schick RC, Koehler T, Noichl W et al (2021) Correction of motion artifacts in dark-field radiography of the human chest. IEEE Trans Med Imaging 41:895–902. https://doi.org/10.1109/TMI.2021.3126492
Sauter AP, Andrejewski J, De Marco F et al (2019) Optimization of tube voltage in X-ray dark-field chest radiography. Sci Rep 9:1–9. https://doi.org/10.1038/s41598-019-45256-2
Sauter AP, Andrejewski J, Frank M et al (2021) Correlation of image quality parameters with tube voltage in X-ray dark-field chest radiography: a phantom study. Sci Rep 11:14130. https://doi.org/10.1038/S41598-021-93716-5
Launders JH, Cowen AR, Bury RF, Hawkridge P (2001) Towards image quality, beam energy and effective dose optimisation in digital thoracic radiography. Eur Radiol 11:870–875. https://doi.org/10.1007/s003300000525
Honey ID, MacKenzie A, Evans DS (2005) Investigation of optimum energies for chest imaging using film-screen and computed radiography. Br J Radiol 78:422–427. https://doi.org/10.1259/bjr/32912696
Chotas HG, Floyd CE, Dobbins JT, Ravin CE (1993) Digital chest radiography with photostimulable storage phosphors: signal-to-noise ratio as a function of kilovoltage with matched exposure risk. Radiology 186:395–398. https://doi.org/10.1148/radiology.186.2.8421741
Ullman G, Sandborg M, Dance DR et al (2006) Towards optimization in digital chest radiography using Monte Carlo modelling. Phys Med Biol 51:2729–2743. https://doi.org/10.1088/0031-9155/51/11/003
Tingberg A, Sjöström D (2005) Optimisation of image plate radiography with respect to tube voltage. Radiat Prot Dosimetry 114:286–293. https://doi.org/10.1093/rpd/nch536
Mettler FA, Huda W, Yoshizumi TT, Mahesh M (2008) Effective doses in radiology and diagnostic nuclear medicine: a catalog. Radiology 248:254–263
Open Access funding enabled and organized by Projekt DEAL. We acknowledge financial support through the European Research Council (AdG 695045). This work was carried out with the support of the Karlsruhe Nano Micro Facility (KNMF, www.kit.edu/knmf), a Helmholtz Research Infrastructure at Karlsruhe Institute of Technology (KIT). The work was partially funded by the Federal Ministry of Education and Research (BMBF) and the Free State of Bavaria under the Excellence Strategy of the Federal Government and the Länder, the German Research Foundation (GRK2274) as well as by the Technical University of Munich – Institute for Advanced Study.
The scientific guarantor of this publication is Franz Pfeiffer.
Conflict of interest
Thomas Koehler and Hanns-Ingo Maack declare relationships with the following companies: Philips Research and Philips Medical Systems DMC GmbH.
Statistics and biometry
No complex statistical methods were necessary for this paper.
Written informed consent was obtained from all subjects (patients) in this study.
Institutional Review Board approval was obtained.
Study subjects or cohorts overlap
Some study subjects or cohorts have been previously reported in Gassert & Urban et al (X-ray Dark-Field Chest Imaging: Qualitative and Quantitative Results in Healthy Humans. Radiology, 2021), Urban & Gassert et al (Qualitative and Quantitative Assessment of Emphysema Using Dark-Field Chest Radiography. Radiology, 2022), Willer & Fingerle et al (X-ray dark-field chest imaging for detection and quantification of emphysema in patients with chronic obstructive pulmonary disease: a diagnostic accuracy study. The Lancet Digital Health, 2021), Urban & Sauter et al (submitted).
• performed at one institution
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Kattau, M., Willer, K., Noichl, W. et al. X-ray dark-field chest radiography: a reader study to evaluate the diagnostic quality of attenuation chest X-rays from a dual-contrast scanning prototype. Eur Radiol 33, 5549–5556 (2023). https://doi.org/10.1007/s00330-023-09477-4
- Diagnostic X-ray radiology
- Thoracic radiography
- Comparative study