Key points.

  • Two groups of experts (radiographers/radiologist) are looking for different IQ criteria.

  • Eklund manoeuvre mammograms should have specific IQ criteria.

  • BI mammograms must consider maximum retropulsion of the implant.

  • Visualisation of the implant anterior edge means all breast tissue is included.

  • Necessary to adapt the PNL criterion to different BI locations (subglandular/subpectoral).

Introduction

Breast cancer screening programs (BCSP) are implemented across the world with the aim of reducing mortality by detecting cancer in its initial stage to increase chances of survival with earlier therapy [1]. Even being controversial [2], mammography is still considered the gold standard in some countries as the initial examination if equivocal clinical assessments or suspected implant complications are observed, particularly for women over 50 years old and those over 40 years with breast implants (BI) [3]. However, concerns about BI mammography have been raised due to the possible impairment of cancer detection [4,5,6,7,8]. Implants are denser compared to breast tissue [9] bringing challenges in image acquisition, reading and interpretation. The available guidelines for standard mammography do not present appropriate recommendations when a patient has BI, regarding protocols and techniques or how to evaluate image quality (IQ), namely which criteria should be considered to ensure that the exam is adequate to perform diagnosis on images with implants that are denser compared to breast tissue [10,11,12,13]. With the implementation of digital mammography and breast tomosynthesis in BCSP across Europe, it is important to establish what are the best approaches for imaging the breast, including those with implants, namely protocols and techniques, but also how to evaluate and interpret the images. Considering there is limited evidence in published literature about IQ criteria for BI mammography assessment [7, 9, 14,15,16,17,18,19,20,21,22,23,24,25,26,27,28,29,30,31,32,33], this study aimed to identify image quality criteria that can be applied to assess breast implant mammograms according to both radiologists’ and radiographers’ perspectives. It also aimed to explore the level of agreement regarding the priority of each criterion to distinguish between those that must be verified and those that are not a priority to determine when an examination needs to be rejected and/or repeated.

Methods

To identify image quality criteria that can be applied to assess breast implant mammograms, a list of criteria available for standard mammography previously identified [34] was presented to a group of experts or stakeholders using a questionnaire and applying a two-round Delphi method [35,36,37,38]. The Delphi method provides an opportunity for experts/stakeholders to exchange viewpoints about a complex problem, to see how their evaluation of the issue aligns with others and to change their opinions, if desired, after reconsideration of the findings of the group’s work. The main stakeholders involved in this specific context are typically radiographers and radiologists. Radiographers have their role in the assessment of IQ immediately after acquiring the images and radiologists subsequently evaluate the images, to interpret and report the examination. Because of their respective roles, they were brought together and, with the guidance of a facilitator, their informed opinions were interrogated to create a final list of criteria to be used for assessing BI mammography examinations. The facilitator explained the objectives of this study and also the scale used to classify each criteria. The aim of the listed criteria was to help with deciding if an examination, including images in craniocaudal (CC), mediolateral-oblique (MLO), mediolateral (ML), acquired with and without Eklund Manoeuvre, presents all relevant imaging information to provide a diagnosis or if the examination should be repeated [39, 40]. The priority of each criterion was additionally explored. A consensus approach was used to define the level of agreement between the group members [35, 41]. According to the literature [35,36,37, 42], the group size can vary according to the purpose of the research or can be defined according to those who express interest in participating [36]. In this study, 10 participants (6 radiographers and 4 radiologists), all working in Swiss BCSP institutions, were invited to join the study after expressing their interest in the experience. All participants had a minimum of 7 years of experience in their respective profession.

The classical Delphi method was followed and involved 5 steps [36]:

  1. 1.

    A questionnaire was submitted online to the experts (participants), which presented a list of criteria that was based on a previous study [34]. They were asked to identify which items could be applicable to assess BI mammograms and add others that were not noted in the list (Tables 1 and 2);

  2. 2.

    The experts examined the criteria to categorise them as important or not and to ranked them according to the perceived level of importance as (a) need to have, (b) nice to have, (c) not pertinent/appropriate and (d) I do not know;

  3. 3.

    Findings were analysed and presented to provide feedback to both radiographers and radiologists;

  4. 4.

    After subsequent readjustments, a second list of criteria was submitted for another round of assessment by the experts;

  5. 5.

    Finally, an agreement based on both rankings was attempted, to set a list of criteria to be applied by professionals working in a regional BCSP.

Table 1 Criteria to assess mammography examinations grouped by type (positioning, artefacts, sharpness, parameters) in craniocaudal, mediolateral oblique and mediolateral mammograms
Full size table
Table 2 Criteria designed to assess the implant imaging in craniocaudal, mediolateral oblique and mediolateral mammograms
Full size table

Parallel to the Delphi rounds, the same criteria identified during the literature review were used on a set of 1207 images to verify if they were applicable or not to real clinical scenarios and see if it is possible to assess each criterion when BI mammograms are acquired [34].

The 4-point Likert-type scale was used to rank each image criteria; the agreement percentage was calculated for the four levels of all criteria. The Kendall’s W (also known as Kendall’s coefficient of concordance) was then used to identify the level of agreement amongst the raters. Kendall’s W ranges from 0 (no agreement) to 1 (complete agreement) [47]. The statistical analysis was performed using Statistical Package for the Social Sciences (SPSS) version 23 and Excel software. Subgroup analysis by profession was also performed.

Approval was obtained from participant stakeholders. All participants gave their written informed consent.

Results

The first round response rate was 100% (n = 10) and for the second round was 90% (n = 9). The number of criteria ranked during the first round were in total 25, distributed between positioning, parameters, sharpness/compression and artefacts, and were adapted to each projection. Additionally, 4 criteria to assess the implant itself in a mammographic examination were considered (Table 2).

  1. A.

    Criteria to assess image quality of CC projections performed with Eklund manoeuvre performed in women with BI

Criteria classified as “need to have” were sharpness of glandular tissue, absence of artefacts with a degree of consensus of 80%; spread of breast tissue to differentiate adipose from fibroglandular tissue with a degree of consensus of 70%; nipple in profile, maximum retropulsion of breast implant, breast aligned to the detector, absence of skin folders and adequate contrast between anatomical structures with a degree of consensus of 60%. The visualisation of the medial border, retroglandular adipose tissue and axillary tail were considered as “nice to have” structures with a degree of consensus of 60%. The sharp reproduction of skin structure (rosettes from pores) was considered as not necessary (Table 3).

Table 3 Criteria scoring for craniocaudal projection applying Eklund manoeuvre combining the opinions of both groups (radiologists and radiographers) and respective percentage (%)
Full size table

The CC images acquired without Eklund technique had an extra criterion: the absence of flow in the implant area and symmetrical (in mirror) CC images.

Between the first and second Delphi rounds, it was possible to exclude some criteria (Table 4) due to poor scoring attributed to them, namely visualisation of pores, visualisation of the pectoral muscle and vascular anatomy. Contrast and adequate radiation penetration of the breast tissues were suggested as relevant in the first round outcomes and so were introduced into the second round and ranked high amongst the criteria.

  1. B.

    Criteria to assess image quality of standard MLO projections performed in women with BI

Table 4 Criteria raking (mean values based in Kendall’s W) comparison between first and second Delphi rounds regarding craniocaudal images performed with Eklund manoeuvre combining the opinions of both groups (radiologists and radiographers)
Full size table

The most important criteria for MLO images were as follows: absence of artefacts with a degree of consensus of 78%; sharpness and spread of breast tissues, inframammary angle clearly demonstrated, full visualisation of inferior breast tissue and maximum visualisation of pectoral muscle, nipple on profile, breast aligned with the detector centre, with a degree of consensus of 67%.

The sharp reproduction of skin structure (rosettes from pores) and skin line visualisation were considered as not necessary.

Between the first and second Delphi rounds, some criteria were excluded as observed above for CC images (Table 5). One of criterion that became less relevant in the second round for images with BI was the level of visualisation of the pectoral muscle, namely the pectoral to nipple line (PNL). That criterion was left out of the questionnaire for the second round.

  1. C.

    Criteria to assess image quality of ML projections performed with Eklund manoeuvre performed in women with BI

Table 5 Criteria rakings (mean values based on Kendall’s W) comparison between first and second Delphi rounds regarding mediolateral oblique image manoeuvre combining the opinions of both groups (radiologists and radiographers)
Full size table

For ML images, the absence of artefacts, spread and sharp visualisation of breast tissues and breast aligned with the detector were considered as the most important parameters to be included in the analysis of ML images with a degree of consensus of 80%. The visualisation of superior and inferior breast tissues, the absence of skin folders and the maximum retropulsion of the implant to reduce the superimposition over breast tissue were other criteria highlighted as important with a degree of consensus of 60%. Adequate contrast and penetration were parameters not considered during the first Delphi round, but from the second round, these parameters were ranked in fifth and sixth positions (Tables 6 and 7).

Table 6 Criteria scoring for mediolateral projection using Eklund manoeuvre combining the opinions of both groups (radiologists and radiographers) and respective percentage (%)
Full size table
Table 7 Criteria rakings (mean values based on Kendall’s W) comparison between first and second Delphi rounds regarding mediolateral image manoeuvre combining the opinions of both groups (radiologists and radiographers)
Full size table

Radiographers and radiologists did not agree in their ranking of 11 criteria for image quality assessment for the most common projections (CC and MLO) performed in women with BI (Figs. 1 and 2). The criteria considered as most relevant by radiographers to assess CC images were definition/sharpness of breast tissues, nipple in profile and spread of breast tissue. Radiologists noted the alignment of the breast with the detector’s centre as “need to have” as well as definition/sharpness of breast tissues. Radiographers considered it important in MLO views to visualise the inframammary angle and also the visibility of inferior tissues, while radiologists were looking for the absence of artefacts, nipple not superimposed over breast tissue, absence of skin folders and definition/sharpness of breast tissue.

Fig. 1
figure 1

Rankings attributed to image quality criteria used to assess mediolateral oblique (MLO) images by radiographers and radiologists

Full size image
Fig. 2
figure 2

Average rankings attributed to image quality criteria used to assess craniocaudal (CC) images performed with Eklund Manoeuvre by radiographers and radiologists

Full size image

Kendall’s coefficient of concordance was performed to verify the level of agreement between the two professional groups, and the differences were visible. The level of agreement between participants ranged from − 0.13 to 0.7 for craniocaudal image criteria and − 0.06 to 0.7 for MLO image criteria.

Discussion

The objectives of this study were to identify image quality criteria that are currently in use to assess BI mammograms according to radiologists and radiographers’ perspectives and to explore the level of agreement about criteria priority.

To achieve these objectives a search was performed to identify possible criteria adapted to this specific context; however, no guidance was found [34]. This gap can impact on radiographers and radiologists’ activities considering that is important to know what should be demonstrated on the image to select the most suitable protocol and to achieve examination goals. Not having a level of image quality that allows for the analysis of all relevant anatomy of the breast with implants means the diagnosis of breast pathologies can be compromised [48].

This study showed that the two professional groups look at BI mammograms in different ways, having individual strategies to assess IQ as demonstrated by the results of the Kendall concordance test. The agreement between radiographers and radiologists ranged from weak (− 0.13) to good agreement (0.7). Major differences in agreement were related to the priority of criteria, with radiographers searching for specific anatomical details (nipple in profile, visualisation of medial, superior and inferior breast tissues), while radiologists were focused on overall assessment such as contrast, breast aligned with the detector, beam penetration, spread and sharpness of breast tissue and absence of artefacts. In a study promoted by the Canadian Association of Radiologists [49], the problems related to the presence of artefacts in the image were emphasised as they can promote an increase in false positive rates compromising the diagnosis. On the other hand, another study stressed positioning deficiencies as the main causes of inadequate image quality. The presence of skin folds, the pectoral muscle being concave or thin or having a sagging breast on the MLO, or a portion of breast cut off were frequently highlighted [50]. However, having a BI means the relevance and priority of some criteria can vary compared to standard mammograms. For example, the visualisation and shape of pectoral muscle will change if a subglandular implant is placed inside the breast because the implant will be overlapping with the muscle. A portion of breast being cut off can also happen in this situation, due to the limitations in manipulating the implant when it is encapsulated [51] or even to include inframammary angle in MLO projections [34].

This study also showed that the priority of each criterion is different amongst the two professional groups, it being desirable to take into account the likelihood of attaining each criterion in further studies. Radiographers prioritise the aesthetic side while radiologists look to see if the relevant information is noted in the image or not [52]. Previous studies showed that is effectively important as an overall assessment of image quality [43, 52], it being crucial to have all breast tissues included and correctly demonstrated. However, the proposed strategies to assess mammograms were still considered subjective for some criteria, and the need for standardisation was highlighted [53]. The words “appropriate” and “general amount” are being used but they are open to individual interpretation bringing variations in the final IQ analysis. Additionally, BI are an extra challenge because there is a superimposition of a dense structure over soft breast tissues, increasing the possibility of hiding relevant pathologies [43]. For that reason, modified positioning is required (Eklund) to help with the reduction of the amount of breast tissue superimposition. This is managed by displacing the implant posteriorly against the chest wall and pulling breast tissue over and in front of the implant, facilitating also the compression [51]. But these changes in positioning bring concomitant changes in the image appearance, making it necessary that radiographers know exactly what is required to be demonstrated, and communicating with radiologists to achieve a better alignment between both. Education also has a role to play as revealed in a previous study about mammography education in Europe [54] which demonstrated that positioning and image quality assessment are very challenging, leading to students demanding more training and a wider exposure to different clinical scenarios. Specific training for BI imaging could be an approach that would reduce professional differences.

The main limitations of this study are related to a different number of participants in both rounds (first 10, second 9) and also the 2 groups of professionals were not the same size (6 radiographers and 4 radiologists), which may affect the subgroup analyses. ML view and Eklund manoeuvre were not currently performed by all participants and implant location (subglandular or subpectoral) was not considered, and that has an impact on the visible anatomy as demonstrated previously [34]. This means that during the ranking process the decision of the participants would not consider the changes in image.

Further research is required for the identification of quality targets that should be reached in daily practice. However, the risk of omitting indicators was mitigated by the expertise of the panel who were given the opportunity to suggest additional ones, considering they were familiar with the relevant literature and BI imaging. That is also one of the advantages of using the Delphi method, where opinions can be different from one round to another [52], making the list richer.

Even with published work showing that is possible to use the Delphi method to identify quality indicators and prioritise criteria to be included in guidelines, it was challenging to conduct this study. The lack of standardisation of definitions, number of participants, optimal variance of rating scale, the best means for each answer and image quality assessment methodologies can lead to an incomplete list of criteria to assess BI examinations.

Therefore, basic criteria to start the image analysis were identified for BI such as maximum retropulsion of implant, visualisation of anterior edge of implant and no artefacts (such as flow). But some criteria identified as necessary are still subjective and that can be considered a limitation of this study, for example, “adequate contrast” and “adequate beam penetration”.

Conclusions

Radiologists and radiographers did not consider the same parameters as relevant to assess image quality of BI mammograms; however, a list of criteria to assess BI mammograms was produced focusing on aspects of positioning, exposure parameters, sharpness and compression regarding the implant itself. This difference in the approach to image assessment shows that it is necessary to develop a standardised strategy in BI mammography, including different criteria adapted to each type of implant (subglandular versus subpectoral) as the changes promoted in the anatomy are different. Considering the experts’ opinions, the criteria to assess BI mammograms must consider maximum retropulsion of the implant, visualisation of the anterior edge of the implant and no artefacts (such as flow). The spread and sharpness of breast tissues are the other “need to have” parameters that do not differ from standard mammography. The revision of the PNL line and inclusion of the inframmamary angle criteria seem to be necessary to adapt to this specific context taking in consideration the implant location (subglandular/subpectoral).

Education and training to align radiographers and radiologists understandings is also necessary to have examination outcomes that match the interpretation requirements that lead to the optimal diagnostic outcomes of breast pathologies.