Modified look-locker inversion recovery T1 mapping indices: assessment of accuracy and reproducibility between magnetic resonance scanners

Abstract

Background

Cardiovascular magnetic resonance (CMR) T1 mapping indices, such as T1 time and partition coefficient (λ), have shown potential to assess diffuse myocardial fibrosis. The purpose of this study was to investigate how scanner and field strength variation affect the accuracy and precision/reproducibility of T1 mapping indices.

Methods

CMR studies were performed on two 1.5T and three 3T scanners. Eight phantoms were made to mimic the T1/T2 of pre- and post-contrast myocardium and blood at 1.5T and 3T. T1 mapping using MOLLI was performed with simulated heart rate of 40-100 bpm. Inversion recovery spin echo (IR-SE) was the reference standard for T1 determination. Accuracy was defined as the percent error between MOLLI and IR-SE, and scan/re-scan reproducibility was defined as the relative percent mean difference between repeat MOLLI scans. Partition coefficient was estimated by ΔR1myocardium phantom/ΔR1blood phantom. Generalized linear mixed model was used to compare the accuracy and precision/reproducibility of T1 and λ across field strength, scanners, and protocols.

Results

Field strength significantly affected MOLLI T1 accuracy (6.3% error for 1.5T vs. 10.8% error for 3T, p<0.001) but not λ accuracy (8.8% error for 1.5T vs. 8.0% error for 3T, p=0.11). Partition coefficients of MOLLI were not different between two 1.5T scanners (47.2% vs. 47.9%, p=0.13), and showed only slight variation across three 3T scanners (49.2% vs. 49.8% vs. 49.9%, p=0.016). Partition coefficient also had significantly lower percent error for precision (better scan/re-scan reproducibility) than measurement of individual T1 values (3.6% for λ vs. 4.3%-4.8% for T1 values, approximately, for pre/post blood and myocardium values).

Conclusion

Based on phantom studies, T1 errors using MOLLI ranged from 6-14% across various MR scanners while errors for partition coefficient were less (6-10%). Compared with absolute T1 times, partition coefficient showed less variability across platforms and field strengths as well as higher precision.

Background

Diffuse myocardial fibrosis is a common feature of a broad variety of cardiovascular diseases. Cardiovascular magnetic resonance (CMR) T1 mapping indices, including T1 time, partition coefficient (λ), and extracellular volume fraction (ECV) measurements, have all been used to estimate the expansion of myocardial interstitial space thought to be associated with myocardial fibrosis [1–3]. T1 mapping indices are altered in a variety of cardiomyopathies, including chronic aortic regurgitation [4], heart failure [5], aortic stenosis [6], and adult congenital heart disease [7]. Compared with absolute T1 time, partition coefficient and ECV are relatively stable in-vivo in mild interstitial expansion conditions approximately 10 min after intravenous gadolinium based contrast agent (GBCA) administration [8, 9]. They are less sensitive to magnetic field strength and are similar between different GBCAs [10, 11]. ECV, in particular, has been linked to disease-specific changes and correlate with CMR parameters of disease severity [12].

MOLLI determination of T1 offers tighter limits of agreement between repeated measurements than traditional T1 mapping techniques, such as Look-Locker or multibreath-hold FLASH inversion recovery sequences [13, 14]. T1 determination by MOLLI can be influenced by multiple scanner dependent factors, such as field strength, gradient systems, coil configuration, pulse sequence design, artifacts related to field inhomogeneity and eddy currents. Those factors are directly related to the scanner’s performance, and therefore, are usually site/scanner-dependent and time-variant. However, to the best of our knowledge, the variability of MOLLI T1 measurement has not been well established between different scanners and static magnetic field strengths. Understanding MOLLI T1 variability is highly relevant to multi-center studies as well as follow-up of an individual patient using a different MR scanner than at baseline.

The purpose of the study was to determine the variation in T1 and partition coefficient between MR scanners using MOLLI in comparison to a set of reference T1 values. For this evaluation, we measured MOLLI T1 values in comparison to standard of reference inversion-recovery spin-echo (IR-SE) phantom vials that mimicked the T1 and T2 values of pre- and post-contrast myocardium and blood pool measurements at 1.5 and 3T.

Methods

Phantom

Eight phantoms total, or a set of four phantoms for each 1.5T and 3T, were made from a NiCl₂-DTPA/agarose solution to evaluate a range of pre- and post-contrast myocardium and blood pool T1 values [15]. The concentrations of reagents were adjusted to mimic the T1 and T2 values of the normal myocardium and blood pool [9, 16, 17].

CMR parameters

A list of the scanners with vendor, field strength, and coil information are shown in Table 1. Two different MOLLI acquisitions were performed on phantoms on all of the scanners with a simulated heart rate ranging from 40–100 beats per minute. The standard 17 heart beat MOLLI protocol has three inversion blocks; three images are acquired after each of the first two inversion pulses (3a), followed by a pause of three heart beats (3p), then five images are acquired after a third inversion pulse (5a). The shortened 11 heart beat MOLLI protocol has two inversion blocks; three images are acquired after the first inversion pulse (3a), followed by a pause of three heart beats (3p), then five images are acquired after a second inversion pulse (5a). Parallel imaging with a phase reduction factor of two was used. Localized shim and frequency scout was performed before MOLLI acquisition to improve static magnetic field homogeneity [18]. The full CMR parameters are listed in Table 2. Due to inherent differences in scanner performance and software, there are minor differences in sequence parameters as shown, but these variations were kept to a minimum and would not be expected to affect T1 estimation.

Table 1 CMR scanners used for experiments

Table 2 MOLLI scan parameters

Reference T1 times on each scanner were determined using standard inversion recovery prepared spin echo sequences at 10 different TIs from 22 to 5,000 ms (TR=10,000 ms, TE=9 ms), with the same FOV, matrix size, and slice thickness as the MOLLI experiment. For precision/reproducibility measurements, the phantoms were taken out of the magnet after the MOLLI and IR-SE images were acquired. Phantoms were then repositioned into the magnet 10–15 minutes later and a second set of MOLLI images acquired using the exact same parameters. The total average delay between two MOLLI scans was 8 hours. Our method of testing the true reproducibility measurements by leaving a long time span between the scans and repositioning the phantom resembles those of clinical reproducibility studies [19, 20], allowing these results to be more directly transferrable for in-vivo assessment.

Image analysis

Both inversion recovery and MOLLI T1 maps were calculated using MRmap [21]. T1 time was calculated with a 3-parameter curve fitting using a Levenberg-Marquardt algorithm and additional T1* correction was applied for MOLLI data.

$$y=A-Bexp\left(-\mathit{TI}/T1\right)$$

(1)

$$T1=T1*\left(\left(B/A\right)-1\right)$$

(2)

ImageJ was used to measure the T1 values for each of the vials. Partition coefficient (λ) was calculated according to the following formulae [8]:

$${{\displaystyle \mathrm{\Delta }R1}}_{\mathit{myocardium}}=1/\left({{\displaystyle T1}}_{\mathit{post}-\mathit{myo}}\right)-1/\left({{\displaystyle T1}}_{\mathit{pre}-\mathit{myo}}\right)$$

(3)

$${{\displaystyle \mathrm{\Delta }R1}}_{\mathit{blood}}=1/\left({{\displaystyle T1}}_{\mathit{post}-\mathit{blood}}\right)-1/\left({{\displaystyle T1}}_{\mathit{pre}-\mathit{blood}}\right)$$

(4)

$$\lambda ={{\displaystyle \mathit{\Delta R}1}}_{\mathit{myocardium}}/{{\displaystyle \mathit{\Delta R}1}}_{\mathit{blood}}$$

(5)

Accuracy assessment

Accuracy was assessed for T1 mapping indices with IR-SE as a reference. The percent error between MOLLI and IR-SE was calculated for both T1 values and partition coefficient. The error was defined in the following equations:

$$\mathrm{T}1\mathrm{error}\left(\%\right)=\frac{\left|\mathit{MOLL}{I}_{T_1}-\mathit{IRS}{E}_{T_1}\right|}{\mathit{IRS}{E}_{T_1}}\times 100\%$$

(6)

$$\mathrm{Partition}\mathrm{coefficient}\mathrm{error}\left(\%\right)=\frac{\left|\mathit{MOLL}{I}_{\lambda }-\mathit{IRS}{E}_{\lambda }\right|}{\mathit{IRS}{E}_{\lambda }}\times 100\%$$

(7)

Smaller error numbers represent better accuracy.

Precision assessment (test-retest reproducibility)

Precision (test-retest reproducibility) was assessed by measuring the agreement between independent MOLLI acquisitions. The relative mean percent difference between the two MOLLI scans was calculated for both T1 values and partition coefficient reproducibility. Smaller error numbers represent better precision.

$$\mathrm{Relative}\mathrm{mean}\mathrm{difference}=\frac{\left|\mathit{MOLL}{I}_{\mathit{Scan}1}-\mathit{MOLL}{I}_{\mathit{Scan}2}\right|}{\mathit{MOLL}{I}_{\mathit{average}}}\times 100\%$$

(8)

Statistical analysis

Statistical analyses were performed using SAS 9.1 (Cary, North Carolina, USA) and MedCalc 12.2 (MedCalc Software, Mariakerke, Belgium). Statistical significance was defined as p<0.05. In order to statistically compare the T1/partition coefficient accuracy and reproducibility across field strengths, scanners, and protocols, a general linear mixed model was used. The scanners, field strengths, and MOLLI protocols were included as a fixed effect. Results were reported as least squared means ± standard error. Bland-Altman plots were used to describe the difference between scan repetitions for both native T1 and partition coefficient values.

Results

CMR studies were performed on two 1.5T (1 Philips, 1 Siemens) and three 3T (2 Philips, 1 Siemens) scanners. Four phantoms were analyzed per scan for two MOLLI protocols at seven different heart rates for five scanners with two repetitions, totaling 560 MOLLI T1 measurements. All scanners are operating within manufacturer’s specification.

Comparison of T1 and partition coefficient

T1 values for both IR-SE and MOLLI are shown in Table 3. MOLLI T1 values were significantly different between scanners within the same field strength (p<0.0001 for 1.5T and 3T). MOLLI partition coefficients were not significantly different between 1.5T scanners (47.2% vs. 47.9%, p=0.13) as shown in Table 3. On the other hand, MOLLI partition coefficients were significantly different among 3T scanners (p=0.016). However, the differences among 3T scanners were very small (49.2% vs. 49.8% vs. 50.0%, Table 3) and probably wouldn’t have any clinical implication.

Table 3 IR-SE, MOLLI T1 and partition coefficient values

Accuracy assessment

The mean percent error of MOLLI T1 values are displayed in Figure 1 and comparison of field strengths and protocols are summarized in Table 4. The MOLLI T1 errors were 6-14% across various MR scanners, while the errors for partition coefficient were less (6-10%) between MR scanners (Figure 1). There was no statistical significance in MOLLI T1 accuracy between the 17HB protocol and 11HB protocol (8.3% vs. 8.8%, p=0.18), so these values were combined for subsequent analyses. Mean percentage T1 errors were 6.7 ± 0.5%, 6.0 ± 0.4%, 8.0 ± 0.4%, 13.9 ± 0.4%, and 10.6 ± 0.4% for scanners 1 thru 5, respectively (least square means ± standard error).

Figure 1

MOLLI T1 and partition coefficient accuracy with different scanners. Bar graph representation of accuracy for MOLLI T1 and partition coefficient for each of the 5 scanners. Accuracy is reported as the percentage difference between MOLLI and IR-SE. Data is presented as least square means ± standard error. Smaller numbers represent better accuracy.

Table 4 MOLLI T1 and partition coefficient accuracy and reproducibility across field strengths and protocols

1.5T scanners had smaller percent error, and hence better T1 accuracy, than 3T scanners (6.3 ± 0.3% for 1.5T vs. 10.8 ± 0.2% for 3T, p<0.0001). T1 accuracy for individual vials was also compared to look at subtleties as shown in Figure 2. The two post-contrast vials with lower T1 times had better accuracy (6.4 ± 0.4% and 7.2 ± 0.4%) than the two pre-contrast vials with longer T1 values (11.0 ± 0.4% and 15.9 ± 0.4%). The partition coefficient accuracy lies in the middle of pre and post-contrast vials (9.4 ± 0.3%).

Figure 2

Accuracy measurements for different vials. Bar graph representation comparing MOLLI T1 accuracy measurements across four different vials. Accuracy is reported as the percentage difference between MOLLI and IR-SE. Data is presented as least square means ± standard error. Smaller numbers represent better accuracy. The two post-contrast vials with lower T1 times had better accuracy than the two pre-contrast vials with longer T1 values. The accuracy of partition coefficient is in the middle of pre and post-contrast vials.

The reference partition coefficient values estimated from IR-SE were 43.7% for 1.5T and 46.0% for 3T, corresponding to ECV values of 26.2% and 27.6%, respectively, if an average hematocrit of 0.4 is assumed. These values were similar to normal in-vivo ECV values from literature, 25.4% at 1.5T [17] and 26.7% at 3T [8]. Partition coefficient accuracy varied significantly between different scanners (p<0.0001). Average percentage partition coefficient errors were 7.9 ± 1.0%, 9.7 ± 0.9%, 8.9 ± 0.9%, 8.6 ± 0.9%, and 6.7 ± 0.9% for scanners 1 thru 5, respectively (least square means ± standard error, Figure 1). Field strength did not significantly affect partition coefficient accuracy (8.8 ± 0.6% for 1.5T vs. 8.0 ± 0.5% for 3T, p=0.109). In addition, different MOLLI protocols did not significantly affect partition coefficient accuracy (8.3 ± 0.6% for 17HB vs. 8.5 ± 0.6% for 11HB, p=0.574). Both T1 (p<0.001) and partition coefficient (p=0.001) accuracy vary significantly across heart rate.

Precision/reproducibility assessment

T1 reproducibility varied significantly between different scanners (p=0.007). Average T1 differences were 5.2 ± 0.4%, 5.5 ± 0.3%, 4.7 ± 0.3%, 3.8 ± 0.3%, and 3.1 ± 0.3% for scanners 1 thru 5, respectively (least square means ± standard error, Figure 3). T1 reproducibility did not vary significantly across heart rates (p=0.375). However, field strength did significantly affect T1 precision with 3T showing smaller percent error, or better scan/re-scan reproducibility, than 1.5T (5.3 ± 0.3% for 1.5T vs. 3.9 ± 0.2% for 3T, p<0.0001, Table 4).

Figure 3

MOLLI T1 and partition coefficient reproducibility with different scanners. Bar graph representation of reproducibility measurements for both T1 and partition coefficient for each of the 5 scanners as well as field strength, and protocols. Scan/rescan reproducibility is reported as the relative percent mean difference between two MOLLI scans. Data is presented as least square means ± standard error. Smaller numbers represent better reproducibility.

Partition coefficient precision/reproducibility varied significantly between different scanners (p<0.0001). Average partition coefficient differences were 1.3 ± 0.6%, 6.4 ± 0.4%, 3.8 ± 0.4%, 3.3 ± 0.4%, and 1.3 ± 0.4% for scanners 1 thru 5, respectively (least square means ± standard error, Figure 3). Partition coefficient precision did not vary significantly across heart rates (p=0.24). However, field strength did significantly affect partition coefficient precision with 3T showing higher precision than 1.5T (3.8 ± 0.3% for 1.5T vs. 2.8 ± 0.2% for 3T, p=0.021, Table 4).

When compared individually, partition coefficient had significantly better precision (scan/re-scan reproducibility) than three of the four T1 vials with the “post-contrast blood” vial being the only exception (p=.096 for “post-contrast blood” vial vs. p<0.05 for all other vials). There was no statistical difference of precision when comparing individual T1 vials with each other. Precision was 3.6% for partition coefficient compared to 4.3%, 4.8%, 4.5%, and 4.5% for the four different T1 vials (Figure 4). Bland-Altman analysis in Figure 5 revealed tighter 95% confidence interval (CI) limits of agreement for partition coefficient over MOLLI T1 for both 1.5T and 3T (1.5T: -9.0% to 12.2% for T1 vs. -11.0% to 2.2% for partition coefficient; 3T: -8.0% to 10.3% for T1 vs. -1.8% to 6.8% for partition coefficient).

Figure 4

Reproducibility measurements for individual vials. Bar graph representation comparing MOLLI T1 reproducibility measurements across four different vials. Scan/rescan reproducibility is reported as the relative percent mean difference between two MOLLI scans. Smaller numbers represent better reproducibility. Data is presented as least square means ± standard error. Partition coefficient had significantly better scan/re-scan reproducibility than three of the four T1 vials with “post-contrast blood” vial being the only exception.

Figure 5

Reproducibility: Bland-Altman. Bland-Altman plots show partition coefficient and T1 reproducibility. Mean (bias) and 95% confidence interval limits of agreement are displayed. All values are presented as percentage differences.

Discussion

CMR T1 mapping indices are novel non-invasive imaging biomarkers for myocardial extracellular space measurement [22–24]. There is increasing evidence supporting the clinical utility of T1 mapping quantification as well as of the serial assessment of such values. Multi-center studies using different MR platforms are ultimately required to assess the robustness of T1 measurements as a biomarker. Our major findings are: 1) T1 values by both IR-SE and MOLLI were different across scanners in the same field strength; 2) there was no difference between partition coefficients of 1.5T scanners (47.2% vs. 47.9%, p=0.13) and only slight differences across 3T scanners (49.2% vs. 49.8% vs. 49.9%, p=0.016); 3) partition coefficient had less variability in accuracy across platforms and field strength (8.8% error for 1.5T vs. 8.0% error for 3T, p=0.11) than MOLLI T1 values (6.3% error for 1.5T vs. 10.8% error for 3T, p<0.001); 4) partition coefficient had higher scan/re-scan reproducibility than MOLLI T1 values. In summary, the partition coefficient may be more robust than MOLLI T1 values when comparing between different scanners and field strengths. It is important to note that although only partition coefficient, and not ECV, was evaluated due to lack of hematocrit data, these results can be directly translated to ECV for clinical relevance as the only difference between partition coefficient and ECV is hematocrit correction.

Accuracy

Accuracy was defined as the closeness of a MOLLI measurement to a reference IR-SE value, which was represented by percent error between MOLLI and IR-SE in this study. High T1/ECV accuracy will be particularly important for low to moderate extracellular matrix expansion diseases such as aging [25], diabetes [26], and hypertension; compared to diseases with substantial expansion like cardiac amyloidosis [27]. Different accuracy levels due to system differences will increase the inter-site variability and decrease the power of statistical comparison. Our data shows that IR-SE T1 values were different across scanners within the same field strength, validating our method of using scanner-specific IR-SE values to calculate accuracies. 17HB or 11HB protocol did not significantly affect either MOLLI T1 or partition coefficient values (p=0.177 for T1 vs. p=0.574 for partition coefficient). These results are consistent with previous reports on 1.5 and 3T scanners [8, 28]. Unlike MOLLI T1, partition coefficient accuracy was not dependent on field strength (p<0.0001 for T1 vs. p=0.109 for partition coefficient). Within the same field strength, MOLLI T1 values were significantly different across scanners (p<0.0001 for both 1.5T and 3T). However, partition coefficient had no significant difference among 1.5T scanners (p=0.13) and only had a very small difference among 3T scanners (49.2% vs. 49.8% vs. 50.0%, p=0.016).

Newer T1 mapping techniques, such as shortened modified look-locker inversion recovery (shMOLLI) [29] and saturation recovery sequences [30, 31], which are insensitive to heart rate variation were not available to us at the time of the study. ShMOLLI reduces acquisition time by using sequential inversion recovery measurements in a 5a+1a+1a sampling scheme each separated by only one R-R interval, which does not allow for full recovery of the magnetization for the three inversion pulses. Post-processing of images helps to correct for this problem by excluding data samples that fall outside accurate threshold. Saturation recovery sequences has demonstrated to have less T2 dependence and good agreement with IR-SE, as well as improved acquisition efficiency. As pre- and post-contrast T1 values are inherently different, an adaptive protocol (conditional sampling scheme) that optimizes for specific T1 ranges should improve accuracy. Preliminary data has shown subtle improvements of one such adaptive scheme over the standard MOLLI [32] with less variation at higher heart rates for 1.5T [9, 33]. In addition, latest MOLLI sequence has offered the flexibility of a fixed time pause in seconds instead of the traditional heartbeats between inversion recovery blocks. This improvement is important for proper magnetization recovery in subjects with fast heart rates, especially at 3T where the pre contrast T1 value is longer.

It is well know that considerable spatial variation in transmit field (B1) exists even at 1.5T and adiabatic pulses are used to reduce the sensitivity to B1 field inhomogeneity. Kellman and et al. demonstrated that a shorter tangent/hyperbolic pulse outperforms the traditional hyperbolic secant pulse with an improved inversion factor of 0.96 [34]. This improved inversion efficiency translates directly into higher MOLLI T1 accuracy and meet the specific absorption rate requirement of both 1.5T and 3T. Future research should explore new T1 acquisition techniques to more accurately assess myocardial and blood pool T1.

Precision/reproducibility

Reproducibility or precision is defined as the degree of closeness to which repeated measurements show similar results, which was measured by relative mean percent error between MOLLI scan repetitions. High reproducibility/precision leads to greater reliability of observed changes for a given parameter and significant reduction in sample size needed, as sample size varies with the square of the reproducibility.

Liu et al. reported good ECV and partition coefficient reproducibility for a single center; however, a lack of ECV and partition coefficient reproducibility/precision data exists for multicenter studies [20]. In this study, we demonstrated that although both MOLLI T1 and partition coefficient reproducibility were different across scanners and affected by field strength, they were not affected by heart rate (p=0.432 for T1 vs. p=0.375 for partition coefficient). When comparing partition coefficient to T1 values individually, partition coefficient had better precision than T1 for all vials, with only the “post-contrast blood” vial not showing a significant difference (p=.096 for “post-contrast blood” vial vs. p<0.05 for all others). Tighter limits of agreement for partition coefficient over MOLLI T1 for both 1.5T and 3T via Bland-Altman analysis further demonstrated better reproducibility of partition coefficient over T1 values. Thus, relative measures, such as partition coefficient, displayed its superiority to direct T1 quantification for reproducibility. This will translate directly to better power and smaller sample size requirement for ECV over T1 in multi-center studies [20].

Limitations

Several limitations in this study existed. First, no in vivo human data was used for the study. As the purpose of this study was to validate the accuracy and reproducibility of the acquisition technique itself, phantoms provided the most reproducible tools to examine and optimize the various parameters. To test the accuracy and precision across multiple scanners in-vivo, serial contrast-enhanced CMR studies need to be performed on the same subjects within a short time interval on different scanners. Such testing is unlikely due to the risks associated with multiple injections of MR contrast agents within a short time frame. Measurement errors are expected to be higher in patients compared with phantoms because of increased errors associated with physiological variations in-vivo. Additionally, ECV, rather than partition coefficient, is appearing to be more useful in the detection of subtle abnormalities present in diffuse myocardial fibrosis due to the large variability in patient hematocrit data [17]. As the only difference between partition coefficient and ECV is the hematocrit factor of roughly 0.4, the results in this study are easily translatable. Furthermore, only one time point post-contrast was chosen exemplarily. This coincides with most clinical protocols. Lastly, it is well known that T1 values could be affected by many factors, such as, room temperature [35]. Relative, and not absolute, accuracy and reproducibility measurements were reported in this study. Accuracy measures were standardized with IR-SE T1 and precision measures compared two MOLLIs with one another under same technical condition. This approach negates the potential influence of temperature and many other factors that might affect the results of comparison across different scanners.

Conclusion

Our data indicates that significant accuracy and precision/reproducibility variation of T1 indices exists across scanners. This finding is consistent with across scanners variation of other quantitative CMR indices, such as apparent diffusion coefficient [36], fractional anisotropy and mean diffusivity [37], and voxel based morphometry [38]. MOLLI precision is preserved, and increases when partition coefficient is calculated. Over the entire range of T1 values expected to be encountered before and after gadolinium administration, the precision of partition coefficient, a relative T1 mapping index, was approximately 25% better than absolute T1 values. As multi-center studies using different MR platforms are ultimately required to assess the value of T1 measurements as a surrogate biomarker, pooling data together without quantification and control of the inter-site variability might affect statistical analysis which could require a larger sample size to compensate for such variability. In addition, serial assessment should be performed on the same platform. A pilot phantom study might be helpful to identify any scanners that may deviate from others with respect to T1 measurement.