Abstract
Background
The D1-dopamine receptor radioligand [11C]SCH23390 has been frequently used in PET studies. In drug-naïve patients with schizophrenia, the findings have been inconsistent, with decreases, increases, and no change in the frontal cortex D1-dopamine receptors. While these discrepancies are likely primarily due to a lack of statistical power in these studies, we speculated that an additional explanation may be the differences due to methods of image analysis between studies, affecting reliability as well as bias between groups.
Methods
Fifteen healthy subjects underwent two PET measurements with [11C]SCH23390 on the same day. The binding potential (BPND) was compared using a 95% confidence interval following manual and automated delineation of a region of interest (ROI) as well as with and without frame-by-frame realignment.
Results
Automated target region delineation produced lower BPND values, while automated delineation of the reference region yielded higher BPND values. However, no significant differences were observed for repeatability using automated and manual delineation methods. Frame-by-frame realignment generated higher BPND values and improved repeatability.
Conclusions
The results suggest that the choice of ROI delineation method is not an important factor for reliability, whereas the improved results following movement correction confirm its importance in PET image analysis. Realignment is therefore especially important for measurements in patient populations such as schizophrenia or Parkinson’s disease, where motion artifacts may be more prevalent.
Similar content being viewed by others
Explore related subjects
Find the latest articles, discoveries, and news in related topics.Background
The development of molecular imaging in the 1980s was largely driven by the need to examine the dopamine system in CNS disorders such as schizophrenia and Parkinson’s disease [1, 2]. For this reason, radioligands were developed for the D1-dopamine receptor (D1-DR), the D2-dopamine receptor (D2-DR), and for the presynaptic synthesis of dopamine. In the research on the pathophysiology of schizophrenia, a large number of PET studies on the dopamine system have since then been reported and covered in reviews and meta-analyses [3, 4]. However, for the dopamine receptors and transporters, the results have been inconsistent in several respects. One example is D1-DR binding, which has been reported as lower, unchanged, and higher in the frontal cortex [5,6,7,8,9,10]. Medication effects may explain some of the differences between the results since experimental studies have shown that D1-R expression is affected by antipsychotic medication [11,12,13]. However, studies in drug-naïve patients have also been inconclusive [5,6,7,8]. For these analyses, sample sizes have typically been small, leading to an increased risk for both type I and type II errors [9, 13, 14]. A wider consideration is that the series of D1-DR studies in schizophrenia has been reported over many years during which time the methods for image analysis have been improved, including the development of new software and strategies for the definition of regions of interest (ROI) and methods for motion correction. Hence, it cannot be excluded that differences in methodological reliability may also contribute to the discrepant findings to some degree.
In the early years of PET imaging, the delineation of ROIs was performed manually directly on the PET images and guided only by the regional distribution of radioactivity. In the late 1980s, the advent of magnetic resonance imaging (MRI) allowed for manual ROI definition on individual MR images and co-registration to the PET images. Subsequently, structural brain atlases and software tools were developed for automated definition of ROIs, offering advantages in terms of reduced investigator bias and workload [15].
The agreement between manual and automated ROI delineations on PET-measured receptor-binding measurements using PET has been addressed in several studies. Good agreement has been demonstrated for tracers with widespread homogenous cortical binding [16,17,18,19] as well as more restricted subcortical binding [20, 21]. For [11C] raclopride binding to the D2-DR, which is restricted to the striatum, there was also a good agreement in repeatability as assessed using a test-retest design [21]. In contrast to the D2-DR, the D1-DR is widely expressed in the cortical regions. Importantly, the proximity of the cortical regions to the subarachnoidal space provides specific challenges for ROI definition and may also render measurements more susceptible to motion artifacts.
The primary aim of the present PET study with [11C]SCH23390 in healthy subjects was to compare manual and automated methods for ROI definition of both subcortical and cortical regions in a test-retest design. The secondary aim was to evaluate the effect of motion correction, and the third was to compare the use of manual and automated ROIs for the reference region, cerebellum. The methods were compared with regard to the size and spatial agreement of the ROIs, the binding potential (BPND) values, and repeatability of the BPND values.
Methods
Sixteen healthy subjects, age 22–35 years, were enrolled at the Center for Psychiatry Research, Department of Clinical Neuroscience, Karolinska Institutet, and Stockholm County Council, Stockholm, Sweden. One subject was excluded from the analysis due to incorrect head positioning in the PET system rendering a small portion of the cerebellum visible in only one image section. All subjects were male since this study was made in preparation for a planned phase 1 trial on drug-induced D1-DR occupancy.
The subjects were healthy according to medical history, physical examination, MRI, blood and urine chemistry, and psychiatric screening based on M.I.N.I. interview, Becks Anxiety Inventory, the Montgomery-Åsberg Depression Rating Scale, and the Alcohol Use Disorders Identification Test (AUDIT). They had no history of alcohol or drug addiction or abuse [22], frequent nicotine use, or history or presence of epilepsy and brain injury. A urine drug screening was performed at screening and before each PET measurement.
All subjects underwent MRI, performed on a 1.5-T Siemens Avanto imaging system (Siemens AG, Muenchen, Germany) at Praktikertjänst Röntgen, Odenplan, Stockholm, Sweden. Each individual underwent one MR examination. A T2-weighted measurement was performed to rule out any brain abnormality, and a T1-weighted measurement was performed with isometric 1-mm voxels used for gray and white matter segmentation and delineation of ROIs. The T2 protocol used the following sequence: repetition time/echo time = 4990/100 ms, field of view 230 mm, image matrix 18 blades, flip angle 150°, and slice thickness = 5 mm. The T1 protocol used a 3D sagittal magnetization-prepared rapid gradient-echo (3D MP-RAGE) with the following sequence: repetition time/echo time/inversion time = 1790/3.53/1100 ms, field of view 260 mm, image matrix 256 mm × 208 mm, flip angle 15°, and slice thickness = 1 mm.
For each subject, examinations were performed twice on the ECAT EXACT HR PET system, in the morning and afternoon, respectively. Radioactivity in the brain was measured with 3D data acquisition. The spatial resolution in the reconstructed sections is 3.6 mm at the center of the field of view [23]. A transmission scan was performed using three rotating 68Ge rod sources for 5 min.
To minimize head movement during the PET measurement, a plaster helmet was made for each subject individually, for use during the PET measurement [24]. At the start of the PET measurement, a sterile phosphate buffer (pH = 7.4) containing [11C]SCH23390 was injected as a bolus during several seconds into the cubital vein. The venous catheter was then immediately flushed with up to 10 mL saline solution.
The injected radioactivity was 333 ± 44 and 332 ± 49 MBq (mean, SD), in the morning and the afternoon, respectively, with a specific radioactivity of 507 ± 244 and 574 ± 238 MBq/nmol, which correspond to a mass of 0.23 ± 0.13 μg and 0.20 ± 0.10 μg (mean ± SD) [25].
Following injection, emission data were collected for 51 min in a sequence of 13 time frames. The time frames of acquisition data were reconstructed into a series of 3D PET images of radioactivity concentration. Images were reconstructed to correct for attenuation and scatter using 2D filtered back projection, with a Hanning filter (2.0 mm) on a 128 × 128 matrix and azoom = 2.17. The voxel size was 2.030 × 2.030 × 3.125 mm.
MR and PET image processing
Processing of MRI and PET data
The PET images were corrected for head movement using a frame-by-frame realignment algorithm, in which all frames were individually realigned to the first minute of acquisition [26] using SPM5 (Wellcome Department of Cognitive Neurology, University College London) [27]. For comparison, a parallel data set was created for which no realignment was performed.
The T1-weighted MR images were reoriented according to the line defined by the anterior and posterior commissures (AC-PC line) being parallel to the horizontal plane and the inter-hemispheric plane parallel to the sagittal plane. The MR images were then co-registered to the summation PET image (9–51 min) using SPM5 (Wellcome Department of Imaging Neuroscience, London, UK) using the normalized mutual information algorithm [28] and the default 7 × 7 FWHM smoothing of the 256 × 256 joint histogram.
The MR images were used to delineate anatomical regions of interest (ROI) for the caudate nucleus (CAU), the putamen (PUT), the dorsolateral prefrontal cortex (DLPFC), and the insular cortex (INS). Each region was defined by a manual and an automated method, respectively. The regions were chosen to represent the regions of central interest in schizophrenia research and include high- and low D1-DR density regions with different degrees of proximity to CSF. Regions with more CSF borders may be particularly vulnerable to errors in ROI definition or motion artifacts. The caudate and putamen are high-D1-DR density regions bordering and not bordering to CSF, respectively. The DLPFC and INS are low-density D1-DR regions bordering more and less to CSF, respectively.
Manual ROIs
For the manual method, an in-house software, HBA [29], was used where the reoriented MP-RAGE volume was loaded for manual delineation of the ROIs on any of the three orthogonal projections. The manual segmentation was performed by one investigator (PS) who has more than 20 years of experience in manual ROI delineation. The CAU and PUT were delineated as described by Mawlawi et al. [30], with the modification that the sagittal planes were used instead of the coronal. The DLPFC was traced on all the coronal planes anterior to the genu of the corpus callosum. The INS was delineated on all of its transaxial planes. The cerebellum was drawn on the central six transaxial images of the cerebellum separately on each hemisphere and about 1 cm distant from the subarachnoidal space. The manual ROIs were not masked by the GM map in order to have a complete manual method of gray-white matter segmentation for comparison with the automated ROIs that were masked by the GM map. The ROIs were translated into each PET study space using the inter-modality co-registration matrices.
Automated ROIs
The automated definition of target ROIs was performed using FreeSurfer (FS, version 5.0.0, http://surfer.nmr.mgh.harvard.edu/) [31] to obtain subject-specific anatomical delineation by reconstruction of the cortex and segmentation of subcortical structures as described elsewhere [32, 33]. The FreeSurfer morphometric procedures have been shown to exhibit good reproducibility across scanner manufacturers and across different field strengths [34, 35] and have been validated against histological [36] and manual measurements [37]. In addition, the cortical structures are divided based on individual cortical folding patterns to match the cortical geometry across subjects [38].
The ROI for the dorsolateral prefrontal cortex used here comprises the ctx-rostralmiddlefrontal and ctx-parstriangularis regions of the Desikan-Killiany Atlas in FreeSurfer [39].
Finally, an automated ROI for the cerebellum was defined using FSL (the FMRIB Software Library), a library of analysis tools for brain imaging data [40]. This region was defined using the maximum probability FSL MNIfnirt atlas segmentation with 25% probability threshold [41], from which a mask was defined containing cerebellar regions VI, crus I, and crus II (indices [5, 7, 8, 10, 11, 13]). This mask was then registered to the space of each individual’s MR using the inverse FNIRT warp parameters. This mask was subsequently then trimmed as follows: 8 mm from the cortex, 8 mm from the vermis (defined using the same atlas), 4 mm from the edge of the brain mask (FSL brain mask). In addition, voxels belonging to the two most inferior planes of the PET image were excluded from the ROI. The resulting ROI was multiplied by the FreeSurfer gray matter segmentation mask to obtain a ROI consisting of only those voxels identified as belonging to gray matter. For more information, see Matheson et al. [42]. The purpose was to compare the different impact on the BPND value using a standardized automatically delineated cerebellum compared to using the manual cerebellum as reference region.
Time-activity curves
The two ROI data sets (manual and automated) were applied to extract time-activity curves (TACs) from the four dynamic PET images (test and retest each processed with or without realignment) amounting to eight sets of TACs.
Calculation of BPND values
The regional BPND values for [11C]SCH23390 binding to D1-DR were calculated with the simplified reference tissue model using the cerebellum curve as an estimate for non-specifically bound [11C]SCH23390 [43]. The eight sets of TACs were analyzed twice using the manual and modified FSL cerebellum ROI-derived TAC, respectively, amounting to 16 sets of BPND values for each measurement.
Comparison of ROI volumes
To compare manually and automatically generated ROIs (FreeSurfer and FSL), the number of voxels for each paired ROI (both hemispheres) was extracted from the ROI files and converted to cubic millimeter. The spatial agreement between the methods was expressed by the Jaccard coefficient which is the ratio between the size of the intersection and the size of the union of the voxel sets:
The coefficient can vary between 0 (no agreement) and 1 (perfect match).
In addition, the spatial agreement was estimated for the relatively smaller manual ROI by the percentage of the manual ROI covered by the FreeSurfer or FSL ROI:
The values increase with the overlap of the manual and automated ROIs so that 100% indicates that the manual ROI is completely encompassed by the FreeSurfer or FSL ROI.
Statistics
Statistical analysis—general
In the following, the terminology related to the statistical analysis follows the recommendations of the Terminology Working Group of the Quantitative Imaging Biomarker Alliance [44]. The inclusion of a test-retest analysis serves two purposes. First, it allows for the examination of the repeatability of PET measurements with [11C]SCH23390. Second, it can be viewed as a duplicate measure of the same variable, i.e., in the same way as the mean of triplicate measurements commonly are used in biochemistry and bioanalyses.
Test-retest analysis
Repeatability was measured by calculating the absolute variability (AV) expressed as the difference in the BPND values between the first and second PET measurements relative to the mean of the two values according to the following equation:
The intraclass correlation coefficient (ICC) was used as a relative measure of reliability in BPND, where the variability between the test and retest BPND is related to the variability of BPND among the subjects according to the following equation:
where MSB is the between-subject mean sum of squares, MSW is the within-subject mean sum of squares, and k represents the number of observations (in this case 2). The ICC is an estimation of reliability, which is the “true” variance/total variance. Thus, a value of 1 means that there is no measurement error at all, while a value of 0 means that the obtained measurements are entirely comprised of measurement error. Zero is therefore technically the lowest value for the ICC, and a negative value can be approximated by 0.
Comparisons of ROI volumes and BPND values between the methods for image analyses
The advantages of interval estimate compared to point estimate as the output of statistical analysis have been demonstrated for medical research in general [45, 46] and specifically for the comparison of quantitative biomarkers [47]. Hypothesis testing for a point estimate using a p value is a binary (yes or no) decision even for minor differences that may not be of practical importance [48]. It may thus be more useful to evaluate the data with an interval estimate that in addition to a p value provides a plausible range for the true value, which can be judged subjectively on an agreement between and precision of the methods [49].
Computation of median, interquartile range (25th to 75th), and coefficient of variation (CoV; \( \frac{\mathrm{standard}\ \mathrm{deviation}}{\mathrm{mean}} \)) was applied to evaluate the distribution and variability of the BPND values. Computation of a 95% confidence interval was applied for the evaluation of the agreement and precision of the two ROI volumes (manual and automated), and the two BPND values from the three comparisons in the image analysis (ROI definition, realignment and definition of reference region).
The two PET measurements and the two methods in each of the three comparisons of the analysis amounted to 2 × 2 × 2 × 2 equals 16 sets or 8 pairs of BPND values for each ROI as illustrated in Additional file 1: Table S1 for the test-retest combinations. The balanced data set made it possible to test for agreement between the pairs of BPND values only once instead of for each of the eight combinations of the test-retest and three pairs of methods of analysis (manual target ROI/automated target ROI, no realignment/realignment, manual reference ROI/automated cerebellum ROI). Hence, the statistical computations were applied once for each pair of BPND values using the mean BPND value of the other eight combinations of data (2 × 2 × 2). This averaging was justified after testing by ANOVA for the absence of two- and three-way interactions among the pairs of variables.
The two absolute variability (AV) values and ICC values were also evaluated for agreement and precision by the mean differences and confidence intervals in the same way as for the BPND values with the difference that there were 2 × 2 × 2 (i.e., eight sets or four pairs) AV and ICC values for each of the three parts of the image analysis. The comparison of ICC values between the methods was assessed by using the 95% confidence intervals [50] to examine whether there was an overlap between the confidence intervals between the pairs of methods compared.
Results
The subjects completed the study according to the protocol. Each subject underwent one T1 MRI scan on 1 day and two PET measurements in the morning and afternoon of another day after a negative urine drug screen on the same day. The time gap between PET and MRI studies was 1 to 96 days, median 6 days.
The spatial agreement of the manual and FreeSurfer ROIs estimated by the Jaccard coefficient varied between 32 and 69% (Table 1). The highest values were obtained for the caudate (59%), putamen (57%), and insula (69%), indicating that the ROIs overlapped to a major extent. The percentage of the manual ROI covered by the FreeSurfer ROI varied between 51.3 and 92.5%.
The ROI volumes were calculated by the number of voxels multiplied by the voxel volume for each paired ROI (both hemispheres) extracted from the ROI files. Worth noting is that the positioning of the head in the gantry differed slightly between the two PET measurements, and the subsequent two sets of re-sliced ROIs in PET space differed in volumes by 1.7 ± 3.0% (mean ± SD).
Each of the FreeSurfer ROIs and the modified FSL cerebellum ROI were significantly larger compared to the corresponding manual ROIs (Figs. 1a and 2, Table 2). The 95% CI for the differences was relatively narrow indicating a high precision for both methods (Fig. 1a, Table 2). The CoV (%) for the manual ROI volume was generally higher than for the automatically generated ROIs.
Bland-Altman plots with the mean and 95% confidence interval of ROI volumes (a) and binding potential (BPND) of [11C]SCH23390 (b) of the caudate, putamen, dorsolateral prefrontal cortex, and insula derived from manual (man) and FreeSurfer (FS) methods. Man = manual, FS = FreeSurfer, CAU = caudate, PUT = putamen, DLPFC = dorsolateral prefrontal cortex, and INS = insula
Color-coded voxels of the manual (Man) and automated (Aut) ROIs superimposed on the corresponding MR image of a healthy volunteer selected at random. ROIs generated manually are superimposed on those generated by FreeSurfer. CAU = caudate, PUT = putamen, DLPFC = dorsolateral prefrontal cortex, INS = insula, and CBL = cerebellum
As can be seen from the TACs, there was a rapid initial increase of brain radioactivity that peaked after 5–10 min followed by a rapid decline (Fig. 3). The AUC of the TACs for the realigned PET images was 2–18% higher for the manually generated target ROIs when compared to that of the FreeSurfer (p < 0.001; data not shown) (Fig. 3). The AUC of the cerebellum TACs were similar in the beginning and 3% higher during the last 24 min for the manual CBL compared to modified FSL CBL (p < 0.001 for the last 24 min; data not shown).
Time-activity curves from a healthy volunteer after i.v. injection of [11C]SCH23390 in the morning (left) and afternoon (right). The curves were derived from realigned dynamic PET images using manually and automatically generated ROIs, respectively. PUT = putamen, DLPFC = dorsolateral prefrontal cortex, CBL = cerebellum. SUV = standardized uptake value = (CROI/inj dose) × body weight
The eight sets of target TACs and two sets of cerebellum TACs amounted to 16 BPND values for each ROI (Additional file 1: Table S1). The statistical computations of the regional BPND values for the three parts of the analysis are listed in Table 2. The 95% CI for most of the differences was relatively narrow and did not contain zero indicating statistical significance for the difference between methods (Fig. 1b). The manually generated BPND values were 3–21% higher with a generally low CoV and interquartile range compared to that of the automatically generated BPND values. After realignment, the BPND values became higher for the caudate and DLPFC (Table 2). On the contrary, the BPND values for putamen and insula did not increase after realignment. The use of the modified FSL cerebellum ROI increased BPND by 3 to 7% in all regions as compared to that of the manual CBL.
The absolute variability values (AV) for each of the four regional BPND values were calculated for the total of eight pairs of regional BPND values from the three parts of the analysis (2 × 2 × 2 = 8) (Additional file 1: Table S1). The AV values among the methods varied between 3.9–11.9% for the caudate and putamen and 8.0–17.9% for the DLPFC and insula. The 95% CI of the mean difference in AV was wide and included zero in most cases indicating no significant differences (Table 3). However, following realignment, the 95% CI of the mean difference in AV did not overlap with zero for caudate, putamen, and DLPFC, suggesting a small but significant improvement. The use of automated cerebellum did not improve the AV values in any region compared to that of the manual. The ICCs were generally higher using FreeSurfer, but all comparisons fell within the limits of the 95% confidence intervals, meaning that these differences are not significant.
Discussion
The main objective of the present study was to examine the impact of specific methodological steps used in quantitative image analysis of [11C]SCH23390 binding to D1-DR on variability and reliability. The methods were chosen to allow for comparison to historical conditions so that the results would be applicable for interpreting the existing PET literature. For that purpose, data were acquired using the PET system ECAT EXACT HR, which has a resolution comparable to the currently widely used whole-body PET systems. In relation to the major aims of the study, the results show that automated ROIs generally produce lower BPND values than manual ROIs, whereas absolute variability was similar. Moreover, the use of realignment improved the absolute variability, and an automated cerebellum ROI yielded slightly increased BPND values.
The volumes were significantly larger for the automated ROIs, with lower interindividual variability except for the cerebellum, which had larger variability for the automated ROI (Table 2). The differences in volumes between the methods were largest for the caudate and putamen. Similar results of smaller manual compared to FreeSurfer striatal ROIs, but with greater interindividual variability, have recently been reported when analyzing MRI data for the caudate and putamen [22, 51]. Other studies have demonstrated that FS can produce measurements that are comparable to those derived from manual tracing of ROIs [52, 53]. However, manual editing of FS ROIs may still be required in order to improve validity [54].
The intersection of the manual and FreeSurfer ROIs was smaller than the manual ROI itself, which indicates that the ROIs did not overlap completely or in a symmetrical fashion (Table 1). Hence, to shrink or erode the FreeSurfer ROI, as shown for partial volume correction [55], to the same volume as the manual would still result in a placement mismatch.
FreeSurfer has become the standard for obtaining cortical metrics with demonstrated high validity and reliability [56]. For the subcortical regions, manual segmentation still remains the gold standard due to a better specificity of anatomic boundaries compared to FreeSurfer which yields larger caudate and putamen and to FSL-FIRST generating larger caudate ROIs [51, 57]. However, manual subcortical ROI volumes do also vary between different raters [57]. Hence, the differences in the size and placement of the ROIs in the present study may be due to both systematic differences in anatomical designation and in software-based segmentation.
The higher BPND for the manual ROIs is consistent with their smaller volumes (Table 2). All regions examined have a higher BP when compared with surrounding tissue or the subarachnoidal space. More spill-out than spill-in of the measured radioactivity will yield a recovery coefficient < 1. It is thus conceivable that recovery and BPND will be lower for a larger delineation of a particular ROI.
After realignment of the dynamic PET images, the BPND values were significantly higher for the caudate and the dorsolateral prefrontal cortex. For putamen and insula, there was no evident effect of realignment on the BPND values. A possible explanation for the regional differences in the impact of realignment is that the caudate and dorsolateral prefrontal cortex border to the subarachnoidal or ventricular space where radioactivity is very low or negligible. These regions are thus more sensitive to movement artifacts, while the putamen and insula are embedded in the white matter and subsequently less sensitive.
The use of the modified FSL ROIs for CBL increased the BPND values by a few percents and decreased the corresponding CoVs for all regions compared to those obtained using the manual cerebellum (Table 2). A possible explanation is that the trimmed and masked FSL ROIs for CBL are less sensitive to the partial volume effects. However, the small difference and narrow CI indicate similarity between these measures and hence the usefulness of both the manual and automated cerebellum ROI.
Generally, the absolute variability decreased significantly after realignment, likely due to the influence of more reliable TACs on the subsequent calculation of the BPND. For the CAU and PUT, which were the regions showing the highest degree of anatomical overlap in our study and therefore represents the best points of comparison, the absolute variability was 6.47 and 3.54% respectively for the automated ROIs (Additional file 1: Table S1). These observations are in line with two previous test-retest studies using manual ROIs to quantify [11C]SCH23390 binding. Hirvonen and coworkers investigated five healthy volunteers and found an absolute variability of 4.2–6.6% [58], whereas the absolute variability was 7.8–8.4% in a recent study on 13 individuals [59]. Importantly, the present study shows that the use of automated ROIs has a similar absolute variability of D1-DR BPND values as compared to that of manual ROIs.
The present level of absolute variability among all the brain regions is comparable to that of other PET neuroreceptor radioligands such as [11C]raclopride [21, 60], [11C]FLB 457 [61], [11C]MADAM [62], and [11C]AZ10419369 [63]. The repeatability of PET-measured BPND is of importance to increase the statistical power in receptor occupancy studies, as well as in both cross-sectional and longitudinal studies. For instance, a power analysis based on the present results gives a statistical power to detect a 20% change in BPND (n = 10) in the putamen of 100 and 96% for the manual and FreeSurfer methods, respectively. A 20% change represents a Cohen’s d of over 6, which is extremely high for biological changes but commonly seen in drug receptor occupancy studies.
Whereas significant ventricular enlargement and cerebral cortical atrophy are a well-replicated observation in schizophrenia, these changes are usually small and require large sample sizes for detection [64, 65]. Hence, the present findings in healthy volunteers should be applicable in schizophrenia research. Importantly, our results do not support a role for different ROI delineation methods as an explanation for discrepant results in studies on D1-R in drug-naïve schizophrenia. In contrast, the present increase in BPND in putamen and DLPFC with improved absolute variability after realignment may be more relevant. In studies in drug-naïve samples, Okubo et al. found lower D1-R in the frontal cortex in patients, whereas Abi-Dargham and colleagues found higher levels [5, 6] and Karlsson et al. found no significant differences, although D1-R was numerically higher with an effect size of 0.3 in the frontal cortex [8, 13]. Across all of these papers, movement correction is only described in the 2002 study by Abi-Dargham et al. [5], but no information is provided in the 2012 paper [6]. Although both our previous and the present studies employed head fixation to minimize head movement, the present results show that the absence of movement correction may still produce both lower BPND and lower reliability. It should be noted that the magnitude of change in BPND values following movement correction would not be sufficiently large to explain the differences in the direction of the reported clinical findings. However, it may be speculated that movement artifacts may have occurred more commonly among patients than healthy volunteers and subsequently biased the results.
In contrast to the subtle structural brain changes in schizophrenia, gross changes are consistently seen in neurodegenerative diseases such as Alzheimer’s, Parkinson’s, and Huntington’s diseases [66,67,68]. Structural brain changes may be biased differently by the manual and automated methods, as shown in a recent cross-validation study among automated and manual ROI methods on patients with multiple sclerosis where differences in atrophy measurements both in size and proportionality were demonstrated [69]. Although FreeSurfer has functionality for manual intervention to accommodate for certain morphological changes [54], the present results of similar absolute variability of manual and automated FresSurfer ROI definition (for PET) in healthy subjects need to be confirmed in patient with neurodegenerative disorders.
There are two major advantages of automated ROI definition. First, it is less labor-intensive than tedious hand tracing of ROIs, especially in large high-resolution data sets, and second, it is less biased to rater subjectivity when compared to manual methods. Additionally, automated ROI definition is more amenable for pooling data for meta-analysis, an important aspect since PET studies in patient populations usually have small sample sizes.
Conclusions
In summary, the results show that the repeatability of BPND was similar between the manual and FS ROIs, while it improved after realignment in all regions. The results suggest that the choice of the ROI method is more dependent on questions of validity, such as anatomical precision, which may be particularly important in patients with gross morphological changes or very localized pathology. The importance of the correction of motion artifacts by realignment to obtain higher and more reliable BPND values may be particularly important in patient populations such as schizophrenia where motion artifacts may be more prevalent.
References
Wagner HN Jr, Burns HD, Dannals RF, Wong DF, Langstrom B, Duelfer T, et al. Imaging dopamine receptors in the human brain by positron tomography. Science. 1983;221:1264–6.
Garnett ES, Firnau G, Nahmias C. Dopamine visualized in the basal ganglia of living man. Nature. 1983;305:137–8.
Howes O, McCutcheon R, Stone J. Glutamate and dopamine in schizophrenia: an update for the 21st century. J Psychopharmacol. 2015;29:97–115. https://doi.org/10.1177/0269881114563634.
Kambeitz J, Abi-Dargham A, Kapur S, Howes OD. Alterations in cortical and extrastriatal subcortical dopamine function in schizophrenia: systematic review and meta-analysis of imaging studies. Br J Psychiatry. 2014;204:420–9. https://doi.org/10.1192/bjp.bp.113.132308.
Abi-Dargham A, Mawlawi O, Lombardo I, Gil R, Martinez D, Huang Y, et al. Prefrontal dopamine D1 receptors and working memory in schizophrenia. J Neurosci. 2002;22:3708–19.
Abi-Dargham A, Xu X, Thompson JL, Gil R, Kegeles LS, Urban N, et al. Increased prefrontal cortical D(1) receptors in drug naive patients with schizophrenia: a PET study with [(1)(1)C]NNC112. J Psychopharmacol. 2012;26:794–805. https://doi.org/10.1177/0269881111409265.
Okubo Y, Suhara T, Suzuki K, Kobayashi K, Inoue O, Terasaki O, et al. Decreased prefrontal dopamine D1 receptors in schizophrenia revealed by PET. Nature. 1997;385:634–6.
Karlsson P, Farde L, Halldin C, Sedvall G. PET study of D(1) dopamine receptor binding in neuroleptic-naive patients with schizophrenia. Am J Psychiatry. 2002;159:761–7.
Kosaka J, Takahashi H, Ito H, Takano A, Fujimura Y, Matsumoto R, et al. Decreased binding of [11C]NNC112 and [11C]SCH23390 in patients with chronic schizophrenia. Life Sci. 2010;86:814–8. https://doi.org/10.1016/j.lfs.2010.03.018.
Hirvonen J, van Erp TG, Huttunen J, Aalto S, Nagren K, Huttunen M, et al. Brain dopamine d1 receptors in twins discordant for schizophrenia. Am J Psychiatry. 2006;163:1747–53. https://doi.org/10.1176/ajp.2006.163.10.1747.
Lidow MS, Goldman-Rakic PS. A common action of clozapine, haloperidol, and remoxipride on D1- and D2-dopaminergic receptors in the primate cerebral cortex. Proc Natl Acad Sci U S A. 1994;91:4353–6.
Lidow MS, Elsworth JD, Goldman-Rakic PS. Down-regulation of the D1 and D5 dopamine receptors in the primate prefrontal cortex by chronic treatment with antipsychotic drugs. J Pharmacol Exp Ther. 1997;281:597–603.
Cervenka S. PET radioligands for the dopamine D1-receptor: application in psychiatric disorders. Neurosci Lett. 2018; https://doi.org/10.1016/j.neulet.2018.03.007.
Poels EM, Girgis RR, Thompson JL, Slifstein M, Abi-Dargham A. In vivo binding of the dopamine-1 receptor PET tracers [(1)(1)C]NNC112 and [(1)(1)C]SCH23390: a comparison study in individuals with schizophrenia. Psychopharmacology. 2013;228:167–74. https://doi.org/10.1007/s00213-013-3026-8.
Klein A, Andersson J, Ardekani BA, Ashburner J, Avants B, Chiang MC, et al. Evaluation of 14 nonlinear deformation algorithms applied to human brain MRI registration. NeuroImage. 2009;46:786–802. https://doi.org/10.1016/j.neuroimage.2008.12.037.
Chow TW, Takeshita S, Honjo K, Pataky CE, St Jacques PL, Kusano ML, et al. Comparison of manual and semi-automated delineation of regions of interest for radioligand PET imaging analysis. BMC Nucl Med. 2007;7:2. https://doi.org/10.1186/1471-2385-7-2.
Raniga P, Bourgeat P, Fripp J, Acosta O, Villemagne VL, Rowe C, et al. Automated (11)C-PiB standardized uptake value ratio. Acad Radiol. 2008;15:1376–89. https://doi.org/10.1016/j.acra.2008.07.006.
Rosario BL, Weissfeld LA, Laymon CM, Mathis CA, Klunk WE, Berginc MD, et al. Inter-rater reliability of manual and automated region-of-interest delineation for PiB PET. NeuroImage. 2011;55:933–41. https://doi.org/10.1016/j.neuroimage.2010.12.070.
Su Y, D’Angelo GM, Vlassenko AG, Zhou G, Snyder AZ, Marcus DS, et al. Quantitative analysis of PiB-PET with FreeSurfer ROIs. PLoS One. 2013;8:e73377. https://doi.org/10.1371/journal.pone.0073377.
Wallius E, Tohka J, Hirvonen J, Hietala J, Ruotsalainen U. Evaluation of the automatic three-dimensional delineation of caudate and putamen for PET receptor occupancy studies. Nucl Med Commun. 2008;29:53–65. https://doi.org/10.1097/MNM.0b013e3282f1bba0.
Johansson J, Alakurtti K, Joutsa J, Tohka J, Ruotsalainen U, Rinne JO. Comparison of manual and automatic techniques for substriatal segmentation in 11C-raclopride high-resolution PET studies. Nucl Med Commun. 2016;37:1074–87. https://doi.org/10.1097/MNM.0000000000000559.
Johansson J, Alakurtti K, Joutsa J, Tohka J, Ruotsalainen U, Rinne JO. Comparison of manual and automatic techniques for substriatal segmentation in 11C-raclopride high-resolution PET studies. Nucl Med Commun. 2016; https://doi.org/10.1097/MNM.0000000000000559.
Wienhard K, Dahlbom M, Eriksson L, Michel C, Bruckbauer T, Pietrzyk U, et al. The ECAT EXACT HR: performance of a new high resolution positron scanner. J Comput Assist Tomogr. 1994;18:110–8.
Bergstrom M, Boethius J, Eriksson L, Greitz T, Ribbe T, Widen L. Head fixation device for reproducible position alignment in transmission CT and positron emission tomography. J Comput Assist Tomogr. 1981;5:136–41.
Halldin C, Stone-Elander S, Farde L, Ehrin E, Fasth KJ, Langstrom B, et al. Preparation of 11C-labelled SCH 23390 for the in vivo study of dopamine D-1 receptors using positron emission tomography. Int J Radiat Appl Instrum Part A. 1986;37:1039–43.
Schain M, Toth M, Cselenyi Z, Stenkrona P, Halldin C, Farde L, et al. Quantification of serotonin transporter availability with [11C]MADAM—a comparison between the ECAT HRRT and HR systems. NeuroImage. 2012;60:800–7. https://doi.org/10.1016/j.neuroimage.2011.12.047.
Friston KJ, Ashburner J, Frith CD, Poline J-B, Heather JD, Frackowiak RSJ. Spatial registration and normalization of images. Hum Brain Mapp. 1995;3:165–89.
Studholme C, Hill D, Hawkes DJ. Normalized entropy measure of 3-D medical image alignment. Medical imaging 1998. San Diego; 1998. p. 132–43.
Roland PE, Graufelds CJ, Wåhlin L, Ingelman L, Andersson M, Ledberg A, et al. Human brain atlas: for high-resolution functionel and anatomical mapping. Hum Brain Mapp. 1994;1:173–84.
Mawlawi O, Martinez D, Slifstein M, Broft A, Chatterjee R, Hwang DR, et al. Imaging human mesolimbic dopamine transmission with positron emission tomography: I. Accuracy and precision of D(2) receptor parameter measurements in ventral striatum. J Cereb Blood Flow Metab. 2001;21:1034–57.
Fischl B. FreeSurfer. NeuroImage. 2012;62:774–81. https://doi.org/10.1016/j.neuroimage.2012.01.021.
Dale AM, Fischl B, Sereno MI. Cortical surface-based analysis. I Segmentation Surface Reconstruction Neuroimage. 1999;9:179–94. https://doi.org/10.1006/nimg.1998.0395.
Fischl B, Sereno MI, Dale AM. Cortical surface-based analysis. II: inflation, flattening, and a surface-based coordinate system. NeuroImage. 1999;9:195–207. https://doi.org/10.1006/nimg.1998.0396.
Han X, Jovicich J, Salat D, van der Kouwe A, Quinn B, Czanner S, et al. Reliability of MRI-derived measurements of human cerebral cortical thickness: the effects of field strength, scanner upgrade and manufacturer. NeuroImage. 2006;32:180–94. https://doi.org/10.1016/j.neuroimage.2006.02.051.
Reuter M, Schmansky NJ, Rosas HD, Fischl B. Within-subject template estimation for unbiased longitudinal image analysis. NeuroImage. 2012;61:1402–18. https://doi.org/10.1016/j.neuroimage.2012.02.084.
Rosas HD, Liu AK, Hersch S, Glessner M, Ferrante RJ, Salat DH, et al. Regional and progressive thinning of the cortical ribbon in Huntington’s disease. Neurology. 2002;58:695–701.
Kuperberg GR, Broome MR, McGuire PK, David AS, Eddy M, Ozawa F, et al. Regionally localized thinning of the cerebral cortex in schizophrenia. Arch Gen Psychiatry. 2003;60:878–88. https://doi.org/10.1001/archpsyc.60.9.878.
Fischl B, Sereno MI, Tootell RB, Dale AM. High-resolution intersubject averaging and a coordinate system for the cortical surface. Hum Brain Mapp. 1999;8:272–84.
Desikan RS, Segonne F, Fischl B, Quinn BT, Dickerson BC, Blacker D, et al. An automated labeling system for subdividing the human cerebral cortex on MRI scans into gyral based regions of interest. NeuroImage. 2006;31:968–80. https://doi.org/10.1016/j.neuroimage.2006.01.021.
Jenkinson M, Beckmann CF, Behrens TE, Woolrich MW, Smith SM. Fsl. NeuroImage. 2012;62:782–90. https://doi.org/10.1016/j.neuroimage.2011.09.015.
Diedrichsen J, Balsters JH, Flavell J, Cussans E, Ramnani N. A probabilistic MR atlas of the human cerebellum. NeuroImage. 2009;46:39–46. https://doi.org/10.1016/j.neuroimage.2009.01.045.
Matheson GJ, Stenkrona P, Cselenyi Z, Plaven-Sigray P, Halldin C, Farde L, et al. Reliability of volumetric and surface-based normalisation and smoothing techniques for PET analysis of the cortex: a test-retest analysis using [11C]SCH-23390. NeuroImage. 2017;155:344–53. https://doi.org/10.1016/j.neuroimage.2017.04.031.
Lammertsma AA, Hume SP. Simplified reference tissue model for PET receptor studies. NeuroImage. 1996;4:153–8.
Kessler LG, Barnhart HX, Buckler AJ, Choudhury KR, Kondratovich MV, Toledano A, et al. The emerging science of quantitative imaging biomarkers terminology and definitions for scientific studies and regulatory submissions. Stat Methods Med Res. 2015;24:9–26. https://doi.org/10.1177/0962280214537333.
Bland JM, Altman DG. Statistical methods for assessing agreement between two methods of clinical measurement. Lancet. 1986;1:307–10.
du Prel JB, Hommel G, Rohrig B, Blettner M. Confidence interval or p-value?: part 4 of a series on evaluation of scientific publications. Dtsch Arztebl Int. 2009;106:335–9. https://doi.org/10.3238/arztebl.2009.0335.
Obuchowski NA, Reeves AP, Huang EP, Wang XF, Buckler AJ, Kim HJ, et al. Quantitative imaging biomarkers: a review of statistical methods for computer algorithm comparisons. Stat Methods Med Res. 2015;24:68–106. https://doi.org/10.1177/0962280214537390.
Thirthalli J, Rajkumar RP. Statistical versus clinical significance in psychiatric research—an overview for beginners. Asian J Psychiatr. 2009;2:74–9. https://doi.org/10.1016/j.ajp.2009.04.004.
Shakespeare TP, Gebski VJ, Veness MJ, Simes J. Improving interpretation of clinical studies by use of confidence levels, clinical significance curves, and risk-benefit contours. Lancet. 2001;357:1349–53. https://doi.org/10.1016/S0140-6736(00)04522-0.
Searle SR. Linear models. New York: Wiley; 1971.
Perlaki G, Horvath R, Nagy SA, Bogner P, Doczi T, Janszky J, et al. Comparison of accuracy between FSL’s FIRST and FreeSurfer for caudate nucleus and putamen segmentation. Sci Rep. 2017;7:2418. https://doi.org/10.1038/s41598-017-02584-5.
Fischl B, Salat DH, Busa E, Albert M, Dieterich M, Haselgrove C, et al. Whole brain segmentation: automated labeling of neuroanatomical structures in the human brain. Neuron. 2002;33:341–55.
Tae WS, Kim SS, Lee KU, Nam EC, Kim KW. Validation of hippocampal volumes measured using a manual method and two automated methods (FreeSurfer and IBASPM) in chronic major depressive disorder. Neuroradiology. 2008;50:569–81. https://doi.org/10.1007/s00234-008-0383-9.
McCarthy CS, Ramprashad A, Thompson C, Botti JA, Coman IL, Kates WR. A comparison of FreeSurfer-generated data with and without manual intervention. Front Neurosci. 2015;9:379. https://doi.org/10.3389/fnins.2015.00379.
Rousset O, Rahmim A, Alavi A, Zaidi H. Partial volume correction strategies in PET. PET Clin. 2007;2:235–49. https://doi.org/10.1016/j.cpet.2007.10.005.
Cardinale F, Chinnici G, Bramerio M, Mai R, Sartori I, Cossu M, et al. Validation of FreeSurfer-estimated brain cortical thickness: comparison with histologic measurements. Neuroinformatics. 2014;12:535–42. https://doi.org/10.1007/s12021-014-9229-2.
Nugent AC, Luckenbaugh DA, Wood SE, Bogers W, Zarate CA Jr, Drevets WC. Automated subcortical segmentation using FIRST: test-retest reliability, interscanner reliability, and comparison to manual segmentation. Hum Brain Mapp. 2013;34:2313–29. https://doi.org/10.1002/hbm.22068.
Hirvonen J, Nagren K, Kajander J, Hietala J. Measurement of cortical dopamine d1 receptor binding with 11C[SCH23390]: a test-retest analysis. J Cereb Blood Flow Metab. 2001;21:1146–50.
Kaller S, Rullmann M, Patt M, Becker GA, Luthardt J, Girbardt J, et al. Test-retest measurements of dopamine D1-type receptors using simultaneous PET/MRI imaging. Eur J Nucl Med Mol Imaging. 2017;44:1025–32. https://doi.org/10.1007/s00259-017-3645-0.
Nyberg S, Farde L, Halldin C. Test-retest reliability of central [11C]raclopride binding at high D2 receptor occupancy. A PET study in haloperidol-treated patients. Psychiatry Res. 1996;67:163–71.
Sudo Y, Suhara T, Inoue M, Ito H, Suzuki K, Saijo T, et al. Reproducibility of [11 C]FLB 457 binding in extrastriatal regions. Nucl Med Commun. 2001;22:1215–21.
Lundberg J, Halldin C, Farde L. Measurement of serotonin transporter binding with PET and [11C]MADAM: a test-retest reproducibility study. Synapse. 2006;60:256–63. https://doi.org/10.1002/syn.20297.
Nord M, Finnema SJ, Schain M, Halldin C, Farde L. Test-retest reliability of [11C]AZ10419369 binding to 5-HT(1B) receptors in human brain. Eur J Nucl Med Mol Imaging. 2014;41:301–7. https://doi.org/10.1007/s00259-013-2529-1.
Haukvik UK, Hartberg CB, Agartz I. Schizophrenia—what does structural MRI show? Tidsskr Nor Laegeforen. 2013;133:850–3. https://doi.org/10.4045/tidsskr.12.1084.
Olabi B, Ellison-Wright I, McIntosh AM, Wood SJ, Bullmore E, Lawrie SM. Are there progressive brain changes in schizophrenia? A meta-analysis of structural magnetic resonance imaging studies. Biol Psychiatry. 2011;70:88–96. https://doi.org/10.1016/j.biopsych.2011.01.032.
Teipel SJ, Grothe M, Lista S, Toschi N, Garaci FG, Hampel H. Relevance of magnetic resonance imaging for early detection and diagnosis of Alzheimer disease. Med Clin North Am. 2013;97:399–424. https://doi.org/10.1016/j.mcna.2012.12.013.
Politis M. Neuroimaging in Parkinson disease: from research setting to clinical practice. Nat Rev Neurol. 2014;10:708–22. https://doi.org/10.1038/nrneurol.2014.205.
Aylward EH. Magnetic resonance imaging striatal volumes: a biomarker for clinical trials in Huntington’s disease. Mov Disord. 2014;29:1429–33. https://doi.org/10.1002/mds.26013.
Steenwijk MD, Amiri H, Schoonheim MM, de Sitter A, Barkhof F, Pouwels PJW, et al. Agreement of MSmetrix with established methods for measuring cross-sectional and longitudinal brain atrophy. Neuroimage Clin. 2017;15:843–53. https://doi.org/10.1016/j.nicl.2017.06.034.
Acknowledgements
The authors thank the Karolinska positron emission tomography group for the excellent technical assistance and in particular Dr. Zhisheng Jia and Guennadi Jogolev.
Funding
This study was funded by the Swedish Science Council grant no. 2015-02398 to LF and by Pfizer, Inc. The funding bodies did not play a role in the design of the study; collection, analysis, and interpretation of data; and in writing the manuscript.
Availability of data and materials
Please contact the author for data requests.
Author information
Authors and Affiliations
Contributions
LF, CH, and PS conceived the study. All authors designed the study. PS did the screening and examination of the subjects. LF, GJM, and PS analyzed the data and interpreted the results. LF and PS drafted the article. All authors critically revised the article and approved of the final version for publication.
Corresponding author
Ethics declarations
Ethics approval and consent to participate
The study was conducted in compliance with the ethical principles originating in the Declaration of Helsinki and the Good Clinical Practice (GCP) Guidelines of the International Conference on Harmonization (ICH). The study was approved by the Regional Ethical Review Board in Stockholm, Sweden (registration number 2013/1703-31/1) and the Radiation Safety Committee at the Karolinska University Hospital in Solna, Stockholm, Sweden (registration number K1865-2013). Written informed consent to participate was obtained from all individual participants.
Consent for publication
Not applicable.
Competing interests
LF is a shareholder of AstraZeneca. All other authors declare that they have no competing interest.
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Additional file
Additional file 1:
Table S1. Mean BPND values of [11C]SCH23390 in the morning and afternoon, the absolute variability, and ICC in 15 healthy men in four brain regions. There are eight BPND values for each region derived from the different combinations of methods in the analysis process. (DOCX 18 kb)
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.
About this article
Cite this article
Stenkrona, P., Matheson, G.J., Cervenka, S. et al. [11C]SCH23390 binding to the D1-dopamine receptor in the human brain—a comparison of manual and automated methods for image analysis. EJNMMI Res 8, 74 (2018). https://doi.org/10.1186/s13550-018-0416-2
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s13550-018-0416-2