Abstract
Several systematic reviews have highlighted the role of multiple sources in the investigation of psychiatric illness. For what concerns fMRI, the focus of recent literature preferentially lies on three lines of research, namely: functional connectivity, network analysis and spectral analysis. Data was gathered from the UCLA Consortium for Neuropsychiatric Phenomics. The sample was composed by 130 neurotypicals, 50 participants diagnosed with Schizophrenia, 49 with Bipolar disorder and 43 with ADHD. Single fMRI scans were reduced in their dimensionality by a novel method (i-ECO) averaging results per Region of Interest and through an additive color method (RGB): local connectivity values (Regional Homogeneity), network centrality measures (Eigenvector Centrality), spectral dimensions (fractional Amplitude of Low-Frequency Fluctuations). Average images per diagnostic group were plotted and described. The discriminative power of this novel method for visualizing and analyzing fMRI results in an integrative manner was explored through the usage of convolutional neural networks. The new methodology of i-ECO showed between-groups differences that could be easily appreciated by the human eye. The precision-recall Area Under the Curve (PR-AUC) of our models was > 84.5% for each diagnostic group as evaluated on the test-set – 80/20 split. In conclusion, this study provides evidence for an integrative and easy-to-understand approach in the analysis and visualization of fMRI results. A high discriminative power for psychiatric conditions was reached. This proof-of-work study may serve to investigate further developments over more extensive datasets covering a wider range of psychiatric diagnoses.
Similar content being viewed by others
Avoid common mistakes on your manuscript.
Introduction
Several systematic reviews have highlighted the role of multiple sources in the investigation of psychiatric illness (Keshavan et al., 2020). In particular, for what concerns functional Magnetic Resonance Imaging (fMRI), the focus of recent literature lies on three lines of research, namely functional connectivity (Damiani et al., 2021; Du et al., 2018; Giraldo-Chica et al., 2018; Sheffield & Barch, 2016; Sörös et al., 2019; L. Zhang et al., 2020; Y. Zhou et al., 2015), network analysis (Jiang et al., 2019; Scalabrini et al., 2020; M. Zhou et al., 2019a, 2019b; Q. Zhou et al., 2017; Y. Zhou et al., 2007), and spectral analysis (Malhi et al., 2020; Shang et al., 2016; P. Zhang et al., 2018; C. Zhou et al., 2019a, b).
Functional Connectivity in fMRI mainly stresses two different phenomena during image acquisition. The first is the long-distance relationship between brain areas, with one main region serving as a seed or reference. The second phenomenon is local connectivity between a brain region and its neighborhood, which can be measured by Regional Homogeneity – ReHo (Zang et al., 2004).
Measures of centrality in fMRI derive from graph-based analyses and are considered a computationally efficient tool for capturing intrinsic neural networks architecture in the human brain (Achard et al., 2006; He et al., 2009; Sporns et al., 2007). In this study, we investigated Eigenvector Centrality—ECM (Lohmann et al., 2010), as other commonly used centrality measurements (e.g. Degree of Centrality) are more sensitive to higher order cortical regions and less sensitive to subcortical ones (Zuo et al., 2012). As recent research in fMRI has shifted attention from cortical to subcortical areas in the investigation of psychiatric disorders (Damiani et al., 2020; Giraldo-Chica & Woodward, 2017; Lottman et al., 2019; Q. Zhou et al., 2017), ECM was preferred.
Spectral analyses in fMRI are based on the notion that valuable information can be found analyzing results in a time-domain manner, as opposed to the more commonly used space-domain. In our spectral analyses, we used fractional Amplitude of Low-Frequency Fluctuations—fALFF (Zou et al., 2008). Recent research has focused on fALFF as one of the most promising parameters for detecting regional signals change in relation to spontaneous activity (F. Liu et al., 2013; Yu-feng et al., 2007).
The technical barrier between the neuroimaging field and clinical practice may delay the transition of analytic results from the overall scientific debate to professional applications. Therefore, the present study aimed to offer a novel method to aid in analyzing, reporting, and visualizing fMRI results in a structured and integrated manner. A more accessible method to analyze and report fMRI results could support both research and clinical practice, as well as benefitting rapid fruition in a dual manner: through numerical dimensionality reduction for machine-learning potentials, through color-coding for human readability. The authors refer to this new proposed methodology by its acronym i-ECO (integrated-Explainability through Color Coding).
Aims of the study
The purpose of the present study was to evaluate a novel method of visualizing and interpreting fMRI results, based on the integration between functional connectivity, network analysis and time-domain analyses. The primary endpoint was to report the results of the proposed novel method of visualization. The secondary endpoint was to observe the discriminative power of the proposed novel method in the classification of participants based on their psychiatric clinical status.
Materials and methods
Study design
The present study was conducted on a shared neuroimaging dataset from the UCLA Consortium for Neuropsychiatric Phenomics, which included imaging and clinical data for 130 healthy adults, men or women between 21 and 50 years old. The shared dataset also included 50 participants diagnosed with Schizophrenia, 49 participants diagnosed with Bipolar disorder and 43 participants diagnosed with ADHD. Diagnoses were reached following DSM-IV TR criteria (American Psychiatric Association, 2000), through the Structured Clinical Interview for DSM-IV, SCID-I (American Psychiatric Association, 2000), in addition to a structured interview for Adult ADHD derived from the Kiddie Schedule for Affective Disorders and Schizophrenia, Present and Lifetime Version (Ambrosini et al., 1989; Poldrack et al., 2016; Schmidt et al., 2013). Further details about the sample can be found in the original study (Poldrack et al., 2016).
Sample—procedures
fMRI data preprocessing steps were implemented in AFNI (http://afni.nimh.nih.gov/afni) (Cox, 1996; Cox & Hyde, 1997; Taylor et al., 2018). Firstly, the structural and functional reference images were co-registered (Saad et al., 2009). The first 4 frames of each fMRI run were removed in order to discard the transient effects in amplitude observed until magnetization achieves steady state (Caballero-Gaudes & Reynolds, 2017). Slice timing correction (Konstantareas & Hewitt, 2001) and despike methods (Satterthwaite et al., 2013) were applied. Rigid-body alignment of the structural and functional image was performed. The anatomical image was then warped using the Montreal Neurological Institute standard space (MNI152_T1_2009c) template provided with the AFNI binaries. Volume registration was then used to align the functional data to the base volume, warping it to the stereotactic space of choice. Spatial blurring was performed, with a kernel of full width at half maximum of 6 mm. Bandpass (0.01–0.1 Hz) was performed (William R. Shirer et al., 2015). Each of the voxel time series was then scaled to have a mean of 100. To control for non-neural noise, regression based on the 6 rigid body motion parameters and their derivates was applied, as well as mean time series from cerebro-spinal fluid masks (Fox et al., 2005; Vovk et al., 2011) eroded by one voxel (Chai et al., 2012). Regression of white matter artefacts was performed through the fast ANATICOR technique as included in AFNI (Jo et al., 2010). To further improve motion correction, censoring of voxels with a Framewise Displacement above 0.5 mm was applied (Power et al., 2014) to the timeseries in network and functional connectivity analyses, while the time-domain analyses used non-censored data in order to preserve continuity along the time axis.
Subjects with excessive motion were excluded (> 2 mm of motion and/or more than 20% of timepoints above FD 0.5 mm). Overall, 44 subjects were excluded from the fMRI analysis: 11 Neurotypicals, 18 participants with Schizophrenia, 11 subjects with a diagnosis of Bipolar Disorder, and 4 with a diagnosis of ADHD.
Primary aim—methods
The ReHo value was calculated to measure the similarity of the time series of a given voxel to its nearest 26 voxels (Taylor & Saad, 2013; Zang et al., 2004). In each participant, the Kendall’s Coefficient of Concordance (KCC) for each voxel was normalized using Fisher z-transformation with the formula:
where \(\stackrel{\sim }{\rho }\) represents the normalized value of ρ, the voxel’s KCC value.
The ECM value was calculated through the Fast Eigenvector Centrality method as described by Wink et al. (Wink et al., 2012). 13 Neurotypicals, 5 participants with Schizophrenia, 7 participants with Bipolar Disorder and 4 participants with ADHD were excluded as at least one region had an ECM value of 0, as it was not possible to calculate their ECM value due to computational or technical impossibility to determine result matrices from the data structure (Wink et al., 2012).
The fALFF value was calculated by FATCAT functionalities (Taylor & Saad, 2013) in order to estimate spectral parameters. Firstly, data was bandpassed and the time series average, as well as the Nyquist frequency, were excluded. After the exclusion of selected frequencies and performing a bandpass, the time series was transformed in a periodogram using a Fast Fourier Transform (FFT). The frequency domain thus was in the range from 1/T to the Nyquist frequency, where T was the total duration of the time series. The step size between frequencies was given by the sampling time (1/TR), where TR was the repetition time or the length in time between two consecutive points on a repeating series of acquisitions.
By calculating the voxel-wise values, individual variations were summarized by averaging results per Region of Interest (ROI). For each participant, average values per functional network were obtained. Reference network masks were retrieved from the Functional Imaging in Neuropsychiatric Disorder Lab website – University of Stanford (Greicius & Eger, 2021; W. R. Shirer et al., 2012) and referred to as Regions of Interests (ROIs). Individual values were then scaled through the following formula:
where \(\tilde{x }\) represents the scaled value of x, the individual subject’s value, and max and min represented respectively the overall maximum and minimum value per subject, per variable, per ROI.
The ECM, ReHo and fALFF values, per subject, per ROI, were then condensed through a color mixing technique using an additive color model (RGB). ECM values were interpreted as the red component, fALFF as the green component and ReHo as the blue component.
Images for each subject were then compiled through Python 3.8.5 (Van Rossum & Drake, 2009) and the following libraries: numpy (Harris et al., 2020), PIL (Umesh, 2012). Average images per diagnostic group were drawn by averaging values by group and compiling the resulting image. Images obtained by subtracting resulting images per diagnostic group versus neurotypicals were drawn. An heatmap describing the numerical differences in scaled feature values was plotted. A MANOVA test for each feature (ECM, fALFF, ReHo) was carried forward, with the diagnostic labels as fixed factors.
Secondary aim—methods
A Convolutional Neural Network (CNN) was computed in order to discriminate between neurotypicals (TYP) and psychiatric participants. Each diagnostic group (participants with Schizophrenia – SCH; participants with a diagnosis of Bipolar Disorder – BIP; participants with a diagnosis of Attention Deficit/Hyperactivity Disorder – ADHD) was compared to neurotypicals, and the resulting Precision-Recall Area Under the Curve (PR-AUC) for the model was presented. The neural network was built using Python 3.8.5 (Van Rossum & Drake, 2009) and the following libraries: TensorFlow (Martín Abadi et al., 2015), Keras (Chollet, 2015). The neural network had the following structure: firstly, images were scaled to low resolution (14*1 pixel, one band of color per ROI, each row for a different subject). The overall sample was divided in a train and test set through a 80/20 ratio. The first layer rescaled pixel RGB values from the [0,255] range to [0,1]. Preprocessed data then served as the input to a convolutional neural network with activation pattern Rectified Linear Activation Function and sliding window of size 1 on the x-axis, 3 on the y-axis. A flattening layer was then added, and two dense layers were built as the final steps. The first dense layer had 4 neurons, and activation pattern Rectified Linear Activation Function. The second dense layer had 1 final neuron with activation pattern Sigmoid Function. The CNN models were built using optimizer adam (Kingma & Ba, 2017), loss was defined as the binary cross-entropy (Boer et al., 2005). A graphical representation of the flow of information, from input to output, of the neural net was offered in Fig. 1.
Control analyses – baseline models and the role of motion
Logistic models (GLM) were built in order to evaluate the discriminative power through interpretable and more commonly used Machine Learning Algorithms. The GLM models were built for each diagnostic label compared to neurotypicals and served as a baseline model to compare and contrast CNN results. All the parameters used for building individual subject’s images were used for the prediction (ECM, fALFF, ReHo values for each ROI – for a total of 42 features). As for the CNN model, the overall sample was split in a 80/20 ratio between test and training sets. The discriminative power was evaluated through the PR-AUC on the test set.
As motion during scan is a common source of noise in fMRI (Makowski et al., 2019), the authors investigated baseline models constructed on mean Framewise Displacement (Power et al., 2014) values per scan per subject. As for the other analyses, the overall sample was split in 80/20 ratio between test and training sets. The discriminative power was evaluated through the PR-AUC on the test set.
GLM models were built in R 4.0.3 (R Core Team, 2020), using RStudio 1.3.1093 (RStudio Team, 2020) and using the following libraries: tidyverse (Wickham et al., 2019), caret (Kuhn, 2008), PRROC (Keilwagen et al., 2014).
Results
Primary results
Average images per diagnostic group were plotted. Each image was composed by 14 bands of colors, one for each Functional Network. The resulting image was presented as Fig. 2. By a visual inspection, the average image for the participants with Schizophrenia had a higher component of purple color (+ Red -Green + Blue) in comparison to neurotypicals. The average image for the patients with Bipolar Disorder in comparison to neurotypicals had a higher component of purple color as well. The average image for the patients with ADHD showed similar color components than neurotypicals. Of particular interests, the Precuneus showed a prevalence of fALFF components (Green) in neurotypicals and ADHD participants, whereas a higher presence of ReHo components (Blue) in participants with Schizophrenia or Bipolar Disorder. The ECM component (Red) was low in the overall sample for the region.
Subtracted images (diagnostic group – neurotypicals) were plotted as Fig. 3. The group of participants with Schizophrenia and Bipolar Disorder had similar prevalence of green components overall (fALFF higher in neurotypicals), but with visible differences in the dorsal and ventral Default Mode Networks, High Visual Network, Left and Right Executive Control Network, Primary Visual Network and the Visuospatial Network. The group of participants with Schizophrenia and Bipolar Disorder differed in the anterior Salience Network, Auditory Network and Basal Ganglia, with a higher prevalence of blue (ReHo) in Schizophrenia and a higher presence of red (ECM) in Bipolar Disorder. The sample of participants with ADHD had a prevalence of black (0 values, as the two groups had comparable mean values) and blue (ReHo, higher in ADHD).
Numerical differences to neurotypicals were also plotted as a heatmap in Fig. 4.
MANOVA results were described in Supplementary Table S1, S2 and S3.
Only the group of participants with a diagnosis of Schizophrenia had significant differences for ECM results (p-value 0.045). Post-hoc ANOVA test were significant for the High Visual Network, Posterior Salience Network, Right Executive Control Network, ventral Default Mode Network, and the Visuospatial Network (minimum p-value 0.008, maximum 0.040). ECM results were reported in Supplementary Table S1.
For what concerned fALFF results, both the group of participants with a diagnosis of Schizophrenia and Bipolar Disorder had significant differences in comparison to neurotypicals (p-value 0.032 and < 0.001 respectively). Post-hoc ANOVA test were significant in the Auditory Network, Language Network, Precuneus, Sensorimotor Network, ventral Default Mode Network, Visuospatial Network for both the group of participants with a diagnosis of Schizophrenia and Bipolar Disorder (minimum p-value < 0.001, maximum 0.042). Participants with Schizophrenia also showed significant difference in comparison to neurotypicals in the High Visual Network and Primary Visual Network, while participants with Bipolar Disorder in the dorsal Default Mode Network, Anterior and Posterior Salience Network, Left and Right Executive Control Networks. fALFF results were reported in Supplementary Table S2.
ReHo showed significant differences for the Left Executive Network for both participants with Schizophrenia and ADHD, although borderline significant (p-value 0.040 and 0.050 respectively). The Posterior Salience also had borderline significant results for participants with Schizophrenia (p-value 0.049). Participants with Schizophrenia had statistically significant differences for ReHo in the Anterior Salience and Language Networks as well as the Basal Ganglia (p-values 0.015; 0.025 and 0.027 respectively). Participants with Bipolar Disorder exhibited significant differences for ReHo in the Primary Visual Network (p-value 0.011) and participants with ADHD in the Right Executive Control Network (p-value 0.017). ReHo results were reported in Supplementary Table S3.
Secondary Results – discriminative power
One Convolutional Neural Network (CNN) per diagnostic group was built in order to discriminate between case (psychiatric participants) and controls (neurotypicals). The classification ability of the CNNs were evaluated through their Precision-Recall AUC (PR-AUC) on the test-set. All the models reached a PR-AUC > 80%. Results were described in Table 1. The highest PR-AUC was reached for the sample of patients suffering from Bipolar Disorder (96.8%), followed by the sample of patients suffering from Schizophrenia (91.8%) and patients with ADHD (84.6%).
Control analyses– baseline models and the role of motion
GLM models computed on the same data used to construct individual integrated images resulted in an overall lower discriminative power in comparison to CNN algorithms. PR-AUC was measured on the test-set. The highest PR-AUC was reached for the ADHD sample (78.5% GLM vs 84.62% CNN). Both the sample of participants with a diagnosis of Schizophrenia (77.8% GLM vs 91.8% CNN) and Bipolar Disorder (68.5% GLM vs 96.8% CNN) reported significantly lower PR-AUC values in comparison to CNN results. Results were reported in Table 1.
When GLM models were trained on mean FD values per subject per run, their predictive power for diagnostic label was evaluated. The discriminative power of GLM models evaluated on the test-set and built on motion parameters was moderate, but significantly lower than GLM models built on integrated data or CNN models. The highest PR-AUC was reached in the ADHD sample (65.9%), and the lowest in the sample of participants with a diagnosis of Schizophrenia (60.8%). The sample of participants with a diagnosis of Bipolar Disorder was moderate (62.7%). Results were reported in Table 1.
Discussion
Clinical significance and future prospects
In the development of the presented methodology, the authors focused on color-coding as a scheme of representing higher-order information through a simple and human readable content. Indeed, color schemes have long been used in communication technology as secondary notation. Color coding seems to offer a quick system of reference which may be easily discriminated by the human eye (Rozak & Rozak, 2014), aiding in reducing the perceived complexity of presented information (Yuditsky et al., 2002) as well as increasing consistency in the derived decision-making processes (Jonker et al., 2019). As recently stated in a review over neuroimaging tools for the psychiatric clinical practice (Scarpazza et al., 2020), most tools available to the present day were developed and validated for neurological disorders and are not suitable for application in the general psychiatric setting. Moreover, the authors suggested moving from a region-of-interest to a whole-brain approach, as well as accounting for disease heterogeneity (Scarpazza et al., 2020). In authors’ opinion, i-ECO well addresses both suggestions in an accessible manner.
While the current study supports the usage of i-ECO to classify fMRI participants according to diagnostic groups, considering previous discussed views offered by the clinical setting, the potential of a dimensional approach seems warranted. According to previous research in fact, neuroimaging biomarkers may have the potential to find different correspondences of psychopathology (Kebets et al., 2019; McTeague et al., 2017), in order to arrive to a more specific definition of cornerstone symptoms, their biological correlates and overall classifications supported by experimental results (Chang et al., 2020; Iravani et al., 2021; Schilbach et al., 2015; Tokuda et al., 2018). An integrated approach to neuroimaging has the potential for direct implications in the treatment of mental suffering and psychiatric practice (Iravani et al., 2021; Price et al., 2018), through a coordination of theoretical models for general psychiatry, psychotherapy, and neuroimaging—e.g. attachment theory and depression (X. Zhang et al., 2011); body image distortion and eating disorders (Castellini et al., 2013); face discrimination and gender incongruence (Fisher et al., 2020). The current study and its proposed novel methodology may thus aid clinicians in overcoming the technical barrier of entry to the field of neuroimaging for what concerns fMRI results. In addition to the psychiatric field, fMRI has been employed in the study of at-risk regions of the brain during the planning of neurosurgery (Unadkat et al., 2019). While early usage focused on functional mapping during task-based fMRI (Unadkat et al., 2019), recent developments integrated insight offered by resting-state information – either by functional connectivity, centrality measures or spectral dimensions (D’Andrea, Trillo’, Picotti, & Raco, 2017; Hart et al., 2016; Shimony et al., 2009). fMRI has also been investigated in the study of neurological disorders, in particular migraine (Schwedt et al., 2015) or neurodegenerative diseases (Rodriguez-Raecke et al., 2021), as well as other general clinical conditions (Chen et al., 2021; C. Liu et al., 2021). No formal rationale seems to arise in favor a limitation of i-ECO to the psychiatric field alone, as the proposed measures it relies upon seem to have a confirmed role over a wide array of clinical diagnoses. Therefore, the authors would like to invite clinical feedback to the project, in order to further enhance i-ECO as a methodology and extend its scope of applications.
The authors welcome clinical feedbacks to the project in order to further enhance the i-ECO methodology.
Partial overlap schizophrenia and bipolar disorder
Our results supported an interpretation in favor of a global difference in fMRI components for the sample of patients suffering from either Schizophrenia or Bipolar Disorder in comparison to controls. In particular, a higher dominance of ECM and ReHo components was appreciable and confirmed by the secondary analyses. fALFF resulted less represented in the sample of patients suffering from either Schizophrenia or Bipolar Disorder in comparison to controls. These findings seem to be supported by recent studies in the field of Resting-State fMRI (Duan et al, 2017; C. Zhou et al., 2019a, b; Q. Zhou et al., 2017).
The partial overlap of findings between the sample of patients suffering from Schizophrenia and Bipolar Disorder can be interpreted in light of the clinical account of a continuity between the two disorders (Möller, 2003; Salagre et al., 2020). A continuity in the spectrum between Schizophrenia and Bipolar Disorder seems to be also supported by previous remarks of common and shared biomarkers (Yamada et al., 2020), from common genetic determinants (Lichtenstein et al., 2009; Prata et al., 2019) to shared neuroimaging features (Ji et al., 2019; Jimenez et al., 2019; Madre et al., 2020). This difficulty in differentiating between Schizophrenia and Bipolar Disorder is similar to the one that emerges in clinical practice when considering the diagnosis at a single time-point without the help of a longitudinal perspective (Rosen et al., 2011).
ADHD specificity and role of precuneus
In contrast to the sample of patients suffering from either Schizophrenia or Bipolar Disorder, our results supported an interpretation of a local rather than global difference of fMRI components for the ADHD sample in comparison to neurotypical controls. Our findings suggested a potential role for the precuneus, which seems supported by previous literature (Castellanos et al., 2008; Christakou et al., 2013). Precuneus’ findings might be interpreted in light of its role in the default mode network (Cunningham et al., 2017; R. Li et al., 2019), and specifically in its suggested involvement in the activation/deactivation as part of the default mode network during task (Christakou et al., 2013). The role of precuneus in response inhibition seems to be of particular interest when considering the clinical presentation of ADHD, as the precuneus has been shown to be related to response inhibition (Albert et al., 2019), emotion regulation and attentional deployment (Ferri et al., 2016; B. Li et al., 2020). A role for the precuneus in ADHD seems to be supported also by reports of normalization in precuneus connectivity at the fMRI after methylphenidate or atomoxetine treatment (Kowalczyk et al., 2019), along symptomatic amelioration.
Technical contributions
Dimensionality reduction represents one of the pivotal challenges in fMRI (Pereira et al., 2009), with most commonly used approaches – e.g. Principal Components Analysis, Autoregression, Linear Embeddings, Autoencoders (Cordes & Nandy, 2006; Huang et al., 2018; Mannfolk et al., 2010; Pereira et al., 2009) being of difficult interpretation for clinicians and hard to generalize. Research in fMRI has been recently characterized by a higher reliance on Neural Networks (Suk et al., 2016) and Embeddings (Sidhu, 2019), with the most promising results coming from CNN (Meszlényi et al., 2017; Sarraf et al., 2019; Tahmassebi et al., 2018; Zhao et al., 2018), especially in the field of Computational Psychiatry (Ariyarathne et al., 2020; El Gazzar et al., 2019; Oh et al., 2019; Silva et al., 2021). Convolutional Neural Networks design follows biological research and the study of the receptive field by the visual cortex (Hubel & Wiesel, 1959), their first development establishing the groundwork for the field of computer vision (Denker et al., 1989; LeCun et al., 1989). The present work establishes a direct connection between computer vision, fMRI data and CNN classifiers, providing a simple interpretation to the reason why CNN deep learning algorithms have been highly efficient when analyzing fMRI results. When fMRI data is recognized as a collection of spatially dispersed temporal components (either derived from functional connectivity, graph-network theory, or spectral analysis), and interpreted visually, the abstractness of a CNN classifier is reduced. Recent developments in the interpretation of variable importance for CNN models (Mijolla et al., 2020; Malmgren-Hansen et al., 2021) may shed further light over the contribution of the three fMRI components here analyzed, thus enriching the interpretation offered by the authors.
Although motion parameters seemed to have a moderate predictive power for psychiatric diagnoses, the overall precision of classifier models was highest when using an integrated approach to fMRI results. A convolutional network approach to classifiers seemed to increase the precision and recall in order to classify participants as either neurotypicals or suffering from a mental disorder. These preliminary results highlight the importance of motion in fMRI (Bolton et al., 2020; Makowski et al., 2019), but also caution authors to consider the information given by established measures in the field for the study and evaluation of psychiatric disorders.
Limitations
The sample size in this study was limited and only comprised participants in a range of three different psychiatric diagnoses: Schizophrenia, Bipolar Disorder, ADHD. Further analyses with a multi-class.
approach are warranted before the generalization of its results. An evaluation of the discriminative power of this method over different diagnoses is warranted before generalizing its results on the overall general psychiatric field.
Conclusions
In conclusion, this study provides preliminary evidence in support of an integrative approach in the analysis and visualization of fMRI results. The usage of macro-level regions, although diluting particular signals in specific brain areas, seemed to provide a high discriminative power for psychiatric disorders. This proof-of-work may serve to investigate further developments over more extensive dataset and over a different range of psychiatric diagnoses.
Abbreviations
- ADHD:
-
Attention Deficit Hyperactivity Disorder
- AFNI:
-
Analysis of Functional NeuroImages
- AUC:
-
Area Under the Curve
- BIP:
-
Bipolar Disorder
- BOLD:
-
Blood Oxygenation Level Dependent
- CNN:
-
Convolutional Neural Network
- ECM:
-
Eigenvector Centrality
- fALFF:
-
Fractional Amplitude of Low-Frequency Fluctuation
- FFT:
-
Fast Fourier Transform
- FDR:
-
False Discovery Rate
- fMRI:
-
Functional Magnetic Resonance Imaging
- KCC:
-
Kendall’s Coefficient of Concordance
- i-ECO:
-
Integrated-Explainability through Color Coding
- MEG:
-
Magnetoencephalography
- MENT:
-
Participants with any Mental Disorder
- MNI:
-
Montreal Neurological Institute
- ROI:
-
Region/regions of interest
- TYP:
-
Neurotypicals
- SCH:
-
Participants with Schizophrenia
References
Achard, S., Salvador, R., Whitcher, B., Suckling, J., & Bullmore, E. (2006). A Resilient, Low-Frequency, Small-World Human Brain Functional Network with Highly Connected Association Cortical Hubs. Journal of Neuroscience, 26(1), 63–72. https://doi.org/10.1523/JNEUROSCI.3874-05.2006
Albert, J., López-Martín, S., Arza, R., Palomares, N., Hoyos, S., Carretié, L., … Carrasco, J. L. (2019). Response inhibition in borderline personality disorder: Neural and behavioral correlates. Biological Psychology, 143, 32–40. https://doi.org/10.1016/j.biopsycho.2019.02.003
Ambrosini, P. J., Metz, C., Prabucki, K., & Lee, J. C. (1989). Videotape reliability of the third revised edition of the K-SADS. Journal of the American Academy of Child and Adolescent Psychiatry, 28(5), 723–728. https://doi.org/10.1097/00004583-198909000-00013
American Psychiatric Association. (2000). Diagnostic and statistical manual of mental disorders (4th ed., Text Revision). Washington, DC.
Ariyarathne, G., De Silva, S., Dayarathna, S., Meedeniya, D., & Jayarathne, S. (2020). ADHD Identification using Convolutional Neural Network with Seed-based Approach for fMRI Data. Proceedings of the 2020 9th International Conference on Software and Computer Applications, 31–35. New York, NY, USA: Association for Computing Machinery. https://doi.org/10.1145/3384544.3384552
de Boer, P.-T., Kroese, D. P., Mannor, S., & Rubinstein, R. Y. (2005). A Tutorial on the Cross-Entropy Method. Annals of Operations Research, 134(1), 19–67. https://doi.org/10.1007/s10479-005-5724-z
Bolton, T. A. W., Kebets, V., Glerean, E., Zöller, D., Li, J., Yeo, B. T. T., … Van De Ville, D. (2020). Agito ergo sum: Correlates of spatio-temporal motion characteristics during fMRI. NeuroImage, 209, 116433. https://doi.org/10.1016/j.neuroimage.2019.116433
Caballero-Gaudes, C., & Reynolds, R. C. (2017). Methods for cleaning the BOLD fMRI signal. NeuroImage, 154, 128–149. https://doi.org/10.1016/j.neuroimage.2016.12.018
Castellanos, F. X., Margulies, D. S., Kelly, C., Uddin, L. Q., Ghaffari, M., Kirsch, A., … Milham, M. P. (2008). Cingulate-precuneus interactions: A new locus of dysfunction in adult attention-deficit/hyperactivity disorder. Biological Psychiatry, 63(3), 332–337. https://doi.org/10.1016/j.biopsych.2007.06.025
Castellini, G., Polito, C., Bolognesi, E., D’Argenio, A., Ginestroni, A., Mascalchi, M., … Ricca, V. (2013). Looking at my body. Similarities and differences between anorexia nervosa patients and controls in body image visual processing. European Psychiatry, 28(7), 427–435. https://doi.org/10.1016/j.eurpsy.2012.06.006
Chai, X. J., Castañón, A. N., Ongür, D., & Whitfield-Gabrieli, S. (2012). Anticorrelations in resting state networks without global signal regression. NeuroImage, 59(2), 1420–1428. https://doi.org/10.1016/j.neuroimage.2011.08.048
Chang, M., Womer, F. Y., Gong, X., Chen, X., Tang, L., Feng, R., … Wang, F. (2020). Identifying and validating subtypes within major psychiatric disorders based on frontal–posterior functional imbalance via deep learning. Molecular Psychiatry, 1–12. https://doi.org/10.1038/s41380-020-00892-3
Chen, P., Hu, R., Gao, L., Wu, B., Peng, M., Jiang, Q., … Xu, H. (2021). Abnormal degree centrality in end-stage renal disease (ESRD) patients with cognitive impairment: A resting-state functional MRI study. Brain Imaging and Behavior, 15(3), 1170–1180. https://doi.org/10.1007/s11682-020-00317-3
Chollet, F. & others. (2015). Keras. Retrieved from https://keras.io. Accessed 12 October 2021.
Christakou, A., Murphy, C. M., Chantiluke, K., Cubillo, A. I., Smith, A. B., Giampietro, V., … Rubia, K. (2013). Disorder-specific functional abnormalities during sustained attention in youth with Attention Deficit Hyperactivity Disorder (ADHD) and with Autism. Molecular Psychiatry, 18(2), 236–244. https://doi.org/10.1038/mp.2011.185
Cordes, D., & Nandy, R. R. (2006). Estimation of the intrinsic dimensionality of fMRI data. NeuroImage, 29(1), 145–154. https://doi.org/10.1016/j.neuroimage.2005.07.054
Cox, R. W. (1996). AFNI: Software for analysis and visualization of functional magnetic resonance neuroimages. Computers and Biomedical Research, an International Journal, 29(3), 162–173. https://doi.org/10.1006/cbmr.1996.0014
Cox, R. W., & Hyde, J. S. (1997). Software tools for analysis and visualization of fMRI data. NMR in Biomedicine, 10(4–5), 171–178. https://doi.org/10.1002/(sici)1099-1492(199706/08)10:4/5%3c171::aid-nbm453%3e3.0.co;2-l
Cunningham, S. I., Tomasi, D., & Volkow, N. D. (2017). Structural and functional connectivity of the precuneus and thalamus to the default mode network. Human Brain Mapping, 38(2), 938–956. https://doi.org/10.1002/hbm.23429
Damiani, S., Scalabrini, A., Ku, H.-L., Lane, T. J., Politi, P., & Northoff, G. (2021). From local to global and back: An exploratory study on cross-scale desynchronization in schizophrenia and its relation to thought disorders. Schizophrenia Research, 231, 10–12. https://doi.org/10.1016/j.schres.2021.02.021
Damiani, S., Tarchi, L., Scalabrini, A., Marini, S., Provenzani, U., Rocchetti, M., … Politi, P. (2020). Beneath the surface: Hyper-connectivity between caudate and salience regions in ADHD fMRI at rest. European Child & Adolescent Psychiatry. https://doi.org/10.1007/s00787-020-01545-0
D’Andrea, G., Trillo’, G., Picotti, V., & Raco, A. (2017). Functional Magnetic Resonance Imaging (fMRI), Pre-intraoperative Tractography in Neurosurgery: The Experience of Sant’ Andrea Rome University Hospital. In M. Visocchi, H. M. Mehdorn, Y. Katayama, & K. R. H. von Wild (Eds.), Trends in Reconstructive Neurosurgery (pp. 241–250). Cham: Springer International Publishing. https://doi.org/10.1007/978-3-319-39546-3_36
de Mijolla, D., Frye, C., Kunesch, M., Mansir, J., & Feige, I. (2020). Human-interpretable model explainability on high-dimensional data. ArXiv:2010.07384 [Cs, Stat]. Retrieved October 12, 2021, from http://arxiv.org/abs/2010.07384
Denker, J., Gardner, W., Graf, H., Henderson, D., Howard, R., Hubbard, W., Jackel, L. D., Baird, H., & Guyon, I. (1989). Neural Network Recognizer for Hand-Written Zip Code Digits.In D. Touretzky (Ed.), Advances in neural information processing systems (Vol. 1). Morgan-Kaufmann. https://proceedings.neurips.cc/paper/1988/file/a97da629b098b75c294dffdc3e463904-Paper.pdf
Du, Y., Fu, Z., & Calhoun, V. D. (2018). Classification and Prediction of Brain Disorders Using Functional Connectivity: Promising but Challenging. Frontiers in Neuroscience, 12, 525. https://doi.org/10.3389/fnins.2018.00525
Duan, M., Jiang, Y., Chen, X., Luo, C., & Yao, D. (2017). [Degree centrality of the functional network in schizophrenia patients]. Sheng Wu Yi Xue Gong Cheng Xue Za Zhi = Journal of Biomedical Engineering = Shengwu Yixue Gongchengxue Zazhi, 34(6), 837–841. https://doi.org/10.7507/1001-5515.201607062
El Gazzar, A., Cerliani, L., van Wingen, G., & Thomas, R. M. (2019). Simple 1-D Convolutional Networks for Resting-State fMRI Based Classification in Autism. International Joint Conference on Neural Networks (IJCNN), 2019, 1–6. https://doi.org/10.1109/IJCNN.2019.8852002
Ferri, J., Schmidt, J., Hajcak, G., & Canli, T. (2016). Emotion regulation and amygdala-precuneus connectivity: Focusing on attentional deployment. Cognitive, Affective & Behavioral Neuroscience, 16(6), 991–1002. https://doi.org/10.3758/s13415-016-0447-y
Fisher, A. D., Ristori, J., Castellini, G., Cocchetti, C., Cassioli, E., Orsolini, S., … Gavazzi, G. (2020). Neural Correlates of Gender Face Perception in Transgender People. Journal of Clinical Medicine, 9(6), 1731. https://doi.org/10.3390/jcm9061731
Fox, M. D., Snyder, A. Z., Vincent, J. L., Corbetta, M., Van Essen, D. C., Raichle, M. E. (2005). The human brain is intrinsically organized into dynamic, anticorrelated functional networks. Proceeding Natural Academy Science USA, 102(27), 9673–8. https://doi.org/10.1073/pnas.0504136102
Giraldo-Chica, M., Rogers, B. P., Damon, S. M., Landman, B. A., & Woodward, N. D. (2018). Prefrontal-Thalamic Anatomical Connectivity and Executive Cognitive Function in Schizophrenia. Biological Psychiatry, 83(6), 509–517. https://doi.org/10.1016/j.biopsych.2017.09.022
Giraldo-Chica, M., & Woodward, N. D. (2017). Review of thalamocortical resting-state fMRI studies in schizophrenia. Schizophrenia Research, 180, 58–63. https://doi.org/10.1016/j.schres.2016.08.005
Greicius, M., & Eger, S. (2021). FIND Lab at Stanford University. Retrieved March 23, 2021, from Functional Imaging in Neuropsychiatric Disorders (FIND) Lab at Stanford University website: https://findlab.stanford.edu/functional_ROIs.html
Harris, C. R., Millman, K. J., Walt, S. J. van der, Gommers, R., Virtanen, P., Cournapeau, D., … Oliphant, T. E. (2020). Array programming with NumPy. Nature, 585(7825), 357–362. https://doi.org/10.1038/s41586-020-2649-2
Hart, M. G., Price, S. J., & Suckling, J. (2016). Functional connectivity networks for preoperative brain mapping in neurosurgery. Journal of Neurosurgery, 126(6), 1941–1950. https://doi.org/10.3171/2016.6.JNS1662
He, Y., Wang, J., Wang, L., Chen, Z. J., Yan, C., Yang, H., … Evans, A. C. (2009). Uncovering Intrinsic Modular Organization of Spontaneous Brain Activity in Humans. PLOS ONE, 4(4), e5226. https://doi.org/10.1371/journal.pone.0005226
Huang, H., Hu, X., Zhao, Y., Makkie, M., Dong, Q., Zhao, S., … Liu, T. (2018). Modeling Task fMRI Data Via Deep Convolutional Autoencoder. IEEE Transactions on Medical Imaging, 37(7), 1551–1561. https://doi.org/10.1109/TMI.2017.2715285
Hubel, D. H., & Wiesel, T. N. (1959). Receptive fields of single neurones in the cat’s striate cortex. The Journal of Physiology, 148(3), 574–591.
Iravani, B., Arshamian, A., Fransson, P., & Kaboodvand, N. (2021). Whole-brain modelling of resting state fMRI differentiates ADHD subtypes and facilitates stratified neuro-stimulation therapy. NeuroImage, 231, 117844. https://doi.org/10.1016/j.neuroimage.2021.117844
Ji, E., Lejuste, F., Sarrazin, S., & Houenou, J. (2019). From the microscope to the magnet: Disconnection in schizophrenia and bipolar disorder. Neuroscience and Biobehavioral Reviews, 98, 47–57. https://doi.org/10.1016/j.neubiorev.2019.01.005
Jiang, K., Yi, Y., Li, L., Li, H., Shen, H., Zhao, F., … Zheng, A. (2019). Functional network connectivity changes in children with attention-deficit hyperactivity disorder: A resting-state fMRI study. International Journal of Developmental Neuroscience: The Official Journal of the International Society for Developmental Neuroscience, 78, 1–6. https://doi.org/10.1016/j.ijdevneu.2019.07.003
Jimenez, A. M., Riedel, P., Lee, J., Reavis, E. A., & Green, M. F. (2019). Linking resting-state networks and social cognition in schizophrenia and bipolar disorder. Human Brain Mapping, 40(16), 4703–4715. https://doi.org/10.1002/hbm.24731
Jo, H. J., Saad, Z. S., Simmons, W. K., Milbury, L. A., & Cox, R. W. (2010). Mapping sources of correlation in resting state FMRI, with artifact detection and removal. NeuroImage, 52(2), 571–582. https://doi.org/10.1016/j.neuroimage.2010.04.246
Jonker, M. F., Donkers, B., de Bekker-Grob, E., & Stolk, E. A. (2019). Attribute level overlap (and color coding) can reduce task complexity, improve choice consistency, and decrease the dropout rate in discrete choice experiments. Health Economics, 28(3), 350–363. https://doi.org/10.1002/hec.3846
Kebets, V., Holmes, A. J., Orban, C., Tang, S., Li, J., Sun, N., … Yeo, B. T. T. (2019). Somatosensory-Motor Dysconnectivity Spans Multiple Transdiagnostic Dimensions of Psychopathology. Biological Psychiatry, 86(10), 779–791. https://doi.org/10.1016/j.biopsych.2019.06.013
Keilwagen, J., Grosse, I., & Grau, J. (2014). Area under Precision-Recall Curves for Weighted and Unweighted Data. PLOS ONE, 9(3)
Keshavan, M. S., Collin, G., Guimond, S., Kelly, S., Prasad, K. M., & Lizano, P. (2020). Neuroimaging in schizophrenia. Neuroimaging Clinics of North America, 30(1), 73–83. https://doi.org/10.1016/j.nic.2019.09.007
Kingma, D. P., & Ba, J. (2017). Adam: A Method for Stochastic Optimization. ArXiv:1412.6980 [Cs]. Retrieved October 12, 2021, from http://arxiv.org/abs/1412.6980
Konstantareas, M. M., & Hewitt, T. (2001). Autistic disorder and schizophrenia: Diagnostic overlaps. Journal of Autism and Developmental Disorders, 31(1), 19–28.
Kowalczyk, O. S., Cubillo, A. I., Smith, A., Barrett, N., Giampietro, V., Brammer, M., … Rubia, K. (2019). Methylphenidate and atomoxetine normalise fronto-parietal underactivation during sustained attention in ADHD adolescents. European Neuropsychopharmacology: The Journal of the European College of Neuropsychopharmacology, 29(10), 1102–1116. https://doi.org/10.1016/j.euroneuro.2019.07.139
Kuhn, M. (2008). Building Predictive Models in R Using the caret Package. Journal of Statistical Software, 28(1), 1–26. https://doi.org/10.18637/jss.v028.i05
LeCun, Y., Boser, B., Denker, J. S., Henderson, D., Howard, R. E., Hubbard, W., & Jackel, L. D. (1989). Backpropagation Applied to Handwritten Zip Code Recognition. Neural Computation, 1(4), 541–551. https://doi.org/10.1162/neco.1989.1.4.541
Li, B., Zhang, L., Zhang, Y., Chen, Y., Peng, J., Shao, Y., & Zhang, X. (2020). Decreased Functional Connectivity Between the Right Precuneus and Middle Frontal Gyrus Is Related to Attentional Decline Following Acute Sleep Deprivation. Frontiers in Neuroscience, 14, 530257. https://doi.org/10.3389/fnins.2020.530257
Li, R., Utevsky, A. V., Huettel, S. A., Braams, B. R., Peters, S., Crone, E. A., & van Duijvenvoorde, A. C. K. (2019). Developmental Maturation of the Precuneus as a Functional Core of the Default Mode Network. Journal of Cognitive Neuroscience, 31(10), 1506–1519. https://doi.org/10.1162/jocn_a_01426
Lichtenstein, P., Yip, B. H., Björk, C., Pawitan, Y., Cannon, T. D., Sullivan, P. F., & Hultman, C. M. (2009). Common genetic determinants of schizophrenia and bipolar disorder in Swedish families: A population-based study. Lancet (london, England), 373(9659), 234–239. https://doi.org/10.1016/S0140-6736(09)60072-6
Liu, C., Xuan, C., Wu, J., Li, S., Yang, G., Piao, R., … Liu, P. (2021). Altered resting-state functional networks in patients with premenstrual syndrome: A graph-theoretical based study. Brain Imaging and Behavior. https://doi.org/10.1007/s11682-021-00518-4
Liu, F., Guo, W., Liu, L., Long, Z., Ma, C., Xue, Z., … Chen, H. (2013). Abnormal amplitude low-frequency oscillations in medication-naive, first-episode patients with major depressive disorder: A resting-state fMRI study. Journal of Affective Disorders, 146(3), 401–406. https://doi.org/10.1016/j.jad.2012.10.001
Lohmann, G., Margulies, D. S., Horstmann, A., Pleger, B., Lepsien, J., Goldhahn, D., … Turner, R. (2010). Eigenvector Centrality Mapping for Analyzing Connectivity Patterns in fMRI Data of the Human Brain. PLOS ONE, 5(4), e10232. https://doi.org/10.1371/journal.pone.0010232
Lottman, K. K., Gawne, T. J., Kraguljac, N. V., Killen, J. F., Reid, M. A., & Lahti, A. C. (2019). Examining resting-state functional connectivity in first-episode schizophrenia with 7T fMRI and MEG. NeuroImage. Clinical, 24, 101959. https://doi.org/10.1016/j.nicl.2019.101959
Madre, M., Canales-Rodríguez, E. J., Fuentes-Claramonte, P., Alonso-Lana, S., Salgado-Pineda, P., Guerrero-Pedraza, A., … Pomarol-Clotet, E. (2020). Structural abnormality in schizophrenia versus bipolar disorder: A whole brain cortical thickness, surface area, volume and gyrification analyses. NeuroImage. Clinical, 25, 102131. https://doi.org/10.1016/j.nicl.2019.102131
Makowski, C., Lepage, M., & Evans, A. C. (2019). Head motion: The dirty little secret of neuroimaging in psychiatry. Journal of Psychiatry & Neuroscience: JPN, 44(1), 62–68. https://doi.org/10.1503/jpn.180022
Malhi, G. S., Das, P., Outhred, T., Bryant, R. A., Calhoun, V., & Mann, J. J. (2020). Default mode dysfunction underpins suicidal activity in mood disorders. Psychological Medicine, 50(7), 1214–1223. https://doi.org/10.1017/S0033291719001132
Malmgren-Hansen, D., Nielsen, A. A., & Pedersen, L. T. (2021). Explainability in CNN Models By Means of Z-Scores. ArXiv:2102.05874 [Cs]. Retrieved October 12, 2021, from http://arxiv.org/abs/2102.05874
Mannfolk, P., Wirestam, R., Nilsson, M., Ståhlberg, F., & Olsrud, J. (2010). Dimensionality reduction of fMRI time series data using locally linear embedding. Magnetic Resonance Materials in Physics, Biology and Medicine, 23(5–6), 327–338. https://doi.org/10.1007/s10334-010-0204-0
Martín Abadi, Ashish Agarwal, Paul Barham, Eugene Brevdo, Zhifeng Chen, Craig Citro, … Xiaoqiang Zheng. (2015). TensorFlow: Large-Scale Machine Learning on Heterogeneous Systems. Retrieved October 12, 2021 from https://www.tensorflow.org/
McTeague, L. M., Huemer, J., Carreon, D. M., Jiang, Y., Eickhoff, S. B., & Etkin, A. (2017). Identification of Common Neural Circuit Disruptions in Cognitive Control Across Psychiatric Disorders. American Journal of Psychiatry, 174(7), 676–685. https://doi.org/10.1176/appi.ajp.2017.16040400
Meszlényi, R. J., Buza, K., & Vidnyánszky, Z. (2017). Resting State fMRI Functional Connectivity-Based Classification Using a Convolutional Neural Network Architecture. Frontiers in Neuroinformatics, 11. https://doi.org/10.3389/fninf.2017.00061
Möller, H.-J. (2003). Bipolar disorder and schizophrenia: Distinct illnesses or a continuum? The Journal of Clinical Psychiatry, 64(Suppl 6), 23–27. discussion 28.
Oh, K., Kim, W., Shen, G., Piao, Y., Kang, N.-I., Oh, I.-S., & Chung, Y. C. (2019). Classification of schizophrenia and normal controls using 3D convolutional neural network and outcome visualization. Schizophrenia Research, 212, 186–195. https://doi.org/10.1016/j.schres.2019.07.034
Pereira, F., Mitchell, T., & Botvinick, M. (2009). Machine learning classifiers and fMRI: A tutorial overview. NeuroImage, 45(1, Supplement 1), S199–S209. https://doi.org/10.1016/j.neuroimage.2008.11.007
Poldrack, R. A., Congdon, E., Triplett, W., Gorgolewski, K. J., Karlsgodt, K. H., Mumford, J. A., … Bilder, R. M. (2016). A phenome-wide examination of neural and cognitive function. Scientific Data, 3(1), 160110. https://doi.org/10.1038/sdata.2016.110
Power, J. D., Mitra, A., Laumann, T. O., Snyder, A. Z., Schlaggar, B. L., & Petersen, S. E. (2014). Methods to detect, characterize, and remove motion artifact in resting state fMRI. NeuroImage, 84, 320–341. https://doi.org/10.1016/j.neuroimage.2013.08.048
Prata, D. P., Costa-Neves, B., Cosme, G., & Vassos, E. (2019). Unravelling the genetic basis of schizophrenia and bipolar disorder with GWAS: A systematic review. Journal of Psychiatric Research, 114, 178–207. https://doi.org/10.1016/j.jpsychires.2019.04.007
Price, R. B., Cummings, L., Gilchrist, D., Graur, S., Banihashemi, L., Kuo, S. S., & Siegle, G. J. (2018). Towards personalized, brain-based behavioral intervention for transdiagnostic anxiety: Transient neural responses to negative images predict outcomes following a targeted computer-based intervention. Journal of Consulting and Clinical Psychology, 86(12), 1031–1045. https://doi.org/10.1037/ccp0000309
R Core Team. (2020). R: A language and environment for statistical computing. Vienna, Austria. Retrieved October 15, 2020, from https://www.R-project.org
Rodriguez-Raecke, R., Schrader, C., Tacik, P., Dressler, D., Lanfermann, H., & Wittfoth, M. (2021). Conflict adaptation and related neuronal processing in Parkinson’s disease. Brain Imaging and Behavior. https://doi.org/10.1007/s11682-021-00520-w
Rosen, C., Grossman, L. S., Harrow, M., Bonner-Jackson, A., & Faull, R. (2011). Diagnostic and prognostic significance of Schneiderian first-rank symptoms: A 20-year longitudinal study of schizophrenia and bipolar disorder. Comprehensive Psychiatry, 52(2), 126–131. https://doi.org/10.1016/j.comppsych.2010.06.005
Rozak, D. A., & Rozak, A. J. (2014). Using a color-coded ambigraphic nucleic acid notation to visualize conserved palindromic motifs within and across genomes. BMC Genomics, 15(1), 52. https://doi.org/10.1186/1471-2164-15-52
RStudio Team. (2020). RStudio: Integrated Development for R (Version 1.3.1093) [R]. Boston, MA: RStudio, PBC. Retrieved March 2, 2021, from http://www.rstudio.com/
Saad, Z. S., Glen, D. R., Chen, G., Beauchamp, M. S., Desai, R., & Cox, R. W. (2009). A New Method for Improving Functional-to-Structural MRI Alignment using Local Pearson Correlation. NeuroImage, 44(3), 839–848. https://doi.org/10.1016/j.neuroimage.2008.09.037
Salagre, E., Grande, I., Vieta, E., Mezquida, G., Cuesta, M. J., Moreno, C., … Group, Pep. (2020). Predictors of Bipolar Disorder Versus Schizophrenia Diagnosis in a Multicenter First Psychotic Episode Cohort: Baseline Characterization and a 12-Month Follow-Up Analysis. The Journal of Clinical Psychiatry, 81(6), 19m12996. https://doi.org/10.4088/JCP.19m12996
Sarraf, S., Desouza, D. D., Anderson, J. A. E., & Saverino, C. (2019). MCADNNet: Recognizing Stages of Cognitive Impairment Through Efficient Convolutional fMRI and MRI Neural Network Topology Models. IEEE Access, 7, 155584–155600. https://doi.org/10.1109/ACCESS.2019.2949577
Satterthwaite, T. D., Elliott, M. A., Gerraty, R. T., Ruparel, K., Loughead, J., Calkins, M. E., … Wolf, D. H. (2013). An improved framework for confound regression and filtering for control of motion artifact in the preprocessing of resting-state functional connectivity data. NeuroImage, 64, 240–256. https://doi.org/10.1016/j.neuroimage.2012.08.052
Scalabrini, A., Vai, B., Poletti, S., Damiani, S., Mucci, C., Colombo, C., … Northoff, G. (2020). All roads lead to the default-mode network-global source of DMN abnormalities in major depressive disorder. Neuropsychopharmacology: Official Publication of the American College of Neuropsychopharmacology, 45(12), 2058–2069. https://doi.org/10.1038/s41386-020-0785-x
Scarpazza, C., Ha, M., Baecker, L., Garcia-Dias, R., Pinaya, W. H. L., Vieira, S., & Mechelli, A. (2020). Translating research findings into clinical practice: A systematic and critical review of neuroimaging-based clinical tools for brain disorders. Translational Psychiatry, 10(1), 1–16. https://doi.org/10.1038/s41398-020-0798-6
Schilbach, L., Hoffstaedter, F., Müller, V., Cieslik, E. C., Goya-Maldonado, R., Trost, S., … Eickhoff, S. B. (2015). Transdiagnostic commonalities and differences in resting state functional connectivity of the default mode network in schizophrenia and major depression. NeuroImage : Clinical, 10, 326–335. https://doi.org/10.1016/j.nicl.2015.11.021
Schmidt, S., Banaschewski, T., Garbe, E., Petermann, F., & Petermann, U. (2013). Diagnostic of ADHD in childhood and adolescence with the K-SADS-PL. Praxis Der Kinderpsychologie Und Kinderpsychiatrie, 62(7), 473–490.
Schwedt, T. J., Chiang, C.-C., Chong, C. D., & Dodick, D. W. (2015). Functional MRI of migraine. The Lancet. Neurology, 14(1), 81–91. https://doi.org/10.1016/S1474-4422(14)70193-0
Shang, C. Y., Yan, C. G., Lin, H. Y., Tseng, W. Y., Castellanos, F. X., & Gau, S. S. (2016). Differential effects of methylphenidate and atomoxetine on intrinsic brain activity in children with attention deficit hyperactivity disorder. Psychological Medicine, 46(15), 3173–3185. https://doi.org/10.1017/S0033291716001938
Sheffield, J. M., & Barch, D. M. (2016). Cognition and resting-state functional connectivity in schizophrenia. Neuroscience and Biobehavioral Reviews, 61, 108–120. https://doi.org/10.1016/j.neubiorev.2015.12.007
Shimony, J. S., Zhang, D., Johnston, J. M., Fox, M. D., Roy, A., & Leuthardt, E. C. (2009). Resting-state Spontaneous Fluctuations in Brain Activity: A New Paradigm for Presurgical Planning Using fMRI. Academic Radiology, 16(5), 578–583. https://doi.org/10.1016/j.acra.2009.02.001
Shirer, W. R., Ryali, S., Rykhlevskaia, E., Menon, V., & Greicius, M. (2012). Decoding Subject-Driven Cognitive States with Whole-Brain Connectivity Patterns. Cerebral Cortex, 22(1), 158–165. https://doi.org/10.1093/cercor/bhr099
Shirer, W. R., Jiang, H., Price, C. M., Ng, B., & Greicius, M. D. (2015). Optimization of rs-fMRI Pre-processing for Enhanced Signal-Noise Separation, Test-Retest Reliability, and Group Discrimination. NeuroImage, 117, 67–79. https://doi.org/10.1016/j.neuroimage.2015.05.015
Sidhu, G. (2019). Locally Linear Embedding and fMRI Feature Selection in Psychiatric Classification. IEEE Journal of Translational Engineering in Health and Medicine, 7, 1–11. https://doi.org/10.1109/JTEHM.2019.2936348
Silva, S. D., Dayarathna, S. U., Ariyarathne, G., Meedeniya, D., & Jayarathna, S. (2021). FMRI Feature Extraction Model for ADHD Classification Using Convolutional Neural Network. International Journal of E-Health and Medical Communications (IJEHMC), 12(1), 81–105. https://doi.org/10.4018/IJEHMC.2021010106
Sörös, P., Hoxhaj, E., Borel, P., Sadohara, C., Feige, B., Matthies, S., … Philipsen, A. (2019). Hyperactivity/restlessness is associated with increased functional connectivity in adults with ADHD: A dimensional analysis of resting state fMRI. BMC Psychiatry, 19(1), 43. https://doi.org/10.1186/s12888-019-2031-9
Sporns, O., Honey, C. J., & Kötter, R. (2007). Identification and Classification of Hubs in Brain Networks. PLoS ONE, 2(10), e1049. https://doi.org/10.1371/journal.pone.0001049
Suk, H.-I., Wee, C.-Y., Lee, S.-W., & Shen, D. (2016). State-space model with deep learning for functional dynamics estimation in resting-state fMRI. NeuroImage, 129, 292–307. https://doi.org/10.1016/j.neuroimage.2016.01.005
Tahmassebi, A., Gandomi, A. H., McCann, I., Schulte, M. H. J., Goudriaan, A. E., & Meyer-Baese, A. (2018). Deep Learning in Medical Imaging: FMRI Big Data Analysis via Convolutional Neural Networks. Proceedings of the Practice and Experience on Advanced Research Computing, 1–4. New York, NY, USA: Association for Computing Machinery. https://doi.org/10.1145/3219104.3229250
Taylor, P. A., Chen, G., Glen, D. R., Rajendra, J. K., Reynolds, R. C., & Cox, R. W. (2018). FMRI processing with AFNI: Some comments and corrections on “Exploring the Impact of Analysis Software on Task fMRI Results.” BioRxiv, 308643. https://doi.org/10.1101/308643
Taylor, P. A., & Saad, Z. S. (2013). FATCAT: (An Efficient) Functional And Tractographic Connectivity Analysis Toolbox. Brain Connectivity, 3(5), 523–535. https://doi.org/10.1089/brain.2013.0154
Tokuda, T., Yoshimoto, J., Shimizu, Y., Okada, G., Takamura, M., Okamoto, Y., … Doya, K. (2018). Identification of depression subtypes and relevant brain regions using a data-driven approach. Scientific Reports, 8(1), 14082. https://doi.org/10.1038/s41598-018-32521-z
Umesh, P. (2012). Image Processing in Python. CSI Communications, 23
Unadkat, P., Fumagalli, L., Rigolo, L., Vangel, M. G., Young, G. S., Huang, R., … Tie, Y. (2019). Functional MRI Task Comparison for Language Mapping in Neurosurgical Patients. Journal of Neuroimaging, 29(3), 348–356. https://doi.org/10.1111/jon.12597
Van Rossum, G., & Drake, F. L. (2009). Python 3 Reference Manual. Scotts Valley, CA: CreateSpace.
Vovk, A., Cox, R. W., Stare, J., Suput, D., & Saad, Z. S. (2011). Segmentation priors from local image properties: Without using bias field correction, location-based templates, or registration. NeuroImage, 55(1), 142–152. https://doi.org/10.1016/j.neuroimage.2010.11.082
Wickham, H., Averick, M., Bryan, J., Chang, W., McGowan, L. D., François, R., … Yutani, H. (2019). Welcome to the Tidyverse. Journal of Open Source Software, 4(43), 1686. https://doi.org/10.21105/joss.01686
Wink, A. M., de Munck, J. C., van der Werf, Y. D., van den Heuvel, O. A., & Barkhof, F. (2012). Fast eigenvector centrality mapping of voxel-wise connectivity in functional magnetic resonance imaging: Implementation, validation, and interpretation. Brain Connectivity, 2(5), 265–274. https://doi.org/10.1089/brain.2012.0087
Yamada, Y., Matsumoto, M., Iijima, K., & Sumiyoshi, T. (2020). Specificity and Continuity of Schizophrenia and Bipolar Disorder: Relation to Biomarkers. Current Pharmaceutical Design, 26(2), 191–200. https://doi.org/10.2174/1381612825666191216153508
Yuditsky, T., Sollenberger, R. L., Della Rocco, P. S., Friedman-Berg, F., Manning, C. A., & William J. Hughes Technical Center (U.S.). (2002). Application of color to reduce complexity in air traffic control. (No. DOT/FAA/CT-TN03/01). Retrieved September 27, 2021, from https://rosap.ntl.bts.gov/view/dot/16693
Yu-feng, Z., Yong, H., Chao-zhe, Z., Qing-Jiu, C., & Yu-Feng, W. (2007). Altered baseline brain activity in children with ADHD revealed by resting-state functional MRI. Brain and Development. https://doi.org/10.1016/j.braindev.2006.07.002
Zang, Y., Jiang, T., Lu, Y., He, Y., & Tian, L. (2004). Regional homogeneity approach to fMRI data analysis. NeuroImage, 22(1), 394–400. https://doi.org/10.1016/j.neuroimage.2003.12.030
Zhang, L., Li, W., Wang, L., Bai, T., Ji, G.-J., Wang, K., & Tian, Y. (2020). Altered functional connectivity of right inferior frontal gyrus subregions in bipolar disorder: A resting state fMRI study. Journal of Affective Disorders, 272, 58–65. https://doi.org/10.1016/j.jad.2020.03.122
Zhang, P., Li, Y., Fan, F., Li, C.-S. R., Luo, X., Yang, F., … Tan, Y. (2018). Resting-state Brain Activity Changes Associated with Tardive Dyskinesia in Patients with Schizophrenia: Fractional Amplitude of Low-frequency Fluctuation Decreased in the Occipital Lobe. Neuroscience, 385, 237–245. https://doi.org/10.1016/j.neuroscience.2018.06.014
Zhang, X., Yaseen, Z. S., Galynker, I. I., Hirsch, J., & Winston, A. (2011). Can Depression be Diagnosed by Response to Mother’s Face? A Personalized Attachment-Based Paradigm for Diagnostic fMRI. PLoS ONE, 6(12), e27253. https://doi.org/10.1371/journal.pone.0027253
Zhao, Y., Dong, Q., Zhang, S., Zhang, W., Chen, H., Jiang, X., … Liu, T. (2018). Automatic Recognition of fMRI-Derived Functional Networks Using 3-D Convolutional Neural Networks. IEEE Transactions on Biomedical Engineering, 65(9), 1975–1984. https://doi.org/10.1109/TBME.2017.2715281
Zhou, C., Tang, X., You, W., Wang, X., Zhang, X., Zhang, X., & Yu, M. (2019a). Altered Patterns of the Fractional Amplitude of Low-Frequency Fluctuation and Functional Connectivity Between Deficit and Non-Deficit Schizophrenia. Frontiers in Psychiatry, 10, 680. https://doi.org/10.3389/fpsyt.2019.00680
Zhou, M., Yang, C., Bu, X., Liang, Y., Lin, H., Hu, X., … Huang, X. (2019). Abnormal functional network centrality in drug-naïve boys with attention-deficit/hyperactivity disorder. European Child & Adolescent Psychiatry, 28(10), 1321–1328. https://doi.org/10.1007/s00787-019-01297-6
Zhou, Q., Womer, F. Y., Kong, L., Wu, F., Jiang, X., Zhou, Y., … Wang, F. (2017). Trait-Related Cortical-Subcortical Dissociation in Bipolar Disorder: Analysis of Network Degree Centrality. The Journal of Clinical Psychiatry, 78(5), 584–591. https://doi.org/10.4088/JCP.15m10091
Zhou, Y., Fan, L., Qiu, C., & Jiang, T. (2015). Prefrontal cortex and the dysconnectivity hypothesis of schizophrenia. Neuroscience Bulletin, 31(2), 207–219. https://doi.org/10.1007/s12264-014-1502-8
Zhou, Y., Liang, M., Tian, L., Wang, K., Hao, Y., Liu, H., … Jiang, T. (2007). Functional disintegration in paranoid schizophrenia using resting-state fMRI. Schizophrenia Research, 97(1–3), 194–205. https://doi.org/10.1016/j.schres.2007.05.029
Zou, Q.-H., Zhu, C.-Z., Yang, Y., Zuo, X.-N., Long, X.-Y., Cao, Q.-J., … Zang, Y.-F. (2008). An improved approach to detection of amplitude of low-frequency fluctuation (ALFF) for resting-state fMRI: Fractional ALFF. Journal of Neuroscience Methods, 172(1), 137–141. https://doi.org/10.1016/j.jneumeth.2008.04.012
Zuo, X.-N., Ehmke, R., Mennes, M., Imperati, D., Castellanos, F. X., Sporns, O., & Milham, M. P. (2012). Network Centrality in the Human Functional Connectome. Cerebral Cortex, 22(8), 1862–1875. https://doi.org/10.1093/cercor/bhr269
Acknowledgements
This research received no specific grant from any funding agency in the public, commercial, or not-for-profit sectors. Data was obtained from the OpenfMRI database (https://openfmri.org/dataset/ds000030/). Its accession number is ds000030. The Authors would like to thank the investigators who shared the UCLA dataset: Bilder, R, Poldrack, R, Cannon, T, London, E, Freimer, N, Congdon, E, Karlsgodt, K, Sabb, F
Funding
Open access funding provided by Università degli Studi di Firenze within the CRUI-CARE Agreement. This research received no specific grant from any funding agency in the public, commercial, or not-for-profit sectors.
This study used a shared neuroimaging dataset from the UCLA Consortium for Neuropsychiatric Phenomics, all analyses conformed with the ethical standards as laid down in the 1964 Declaration of Helsinki and its later amendments.
Author information
Authors and Affiliations
Contributions
L.T. conceptualized the study and wrote the first draft. S.D. and P.L.T.V. contributed with L.T. to the processing and analysis of data. S.M., N.N., P.P., T.P., V.R. and G.C. revised and enhanced the final draft, offering critical and technical contributions to the interpretation of results. V.R., G.C. and P.P. supervised and coordinated the research groups.
Corresponding author
Ethics declarations
Data availability
The data supporting the findings of this study are available from the corresponding author upon reasonable request.
Conflicts of interest
The authors declare no potential conflict of interest.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Below is the link to the electronic supplementary material.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Tarchi, L., Damiani, S., La Torraca Vittori, P. et al. The colors of our brain: an integrated approach for dimensionality reduction and explainability in fMRI through color coding (i-ECO). Brain Imaging and Behavior 16, 977–990 (2022). https://doi.org/10.1007/s11682-021-00584-8
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11682-021-00584-8