Statistical power and prediction accuracy in multisite resting-state fMRI connectivity.
- Authors
- Dansereau, Christian; Benhajali, Yassine; Risterucci, Celine; Pich, Emilio Merlo; Orban, Pierre; Arnold, Douglas; Bellec, Pierre
- Year
- 2017
- Journal
- NeuroImage
- PMID
- 28161310
- DOI
- 10.1016/j.neuroimage.2017.01.072
Connectivity studies using resting-state functional magnetic resonance imaging are increasingly pooling data acquired at multiple sites. While this may allow investigators to speed up recruitment or increase sample size, multisite studies also potentially introduce systematic biases in connectivity measures across sites. In this work, we measure the inter-site effect in connectivity and its impact on our ability to detect individual and group differences. Our study was based on real, as opposed to simulated, multisite fMRI datasets collected in N=345 young, healthy subjects across 8 scanning sites with 3T scanners and heterogeneous scanning protocols, drawn from the 1000 functional connectome project. We first empirically show that typical functional networks were reliably found at the group level in all sites, and that the amplitude of the inter-site effects was small to moderate, with a Cohen's effect size below 0.5 on average across brain connections. We then implemented a series of Monte-Carlo simulations, based on real data, to evaluate the impact of the multisite effects on detection power in statistical tests comparing two groups (with and without the effect) using a general linear model, as well as on the prediction of group labels with a support-vector machine. As a reference, we also implemented the same simulations with fMRI data collected at a single site using an identical sample size. Simulations revealed that using data from heterogeneous sites only slightly decreased our ability to detect changes compared to a monosite study with the GLM, and had a greater impact on prediction accuracy. However, the deleterious effect of multisite data pooling tended to decrease as the total sample size increased, to a point where differences between monosite and multisite simulations were small with N=120 subjects. Taken together, our results support the feasibility of multisite studies in rs-fMRI provided the sample size is large enough.
No figures extracted from this document.
No chunks β full text not yet ingested.
No entities extracted from this document yet.
No uploaded files.
No citations found.
In this knowledge base
External
| Title | Authors | Journal | Year | Link |
|---|---|---|---|---|
| A general framework for investigating neurodevelopment of brain functional networks using multisite and longitudinal neuroimaging. | Lukemire J et al. | β | 2026 | β |
| Multi-Site Classification of Autism Spectrum Disorder Using Spatially Constrained ICA on Resting-State fMRI Networks. | Baig TI et al. | β | 2026 | β |
| Comprehensive evaluation of pipelines for classification of psychiatric disorders using multi-site resting-state fMRI datasets. | Takahara Y et al. | β | 2025 | β |
| Exploring the impact of APOE Ι4 on functional connectivity in Alzheimer's disease across cognitive impairment levels. | Dong K et al. | β | 2025 | β |
| Functional connectivity as a prognostic biomarker for neurodevelopmental outcomes in preterm infants without severe brain injury. | Li YT et al. | β | 2025 | β |
| Improved injury detection through harmonizing multi-site neuroimaging data after experimental TBI: a Translational Outcomes Project in Neurotrauma consortium study. | Kislik G et al. | β | 2025 | β |
| Neural correlates of rumination and social anxiety: Mediating role of vmPFC connectivity in resting-state fMRI. | Geng L et al. | β | 2025 | β |
| Neurobehavioral therapy in functional seizures: Investigation of mechanism of action with resting-state functional magnetic resonance imaging. | Szaflarski JP et al. | β | 2025 | β |
| Topology Assisted Clustering of Temporal fMRI Brain Networks With Use-Case in Mitigating Non-Neural Multi-Site Variability. | Shovon AR et al. | β | 2025 | β |
| Voxel Volume Overlap: Voxel-Size Sensitive Indicators of Subject Motion in Functional MRI. | Wilke M | β | 2025 | β |
| Altered resting-state connectivity of the auditory cortex in congenital amusia: A functional magnetic resonance imaging study in Mandarin speakers. | Jin Z et al. | β | 2024 | β |
| Efficacy of MRI data harmonization in the age of machine learning: a multicenter study across 36 datasets. | Marzi C et al. | β | 2024 | β |
| Frontoparietal and salience network synchronizations during nonsymbolic magnitude processing predict brain age and mathematical performance in youth. | Ng CT et al. | β | 2024 | β |
| An examination of the reliability of seed-to-seed resting state functional connectivity in tinnitus patients. | Schmidt SA et al. | β | 2023 | β |
| Applications of generative adversarial networks in neuroimaging and clinical neuroscience. | Wang R et al. | β | 2023 | β |
| Comprehensive evaluation of harmonization on functional brain imaging for multisite data-fusion. | Wang YW et al. | β | 2023 | β |
| Confounding Effects on the Performance of Machine Learning Analysis of Static Functional Connectivity Computed from rs-fMRI Multi-site Data. | Artiles O et al. | β | 2023 | β |
| Evidence for embracing normative modeling. | Rutherford S et al. | β | 2023 | β |
| Harmonization of repetition time and scanner effects on estimates of brain hemodynamic response function. | Dole L et al. | β | 2023 | β |
| Hippocampal-cortical functional connectivity during memory encoding and retrieval. | Raud L et al. | β | 2023 | β |
| Predicting Alcohol-Related Memory Problems in Older Adults: A Machine Learning Study with Multi-Domain Features. | Kamarajan C et al. | β | 2023 | β |
| Random matrix theory tools for the predictive analysis of functional magnetic resonance imaging examinations. | Berger D et al. | β | 2023 | β |
| RELIEF: A structured multivariate approach for removal of latent inter-scanner effects. | Zhang R et al. | β | 2023 | β |
| Resting-state functional MRI in multicenter studies on multiple sclerosis: a report on raw data quality and functional connectivity features from the Italian Neuroimaging Network Initiative. | De Rosa AP et al. | β | 2023 | β |
| The robustness of persistent homology of brain networks to data acquisition-related non-neural variability in resting state fMRI. | Kumar S et al. | β | 2023 | β |
| A more unstable resting-state functional network in cognitively declining multiple sclerosis. | Broeders TAA et al. | β | 2022 | β |
| Assessing Multi-Site rs-fMRI-Based Connectomic Harmonization Using Information Theory. | Roffet F et al. | β | 2022 | β |
| Comprehensive evaluation of harmonization on functional brain imaging for multisite data-fusion | Wang Y et al. | β | 2022 | β |
| Differentiating Individuals with and without Alcohol Use Disorder Using Resting-State fMRI Functional Connectivity of Reward Network, Neuropsychological Performance, and Impulsivity Measures. | Kamarajan C et al. | β | 2022 | β |
| Harmonizing functional connectivity reduces scanner effects in community detection. | Chen AA et al. | β | 2022 | β |
| Left DLPFC activity is associated with plasma kynurenine levels and can predict treatment response to escitalopram in major depressive disorder. | Kamishikiryo T et al. | β | 2022 | β |
| Multi-centre classification of functional neurological disorders based on resting-state functional connectivity. | Weber S et al. | β | 2022 | β |
| The Atypical Effective Connectivity of Right Temporoparietal Junction in Autism Spectrum Disorder: A Multi-Site Study. | Hao Z et al. | β | 2022 | β |
| Tonic pain alters functional connectivity of the descending pain modulatory network involving amygdala, periaqueductal gray, parabrachial nucleus and anterior cingulate cortex. | Meeker TJ et al. | β | 2022 | β |
| A multivariate neuromonitoring approach to neuroplasticity-based computerized cognitive training in recent onset psychosis. | Haas SS et al. | β | 2021 | β |
| Effects of different smoothing on global and regional resting functional connectivity. | Alahmadi AAS | β | 2021 | β |
| Increased Resting-State Interhemispheric Functional Connectivity of Posterior Superior Temporal Gyrus and Posterior Cingulate Cortex in Congenital Amusia. | Jin Z et al. | β | 2021 | β |
| Lesion network mapping predicts post-stroke behavioural deficits and improves localization. | Cohen AL et al. | β | 2021 | β |
| Modeling Heterogeneous Brain Dynamics of Depression and Melancholia Using Energy Landscape Analysis. | Regonia PR et al. | β | 2021 | β |
| Reducing Inter-Site Variability for Fluctuation Amplitude Metrics in Multisite Resting State BOLD-fMRI Data. | Wang X et al. | β | 2021 | β |
| Constructing and evaluating a cortical surface atlas and analyzing cortical sex differences in young Chinese adults. | Yang G et al. | β | 2020 | β |
| Effects of spatial smoothing on group-level differences in functional brain networks. | Triana AM et al. | β | 2020 | β |
| Generalizability of machine learning for classification of schizophrenia based on resting-state functional MRI data. | Cai XL et al. | β | 2020 | β |
| Generalizable, Reproducible, and Neuroscientifically Interpretable Imaging Biomarkers for Alzheimer's Disease. | Jin D et al. | β | 2020 | β |
| Multivariate analysis reveals a generalizable human electrophysiological signature of working memory load. | Adam KCS et al. | β | 2020 | β |
| Multivariate consistency of resting-state fMRI connectivity maps acquired on a single individual over 2.5 years, 13 sites and 3 vendors. | Badhwar A et al. | β | 2020 | β |
| Nature abhors a paywall: How open science can realize the potential of naturalistic stimuli. | DuPre E et al. | β | 2020 | β |
| Nonreplication of functional connectivity differences in autism spectrum disorder across multiple sites and denoising strategies. | He Y et al. | β | 2020 | β |
| Random Forest Classification of Alcohol Use Disorder Using EEG Source Functional Connectivity, Neuropsychological Functioning, and Impulsivity Measures. | Kamarajan C et al. | β | 2020 | β |
| Random Forest Classification of Alcohol Use Disorder Using fMRI Functional Connectivity, Neuropsychological Functioning, and Impulsivity Measures. | Kamarajan C et al. | β | 2020 | β |
| Reply: The influence of sample size and arbitrary statistical thresholds in lesion-network mapping. | Cohen AL et al. | β | 2020 | β |
| BOLD signal variability and complexity in children and adolescents with and without autism spectrum disorder. | Easson AK et al. | β | 2019 | β |
| Brain-based ranking of cognitive domains to predict schizophrenia. | Karrer TM et al. | β | 2019 | β |
| Food addiction linked to changes in ventral striatum functional connectivity between fasting and satiety. | Contreras-Rodriguez O et al. | β | 2019 | β |
| Gray Matter Alterations Associated With Dissociation in Female Survivors of Childhood Trauma. | Daniels JK et al. | β | 2019 | β |
| Harmonization of resting-state functional MRI data across multiple imaging sites via the separation of site differences into sampling bias and measurement bias. | Yamashita A et al. | β | 2019 | β |
| Machine learning in resting-state fMRI analysis. | Khosla M et al. | β | 2019 | β |
| Ten simple rules for predictive modeling of individual differences in neuroimaging. | Scheinost D et al. | β | 2019 | β |
| Toward Leveraging Human Connectomic Data in Large Consortia: Generalizability of fMRI-Based Brain Graphs Across Sites, Sessions, and Paradigms. | Cao H et al. | β | 2019 | β |
| Classifying early and late mild cognitive impairment stages of Alzheimer's disease by fusing default mode networks extracted with multiple seeds. | Pei S et al. | β | 2018 | β |
| Cross-validation failure: Small sample sizes lead to large error bars. | Varoquaux G | β | 2018 | β |
| Imaging Cerebral Activity in Amyotrophic Lateral Sclerosis. | Proudfoot M et al. | β | 2018 | β |
| Multisite generalizability of schizophrenia diagnosis classification based on functional brain connectivity. | Orban P et al. | β | 2018 | β |
| Statistical harmonization corrects site effects in functional connectivity measurements from multi-site fMRI data. | Yu M et al. | β | 2018 | β |
| Data-Driven Topological Filtering Based on Orthogonal Minimal Spanning Trees: Application to Multigroup Magnetoencephalography Resting-State Connectivity. | Dimitriadis SI et al. | β | 2017 | β |
| Random Forest Algorithm for the Classification of Neuroimaging Data in Alzheimer's Disease: A Systematic Review. | Sarica A et al. | β | 2017 | β |
| Replicability of time-varying connectivity patterns in large resting state fMRI samples. | Abrol A et al. | β | 2017 | β |