General overview on the merits of multimodal neuroimaging data fusion.
- Authors
- UludaΔ, KΓ’mil; Roebroeck, Alard
- Year
- 2014
- Journal
- NeuroImage
- PMID
- 24845622
- DOI
- 10.1016/j.neuroimage.2014.05.018
Multimodal neuroimaging has become a mainstay of basic and cognitive neuroscience in humans and animals, despite challenges to consider when acquiring and combining non-redundant imaging data. Multimodal data integration can yield important insights into brain processes and structures in addition to spatiotemporal resolution complementarity, including: a comprehensive physiological view on brain processes and structures, quantification, generalization and normalization, and availability of biomarkers. In this review, we discuss data acquisition and fusion in multimodal neuroimaging in the context of each of these potential merits. However, limitations - due to differences in the neuronal and structural underpinnings of each method - have to be taken into account when modeling and interpreting multimodal data using generative models. We conclude that when these challenges are adequately met, multimodal data fusion can create substantial added value for neuroscience applications making it an indispensable approach for studying the brain.
No figures extracted from this document.
No chunks β full text not yet ingested.
No entities extracted from this document yet.
No uploaded files.
No citations found.
In this knowledge base
| Title | Year | PMID |
|---|---|---|
| Advances in Electrophysiological Research. | 2015 | 26259089 |
External
| Title | Authors | Journal | Year | Link |
|---|---|---|---|---|
| A critical review of brain entropy as a biomarker of the psychedelic state. | Moses B et al. | β | 2026 | β |
| Integrating functional network topology, synaptic density, and tau pathology to predict cognitive decline in amnestic mild cognitive impairment. | Lien CH et al. | β | 2026 | β |
| Machine learning unveils three layers of food complexity. | Ke Q et al. | β | 2026 | β |
| Mapping the neural basis of selected cognitive functions: A combined functional, structural, and diffusion MRI study. | Jalalvandi M et al. | β | 2026 | β |
| The exercise and concussion health study (TECHS): Pilot and feasibility protocol. | Tinney EM et al. | β | 2026 | β |
| The structural, functional, and neurophysiological connectome of mild traumatic brain injury: A DTI, fMRI and MEG multimodal clustering and data fusion study. | Zhang J et al. | β | 2026 | β |
| Annotating neurophysiologic data at scale with optimized human input. | Xu Z et al. | β | 2025 | β |
| An optimized framework for simultaneous EEG-fMRI at 7T enabling safe, high-quality human brain imaging with millisecond temporal resolution and sub-millimeter spatial resolution. | Martinez CS et al. | β | 2025 | β |
| A robust multimodal brain MRI-based diagnostic model for migraine: validation across different migraine phases and longitudinal follow-up data. | Namgung JY et al. | β | 2025 | β |
| Emerging biophysical techniques for probing synaptic transmission in neurodegenerative disorders. | Kale MB et al. | β | 2025 | β |
| Integrated brain connectivity analysis with fMRI, DTI, and sMRI powered by interpretable graph neural networks. | Qu G et al. | β | 2025 | β |
| Physiological influences on neurovascular coupling: A systematic review of multimodal imaging approaches and recommendations for future study designs. | Burma JS et al. | β | 2025 | β |
| Structurally informed models of directed brain connectivity. | Greaves MD et al. | β | 2025 | β |
| Trimodal brain imaging: A novel approach for simultaneous investigation of human brain function. | Moore M et al. | β | 2025 | β |
| Unveiling genetic architecture of white matter microstructure through unsupervised deep representation learning of fractional anisotropy maps | Zhao X et al. | β | 2025 | β |
| WAND: A multi-modal dataset integrating advanced MRI, MEG, and TMS for multi-scale brain analysis. | McNabb CB et al. | β | 2025 | β |
| A Method for Multimodal IVA Fusion Within a MISA Unified Model Reveals Markers of Age, Sex, Cognition, and Schizophrenia in Large Neuroimaging Studies. | Silva RF et al. | β | 2024 | β |
| Exploring Schizophrenia Classification Through Multimodal MRI and Deep Graph Neural Networks: Unveiling Brain Region-Specific Weight Discrepancies and Their Association With Cell-Type Specific Transcriptomic Features. | Gao J et al. | β | 2024 | β |
| Improving inner speech decoding by hybridisation of bimodal EEG and fMRI data. | Wellington S et al. | β | 2024 | β |
| Microstructural and functional substrates underlying dispositional greed and its link with trait but not state impulsivity. | Jiang K et al. | β | 2024 | β |
| Multimodal neuroimaging of hierarchical cognitive control. | Pagnotta MF et al. | β | 2024 | β |
| Optical Devices for the Diagnosis and Management of Spinal Cord Injuries: A Review. | Sharma S et al. | β | 2024 | β |
| Paradigm shift required for translational research on the brain. | Yoon JH et al. | β | 2024 | β |
| A revisit of the amygdala theory of autism: Twenty years after. | Wang S et al. | β | 2023 | β |
| A robust and interpretable deep learning framework for multi-modal registration via keypoints. | Wang AQ et al. | β | 2023 | β |
| Automated Medical Diagnosis of AlzheimerΒ΄s Disease Using an Efficient Net Convolutional Neural Network. | Agarwal D et al. | β | 2023 | β |
| Cerebral Hemodynamics and Microvasculature Changes in Relation to White Matter Microstructure After Pediatric Mild Traumatic Brain Injury: An A-CAP Pilot Study. | Lapointe AP et al. | β | 2023 | β |
| Cognition's dependence on functional network integrity with age is conditional on structural network integrity. | Liu X et al. | β | 2023 | β |
| Decoding Mental Effort in a Quasi-Realistic Scenario: A Feasibility Study on Multimodal Data Fusion and Classification. | Gado S et al. | β | 2023 | β |
| Effect of maternal serum magnesium and calcium levels on umbilical glial fibrillary acidic protein levels in preterm labor. | Santoso DPJ et al. | β | 2023 | β |
| Generalized Liquid Association Analysis for Multimodal Data Integration. | Li L et al. | β | 2023 | β |
| Optimized Convolutional Fusion for Multimodal Neuroimaging in Alzheimer's Disease Diagnosis: Enhancing Data Integration and Feature Extraction. | Odusami M et al. | β | 2023 | β |
| Orthogonalized Kernel Debiased Machine Learning for Multimodal Data Analysis. | Dai X et al. | β | 2023 | β |
| Signed graph representation learning for functional-to-structural brain network mapping. | Tang H et al. | β | 2023 | β |
| Supervised Phenotype Discovery From Multimodal Brain Imaging. | Gong W et al. | β | 2023 | β |
| Association of Neuroimaging Data with Behavioral Variables: A Class of Multivariate Methods and Their Comparison Using Multi-Task FMRI Data. | Akhonda MABS et al. | β | 2022 | β |
| Combining advanced MRI and EEG techniques better explains long-term motor outcome after very preterm birth. | van 't Westende C et al. | β | 2022 | β |
| Discussion on "distributional independent component analysis for diverse neuroimaging modalities" by Ben Wu, Subhadip Pal, Jian Kang, and Ying Guo. | Mejia AF | β | 2022 | β |
| Extracting electrophysiological correlates of functional magnetic resonance imaging data using the canonical polyadic decomposition. | Mann-Krzisnik D et al. | β | 2022 | β |
| Genuine high-order interactions in brain networks and neurodegeneration. | Herzog R et al. | β | 2022 | β |
| Identification of the main components of spontaneous speech in primary progressive aphasia and their neural underpinnings using multimodal MRI and FDG-PET imaging. | Matias-Guiu JA et al. | β | 2022 | β |
| Increased amplitude of hippocampal low frequency fluctuations in early psychosis: A two-year follow-up study. | McHugo M et al. | β | 2022 | β |
| Integrative Factor Regression and Its Inference for Multimodal Data Analysis. | Li Q et al. | β | 2022 | β |
| Multidimensional inhibitory signatures of sentential negation in behavioral variant frontotemporal dementia. | DΓaz-Rivera MN et al. | β | 2022 | β |
| Neurological mechanism and treatment effects prediction of acupuncture on migraine without aura: Study protocol for a randomized controlled trial. | Hong J et al. | β | 2022 | β |
| The Task-Dependent Modular Covariance Networks Unveiled by Multiple-Way Fusion-Based Analysis. | Jiang L et al. | β | 2022 | β |
| A Comprehensive Review of Computer-Aided Diagnosis of Major Mental and Neurological Disorders and Suicide: A Biostatistical Perspective on Data Mining. | Mansourian M et al. | β | 2021 | β |
| A multimodal IVA fusion approach to identify linked neuroimaging markers. | Damaraju E et al. | β | 2021 | β |
| Comparison of EEG microstates with resting state fMRI and FDG-PET measures in the default mode network via simultaneously recorded trimodal (PET/MR/EEG) data. | Rajkumar R et al. | β | 2021 | β |
| Deep Fusion of Brain Structure-Function in Mild Cognitive Impairment. | Zhang L et al. | β | 2021 | β |
| Detecting Risk Gene and Pathogenic Brain Region in EMCI Using a Novel GERF Algorithm Based on Brain Imaging and Genetic Data. | Bi XA et al. | β | 2021 | β |
| End-to-end neural system identification with neural information flow. | Seeliger K et al. | β | 2021 | β |
| Factors associated with brain ageing - a systematic review. | Wrigglesworth J et al. | β | 2021 | β |
| How Alpha Rhythm Spatiotemporally Acts Upon the Thalamus-Default Mode Circuit in Idiopathic Generalized Epilepsy. | Qin Y et al. | β | 2021 | β |
| Inferring Macroscale Brain Dynamics via Fusion of Simultaneous EEG-fMRI. | Philiastides MG et al. | β | 2021 | β |
| Multimodal neuroimaging data integration and pathway analysis. | Zhao Y et al. | β | 2021 | β |
| Phenotype discovery from population brain imaging. | Gong W et al. | β | 2021 | β |
| Proof-of-concept evidence for trimodal simultaneous investigation of human brain function. | Moore M et al. | β | 2021 | β |
| Resting-state EEG theta activity reflects degree of genetic determination of the major epilepsy syndromes. | Clemens B et al. | β | 2021 | β |
| Virtual histology of an entire mouse brain from formalin fixation to paraffin embedding. Part 1: Data acquisition, anatomical feature segmentation, tracking global volume and density changes. | Rodgers G et al. | β | 2021 | β |
| Advances in multimodal data fusion in neuroimaging: Overview, challenges, and novel orientation. | Zhang YD et al. | β | 2020 | β |
| Asymmetric high-order anatomical brain connectivity sculpts effective connectivity. | Sokolov AA et al. | β | 2020 | β |
| A Systematic Review of Cerebral Functional Near-Infrared Spectroscopy in Chronic Neurological Diseases-Actual Applications and Future Perspectives. | Bonilauri A et al. | β | 2020 | β |
| Bayesian fusion and multimodal DCM for EEG and fMRI. | Wei H et al. | β | 2020 | β |
| Exploring characteristic features of attention-deficit/hyperactivity disorder: findings from multi-modal MRI and candidate genetic data. | Yoo JH et al. | β | 2020 | β |
| High-dimensional integrative copula discriminant analysis for multiomics data. | He Y et al. | β | 2020 | β |
| Insights into disseminated MS brain pathology with multimodal diffusion tensor and PET imaging. | Bezukladova S et al. | β | 2020 | β |
| Simultaneous Covariance Inference for Multimodal Integrative Analysis. | Xia Y et al. | β | 2020 | β |
| The impact of childhood poverty on brain health: Emerging evidence from neuroimaging across the lifespan. | Dufford AJ et al. | β | 2020 | β |
| Artifacts in EEG of simultaneous EEG-fMRI: pulse artifact remainders in the gradient artifact template are a source of artifact residuals after average artifact subtraction. | Steyrl D et al. | β | 2019 | β |
| Automated registration of magnetic resonance imaging and optoacoustic tomography data for experimental studies. | Ren W et al. | β | 2019 | β |
| Clustering-based multi-view network fusion for estimating brain network atlases of healthy and disordered populations. | Dhifallah S et al. | β | 2019 | β |
| Disrupted core-periphery structure of multimodal brain networks in Alzheimer's disease. | Guillon J et al. | β | 2019 | β |
| Effect and cerebral mechanism of acupuncture treatment for functional constipation: study protocol for a randomized controlled clinical trial. | Yin T et al. | β | 2019 | β |
| Joint modelling of diffusion MRI and microscopy. | Howard AF et al. | β | 2019 | β |
| Learning using privileged information improves neuroimaging-based CAD of Alzheimer's disease: a comparative study. | Li Y et al. | β | 2019 | β |
| Longitudinal brain functional and structural connectivity changes after hemispherotomy in two pediatric patients with drug-resistant epilepsy. | Li Y et al. | β | 2019 | β |
| Multimodal Neuroimaging: Basic Concepts and Classification of Neuropsychiatric Diseases. | Tulay EE et al. | β | 2019 | β |
| Non-invasive imaging modalities to study neurodegenerative diseases of aging brain. | Annavarapu RN et al. | β | 2019 | β |
| Spatially Adaptive Varying Correlation Analysis for Multimodal Neuroimaging Data. | Li L et al. | β | 2019 | β |
| The superior longitudinal fasciculus and its functional triple-network mechanisms in brooding. | Pisner DA et al. | β | 2019 | β |
| Unraveling Diagnostic Biomarkers of Schizophrenia Through Structure-Revealing Fusion of Multi-Modal Neuroimaging Data. | Acar E et al. | β | 2019 | β |
| Integrative linear discriminant analysis with guaranteed error rate improvement. | Li Q et al. | β | 2018 | β |
| Laboratory and Neuroimaging Biomarkers in Neuropsychiatric Systemic Lupus Erythematosus: Where Do We Stand, Where To Go? | Magro-Checa C et al. | β | 2018 | β |
| Modeling and interpreting mesoscale network dynamics. | Khambhati AN et al. | β | 2018 | β |
| Multimodal approaches to functional connectivity in autism spectrum disorders: An integrative perspective. | Mash LE et al. | β | 2018 | β |
| Multimodal Neuroimaging Feature Learning With Multimodal Stacked Deep Polynomial Networks for Diagnosis of Alzheimer's Disease. | Shi J et al. | β | 2018 | β |
| Online Reduction of Artifacts in EEG of Simultaneous EEG-fMRI Using Reference Layer Adaptive Filtering (RLAF). | Steyrl D et al. | β | 2018 | β |
| Optimizing Within-Subject Experimental Designs for jICA of Multi-Channel ERP and fMRI. | Mangalathu-Arumana J et al. | β | 2018 | β |
| Process-specific analysis in episodic memory retrieval using fast optical signals and hemodynamic signals in the right prefrontal cortex. | Dong S et al. | β | 2018 | β |
| Imagined Hand Clenching Force and Speed Modulate Brain Activity and Are Classified by NIRS Combined With EEG. | Fu Y et al. | β | 2017 | β |
| Multivariate functional response regression, with application to fluorescence spectroscopy in a cervical pre-cancer study. | Zhu H et al. | β | 2017 | β |
| Reference layer adaptive filtering (RLAF) for EEG artifact reduction in simultaneous EEG-fMRI. | Steyrl D et al. | β | 2017 | β |
| Schizophrenia Shows Disrupted Links between Brain Volume and Dynamic Functional Connectivity. | Abrol A et al. | β | 2017 | β |
| Simultaneous Intracranial EEG-fMRI Shows Inter-Modality Correlation in Time-Resolved Connectivity Within Normal Areas but Not Within Epileptic Regions. | Ridley B et al. | β | 2017 | β |
| Simultaneous trimodal PET-MR-EEG imaging: Do EEG caps generate artefacts in PET images? | Rajkumar R et al. | β | 2017 | β |
| Spaceflight-induced neuroplasticity in humans as measured by MRI: what do we know so far? | Van Ombergen A et al. | β | 2017 | β |
| Th17 cells correlate positively to the structural and functional integrity of the brain in bipolar depression and healthy controls. | Poletti S et al. | β | 2017 | β |
| The neural correlates of obsessive-compulsive disorder: a multimodal perspective. | Moreira PS et al. | β | 2017 | β |
| A Hitchhiker's Guide to Functional Magnetic Resonance Imaging. | Soares JM et al. | β | 2016 | β |
| A New Computational Model for Neuro-Glio-Vascular Coupling: Astrocyte Activation Can Explain Cerebral Blood Flow Nonlinear Response to Interictal Events. | Blanchard S et al. | β | 2016 | β |
| Exploring Neuro-Physiological Correlates of Drivers' Mental Fatigue Caused by Sleep Deprivation Using Simultaneous EEG, ECG, and fNIRS Data. | Ahn S et al. | β | 2016 | β |
| Extending two-dimensional histology into the third dimension through conventional micro computed tomography. | Khimchenko A et al. | β | 2016 | β |
| Increased resting-state EEG functional connectivity in benign childhood epilepsy with centro-temporal spikes. | Clemens B et al. | β | 2016 | β |
| New frontiers in time-domain diffuse optics, a review. | Pifferi A et al. | β | 2016 | β |
| Non-parametric combination and related permutation tests for neuroimaging. | Winkler AM et al. | β | 2016 | β |
| The Development and Analysis of Integrated Neuroscience Data. | Glaser JI et al. | β | 2016 | β |
| Advances in Electrophysiological Research. | Kamarajan C et al. | β | 2015 | β |
| An automated pipeline for constructing personalized virtual brains from multimodal neuroimaging data. | Schirner M et al. | β | 2015 | β |
| A Thalamic-Fronto-Parietal Structural Covariance Network Emerging in the Course of Recovery from Hand Paresis after Ischemic Stroke. | Abela E et al. | β | 2015 | β |
| Reduction of EEG artifacts in simultaneous EEG-fMRI: Reference layer adaptive filtering (RLAF). | Steyrl D et al. | β | 2015 | β |
| Using structural and functional brain imaging to uncover how the brain adapts to blindness. | Hirsch GV et al. | β | 2015 | β |