Multimodal integration of fMRI and EEG data for high spatial and temporal resolution analysis of brain networks.

paper Cited Public

Authors: Mantini, D; Marzetti, L; Corbetta, M; Romani, G L; Del Gratta, C
Year: 2010
Journal: Brain topography
PMID: 20052528
DOI: 10.1007/s10548-009-0132-3
PMCID: PMC5682027

Figure 1

Schematic representation of the analysis used for linking ERP activity and fMRI networks. The azure and red arrows illustrate the steps for EEG and fMRI data analysis, respectively. The ERP data are processed with temporal ICA, to detect independent neuronal activations. The fMRI data were analyzed with spatial ICA, to identify the spatial distribution of large-scale networks. Finally, for each ERP IC scalp map, source localization is performed jointly using the spatial maps of task-related networks as fMRI priors.

Figure 2

Spatio-temporal analysis of the five networks consistently found across subjects, which spatially overlap with the dorsal attention, the ventral attention, the core, the visual and the sensory-motor networks. For each network, the cortical representation is shown (left panel), along with the time-course in response to rare events (right panel). The average time-courses are normalized because they refer to the average activity of the brain patterns. The thick red line in each graph represents the hemodynamic response function (HRF) best-fit to all data points. (CUN=cuneus; LIN=lingual gyrus; FUS=fusiform gyrus; INS=insula; ACC=anterior cingulate; MFG=middle frontal gyrus; IFG=inferior frontal gyrus; SMA=supplementary motor area; TPJ=temporoparietal junction; IPL=intraparietal lobule; IPS=intraparietal sulcus; FEF=frontal eye field; PRE=precuneus; PCC=posterior cingulate; MI=primary motor area; SI=primary somatosensory area).

Figure 3

ERP analysis of the grand average signals. (a) Scalp maps showing the temporal evolution of the ERP response to rare events; (b) Scalp topography of ERPs associated with rare and frequent events, colored in red and blue respectively; (c) Source distribution for rare-event ERP by WMNLS localization.

Figure 4

Spatio-temporal analysis of the detected ERP ICs. For each IC, the time-domain response to rare and frequent events, the scalp map, and the normalized source power in the main areas of the visual, the core and the ventral attention networks (in blue, red and green colors respectively) are shown. The statistical significance of the ERP-ICs across the brain areas is also provided. (CUN=cuneus; LIN=lingual gyrus; FUS=fusiform gyrus; INS=insula; ACC=anterior cingulate; MFG=middle frontal gyrus; IFG=inferior frontal gyrus; SMA=supplementary motor area; TPJ=temporoparietal junction; IPL=intraparietal lobule).

#	Section	Preview
20	4. Discussion	For the validation of the method, we analyzed data collected in a visual oddball task. In a previous…
21	4. Discussion	It is our opinion that the described ICA-based approach may be extended to more complex experimental…

Citation	PMID	DOI	Status
Benar, CG et al., Hum Brain Mapp, 2007, Single-trial analysis of oddball event-related potentials in simultaneous EEG-fMRI	17295312	10.1002/hbm.20289	Cited
Bledowski, C et al., Neuroimage, 2004, Attentional systems in target and distractor processing: a combined ERP and fMRI study	15193581	10.1016/j.neuroimage.2003.12.034	Cited
Calhoun, VD et al., Neuroimage, 2006, Neuronal chronometry of target detection: fusion of hemodynamic and event-related potential	16246587	10.1016/j.neuroimage.2005.08.060	Cited
Corbetta, M et al., Nat Rev Neurosci, 2002, Control of goal-directed and stimulus-driven attention in the brain	11994752	10.1038/nrn755	Cited
Dale, AM et al., Neuron, 2000, Dynamic Statistical Parametric Neurotechnique Mapping: Combining fMRI and MEG for High-Resolution Imaging of Cortical Activity	10798392	10.1016/s0896-6273(00)81138-1	Cited
Debener, S et al., J Neurosci, 2005, Trial-by-trial coupling of concurrent electroencephalogram and functional magnetic resonance imaging identifies the dynamics of performance monitoring	16354931	10.1523/JNEUROSCI.3286-05.2005	Cited
Dosenbach, NU et al., Neuron, 2006, A core system for the implementation of task sets	16731517	10.1016/j.neuron.2006.04.031	Cited
Eichele, T et al., Int J Psychophysiol, 2008, Unmixing concurrent EEG-fMRI with parallel independent component analysis	17688963	10.1016/j.ijpsycho.2007.04.010	Cited
Esposito, F et al., Neuroimage, 2005, Independent component analysis of fMRI group studies by self-organizing clustering	15734355	10.1016/j.neuroimage.2004.10.042	Cited
Fox, MD et al., Nat Neurosci, 2006, Coherent spontaneous activity accounts for trial-to-trial variability in human evoked brain responses	16341210	10.1038/nn1616	Cited
Fuchs, M et al., IEEE Trans Biomed Eng, 1998, An improved boundary element method for realistic volume-conductor modeling	9691573	10.1109/10.704867	Cited
Goldstein, A et al., Psychophysiology, 2002, The influence of stimulus deviance and novelty on the P300 and novelty P3	12462506	—	Cited
Gonçalves, SI et al., Clin Neurophysiol, 2007, Artifact removal in co-registered EEG-fMRI by selective average subtraction	17889599	10.1016/j.clinph.2007.08.017	Cited
Hamalainen, MS et al., Med Biol Eng Comput, 1994, Interpreting magnetic fields of the brain: minimum norm estimates	8182960	10.1007/BF02512476	Cited
Heeger, DJ et al., Nat Rev Neurosci, 2002, What does fMRI tell us about neuronal activity?	11836522	10.1038/nrn730	Cited
Hyvärinen, A, IEEE Trans Neural Network, 1999, Fast and robust fixed-point algorithms for independent component analysis	18252563	10.1109/72.761722	Cited
James, CJ et al., Physiol Meas, 2005, Independent component analysis for biomedical signals	15742873	10.1088/0967-3334/26/1/r02	Cited
Liu, AK et al., Proc Nat Acad Sci USA, 1998, Spatiotemporal imaging of human brain activity using functional MRI constrained magnetoencephalography: Monte Carlo simulations	9671784	10.1073/pnas.95.15.8945	Cited
Makeig, S et al., Philos Trans R Soc Lond B Biol Sci, Functionally independent components of early event-related potentials in a visual spatial attention task	10466141	10.1098/rstb.1999.0469	Cited
Makeig, S et al., Proc Natl Acad Sci USA, 1997, Blind separation of auditory event-related brain responses into independent components	9380745	10.1073/pnas.94.20.10979	Cited
Mantini, D et al., Neuroimage, 2009, Large-scale brain networks account for sustained and transient activity during target detection	18793734	10.1016/j.neuroimage.2008.08.019	Cited
Mantini, D et al., Neuroimage, Complete artifact removal for EEG recorded during continuous fMRI using independent component analysis	17112747	10.1016/j.neuroimage.2006.09.037	Cited
Mantini, D et al., Proc Natl Acad Sci U S A, Electrophysiological signatures of resting state networks in the human brain	17670949	10.1073/pnas.0700668104	Cited
Maris, E et al., J Neurosci Methods, 2007, Nonparametric statistical testing of EEG- and MEG-data	17517438	10.1016/j.jneumeth.2007.03.024	Cited
McKeown, MJ et al., Hum Brain Mapp, 1998, Analysis of fMRI data by blind separation into independent spatial components	9673671	10.1002/(SICI)1097-0193(1998)6:3<160::AID-HBM5>3.0.CO;2-1	Cited
Mulert, C et al., Neuroimage, 2004, Integration of fMRI and simultaneous EEG: towards a comprehensive understanding of localization and time-course of brain activity in target detection	15109999	10.1016/j.neuroimage.2003.10.051	Cited
Nir, Y et al., Neuroimage, 2006, Widespread functional connectivity and fMRI fluctuations in human visual cortex in the absence of visual stimulation	16413791	10.1016/j.neuroimage.2005.11.018	Cited
Zar, JH, Biostatistical Analysis, 1996	—	—	—

In this knowledge base

Title	Year	PMID
Advances in Electrophysiological Research.	2015	26259089

External

Title	Authors	Journal	Year	Link
AI-powered remote monitoring of brain responses to clear and incomprehensible speech via speckle pattern analysis.	Segal N et al.	—	2025	→
Early warning score and feasible complementary approach using artificial intelligence-based bio-signal monitoring system: a review.	Park D et al.	—	2025	→
Infants' resting-state functional connectivity and event-related potentials: A multimodal approach to investigating the neural basis of infant novelty detection.	Kanel D et al.	—	2025	→
Neuroimaging insights into the psychosocial impact of the COVID-19 pandemic: a systematic review.	Guo Y et al.	—	2025	→
Precision neurodiversity: personalized brain network architecture as a window into cognitive variability.	Mohammad SI et al.	—	2025	→
Sensory Representation of Neural Networks Using Sound and Color for Medical Imaging Segmentation.	Silva ILD et al.	—	2025	→
Classifying Unconscious, Psychedelic, and Neuropsychiatric Brain States with Functional Connectivity, Graph Theory, and Cortical Gradient Analysis.	Jang H et al.	—	2024	→
Functional MR elastography measures visual cortex stiffening proportional to visual contrast intensity in regions of activation.	Palnitkar HR et al.	—	2024	→
Remote Detection of Human Brain Reaction to Speech by AI Speckle Pattern Analysis	Segal N et al.	—	2024	—
Towards real-time identification of large-scale brain states for improved brain state-dependent stimulation.	Marzetti L et al.	—	2024	→
Exploring Network Properties Across Preclinical Stages of Alzheimer's Disease Using a Visual Short-Term Memory and Attention Task with High-Density Electroencephalography: A Brain-Connectome Neurophysiological Study.	Lazarou I et al.	—	2022	→
Blind Visualization of Task-Related Networks From Visual Oddball Simultaneous EEG-fMRI Data: Spectral or Spatiospectral Model?	Labounek R et al.	—	2021	→
Inferring Macroscale Brain Dynamics via Fusion of Simultaneous EEG-fMRI.	Philiastides MG et al.	—	2021	→
Inter-subject P300 variability relates to the efficiency of brain networks reconfigured from resting- to task-state: Evidence from a simultaneous event-related EEG-fMRI study.	Li F et al.	—	2020	→
Adaptive optimal basis set for BCG artifact removal in simultaneous EEG-fMRI.	Marino M et al.	—	2018	→
Heart-Brain Interactions in the MR Environment: Characterization of the Ballistocardiogram in EEG Signals Collected During Simultaneous fMRI.	Marino M et al.	—	2018	→
Optimizing Within-Subject Experimental Designs for jICA of Multi-Channel ERP and fMRI.	Mangalathu-Arumana J et al.	—	2018	→
Advances in Electrophysiological Research.	Kamarajan C et al.	—	2015	→
Multimodal EEG Recordings, Psychometrics and Behavioural Analysis.	Boeijinga PH	—	2015	→
The Roles of Dopamine and Hypocretin in Reward: A Electroencephalographic Study.	Mensen A et al.	—	2015	→
Brain circuits implicated in psychogenic paralysis in conversion disorders and hypnosis.	Vuilleumier P	—	2014	→
Non-negative matrix factorization of multimodal MRI, fMRI and phenotypic data reveals differential changes in default mode subnetworks in ADHD.	Anderson A et al.	—	2014	→
Neurophysiological techniques in the study of the excitability, connectivity, and plasticity of the human brain.	Rossinia PM et al.	—	2013	→
Decoding covert spatial attention using electrocorticographic (ECoG) signals in humans.	Gunduz A et al.	—	2012	→
Neural correlates of visual-spatial attention in electrocorticographic signals in humans.	Gunduz A et al.	—	2011	→
From the analysis of the brain images to the study of brain networks using functional connectivity and multimodal brain signals.	Babiloni F	—	2010	→