EyeLink fMRI/MEG出版物
All EyeLink fMRI and MEG research publications (with concurrent eye tracking) up until 2024 (with some early 2025s) are listed below by year. You can search the publications using keywords such as Visual Cortex, Neural Plasticity, MEG, etc. You can also search for individual author names. If we missed any EyeLink fMRI or MEG articles, please email us!
2024 |
Noor Seijdel; Jan Mathijs Schoffelen; Peter Hagoort; Linda Drijvers Attention drives visual processing and audiovisual integration during multimodal communication Journal Article In: The Journal of Neuroscience, vol. 44, no. 10, pp. 1–11, 2024. @article{Seijdel2024,During communication in real-life settings, our brain often needs to integrate auditory and visual information and at the same time actively focus on the relevant sources of information, while ignoring interference from irrelevant events. The interaction between integration and attention processes remains poorly understood. Here, we use rapid invisible frequency tagging and magnetoencephalography to investigate how attention affects auditory and visual information processing and integration, during multimodal communication. We presented human participants (male and female) with videos of an actress uttering action verbs (auditory; tagged at 58 Hz) accompanied by two movie clips of hand gestures on both sides of fixation (attended stimulus tagged at 65 Hz; unattended stimulus tagged at 63 Hz). Integration difficulty was manipulated by a lower-order auditory factor (clear/degraded speech) and a higher-order visual semantic factor (matching/mismatching gesture). We observed an enhanced neural response to the attended visual information during degraded speech compared to clear speech. For the unattended information, the neural response to mismatching gestures was enhanced compared to matching gestures. Furthermore, signal power at the intermodulation frequencies of the frequency tags, indexing nonlinear signal interactions, was enhanced in the left frontotemporal and frontal regions. Focusing on the left inferior frontal gyrus, this enhancement was specific for the attended information, for those trials that benefitted from integration with a matching gesture. Together, our results suggest that attention modulates audiovisual processing and interaction, depending on the congruence and quality of the sensory input. |
Eelke Spaak; Floortje G. Bouwkamp; Floris P. Lang Perceptual foundation and extension to phase tagging for rapid invisible frequency tagging (RIFT) Eelke Journal Article In: Imaging Neuroscience, vol. 2, pp. 1–14, 2024. @article{Spaak2024,Recent years have seen the emergence of a visual stimulation protocol called Rapid Invisible Frequency Tagging (RIFT) in cognitive neuroscience. In RIFT experiments, visual stimuli are presented at a rapidly and sinusoidally oscillating luminance, using high refresh rate projection equipment. Such stimuli result in strong steady-state responses in visual cortex, measurable extracranially using EEG or MEG. The high signal-to-noise ratio of these neural signals, combined with the alleged invisibility of the manipulation, make RIFT a potentially promising technique to study the neural basis of visual processing. In this study, we set out to resolve two fundamental, yet still outstanding, issues regarding RIFT; as well as to open up a new avenue for taking RIFT beyond frequency tagging per se. First, we provide robust evidence that RIFT is indeed subjectively undetectable, going beyond previous anecdotal reports. Second, we demonstrate that full-amplitude luminance or contrast manipulation offer the best tagging results. Third and finally, we demonstrate that, in addition to frequency tagging, phase tagging can reliably be used in RIFT studies, opening up new avenues for constructing RIFT experiments. Together, this provides a solid foundation for using RIFT in visual cognitive neuroscience. |
Yali Pan; Steven Frisson; Kara D Federmeier; Ole Jensen Early parafoveal semantic integration in natural reading Journal Article In: eLife, vol. 12, pp. 1–27, 2024. @article{Pan2024b,Humans can read and comprehend text rapidly, implying that readers might process multiple words per fixation. However, the extent to which parafoveal words are previewed and integrated into the evolving sentence context remains disputed. We investigated parafoveal processing during natural reading by recording brain activity and eye movements using MEG and an eye tracker while participants silently read one-line sentences. The sentences contained an unpredictable target word that was either congruent or incongruent with the sentence context. To measure parafoveal processing, we flickered the target words at 60 Hz and measured the resulting brain responses (i.e. Rapid Invisible Frequency Tagging, RIFT ) during fixations on the pre-target words. Our results revealed a significantly weaker tagging response for target words that were incongruent with the previous context compared to congruent ones, even within 100ms of fixating the word immediately preceding the target. This reduction in the RIFT response was also found to be predictive of individual reading speed. We conclude that semantic information is not only extracted from the parafovea but can also be integrated with the previous context before the word is fixated. This early and extensive parafoveal processing supports the rapid word processing required for natural reading. Our study suggests that theoretical frameworks of natural reading should incorporate the concept of deep parafoveal processing. |
Kristina I. Pultsina; Tatiana A. Stroganova; Galina L. Kozunova; Andrey O. Prokofyev; Aleksandra S. Miasnikova; Anna M. Rytikova; Boris V. Chernyshev Atypical pupil-linked arousal induced by low-risk probabilistic choices, and intolerance of uncertainty in adults with ASD Journal Article In: Cognitive, Affective, & Behavioral Neuroscience, no. 2023, pp. 1–19, 2024. @article{Pultsina2024,Adults with autism spectrum disorder (ASD) experience stress when operating in a probabilistic environment, even if it is familiar, but the underlying mechanisms remain unclear. Their decision-making may be affected by the uncertainty aversion implicated in ASD and associated with increased autonomic arousal. Previous studies have shown that in neurotypical (NT) people, decisions with predictably better outcomes are less stressful and elicit smaller pupil-linked arousal than those involving exploration. Here, in a sample of 46 high-functioning ASD and NT participants, using mixed-effects model analysis, we explored pupil-linked arousal and behavioral performance in a probabilistic reward learning task with a stable advantage of one choice option over the other. We found that subjects with ASD learned and preferred advantageous probabilistic choices at the same rate and to the same extent as NT participants, both in terms of choice ratio and response time. Although both groups exhibited similar predictive behaviors, learning to favor advantageous choices led to increased pupillary arousal for these choices in the ASD group, while it caused a decrease in pupillary arousal in the NT group. Moreover, greater pupil-linked arousal during decisions with higher expected value correlated with greater degree of self-reported intolerance of uncertainty in everyday life. Our results suggest that in a nonvolatile probabilistic environment, objectively good predictive abilities in people with ASD are coupled with elevated physiological stress and subjective uncertainty regarding the decisions with the best possible but still uncertain outcome that contributes to their intolerance of uncertainty. |
Alessandro Toso; Annika P. Wermuth; Ayelet Arazi; Anke Braun; Tineke Grent-‘t Jong; Peter J. Uhlhaas; Tobias H. Donner 40 Hz steady-state response in human auditory cortex is shaped by gabaergic neuronal inhibition Journal Article In: The Journal of Neuroscience, vol. 44, no. 24, pp. 1–10, 2024. @article{Toso2024,The 40 Hz auditory steady-state response (ASSR), an oscillatory brain response to periodically modulated auditory stimuli, is a promising, noninvasive physiological biomarker for schizophrenia and related neuropsychiatric disorders. The 40 Hz ASSR might be amplified by synaptic interactions in cortical circuits, which are, in turn, disturbed in neuropsychiatric disorders. Here, we tested whether the 40 Hz ASSR in the human auditory cortex depends on two key synaptic components of neuronal interactions within cortical circuits: excitation via N-methyl-aspartate glutamate (NMDA) receptors and inhibition via gamma-amino-butyric acid (GABA) receptors. We combined magnetoencephalography (MEG) recordings with placebo-controlled, low-dose pharmacological interventions in the same healthy human participants (13 males, 7 females). All participants exhibited a robust 40 Hz ASSR in auditory cortices, especially in the right hemisphere, under a placebo. The GABAA receptor–agonist lorazepam increased the amplitude of the 40 Hz ASSR, while no effect was detectable under the NMDA blocker memantine. Our findings indicate that the 40 Hz ASSR in the auditory cortex involves synaptic (and likely intracortical) inhibition via the GABAA receptor, thus highlighting its utility as a mechanistic signature of cortical circuit dysfunctions involving GABAergic inhibition. |
2023 |
Ying Joey Zhou; Aarti Ramchandran; Saskia Haegens Alpha oscillations protect working memory against distracters in a modality-specific way Journal Article In: NeuroImage, vol. 278, pp. 1–9, 2023. @article{Zhou2023d,Alpha oscillations are thought to be involved in suppressing distracting input in working-memory tasks. Yet, the spatial-temporal dynamics of such suppression remain unclear. Key questions are whether such suppression reflects a domain-general inattentiveness mechanism, or occurs in a stimulus- or modality-specific manner within cortical areas most responsive to the distracters; and whether the suppression is proactive (i.e., preparatory) or reactive. Here, we addressed these questions using a working-memory task where participants had to memorize an array of visually presented digits and reproduce one of them upon being probed. We manipulated the presence of distracters and the sensory modality in which distracters were presented during memory maintenance. Our results show that sensory areas most responsive to visual and auditory distracters exhibited stronger alpha power increase after visual and auditory distracter presentation respectively. These results suggest that alpha oscillations underlie distracter suppression in a reactive, modality-specific manner. |
Florian Sandhaeger; Nina Omejc; Anna Antonia Pape; Markus Siegel Abstract perceptual choice signals during action-linked decisions in the human brain Journal Article In: PLoS Biology, vol. 21, no. 10, pp. 1–27, 2023. @article{Sandhaeger2023,Humans can make abstract choices independent of motor actions. However, in laboratory tasks, choices are typically reported with an associated action. Consequentially, knowledge about the neural representation of abstract choices is sparse, and choices are often thought to evolve as motor intentions. Here, we show that in the human brain, perceptual choices are represented in an abstract, motor-independent manner, even when they are directly linked to an action. We measured MEG signals while participants made choices with known or unknown motor response mapping. Using multivariate decoding, we quantified stimulus, perceptual choice, and motor response information with distinct cortical distributions. Choice representations were invariant to whether the response mapping was known during stimulus presentation, and they occupied a distinct representational space from motor signals. As expected from an internal decision variable, they were informed by the stimuli, and their strength predicted decision confidence and accuracy. Our results demonstrate abstract neural choice signals that generalize to action-linked decisions, suggesting a general role of an abstract choice stage in human decision-making. |
Alexander Zhigalov; Ole Jensen Perceptual echoes as travelling waves may arise from two discrete neuronal sources Journal Article In: NeuroImage, vol. 272, pp. 1–9, 2023. @article{Zhigalov2023,Growing evidence suggests that travelling waves are functionally relevant for cognitive operations in the brain. Several electroencephalography (EEG) studies report on a perceptual alpha-echo, representing the brain response to a random visual flicker, propagating as a travelling wave across the cortical surface. In this study, we ask if the propagating activity of the alpha-echo is best explained by a set of discrete sources mixing at the sensor level rather than a cortical travelling wave. To this end, we presented participants with gratings modulated by random noise and simultaneously acquired the ongoing MEG. The perceptual alpha-echo was estimated using the temporal response function linking the visual input to the brain response. At the group level, we observed a spatial decay of the amplitude of the alpha-echo with respect to the sensor where the alpha-echo was the largest. Importantly, the propagation latencies consistently increased with the distance. Interestingly, the propagation of the alpha-echoes was predominantly centro-lateral, while EEG studies reported mainly posterior-frontal propagation. Moreover, the propagation speed of the alpha-echoes derived from the MEG data was around 10 m/s, which is higher compared to the 2 m/s reported in EEG studies. Using source modelling, we found an early component in the primary visual cortex and a phase-lagged late component in the parietal cortex, which may underlie the travelling alpha-echoes at the sensor level. We then simulated the alpha-echoes using realistic EEG and MEG forward models by placing two sources in the parietal and occipital cortices in accordance with our empirical findings. The two-source model could account for both the direction and speed of the observed alpha-echoes in the EEG and MEG data. Our results demonstrate that the propagation of the perceptual echoes observed in EEG and MEG data can be explained by two sources mixing at the scalp level equally well as by a cortical travelling wave. Importantly, these findings should not be directly extrapolated to intracortical recordings, where travelling waves gradually propagate at a sub-millimetre scale. |
Maimu Alissa Rehbein; Thomas Kroker; Constantin Winker; Lena Ziehfreund; Anna Reschke; Jens Bölte; Miroslaw Wyczesany; Kati Roesmann; Ida Wessing; Markus Junghöfer Non-invasive stimulation reveals ventromedial prefrontal cortex function in reward prediction and reward processing Journal Article In: Frontiers in Neuroscience, vol. 17, pp. 1–22, 2023. @article{Rehbein2023,Introduction: Studies suggest an involvement of the ventromedial prefrontal cortex (vmPFC) in reward prediction and processing, with reward-based learning relying on neural activity in response to unpredicted rewards or non-rewards (reward prediction error, RPE). Here, we investigated the causal role of the vmPFC in reward prediction, processing, and RPE signaling by transiently modulating vmPFC excitability using transcranial Direct Current Stimulation (tDCS). Methods: Participants received excitatory or inhibitory tDCS of the vmPFC before completing a gambling task, in which cues signaled varying reward probabilities and symbols provided feedback on monetary gain or loss. We collected self-reported and evaluative data on reward prediction and processing. In addition, cue-locked and feedback-locked neural activity via magnetoencephalography (MEG) and pupil diameter using eye-tracking were recorded. Results: Regarding reward prediction (cue-locked analysis), vmPFC excitation (versus inhibition) resulted in increased prefrontal activation preceding loss predictions, increased pupil dilations, and tentatively more optimistic reward predictions. Regarding reward processing (feedback-locked analysis), vmPFC excitation (versus inhibition) resulted in increased pleasantness, increased vmPFC activation, especially for unpredicted gains (i.e., gain RPEs), decreased perseveration in choice behavior after negative feedback, and increased pupil dilations. Discussion: Our results support the pivotal role of the vmPFC in reward prediction and processing. Furthermore, they suggest that transient vmPFC excitation via tDCS induces a positive bias into the reward system that leads to enhanced anticipation and appraisal of positive outcomes and improves reward-based learning, as indicated by greater behavioral flexibility after losses and unpredicted outcomes, which can be seen as an improved reaction to the received feedback. |
Yali Pan; Tzvetan Popov; Steven Frisson; Ole Jensen Saccades are locked to the phase of alpha oscillations during natural reading Journal Article In: PLoS Biology, vol. 21, no. 1, pp. 1–19, 2023. @article{Pan2023b,AU We:saccade Pleaseconfirmthatallheadinglevelsarerepresentedcorrectly 3 to 5 times per second when reading. However,:little is known about the neuronal mechanisms coordinating the oculomotor and visual system during such rapid processing. Here, we ask if brain oscillations play a role in the temporal coordination of the visuomotor integration. We simultaneously acquired MEG and eye-tracking data while participants read sentences silently. Every sentence was embedded with a target word of either high or low lexical frequency. Our key finding demonstrated that saccade onsets were locked to the phase of alpha oscillations (8 to 13 Hz), and in particular, for saccades towards low frequency words. Source modelling demonstrated that the alpha oscillations to which the saccades were locked, were generated in the right-visual motor cortex (BA 7). Our findings suggest that the alpha oscillations serve to time the processing between the oculomotor and visual systems during natural reading, and that this coordination becomes more pronounced for demanding words. |
Maciej J. Szul; Sotirios Papadopoulos; Sanaz Alavizadeh; Sébastien Daligaut; Denis Schwartz; Jérémie Mattout; James J. Bonaiuto Diverse beta burst waveform motifs characterize movement-related cortical dynamics Journal Article In: Progress in Neurobiology, vol. 228, pp. 1–17, 2023. @article{Szul2023,Classical analyses of induced, frequency-specific neural activity typically average band-limited power over trials. More recently, it has become widely appreciated that in individual trials, beta band activity occurs as transient bursts rather than amplitude-modulated oscillations. Most studies of beta bursts treat them as unitary, and having a stereotyped waveform. However, we show there is a wide diversity of burst shapes. Using a biophysical model of burst generation, we demonstrate that waveform variability is predicted by variability in the synaptic drives that generate beta bursts. We then use a novel, adaptive burst detection algorithm to identify bursts from human MEG sensor data recorded during a joystick-based reaching task, and apply principal component analysis to burst waveforms to define a set of dimensions, or motifs, that best explain waveform variance. Finally, we show that bursts with a particular range of waveform motifs, ones not fully accounted for by the biophysical model, differentially contribute to movement-related beta dynamics. Sensorimotor beta bursts are therefore not homogeneous events and likely reflect distinct computational processes. |
Christian Wienke; Marcus Grueschow; Aiden Haghikia; Tino Zaehle In: Journal of Neuroscience, vol. 43, no. 36, pp. 6306–6319, 2023. @article{Wienke2023,Transcutaneous auricular vagus nerve stimulation (taVNS) has been proposed to activate the locus ceruleus-noradrenaline (LC-NA) system. However, previous studies failed to find consistent modulatory effects of taVNS on LC-NA biomarkers. Previous studies suggest that phasic taVNS may be capable of modulating LC-NA biomarkers such as pupil dilation and alpha oscillations. However, it is unclear whether these effects extend beyond pure sensory vagal nerve responses. Critically, the potential of the pupillary light reflex as an additional taVNS biomarker has not been explored so far. Here, we applied phasic active and sham taVNS in 29 subjects (16 female, 13 male) while they performed an emotional Stroop task (EST) and a passive pupil light reflex task (PLRT). We recorded pupil size and brain activity dynamics using a combined Magnetoencephalography (MEG) and pupillometry design. Our results show that phasic taVNS significantly increased pupil dilation and performance during the EST. During the PLRT, active taVNS reduced and delayed pupil constriction. In the MEG, taVNS increased frontal-midline theta and alpha power during the EST, whereas occipital alpha power was reduced during both the EST and PLRT. Our findings provide evidence that phasic taVNS systematically modulates behavioral, pupillary, and electrophysiological parameters of LC-NA activity during cognitive processing. Moreover, we demonstrate for the first time that the pupillary light reflex can be used as a simple and effective proxy of taVNS efficacy. These findings have important implications for the development of noninvasive neuromodulation interventions for various cognitive and clinical applications. |
Tzvetan Popov; Tobias Staudigl Cortico-ocular coupling in the service of episodic memory formation Journal Article In: Progress in Neurobiology, vol. 227, pp. 1–9, 2023. @article{Popov2023,Encoding of visual information is a necessary requirement for most types of episodic memories. In search for a neural signature of memory formation, amplitude modulation of neural activity has been repeatedly shown to correlate with and suggested to be functionally involved in successful memory encoding. We here report a complementary view on why and how brain activity relates to memory, indicating a functional role of cortico-ocular interactions for episodic memory formation. Recording simultaneous magnetoencephalography and eye tracking in 35 human participants, we demonstrate that gaze variability and amplitude modulations of alpha/beta oscillations (10–20 Hz) in visual cortex covary and predict subsequent memory performance between and within participants. Amplitude variation during pre-stimulus baseline was associated with gaze direction variability, echoing the co-variation observed during scene encoding. We conclude that encoding of visual information engages unison coupling between oculomotor and visual areas in the service of memory formation. |
Vera A. Voigtlaender; Florian Sandhaeger; David J. Hawellek; Steffen R. Hage; Markus Siegel Neural representations of the content and production of human vocalization Journal Article In: Proceedings of the National Academy of Sciences, vol. 120, no. 23, pp. 1–9, 2023. @article{Voigtlaender2023,Speech, as the spoken form of language, is fundamental for human communication. The phenomenon of covert inner speech implies functional independence of speech content and motor production. However, it remains unclear how a flexible mapping between speech content and production is achieved on the neural level. To address this, we recorded magnetoencephalography in humans performing a rule-based vocalization task. On each trial, vocalization content (one of two vowels) and production form (overt or covert) were instructed independently. Using multivariate pattern analysis, we found robust neural information about vocalization content and produc- tion, mostly originating from speech areas of the left hemisphere. Production signals dynamically transformed upon presentation of the content cue, whereas content signals remained largely stable throughout the trial. In sum, our results show dissociable neural representations of vocalization content and production in the human brain and provide insights into the neural dynamics underlying human vocalization. |
Amir Assouline; Avi Mendelsohn Weaving a story: Narrative formation over prolonged time scales engages social cognition and frontoparietal networks Journal Article In: European Journal of Neuroscience, vol. 57, no. 5, pp. 1–15, 2023. @article{Assouline2023,Forming narratives is of key importance to human experience, enabling one to render large amounts of information into relatively compacted stories for future retrieval, giving meaning to otherwise fragmented occurrences. The neural mechanisms that underlie coherent narrative construction of causally connected information over prolonged temporal periods are yet unclear. Participants in this fMRI study observed consecutive scenes from a full-length movie either in their original order, enabling causal inferences over time, or in reverse order, impeding a key component of coherent narratives—causal inference. In between scenes, we presented short periods of blank screens for examining post-encoding processing effects. Using multivariate pattern analysis (MVPA) followed by seed-base correlation analysis, we hypothesized that net- works involved in online monitoring of incoming information on the one hand, and offline processing of previous occurrences on the other would differ between the groups. We found that despite the exposure to the same scenes, the chronological-order condition exhibited enhanced functional connectivity in frontoparietal regions associated with information integration and working memory. The reverse-order condition yielded offline, post-scene coactivation of neural networks involved in social cognition and particularly theory of mind and action comprehension. These findings shed light on offline processes of narrative construction efforts, highlighting the role of social cognition networks in seeking for narrative coherence. |
Lauren M. DiNicola; Wendy Sun; Randy L. Buckner In: Journal of Neurophysiology, vol. 130, no. 6, pp. 1602–1615, 2023. @article{DiNicola2023,A recurring debate concerns whether regions of primate prefrontal cortex (PFC) support domain-flexible or domain-specific processes. Here we tested the hypothesis with functional MRI (fMRI) that side-by-side PFC regions, within distinct parallel association networks, differentially support domain-flexible and domain-specialized processing. Individuals (N = 9) were intensively sampled, and all effects were estimated within their own idiosyncratic anatomy. Within each individual, we identified PFC regions linked to distinct networks, including a dorsolateral PFC (DLPFC) region coupled to the medial temporal lobe (MTL) and an extended region associated with the canonical multiple-demand network. We further identified an inferior PFC region coupled to the language network. Exploration in separate task data, collected within the same individuals, revealed a robust functional triple dissociation. The DLPFC region linked to the MTL was recruited during remembering and imagining the future, distinct from juxtaposed regions that were modulated in a domain-flexible manner during working memory. The inferior PFC region linked to the language network was recruited during sentence processing. Detailed analysis of the trial-level responses further revealed that the DLPFC region linked to the MTL specifically tracked processes associated with scene construction. These results suggest that the DLPFC possesses a domain-specialized region that is small and easily confused with nearby (larger) regions associated with cognitive control. The newly described region is domain specialized for functions traditionally associated with the MTL. We discuss the implications of these findings in relation to convergent anatomical analysis in the monkey.NEW & NOTEWORTHY Competing hypotheses link regions of prefrontal cortex (PFC) to domain-flexible or domain-specific processes. Here, using a precision neuroimaging approach, we identify a domain-specialized region in dorsolateral PFC, coupled to the medial temporal lobe and recruited for scene construction. This region is juxtaposed to, but distinct from, broader PFC regions recruited flexibly for cognitive control. Region distinctions align with broader network differences, suggesting that PFC regions gain dissociable processing properties via segregated anatomical projections. |
Matthias Ekman; Sarah Kusch; Floris P. Lange Successor-like representation guides the prediction of future events in human visual cortex and hippocampus Journal Article In: eLife, vol. 12, pp. 1–19, 2023. @article{Ekman2023,Human agents build models of their environment, which enable them to anticipate and plan upcoming events. However, little is known about the properties of such predictive models. Recently, it has been proposed that hippocampal representations take the form of a predictive map-like structure, the so-called successor representation (SR). Here, we used human functional magnetic resonance imaging to probe whether activity in the early visual cortex (V1) and hippocampus adhere to the postulated properties of the SR after visual sequence learning. Participants were exposed to an arbitrary spatiotemporal sequence consisting of four items (A-B-C-D). We found that after repeated exposure to the sequence, merely presenting single sequence items (e.g.,-B–) resulted in V1 activation at the successor locations of the full sequence (e.g., C-D), but not at the predecessor locations (e.g., A). This highlights that visual representations are skewed toward future states, in line with the SR. Similar results were also found in the hippocampus. Moreover, the hippocampus developed a coactivation profile that showed sensitivity to the temporal distance in sequence space, with fading representations for sequence events in the more distant past and future. V1, in contrast, showed a coactivation profile that was only sensitive to spatial distance in stimulus space. Taken together, these results provide empirical evidence for the proposition that both visual and hippo-campal cortex represent a predictive map of the visual world akin to the SR. |
Magdalena Fafrowicz; Anna Ceglarek; Justyna Olszewska; Anna Sobczak; Bartosz Bohaterewicz; Monika Ostrogorska; Patricia Reuter-Lorenz; Koryna Lewandowska; Barbara Sikora-Wachowicz; Halszka Oginska; Magdalena Hubalewska-Mazgaj; Tadeusz Marek Dynamics of working memory process revealed by independent component analysis in an fMRI study Journal Article In: Scientific Reports, vol. 13, no. 1, pp. 1–18, 2023. @article{Fafrowicz2023,Human memory is prone to errors in many everyday activities but also when cultivating hobbies such as traveling and/or learning a new language. For instance, while visiting foreign countries, people erroneously recall foreign language words that are meaningless to them. Our research simulated such errors in a modified Deese-Roediger-McDermott paradigm for short-term memory with phonologically related stimuli aimed at uncovering behavioral and neuronal indices of false memory formation with regard to time-of-day, a variable known to influence memory. Fifty-eight participants were tested in a magnetic resonance (MR) scanner twice. The results of an Independent Component Analysis revealed encoding-related activity of the medial visual network preceding correct recognition of positive probes and correct rejection of lure probes. The engagement of this network preceding false alarms was not observed. We also explored if diurnal rhythmicity influences working memory processes. Diurnal differences were seen in the default mode network and the medial visual network with lower deactivation in the evening hours. The GLM results showed greater activation of the right lingual gyrus, part of the visual cortex and the left cerebellum in the evening. The study offers new insight into the mechanisms associated with false memories, suggesting that deficient engagement of the medial visual network during the memorization phase of a task results in short-term memory distortions. The results shed new light on the dynamics of working memory processes by taking into account the effect of time-of-day on memory performance. |
Maria Celeste Fasano; Joana Cabral; Angus Stevner; Peter Vuust; Pauline Cantou; Elvira Brattico; Morten L. Kringelbach The early adolescent brain on music: Analysis of functional dynamics reveals engagement of orbitofrontal cortex reward system Journal Article In: Human Brain Mapping, vol. 44, no. 2, pp. 429–446, 2023. @article{Fasano2023,Music listening plays a pivotal role for children and adolescents, yet it remains unclear how music modulates brain activity at the level of functional networks in this young population. Analysing the dynamics of brain networks occurring and dissolving over time in response to music can provide a better understanding of the neural underpinning of music listening. We collected functional magnetic resonance imaging (fMRI) data from 17 preadolescents aged 10–11 years while listening to two similar music pieces separated by periods without music. We subsequently tracked the occurrence of functional brain networks over the recording time using a recent method that detects recurrent patterns of phase-locking in the fMRI signals: the leading eigenvector dynamics analysis (LEiDA). The probabilities of occurrence and switching profiles of different functional networks were compared between periods of music and no music. Our results showed significantly increased occurrence of a specific functional network during the two music pieces compared to no music, involving the medial orbitofrontal and ventromedial prefrontal cortices—a brain subsystem associated to reward processing. Moreover, the higher the musical reward sensitivity of the preadolescents, the more this network was preceded by a pattern involving the insula. Our findings highlight the involvement of a brain subsystem associated with hedonic and emotional processing during music listening in the early adolescent brain. These results offer novel insight into the neural underpinnings of musical reward in early adolescence, improving our understanding of the important role and the potential benefits of music at this delicate age. |
Carolina Feher da Silva; Gaia Lombardi; Micah Edelson; Todd A. Hare Rethinking model-based and model-free influences on mental effort and striatal prediction errors Journal Article In: Nature Human Behaviour, vol. 7, no. 6, pp. 956–969, 2023. @article{FeherdaSilva2023,A standard assumption in neuroscience is that low-effort model-free learning is automatic and continuously used, whereas more complex model-based strategies are only used when the rewards they generate are worth the additional effort. We present evidence refuting this assumption. First, we demonstrate flaws in previous reports of combined model-free and model-based reward prediction errors in the ventral striatum that probably led to spurious results. More appropriate analyses yield no evidence of model-free prediction errors in this region. Second, we find that task instructions generating more correct model-based behaviour reduce rather than increase mental effort. This is inconsistent with cost–benefit arbitration between model-based and model-free strategies. Together, our data indicate that model-free learning may not be automatic. Instead, humans can reduce mental effort by using a model-based strategy alone rather than arbitrating between multiple strategies. Our results call for re-evaluation of the assumptions in influential theories of learning and decision-making. |
Nick Fogt; Andrew J. Toole; Xiangrui Li; Emmanuel Owusu; Steven T. T. Manning; Marjean T. Kulp Functional magnetic resonance imaging activation for different vergence eye movement subtypes Journal Article In: Ophthalmic and Physiological Optics, vol. 43, no. 1, pp. 93–104, 2023. @article{Fogt2023,Introduction: Maddox suggested that there were four convergence subtypes, each driven by a different stimulus. The purpose of this study was to assess the neural correlates for accommodative convergence, proximal convergence (convergence stimulus provided), disparity convergence and voluntary convergence (no specific convergence stimulus provided) using functional magnetic resonance imaging (fMRI). Methods: Ten subjects (mean age = 24.4 years) with normal binocular vision participated. The blood oxygenation level- dependent (BOLD) signals of the brain from fMRI scans were measured when subjects made vergence eye movements while: (1) alternately viewing letters monocularly where one eye viewed through a −2.00 D lens, (2) alternately viewing Difference of Gaussian targets monocularly at distance and near, (3) viewing random dot stereograms with increasing disparity and (4) voluntarily converging the eyes with binocular viewing. Results: The accommodative convergence paradigm resulted in activation on the right side in the right fusiform cortex and the right middle occipital cortex. The proximal convergence stimulus mainly activated areas in the right occipital lobe. The disparity stimulus activated areas in the left occipital cortex and the left frontal cortex. Finally, the voluntary convergence paradigm resulted in activation primarily in the occipital lobe and mostly bilaterally. Conclusion: The accommodative, proximal, disparity and voluntary convergence paradigms resulted in activation in unique areas in the brain with functional MRI. Activation was found in more areas in the proximal and voluntary conditions compared with the accommodative and disparity conditions. |
Rani Gera; Maya Bar Or; Ido Tavor; Dana Roll; Jeffrey Cockburn; Segev Barak; Elizabeth Tricomi; John P. O'Doherty; Tom Schonberg Characterizing habit learning in the human brain at the individual and group levels: A multi-modal MRI study Journal Article In: NeuroImage, vol. 272, pp. 1–23, 2023. @article{Gera2023,The dual-process theory of action control postulates that there are two competitive and complementary mechanisms that control our behavior: a goal-directed system that executes deliberate actions, explicitly aimed toward a particular outcome, and a habitual system that autonomously execute well-learned actions, typically following an encounter with a previously associated cue. In line with dual-process theory, animal studies have provided convincing evidence for dissociable neural mechanisms, mainly manifested in cortico-striatal regions, involved in goal-directed and habitual action control. While substantial progress has been made in characterizing the neural mechanism underlying habit learning in animals, we still lack knowledge on how habits are formed and maintained in the human brain. Thus far only one study, conducted more than a decade ago by Tricomi et al. (2009), has been able to induce habitual behavior in humans via extensive training. This study also implicated the posterior putamen in the process, using functional magnetic resonance imaging (fMRI). However, recent attempts to replicate the behavioral results of this study were not successful. This leaves the research of human habits, and particularly the research of their formation through extensive repetition, as well as their neural basis, limited and far behind the animal research in the field. This motivated us to (1) attempt to replicate the behavioral and imaging main findings of Tricomi et al., (2) identify further functional and microstructural neural modifications associated with habit formation and manifestation, and (3) investigate the relationships between functional and structural plasticity and individual differences in habit expression. To this end, in this registered report we used Tricomi et al.'s free-operant task along with multi-modal MRI methods in a well-powered sample (n=123). In this task participants' sensitivity to outcome devaluation (an index of goal-directed/habitual action control) is tested following either short or extensive training. In contrast to our hypothesis, we were not able to demonstrate habit formation as a function of training duration nor were we able to relate any functional or microstructural plasticity in the putamen with individual habit expression. We found that a pattern of increased activations in the left head of caudate that re-occurred across each day's training is associated with goal directed behavior and that increased processing of devalued cues in low-level visual regions was indicative of goal-directed behavior. In a follow-up exploratory analysis comparing habitual and goal-directed subgroups within each experimental group, we found that elevated activations in frontoparietal regions during early stages of training, as well as increased reactivity towards still-valued cues in somatosensory and superior parietal regions were found in individuals that were more inclined to perform goal-directed behavior (compared with more habitual individuals). Taken together, regions commonly implicated in goal-directed behavior were most predictive of individual habit expression. Finally, we also found that differential patterns of training-related microstructural plasticity, as measured with diffusion MRI, in midbrain dopaminergic regions were associated with habit expression. This work provides new insights into the neural dynamics involved in individual habit formation/expression and encourages the development and testing of new, more sensitive, procedures for experimental habit induction in humans. |
Hengda He; Linbi Hong; Paul Sajda Pupillary response is associated with the reset and switching of functional brain networks during salience processing Journal Article In: PLoS Computational Biology, vol. 19, no. 5, pp. 1–29, 2023. @article{He2023a,The interface between processing internal goals and salient events in the environment involves various top-down processes. Previous studies have identified multiple brain areas for salience processing, including the salience network (SN), dorsal attention network, and the locus coeruleus-norepinephrine (LC-NE) system. However, interactions among these systems in salience processing remain unclear. Here, we simultaneously recorded pupillometry, EEG, and fMRI during an auditory oddball paradigm. The analyses of EEG and fMRI data uncovered spatiotemporally organized target-associated neural correlates. By modeling the target-modulated effective connectivity, we found that the target-evoked pupillary response is associated with the network directional couplings from late to early subsystems in the trial, as well as the network switching initiated by the SN. These findings indicate that the SN might cooperate with the pupil-indexed LC-NE system in the reset and switching of cortical networks, and shed light on their implications in various cognitive processes and neurological diseases. |
Stefano Ioannucci; Valentine Chirokoff; Bixente Dilharreguy; Valéry Ozenne; Sandra Chanraud; Alexandre Zénon In: Communications Biology, vol. 6, no. 1, pp. 1–12, 2023. @article{Ioannucci2023,Cognitive fatigue is defined by a reduced capacity to perform mental tasks. Despite its pervasiveness, the underlying neural mechanisms remain elusive. Specifically, it is unclear whether prolonged effort affects performance through alterations in over-worked task-relevant neuronal assemblies. Our paradigm based on repeated passive visual stimulation discerns fatigue effects from the influence of motivation, skill and boredom. We induced performance loss and observed parallel alterations in the neural blueprint of the task, by mirroring behavioral performance with multivariate neuroimaging techniques (MVPA) that afford a subject-specific approach. Crucially, functional areas that responded the most to repeated stimulation were also the most affected. Finally, univariate analysis revealed clusters displaying significant disruption within the extrastriate visual cortex. In sum, here we show that repeated stimulation impacts the implicated brain areas' activity and causes tangible behavioral repercussions, providing evidence that cognitive fatigue can result from local, functional, disruptions in the neural signal induced by protracted recruitment. |
Nidhi Jain; Aria Wang; Margaret M. Henderson; Ruogu Lin; Jacob S. Prince; Michael J. Tarr; Leila Wehbe Selectivity for food in human ventral visual cortex Journal Article In: Communications Biology, vol. 6, no. 1, pp. 1–14, 2023. @article{Jain2023,Visual cortex contains regions of selectivity for domains of ecological importance. Food is an evolutionarily critical category whose visual heterogeneity may make the identification of selectivity more challenging. We investigate neural responsiveness to food using natural images combined with large-scale human fMRI. Leveraging the improved sensitivity of modern designs and statistical analyses, we identify two food-selective regions in the ventral visual cortex. Our results are robust across 8 subjects from the Natural Scenes Dataset (NSD), multiple independent image sets and multiple analysis methods. We then test our findings of food selectivity in an fMRI “localizer” using grayscale food images. These independent results confirm the existence of food selectivity in ventral visual cortex and help illuminate why earlier studies may have failed to do so. Our identification of food-selective regions stands alongside prior findings of functional selectivity and adds to our understanding of the organization of knowledge within the human visual system. |
Omid Kardan; Andrew J. Stier; Elliot A. Layden; Kyoung Whan Choe; Muxuan Lyu; Xihan Zhang; Sian L. Beilock; Monica D. Rosenberg; Marc G. Berman Improvements in task performance after practice are associated with scale-free dynamics of brain activity Journal Article In: Network Neuroscience, vol. 7, no. 3, pp. 1129–1152, 2023. @article{Kardan2023,Although practicing a task generally benefits later performance on that same task, there are individual differences in practice effects. One avenue to model such differences comes from research showing that brain networks extract functional advantages from operating in the vicinity of criticality, a state in which brain network activity is more scale-free. We hypothesized that higher scale-free signal from fMRI data, measured with the Hurst exponent (H), indicates closer proximity to critical states. We tested whether individuals with higher H during repeated task performance would show greater practice effects. In Study 1, participants performed a dual-n-back task (DNB) twice during MRI (n = 56). In Study 2, we used two runs of n-back task (NBK) data from the Human Connectome Project sample (n = 599). In Study 3, participants performed a word completion task (CAST) across six runs (n = 44). In all three studies, multivariate analysis was used to test whether higher H was related to greater practicerelated performance improvement. Supporting our hypothesis, we found patterns of higher H that reliably correlated with greater performance improvement across participants in all three studies. However, the predictive brain regions were distinct, suggesting that the specific spatial H↑ patterns are not task-general. |
Noa Katabi; Hadas Simon; Sharon Yakim; Inbal Ravreby; Tal Ohad; Yaara Yeshurun Deeper than you think: Partisanship-dependent brain responses in early sensory and motor brain regions Journal Article In: Journal of Neuroscience, vol. 43, no. 6, pp. 1027–1037, 2023. @article{Katabi2023,Recent political polarization has illustrated how individuals with opposing political views often experience ongoing events in markedly different ways. In this study, we explored the neural mechanisms underpinning this phenomenon. We conducted fMRI scanning of 34 right- and left-wing participants (45% females) watching political videos (e.g., campaign ads and political speeches) just before the elections in Israel. As expected, we observed significant differences between left- and right-wing participants in their interpretation of the videos' content. Furthermore, neuroimaging results revealed partisanship-dependent differences in activation and synchronization in higher-order regions. Surprisingly, such differences were also revealed in early sensory, motor, and somatosensory regions. We found that the political content synchronized the responses of primary visual and auditory cortices in a partisanship-dependent manner. Moreover, right-wing (and not left-wing) individuals' sensorimotor cortex was involved in processing right-wing (and not left-wing) political content. These differences were pronounced to the extent that we could predict political orientation from the early brain-response alone. Importantly, no such differences were found with respect to neutral content. Therefore, these results uncover more fundamental neural mechanisms underlying processes of political polarization. |
Hyung Cho Kim; Claire M. Kaplan; Samiha Islam; Allegra S. Anderson; Megan E. Piper; Daniel E. Bradford; John J. Curtin; Kathryn A. DeYoung; Jason F. Smith; Andrew S. Fox; Alexander J. Shackman Acute nicotine abstinence amplifies subjective withdrawal symptoms and threat-evoked fear and anxiety, but not extended amygdala reactivity Journal Article In: PLoS ONE, vol. 18, pp. 1–31, 2023. @article{Kim2023a,Tobacco smoking imposes a staggering burden on public health, underscoring the urgency of developing a deeper understanding of the processes that maintain addiction. Clinical and experience-sampling data highlight the importance of anxious withdrawal symptoms, but the underlying neurobiology has remained elusive. Mechanistic work in animals implicates the central extended amygdala (EAc)—including the central nucleus of the amygdala and the neighboring bed nucleus of the stria terminalis—but the translational relevance of these discoveries remains unexplored. Here we leveraged a randomized trial design, well-established threat-anticipation paradigm, and multidimensional battery of assessments to understand the consequences of 24-hour nicotine abstinence. The threat-anticipation paradigm had the expected consequences, amplifying subjective distress and arousal, and recruiting the canonical threat-anticipation network. Abstinence increased smoking urges and withdrawal symptoms, and potentiated threat-evoked distress, but had negligible consequences for EAc threat reactivity, raising questions about the translational relevance of prominent animal and human models of addiction. These observations provide a framework for conceptualizing nicotine abstinence and withdrawal, with implications for basic, translational, and clinical science. |
Janina Klautke; Celia Foster; W. Pieter Medendorp; Tobias Heed Dynamic spatial coding in parietal cortex mediates tactile-motor transformation Journal Article In: Nature Communications, vol. 14, no. 1, pp. 1–18, 2023. @article{Klautke2023,Movements towards touch on the body require integrating tactile location and body posture information. Tactile processing and movement planning both rely on posterior parietal cortex (PPC) but their interplay is not understood. Here, human participants received tactile stimuli on their crossed and uncrossed feet, dissociating stimulus location relative to anatomy versus external space. Participants pointed to the touch or the equivalent location on the other foot, which dissociates sensory and motor locations. Multi-voxel pattern analysis of concurrently recorded fMRI signals revealed that tactile location was coded anatomically in anterior PPC but spatially in posterior PPC during sensory processing. After movement instructions were specified, PPC exclusively represented the movement goal in space, in regions associated with visuo-motor planning and with regional overlap for sensory, rule-related, and movement coding. Thus, PPC flexibly updates its spatial codes to accommodate rule-based transformation of sensory input to generate movement to environment and own body alike. |
Michaela Klímová; Ilona M. Bloem; Sam Ling Attention preserves the selectivity of feature-tuned normalization Journal Article In: Journal of neurophysiology, vol. 130, no. 4, pp. 990–998, 2023. @article{Klimova2023,Attention and divisive normalization both contribute to making visual processing more efficient. Attention selectively increases the neural gain of relevant information in the early visual cortex, resulting in stronger perceived salience for attended regions or features. Divisive normalization improves processing efficiency by suppressing responses to homogeneous inputs and highlighting salient boundaries, facilitating sparse coding of inputs. Theoretical and empirical research suggest a tight link between attention and normalization, wherein attending to a stimulus results in a release from normalization, thereby allowing for an increase in neural response gain. In the present study, we address whether attention alters the qualitative properties of normalization. Specifically, we examine how attention influences the feature-tuned nature of normalization, whereby suppression is stronger between visual stimuli whose orientation contents are similar, and weaker when the orientations are different. Ten human observers viewed stimuli that varied in orientation content while we acquired fMRI BOLD responses under two attentional states: attending toward or attending away from the stimulus. Our results indicate that attention does not alter the specificity of feature-tuned normalization. Instead, attention seems to enhance visuocortical responses evenly, regardless of the degree of orientation similarity within the stimulus. Since visuocortical responses exhibit adaptation to statistical regularities in natural scenes, we conclude that while attention can selectively increase the gain of responses to attended items, it does not appear to alter the ecologically relevant correspondence between orientation differences and strength of tuned normalization.NEW & NOTEWORTHY The magnitude of visuocortical BOLD responses scales with orientation differences in visual stimuli, with the strongest response suppression for collinear stimuli and least suppression for orthogonal, in a way that appears to match natural scene statistics. We examined the effects of attention on this feature-tuned property of suppression and found that while attending to a stimulus increases the overall gain of visuocortical responses, the qualitative properties of feature-tuning remain unchanged, suggesting attention preserves tuned normalization properties. |
Masih Rahmati; Clayton E. Curtis; Kartik K. Sreenivasan Mnemonic representations in human lateral geniculate nucleus Journal Article In: Frontiers in Behavioral Neuroscience, vol. 17, pp. 1–11, 2023. @article{Rahmati2023,There is a growing appreciation for the role of the thalamus in high-level cognition. Motivated by findings that internal cognitive state drives activity in feedback layers of primary visual cortex (V1) that target the lateral geniculate nucleus (LGN), we investigated the role of LGN in working memory (WM). Specifically, we leveraged model-based neuroimaging approaches to test the hypothesis that human LGN encodes information about spatial locations temporarily encoded in WM. First, we localized and derived a detailed topographic organization in LGN that accords well with previous findings in humans and non-human primates. Next, we used models constructed on the spatial preferences of LGN populations in order to reconstruct spatial locations stored in WM as subjects performed modified memory-guided saccade tasks. We found that population LGN activity faithfully encoded the spatial locations held in memory in all subjects. Importantly, our tasks and models allowed us to dissociate the locations of retinal stimulation and the motor metrics of memory-guided saccades from the maintained spatial locations, thus confirming that human LGN represents true WM information. These findings add LGN to the growing list of subcortical regions involved in WM, and suggest a key pathway by which memories may influence incoming processing at the earliest levels of the visual hierarchy. |
Michael Paul Schallmo; Kimberly B. Weldon; Rohit S. Kamath; Hannah R. Moser; Samantha A. Montoya; Kyle W. Killebrew; Caroline Demro; Andrea N. Grant; Małgorzata Marjańska; Scott R. Sponheim; Cheryl A. Olman The psychosis human connectome project: Design and rationale for studies of visual neurophysiology Journal Article In: NeuroImage, vol. 272, pp. 1–20, 2023. @article{Schallmo2023,Visual perception is abnormal in psychotic disorders such as schizophrenia. In addition to hallucinations, laboratory tests show differences in fundamental visual processes including contrast sensitivity, center-surround interactions, and perceptual organization. A number of hypotheses have been proposed to explain visual dysfunction in psychotic disorders, including an imbalance between excitation and inhibition. However, the precise neural basis of abnormal visual perception in people with psychotic psychopathology (PwPP) remains unknown. Here, we describe the behavioral and 7 tesla MRI methods we used to interrogate visual neurophysiology in PwPP as part of the Psychosis Human Connectome Project (HCP). In addition to PwPP (n = 66) and healthy controls (n = 43), we also recruited first-degree biological relatives (n = 44) in order to examine the role of genetic liability for psychosis in visual perception. Our visual tasks were designed to assess fundamental visual processes in PwPP, whereas MR spectroscopy enabled us to examine neurochemistry, including excitatory and inhibitory markers. We show that it is feasible to collect high-quality data across multiple psychophysical, functional MRI, and MR spectroscopy experiments with a sizable number of participants at a single research site. These data, in addition to those from our previously described 3 tesla experiments, will be made publicly available in order to facilitate further investigations by other research groups. By combining visual neuroscience techniques and HCP brain imaging methods, our experiments offer new opportunities to investigate the neural basis of abnormal visual perception in PwPP. |
Rebekka Schröder; Kristof Keidel; Peter Trautner; Alexander Radbruch; Ulrich Ettinger Neural mechanisms of background and velocity effects in smooth pursuit eye movements Journal Article In: Human Brain Mapping, vol. 44, no. 3, pp. 1–17, 2023. @article{Schroeder2023a,Smooth pursuit eye movements (SPEM) are essential to guide behaviour in complex visual environments. SPEM accuracy is known to be degraded by the presence of a structured visual background and at higher target velocities. The aim of this preregistered study was to investigate the neural mechanisms of these robust behavioural effects. N = 33 participants performed a SPEM task with two background conditions (present and absent) at two target velocities (0.4 and 0.6 Hz). Eye movement and BOLD data were collected simultaneously. Both the presence of a structured background and faster target velocity decreased pursuit gain and increased catch-up saccade rate. Faster targets additionally increased position error. Higher BOLD response with background was found in extensive clusters in visual, parietal, and frontal areas (including the medial frontal eye fields; FEF) partially overlapping with the known SPEM network. Faster targets were associated with higher BOLD response in visual cortex and left lateral FEF. Task-based functional connectivity analyses (psychophysiological interactions; PPI) largely replicated previous results in the basic SPEM network but did not yield additional information regarding the neural underpinnings of the background and velocity effects. The results show that the presentation of visual background stimuli during SPEM induces activity in a widespread visuo-parieto-frontal network including areas contributing to cognitive aspects of oculomotor control such as medial FEF, whereas the response to higher target velocity involves visual and motor areas such as lateral FEF. Therefore, we were able to propose for the first time different functions of the medial and lateral FEF during SPEM. |
Johannes J. D. Singer; Radoslaw M. Cichy; Martin N. Hebart The spatiotemporal neural dynamics of object recognition for natural images and line drawings Journal Article In: Journal of Neuroscience, vol. 43, no. 3, pp. 484–500, 2023. @article{Singer2023,Drawings offer a simple and efficient way to communicate meaning. While line drawings capture only coarsely how objects look in reality, we still perceive them as resembling real-world objects. Previous work has shown that this perceived similarity is mirrored by shared neural representations for drawings and natural images, which suggests that similar mechanisms underlie the recognition of both. However, other work has proposed that representations of drawings and natural images become similar only after substantial processing has taken place, suggesting distinct mechanisms. To arbitrate between those alternatives, we measured brain responses resolved in space and time using fMRI and MEG, respectively, while human participants (female and male) viewed images of objects depicted as photographs, line drawings, or sketch-like drawings. Using multivariate decoding, we demonstrate that object category information emerged similarly fast and across overlapping regions in occipital, ventral-temporal, and posterior parietal cortex for all types of depiction, yet with smaller effects at higher levels of visual abstraction. In addition, cross-decoding between depiction types revealed strong generalization of object category information from early processing stages on. Finally, by combining fMRI and MEG data using representational similarity analysis, we found that visual information traversed similar processing stages for all types of depiction, yet with an overall stronger representation for photographs. Together, our results demonstrate broad commonalities in the neural dynamics of object recognition across types of depiction, thus providing clear evidence for shared neural mechanisms underlying recognition of natural object images and abstract drawings. |
Gene Tangtartharakul; Catherine A. Morgan; Simon K. Rushton; D. Samuel Schwarzkopf Retinotopic connectivity maps of human visual cortex with unconstrained eye movements Journal Article In: Human Brain Mapping, vol. 44, no. 16, pp. 5221–5237, 2023. @article{Tangtartharakul2023,Human visual cortex contains topographic visual field maps whose organization can be revealed with retinotopic mapping. Unfortunately, constraints posed by standard mapping hinder its use in patients, atypical subject groups, and individuals at either end of the lifespan. This severely limits the conclusions we can draw about visual processing in such individuals. Here, we present a novel data-driven method to estimate connective fields, resulting in fine-grained maps of the functional connectivity between brain areas. We find that inhibitory connectivity fields accompany, and often surround facilitatory fields. The visual field extent of these inhibitory subfields falls off with cortical magnification. We further show that our method is robust to large eye movements and myopic defocus. Importantly, freed from the controlled stimulus conditions in standard mapping experiments, using entertaining stimuli and unconstrained eye movements our approach can generate retinotopic maps, including the periphery visual field hitherto only possible to map with special stimulus displays. Generally, our results show that the connective field method can gain knowledge about retinotopic architecture of visual cortex in patients and participants where this is at best difficult and confounded, if not impossible, with current methods. |
Qawi K. Telesford; Eduardo Gonzalez-Moreira; Ting Xu; Yiwen Tian; Stanley J. Colcombe; Jessica Cloud; Brian E. Russ; Arnaud Falchier; Maximilian Nentwich; Jens Madsen; Lucas C. Parra; Charles E. Schroeder; Michael P. Milham; Alexandre R. Franco An open-access dataset of naturalistic viewing using simultaneous EEG-fMRI Journal Article In: Scientific Data, vol. 10, no. 1, pp. 1–13, 2023. @article{Telesford2023,In this work, we present a dataset that combines functional magnetic imaging (fMRI) and electroencephalography (EEG) to use as a resource for understanding human brain function in these two imaging modalities. The dataset can also be used for optimizing preprocessing methods for simultaneously collected imaging data. The dataset includes simultaneously collected recordings from 22 individuals (ages: 23–51) across various visual and naturalistic stimuli. In addition, physiological, eye tracking, electrocardiography, and cognitive and behavioral data were collected along with this neuroimaging data. Visual tasks include a flickering checkerboard collected outside and inside the MRI scanner (EEG-only) and simultaneous EEG-fMRI recordings. Simultaneous recordings include rest, the visual paradigm Inscapes, and several short video movies representing naturalistic stimuli. Raw and preprocessed data are openly available to download. We present this dataset as part of an effort to provide open-access data to increase the opportunity for discoveries and understanding of the human brain and evaluate the correlation between electrical brain activity and blood oxygen level-dependent (BOLD) signals. |
Ruud L. Brink; Keno Hagena; Niklas Wilming; Peter R. Murphy; Christian Büchel; Tobias H. Donner Flexible sensory-motor mapping rules manifest in correlated variability of stimulus and action codes across the brain Journal Article In: Neuron, vol. 111, no. 4, pp. 571–584, 2023. @article{Brink2023,Humans and non-human primates can flexibly switch between different arbitrary mappings from sensation to action to solve a cognitive task. It has remained unknown how the brain implements such flexible sensory-motor mapping rules. Here, we uncovered a dynamic reconfiguration of task-specific correlated variability between sensory and motor brain regions. Human participants switched between two rules for reporting visual orientation judgments during fMRI recordings. Rule switches were either signaled explicitly or inferred by the participants from ambiguous cues. We used behavioral modeling to reconstruct the time course of their belief about the active rule. In both contexts, the patterns of correlations between ongoing fluctuations in stimulus- and action-selective activity across visual- and action-related brain regions tracked participants' belief about the active rule. The rule-specific correlation patterns broke down around the time of behavioral errors. We conclude that internal beliefs about task state are instantiated in brain-wide, selective patterns of correlated variability. |
Isabella C. Wagner; Luise P. Graichen; Boryana Todorova; Andre Lüttig; David B. Omer; Matthias Stangl; Claus Lamm Entorhinal grid-like codes and time-locked network dynamics track others navigating through space Journal Article In: Nature Communications, vol. 14, no. 1, pp. 1–18, 2023. @article{Wagner2023a,Navigating through crowded, dynamically changing environments requires the ability to keep track of other individuals. Grid cells in the entorhinal cortex are a central component of self-related navigation but whether they also track others' movement is unclear. Here, we propose that entorhinal grid-like codes make an essential contribution to socio-spatial navigation. Sixty human participants underwent functional magnetic resonance imaging (fMRI) while observing and re-tracing different paths of a demonstrator that navigated a virtual reality environment. Results revealed that grid-like codes in the entorhinal cortex tracked the other individual navigating through space. The activity of grid-like codes was time-locked to increases in co-activation and entorhinal-cortical connectivity that included the striatum, the hippocampus, parahippocampal and right posterior parietal cortices. Surprisingly, the grid-related effects during observation were stronger the worse participants performed when subsequently re-tracing the demonstrator's paths. Our findings suggests that network dynamics time-locked to entorhinal grid-cell-related activity might serve to distribute information about the location of others throughout the brain. |
Noriya Watanabe; Kosuke Miyoshi; Koji Jimura; Daisuke Shimane; Ruedeerat Keerativittayayut; Kiyoshi Nakahara; Masaki Takeda Multimodal deep neural decoding reveals highly resolved spatiotemporal profile of visual object representation in humans Journal Article In: NeuroImage, vol. 275, pp. 1–19, 2023. @article{Watanabe2023,Perception and categorization of objects in a visual scene are essential to grasp the surrounding situation. Recently, neural decoding schemes, such as machine learning in functional magnetic resonance imaging (fMRI), has been employed to elucidate the underlying neural mechanisms. However, it remains unclear as to how spatially distributed brain regions temporally represent visual object categories and sub-categories. One promising strategy to address this issue is neural decoding with concurrently obtained neural response data of high spatial and temporal resolution. In this study, we explored the spatial and temporal organization of visual object representations using concurrent fMRI and electroencephalography (EEG), combined with neural decoding using deep neural networks (DNNs). We hypothesized that neural decoding by multimodal neural data with DNN would show high classification performance in visual object categorization (faces or non-face objects) and sub-categorization within faces and objects. Visualization of the fMRI DNN was more sensitive than that in the univariate approach and revealed that visual categorization occurred in brain-wide regions. Interestingly, the EEG DNN valued the earlier phase of neural responses for categorization and the later phase of neural responses for sub-categorization. Combination of the two DNNs improved the classification performance for both categorization and sub-categorization compared with fMRI DNN or EEG DNN alone. These deep learning-based results demonstrate a categorization principle in which visual objects are represented in a spatially organized and coarse-to-fine manner, and provide strong evidence of the ability of multimodal deep learning to uncover spatiotemporal neural machinery in sensory processing. |
Kim Lara Weiss; Stefan Hawelka; Florian Hutzler; Sarah Schuster Stronger functional connectivity during reading contextually predictable words in slow readers Journal Article In: Scientific Reports, vol. 13, no. 1, pp. 1–10, 2023. @article{Weiss2023,The effect of word predictability is well-documented in terms of local brain activation, but less is known about the functional connectivity among those regions associated with processing predictable words. Evidence from eye movement studies showed that the effect is much more pronounced in slow than in fast readers, suggesting that speed-impaired readers rely more on sentence context to compensate for their difficulties with visual word recognition. The present study aimed to investigate differences in functional connectivity of fast and slow readers within core regions associated with processing predictable words. We hypothesize a stronger synchronization between higher-order language areas, such as the left middle temporal (MTG) and inferior frontal gyrus (IFG), and the left occipito-temporal cortex (OTC) in slow readers. Our results show that slow readers exhibit more functional correlations among these connections; especially between the left IFG and OTC. We interpret our results in terms of the lexical quality hypothesis which postulates a stronger involvement of semantics on orthographic processing in (speed-)impaired readers. |
Mirjam C. M. Wever; Lisanne A. E. M. Houtum; Loes H. C. Janssen; Wilma G. M. Wentholt; Iris M. Spruit; Marieke S. Tollenaar; Geert Jan Will; Bernet M. Elzinga In: Cognitive, Affective, & Behavioral Neuroscience, vol. 23, no. 6, pp. 1598–1609, 2023. @article{Wever2023,One of the most prevalent nonverbal, social phenomena known to automatically elicit self- and other-referential processes is eye contact. By its negative effects on the perception of social safety and views about the self and others, childhood emotional maltreatment (CEM) may fundamentally affect these processes. To investigate whether the socioaffective consequences of CEM may become visible in response to (prolonged) eye gaze, 79 adult participants (mean [M]age = 49.87, standard deviation [SD]age = 4.62) viewed videos with direct and averted gaze of an unfamiliar other and themselves while we recorded self-reported mood, eye movements using eye-tracking, and markers of neural activity using fMRI. Participants who reported higher levels of CEM exhibited increased activity in ventromedial prefrontal cortex to one's own, but not to others', direct gaze. Furthermore, in contrast to those who reported fewer of such experiences, they did not report a better mood in response to a direct gaze of self and others, despite equivalent amounts of time spent looking into their own and other peoples' eyes. The fact that CEM is associated with enhanced neural activation in a brain area that is crucially involved in self-referential processing (i.e., vmPFC) in response to one's own direct gaze is in line with the chronic negative impact of CEM on a person's self-views. Interventions that directly focus on targeting maladaptive self-views elicited during eye gaze to self may be clinically useful. |
Alex L. White; Kendrick N. Kay; Kenny A. Tang; Jason D. Yeatman Engaging in word recognition elicits highly specific modulations in visual cortex Journal Article In: Current Biology, vol. 33, no. 7, pp. 1308–1320, 2023. @article{White2023,A person's cognitive state determines how their brain responds to visual stimuli. The most common such effect is a response enhancement when stimuli are task relevant and attended rather than ignored. In this fMRI study, we report a surprising twist on such attention effects in the visual word form area (VWFA), a region that plays a key role in reading. We presented participants with strings of letters and visually similar shapes, which were either relevant for a specific task (lexical decision or gap localization) or ignored (during a fixation dot color task). In the VWFA, the enhancement of responses to attended stimuli occurred only for letter strings, whereas non-letter shapes evoked smaller responses when attended than when ignored. The enhancement of VWFA activity was accompanied by strengthened functional connectivity with higher-level language regions. These task-dependent modulations of response magnitude and functional connectivity were specific to the VWFA and absent in the rest of visual cortex. We suggest that language regions send targeted excitatory feedback into the VWFA only when the observer is trying to read. This feedback enables the discrimination of familiar and nonsense words and is distinct from generic effects of visual attention. |
Mathieu Lesourd; Alia Afyouni; Franziska Geringswald; Fabien Cignetti; Lisa Raoul; Julien Sein; Bruno Nazarian; Jean-Luc Anton; Marie-Hélène Grosbras Action observation network activity related to object-directed and socially-directed actions in adolescents Journal Article In: Journal of Neuroscience, vol. 43, no. 1, pp. 125–141, 2023. @article{Lesourd2023,The human action observation network (AON) encompasses brain areas consistently engaged when we observe other's actions. Although the core nodes of the AON are present from childhood, it is not known to what extent they are sensitive to different action features during development. Because social cognitive abilities continue to mature during adolescence, the AON response to socially-oriented actions, but not to object-related actions, may differ in adolescents and adults. To test this hypothesis, we scanned with functional magnetic resonance imaging (fMRI) male and female typically-developing teenagers (n = 28; 13 females) and adults (n = 25; 14 females) while they passively watched videos of manual actions varying along two dimensions: sociality (i.e., directed toward another person or not) and transitivity (i.e., involving an object or not). We found that action observation recruited the same fronto-parietal and occipito-temporal regions in adults and adolescents. The modulation of voxel-wise activity according to the social or transitive nature of the action was similar in both groups of participants. Multivariate pattern analysis, however, revealed that decoding accuracies in intraparietal sulcus (IPS)/superior parietal lobe (SPL) for both sociality and transitivity were lower for adolescents compared with adults. In addition, in the lateral occipital temporal cortex (LOTC), generalization of decoding across the orthogonal dimension was lower for sociality only in adolescents. These findings indicate that the representation of the content of others' actions, and in particular their social dimension, in the adolescent AON is still not as robust as in adults. |
Hsin-Hung Li; Clayton E. Curtis Neural population dynamics of human working memory Journal Article In: Current Biology, vol. 33, no. 17, pp. 3775–3784, 2023. @article{Li2023d,The activity of neurons in macaque prefrontal cortex (PFC) persists during working memory (WM) delays, providing a mechanism for memory.1,2,3,4,5,6,7,8,9,10,11 Although theory,11,12 including formal network models,13,14 assumes that WM codes are stable over time, PFC neurons exhibit dynamics inconsistent with these assumptions.15,16,17,18,19 Recently, multivariate reanalyses revealed the coexistence of both stable and dynamic WM codes in macaque PFC.20,21,22,23 Human EEG studies also suggest that WM might contain dynamics.24,25 Nonetheless, how WM dynamics vary across the cortical hierarchy and which factors drive dynamics remain unknown. To elucidate WM dynamics in humans, we decoded WM content from fMRI responses across multiple cortical visual field maps.26,27,28,29,30,31,32,33,34,35,36,37,38,39,40,41,42,43,44,45,46,47,48 We found coexisting stable and dynamic neural representations of WM during a memory-guided saccade task. Geometric analyses of neural subspaces revealed that early visual cortex exhibited stronger dynamics than high-level visual and frontoparietal cortex. Leveraging models of population receptive fields, we visualized and made the neural dynamics interpretable. We found that during WM delays, V1 population initially encoded a narrowly tuned bump of activation centered on the peripheral memory target. Remarkably, this bump then spread inward toward foveal locations, forming a vector along the trajectory of the forthcoming memory-guided saccade. In other words, the neural code transformed into an abstraction of the stimulus more proximal to memory-guided behavior. Therefore, theories of WM must consider both sensory features and their task-relevant abstractions because changes in the format of memoranda naturally drive neural dynamics. |
Ming-Ray Liao; Andy J. Kim; Brian A. Anderson Neural correlates of value-driven spatial orienting Journal Article In: Psychophysiology, vol. 60, no. 9, pp. 1–13, 2023. @article{Liao2023,Reward learning has been shown to habitually guide overt spatial attention to specific regions of a scene. However, the neural mechanisms that support this bias are unknown. In the present study, participants learned to orient themselves to a particular quadrant of a scene (a high-value quadrant) to maximize monetary gains. This learning was scene-specific, with the high-value quadrant varying across different scenes. During a subsequent test phase, participants were faster at identifying a target if it appeared in the high-value quadrant (valid), and initial saccades were more likely to be made to the high-value quadrant. fMRI analyses during the test phase revealed learning-dependent priority signals in the caudate tail, superior colliculus, frontal eye field, anterior cingulate cortex, and insula, paralleling findings concerning feature-based, value-driven attention. In addition, ventral regions typically associated with scene selection and spatial information processing, including the hippocampus, parahippocampal gyrus, and temporo-occipital cortex, were also implicated. Taken together, our findings offer new insights into the neural architecture subserving value-driven attention, both extending our understanding of nodes in the attention network previously implicated in feature-based, value-driven attention and identifying a ventral network of brain regions implicated in reward's influence on scene-dependent spatial orienting. |
Tianyuan Liu; Bao Li; Chi Zhang; Panpan Chen; Weichen Zhao; Bin Yan Real-time classification of motor imagery using Dynamic Window-Level Granger Causality analysis of fMRI data Journal Article In: Brain Sciences, vol. 13, no. 10, pp. 1–15, 2023. @article{Liu2023d,This article presents a method for extracting neural signal features to identify the imagination of left- and right-hand grasping movements. A functional magnetic resonance imaging (fMRI) experiment is employed to identify four brain regions with significant activations during motor imagery (MI) and the effective connections between these regions of interest (ROIs) were calculated using Dynamic Window-level Granger Causality (DWGC). Then, a real-time fMRI (rt-fMRI) classification system for left- and right-hand MI is developed using the Open-NFT platform. We conducted data acquisition and processing on three subjects, and all of whom were recruited from a local college. As a result, the maximum accuracy of using Support Vector Machine (SVM) classifier on real-time three-class classification (rest, left hand, and right hand) with effective connections is 69.3%. And it is 3% higher than that of traditional multivoxel pattern classification analysis on average. Moreover, it significantly improves classification accuracy during the initial stage of MI tasks while reducing the latency effects in real-time decoding. The study suggests that the effective connections obtained through the DWGC method serve as valuable features for real-time decoding of MI using fMRI. Moreover, they exhibit higher sensitivity to changes in brain states. This research offers theoretical support and technical guidance for extracting neural signal features in the context of fMRI-based studies. |
Marloes Mak; Myrthe Faber; Roel M. Willems Different kinds of simulation during literary reading: Insights from a combined fMRI and eye-tracking study Journal Article In: Cortex, vol. 162, pp. 115–135, 2023. @article{Mak2023,Mental simulation is an important aspect of narrative reading. In a previous study, we found that gaze durations are differentially impacted by different kinds of mental simulation. Motor simulation, perceptual simulation, and mentalizing as elicited by literary short stories influenced eye movements in distinguishable ways (Mak & Willems, 2019). In the current study, we investigated the existence of a common neural locus for these different kinds of simulation. We additionally investigated whether individual differences during reading, as indexed by the eye movements, are reflected in domain-specific activations in the brain. We found a variety of brain areas activated by simulation-eliciting content, both modality-specific brain areas and a general simulation area. Individual variation in percent signal change in activated areas was related to measures of story appreciation as well as personal characteristics (i.e., transportability, perspective taking). Taken together, these findings suggest that mental simulation is supported by both domain-specific processes grounded in previous experiences, and by the neural mechanisms that underlie higher-order language processing (e.g., situation model building, event indexing, integration). |
Audrey Mazancieux; Franck Mauconduit; Alexis Amadon; Jan Willem de Gee; Tobias H. Donner; Florent Meyniel Brainstem fMRI signaling of surprise across different types of deviant stimuli Journal Article In: Cell Reports, vol. 42, no. 11, pp. 1–15, 2023. @article{Mazancieux2023,Detection of deviant stimuli is crucial to orient and adapt our behavior. Previous work shows that deviant stimuli elicit phasic activation of the locus coeruleus (LC), which releases noradrenaline and controls central arousal. However, it is unclear whether the detection of behaviorally relevant deviant stimuli selectively triggers LC responses or other neuromodulatory systems (dopamine, serotonin, and acetylcholine). We combine human functional MRI (fMRI) recordings optimized for brainstem imaging with pupillometry to perform a mapping of deviant-related responses in subcortical structures. Participants have to detect deviant items in a “local-global” paradigm that distinguishes between deviance based on the stimulus probability and the sequence structure. fMRI responses to deviant stimuli are distributed in many cortical areas. Both types of deviance elicit responses in the pupil, LC, and other neuromodulatory systems. Our results reveal that the detection of task-relevant deviant items recruits the same multiple subcortical systems across computationally different types of deviance. |
Lucia Melloni; Liad Mudrik; Michael Pitts; Katarina Bendtz; Oscar Ferrante; Urszula Gorska; Rony Hirschhorn; Aya Khalaf; Csaba Kozma; Alex Lepauvre; Ling Liu; David Mazumder; David Richter; Hao Zhou; Hal Blumenfeld; Melanie Boly; David J. Chalmers; Sasha Devore; Francis Fallon; Floris P. Lange; Ole Jensen; Gabriel Kreiman; Huan Luo; Theofanis I. Panagiotaropoulos; Stanislas Dehaene; Christof Koch; Giulio Tononi An adversarial collaboration protocol for testing contrasting predictions of global neuronal workspace and integrated information theory Journal Article In: PLoS ONE, vol. 18, pp. 1–28, 2023. @article{Melloni2023,The relationship between conscious experience and brain activity has intrigued scientists and philosophers for centuries. In the last decades, several theories have suggested different accounts for these relationships. These theories have developed in parallel, with little to no cross-talk among them. To advance research on consciousness, we established an adversarial collaboration between proponents of two of the major theories in the field, Global Neuronal Workspace and Integrated Information Theory. Together, we devised and preregistered two experiments that test contrasting predictions of these theories concerning the location and timing of correlates of visual consciousness, which have been endorsed by the theories' proponents. Predicted outcomes should either support, refute, or challenge these theories. Six theory-impartial laboratories will follow the study protocol specified here, using three complementary methods: Functional Magnetic Resonance Imaging (fMRI), Magneto-Electroencephalography (M-EEG), and intracranial electroencephalography (iEEG). The study protocol will include built-in replications, both between labs and within datasets. Through this ambitious undertaking, we hope to provide decisive evidence in favor or against the two theories and clarify the footprints of conscious visual perception in the human brain, while also providing an innovative model of large-scale, collaborative, and open science practice. |
Sreenivasan Meyyappan; Abhijit Rajan; George R. Mangun; Mingzhou Ding Top-down control of the left visual field bias in cued visual spatial attention Journal Article In: Cerebral Cortex, vol. 33, no. 9, pp. 5097–5107, 2023. @article{Meyyappan2023,A left visual field (LVF) bias in perceptual judgments, response speed, and discrimination accuracy has been reported in humans. Cognitive factors, such as visual spatial attention, are known to modulate or even eliminate this bias. We investigated this problem by recording pupillometry together with functional magnetic resonance imaging (fMRI) in a cued visual spatial attention task. We observed that (i) the pupil was significantly more dilated following attend-right than attend-left cues, (ii) the task performance (e.g. reaction time [RT]) did not differ between attend-left and attend-right trials, and (iii) the difference in cue-related pupil dilation between attend-left and attend-right trials was inversely related to the corresponding difference in RT. Neuroscientically, correlating the difference in cue-related pupil dilation with the corresponding cue-related fMRI difference yielded activations primarily in the right hemisphere, including the right intraparietal sulcus and the right ventrolateral prefrontal cortex. These results suggest that (i) there is an asymmetry in visual spatial attention control, with the rightward attention control being more effortful than the leftward attention control, (ii) this asymmetry underlies the reduction or the elimination of the LVF bias, and (iii) the components of the attentional control networks in the right hemisphere are likely part of the neural substrate of the observed asymmetry in attentional control. |
Viola Mocz; Su Keun Jeong; Marvin Chun; Yaoda Xu Multiple visual objects are represented differently in the human brain and convolutional neural networks Journal Article In: Scientific Reports, vol. 13, no. 1, pp. 1–16, 2023. @article{Mocz2023,Objects in the real world usually appear with other objects. To form object representations independent of whether or not other objects are encoded concurrently, in the primate brain, responses to an object pair are well approximated by the average responses to each constituent object shown alone. This is found at the single unit level in the slope of response amplitudes of macaque IT neurons to paired and single objects, and at the population level in fMRI voxel response patterns in human ventral object processing regions (e.g., LO). Here, we compare how the human brain and convolutional neural networks (CNNs) represent paired objects. In human LO, we show that averaging exists in both single fMRI voxels and voxel population responses. However, in the higher layers of five CNNs pretrained for object classification varying in architecture, depth and recurrent processing, slope distribution across units and, consequently, averaging at the population level both deviated significantly from the brain data. Object representations thus interact with each other in CNNs when objects are shown together and differ from when objects are shown individually. Such distortions could significantly limit CNNs' ability to generalize object representations formed in different contexts. |
Alina Nostadt; Michael A. Nitsche; Martin Tegenthoff; Silke Lissek In: Scientific Reports, vol. 13, no. 1, pp. 1–16, 2023. @article{Nostadt2023,Contextual information is essential for learning and memory processes and plays a crucial role during the recall of extinction memory, and in the renewal effect, which is the context-dependent recovery of an extinguished response. The dopaminergic system is known to be involved in regulating attentional processes by shifting attention to novel and salient contextual cues. Higher dopamine levels are associated with a better recall of previously learned stimulus-outcome associations and enhanced encoding, as well as retrieval of contextual information which promotes renewal. In this fMRI study, we aimed to investigate the impact of processing contextual information and the influence of dopaminergic D2-like receptor activation on attention to contextual information during a predictive learning task as well as upon extinction learning, memory performance, and activity of extinction-related brain areas. A single oral dose of 1.25 mg bromocriptine or an identical-looking placebo was administered to the participants. We modified a predictive learning task that in previous studies reliably evoked a renewal effect, by increasing the complexity of contextual information. We analysed fixations and dwell on contextual cues by use of eye-tracking and correlated these with behavioural performance and BOLD activation of extinction-related brain areas. Our results indicate that the group with dopaminergic D2-like receptor stimulation had higher attention to task-relevant contextual information and greater/lower BOLD activation of brain regions associated with cognitive control during extinction learning and recall. Moreover, renewal responses were almost completely absent. Since this behavioural effect was observed for both treatment groups, we assume that this was due to the complexity of the altered task design. |
Ilenia Paparella; Islay Campbell; Roya Sharifpour; Elise Beckers; Alexandre Berger; Jose Fermin Balda Aizpurua; Ekaterina Koshmanova; Nasrin Mortazavi; Puneet Talwar; Christian Degueldre; Laurent Lamalle; Siya Sherif; Christophe Phillips; Pierre Maquet; Gilles Vandewalle Light modulates task-dependent thalamo-cortical connectivity during an auditory attentional task Journal Article In: Communications Biology, vol. 6, no. 1, pp. 1–10, 2023. @article{Paparella2023,Exposure to blue wavelength light stimulates alertness and performance by modulating a widespread set of task-dependent cortical and subcortical areas. How light affects the crosstalk between brain areas to trigger this stimulating effect is not established. Here we record the brain activity of 19 healthy young participants (24.05±2.63; 12 women) while they complete an auditory attentional task in darkness or under an active (blue-enriched) or a control (orange) light, in an ultra-high-field 7 Tesla MRI scanner. We test if light modulates the effective connectivity between an area of the posterior associative thalamus, encompassing the pulvinar, and the intraparietal sulcus (IPS), key areas in the regulation of attention. We find that only the blue-enriched light strengthens the connection from the posterior thalamus to the IPS. To the best of our knowledge, our results provide the first empirical data supporting that blue wavelength light affects ongoing non-visual cognitive activity by modulating task-dependent information flow from subcortical to cortical areas. |
Eva R. Pool; Wolfgang M. Pauli; Logan Cross; John P. O'Doherty Neural substrates of parallel devaluation-sensitive and devaluation-insensitive Pavlovian learning in humans Journal Article In: Nature Communications, vol. 14, no. 1, pp. 1–17, 2023. @article{Pool2023,We aim to differentiate the brain regions involved in the learning and encoding of Pavlovian associations sensitive to changes in outcome value from those that are not sensitive to such changes by combining a learning task with outcome devaluation, eye-tracking, and functional magnetic resonance imaging in humans. Contrary to theoretical expectation, voxels correlating with reward prediction errors in the ventral striatum and subgenual cingulate appear to be sensitive to devaluation. Moreover, regions encoding state prediction errors appear to be devaluation insensitive. We can also distinguish regions encoding predictions about outcome taste identity from predictions about expected spatial location. Regions encoding predictions about taste identity seem devaluation sensitive while those encoding predictions about an outcome's spatial location seem devaluation insensitive. These findings suggest the existence of multiple and distinct associative mechanisms in the brain and help identify putative neural correlates for the parallel expression of both devaluation sensitive and insensitive conditioned behaviors. |
Sophia Antonia Press; Stefanie C. Biehl; Gregor Domes; Jennifer Svaldi; Sophia Antonia Press; Stefanie C. Biehl; Gregor Domes; Jennifer Svaldi; Sophia Antonia Press Increased insula and amygdala activity during selective attention for negatively valenced body parts in binge eating disorder Journal Article In: Journal of Psychopathology and Clinical Science, vol. 132, no. 1, pp. 63–77, 2023. @article{Press2023,Previous studies indicate that participants with eating disorders show an attentional bias for the negatively valenced body parts of their own body. However, the neural basis underlying these processes has not been investigated. We conducted a preregistered combined functional MRI (fMRI)/eye tracking study and presented 35 women with binge eating disorder (BED) and 24 weight-matched control subjects (CG) with body part images of their own body and a weight-matched unknown body. After the fMRI examination, participants rated the attractiveness of the presented body parts. As expected, women with BED responded with significantly higher insula and amygdala activity when viewing the negatively valenced body parts of their own body (compared to all other combinations). However, individuals with BED did not deviate from the CG in the processing of these stimuli in the ventromedial prefrontal cortex, the extrastriate body area or the fusiform body area. Our results indicate that the negative valued body parts carry a particularly strong emotional valence in individuals with BED. These results further emphasize the relevance of processing bias for negatively valenced body parts in the pathology of BED. |
Mengna Yao; Bincheng Wen; Mingpo Yang; Jiebin Guo; Haozhou Jiang; Chao Feng; Yilei Cao; Huiguang He; Le Chang High-dimensional topographic organization of visual features in the primate temporal lobe Journal Article In: Nature Communications, vol. 14, no. 1, pp. 1–23, 2023. @article{Yao2023a,The inferotemporal cortex supports our supreme object recognition ability. Numerous studies have been conducted to elucidate the functional organization of this brain area, but there are still important questions that remain unanswered, including how this organization differs between humans and non-human primates. Here, we use deep neural networks trained on object categorization to construct a 25-dimensional space of visual features, and systematically measure the spatial organization of feature preference in both male monkey brains and human brains using fMRI. These feature maps allow us to predict the selectivity of a previously unknown region in monkey brains, which is corroborated by additional fMRI and electrophysiology experiments. These maps also enable quantitative analyses of the topographic organization of the temporal lobe, demonstrating the existence of a pair of orthogonal gradients that differ in spatial scale and revealing significant differences in the functional organization of high-level visual areas between monkey and human brains. |
Wei Zhou; Sile Wang; Ming Yan Fixation-related fMRI analysis reveals the neural basis of natural reading of unspaced and spaced Chinese sentences Journal Article In: Cerebral Cortex, vol. 33, no. 19, pp. 10401–10410, 2023. @article{Zhou2023b,Although there are many eye-movement studies focusing on natural sentence reading and functional magnetic resonance imaging research on reading with serial visual presentation paradigms, there is a scarcity of investigations into the neural mechanism of natural sentence reading. The present study recruited 33 adults to read unspaced and spaced Chinese sentences with the eye tracking and functional magnetic resonance imaging data recorded simultaneously. By using fixation-related functional magnetic resonance imaging analysis, this study showed that natural reading of Chinese sentences produced activations in ventral visual, dorsal attention, and semantic brain regions, which were modulated by the properties of words such as word length and word frequency. The multivoxel pattern analysis showed that the activity pattern in the left middle temporal gyrus could significantly predict the visual layout categories (i.e. unspaced vs. spaced conditions). Dynamic causal modeling analysis showed that there were bidirectional brain connections between the left middle temporal gyrus and the left inferior occipital cortex in the unspaced Chinese sentence reading but not in the spaced reading. These results provide a neural mechanism for the natural reading of Chinese sentences from the perspective of word segmentation. |
Sebastian C. Coleman; Zelekha A. Seedat; Anna C. Whittaker; Agatha Lenartowicz; Karen J. Mullinger Beyond the beta rebound: Post-task responses in oscillatory activity follow cessation of working memory processes Journal Article In: NeuroImage, vol. 265, pp. 1–11, 2023. @article{Coleman2023,Post-task responses (PTRs) are transitionary responses occurring for several seconds between the end of a stimulus/task and a period of rest. The most well-studied of these are beta band (13 – 30 Hz) PTRs in motor networks following movement, often called post-movement beta rebounds, which have been shown to differ in patients with schizophrenia and autism. Previous studies have proposed that beta PTRs reflect inhibition of task-positive networks to enable a return to resting brain activity, scaling with cognitive demand and reflecting cortical self-regulation. It is unknown whether PTRs are a phenomenon of the motor system, or whether they are a more general self-modulatory property of cortex that occur following cessation of higher cognitive processes as well as movement. To test this, we recorded magnetoencephalography (MEG) responses in 20 healthy participants to a working-memory task, known to recruit cortical networks associated with higher cognition. Our results revealed PTRs in the theta, alpha and beta bands across many regions of the brain, including the dorsal attention network (DAN) and lateral visual regions. These PTRs increased significantly (p < 0.05) in magnitude with working-memory load, an effect which is independent of oscillatory modulations occurring over the task period as well as those following individual stimuli. Furthermore, we showed that PTRs are functionally related to reaction times in left lateral visual (p < 0.05) and left parietal (p < 0.1) regions, while the oscillatory responses measured during the task period are not. Importantly, motor PTRs following button presses did not modulate with task condition, suggesting that PTRs in different networks are driven by different aspects of cognition. Our findings show that PTRs are not limited to motor networks but are widespread in regions which are recruited during the task. We provide evidence that PTRs have unique properties, scaling with cognitive load and correlating significantly with behaviour. Based on the evidence, we suggest that PTRs inhibit task-positive network activity to enable a transition to rest, however, further investigation is required to uncover their role in neuroscience and pathology. |
Laura Convertino; Daniel Bush; Fanfan Zheng; Rick A. Adams; Neil Burgess Reduced grid-like theta modulation in schizophrenia Journal Article In: Brain, vol. 146, no. 5, pp. 2191–2198, 2023. @article{Convertino2023,The hippocampal formation has been implicated in the pathophysiology of schizophrenia, with patients showing impairments in spatial and relational cognition, structural changes in entorhinal cortex and reduced theta coherence with medial prefrontal cortex. Both the entorhinal cortex and medial prefrontal cortex exhibit a 6-fold (or ‘hexadirectional') modulation of neural activity during virtual navigation that is indicative of grid cell populations and associated with accurate spatial navigation. Here, we examined whether these grid-like patterns are disrupted in schizophrenia. We asked 17 participants with diagnoses of schizophrenia and 23 controls (matched for age, sex and IQ) to perform a virtual reality spatial navigation task during magnetoencephalography. The control group showed stronger 4–10 Hz theta power during movement onset, as well as hexadirectional modulation of theta band oscillatory activity in the right entorhinal cortex whose directional stability across trials correlated with navigational accuracy. This hexadirectional modulation was absent in schizophrenia patients, with a significant difference between groups. These results suggest that impairments in spatial and relational cognition associated with schizophrenia may arise from disrupted grid firing patterns in entorhinal cortex. |
Anna Corriveau; Alexis Kidder; Lina Teichmann; Susan G. Wardle; Chris I. Baker Sustained neural representations of personally familiar people and places during cued recall Journal Article In: Cortex, vol. 158, pp. 71–82, 2023. @article{Corriveau2023,The recall and visualization of people and places from memory is an everyday occurrence, yet the neural mechanisms underpinning this phenomenon are not well understood. In particular, the temporal characteristics of the internal representations generated by active recall are unclear. Here, we used magnetoencephalography (MEG) and multivariate pattern analysis to measure the evolving neural representation of familiar places and people across the whole brain when human participants engage in active recall. To isolate self- generated imagined representations, we used a retro-cue paradigm in which participants were first presented with two possible labels before being cued to recall either the first or second item. We collected personalized labels for specific locations and people familiar to each participant. Importantly, no visual stimuli were presented during the recall period, and the retro-cue paradigm allowed the dissociation of responses associated with the la- bels from those corresponding to the self-generated representations. First, we found that following the retro-cue it took on average ~1000 ms for distinct neural representations of freely recalled people or places to develop. Second, we found distinct representations of personally familiar concepts throughout the 4 s recall period. Finally, we found that these representations were highly stable and generalizable across time. These results suggest that self-generated visualizations and recall of familiar places and people are subserved by a stable neural mechanism that operates relatively slowly when under conscious control. |
Ingmar E. J. Vries; Moritz F. Wurm Predictive neural representations of naturalistic dynamic input Journal Article In: Nature Communications, vol. 14, no. 1, pp. 1–16, 2023. @article{Vries2023,Adaptive behavior such as social interaction requires our brain to predict unfolding external dynamics. While theories assume such dynamic prediction, empirical evidence is limited to static snapshots and indirect consequences of predictions. We present a dynamic extension to representational similarity analysis that uses temporally variable models to capture neural representations of unfolding events. We applied this approach to source-reconstructed magnetoencephalography (MEG) data of healthy human subjects and demonstrate both lagged and predictive neural representations of observed actions. Predictive representations exhibit a hierarchical pattern, such that high-level abstract stimulus features are predicted earlier in time, while low-level visual features are predicted closer in time to the actual sensory input. By quantifying the temporal forecast window of the brain, this approach allows investigating predictive processing of our dynamic world. It can be applied to other naturalistic stimuli (e.g., film, soundscapes, music, motor planning/execution, social interaction) and any biosignal with high temporal resolution. |
Jasper H. Fabius; Alessio Fracasso; Michele Deodato; David Melcher; Stefan Van der Stigchel Bilateral increase in MEG planar gradients prior to saccade onset Journal Article In: Scientific Reports, vol. 13, no. 1, pp. 1–10, 2023. @article{Fabius2023,Every time we move our eyes, the retinal locations of objects change. To distinguish the changes caused by eye movements from actual external motion of the objects, the visual system is thought to anticipate the consequences of eye movements (saccades). Single neuron recordings have indeed demonstrated changes in receptive fields before saccade onset. Although some EEG studies with human participants have also demonstrated a pre-saccadic increased potential over the hemisphere that will process a stimulus after a saccade, results have been mixed. Here, we used magnetoencephalography to investigate the timing and lateralization of visually evoked planar gradients before saccade onset. We modelled the gradients from trials with both a saccade and a stimulus as the linear combination of the gradients from two conditions with either only a saccade or only a stimulus. We reasoned that any residual gradients in the condition with both a saccade and a stimulus must be uniquely linked to visually-evoked neural activity before a saccade. We observed a widespread increase in residual planar gradients. Interestingly, this increase was bilateral, showing activity both contralateral and ipsilateral to the stimulus, i.e. over the hemisphere that would process the stimulus after saccade offset. This pattern of results is consistent with predictive pre-saccadic changes involving both the current and the future receptive fields involved in processing an attended object, well before the start of the eye movement. The active, sensorimotor coupling of vision and the oculomotor system may underlie the seamless subjective experience of stable and continuous perception. |
Oscar Ferrante; Alexander Zhigalov; Clayton Hickey; Ole Jensen Statistical learning of distractor suppression downregulates prestimulus neural excitability in early visual cortex Journal Article In: Journal of Neuroscience, vol. 43, no. 12, pp. 2190–2198, 2023. @article{Ferrante2023,Visual attention is highly influenced by past experiences. Recent behavioral research has shown that expectations about the spatial location of distractors within a search array are implicitly learned, with expected distractors becoming less interfering. Little is known about the neural mechanism supporting this form of statistical learning. Here, we used magnetoencephalography (MEG) to measure human brain activity to test whether proactive mechanisms are involved in the statistical learning of distractor locations. Specifically, we used a new technique called rapid invisible frequency tagging (RIFT) to assess neural excitability in early visual cortex during statistical learning of distractor suppression while concurrently investigating the modulation of posterior alpha band activity (8–12 Hz). Male and female human participants performed a visual search task in which a target was occasionally presented alongside a color-singleton distractor. Unbeknown to the participants, the distracting stimuli were presented with different probabilities across the two hemifields. RIFT analysis showed that early visual cortex exhibited reduced neural excitability in the prestimulus interval at retinotopic locations associated with higher distractor probabilities. In contrast, we did not find any evidence of expectation-driven distractor suppression in alpha band activity. These findings indicate that proactive mechanisms of attention are involved in predictive distractor suppression and that these mechanisms are associated with altered neural excitability in early visual cortex. Moreover, our findings indicate that RIFT and alpha band activity might subtend different and possibly independent attentional mechanisms. |
M. N. Hebart; O. Contier; L. Teichmann; A. H. Rockter; C. Y. Zheng; A. Kidder; A. Corriveau; M. Vaziri-Pashkam; C. I. Baker THINGS-data, a multimodal collection of large-scale datasets for investigating object representations in human brain and behavior Journal Article In: eLife, vol. 12, pp. 1–37, 2023. @article{Hebart2023,Understanding object representations requires a broad, comprehensive sampling of the objects in our visual world with dense measurements of brain activity and behavior. Here we present THINGS-data, a multimodal collection of large-scale neuroimaging and behavioral datasets in humans, comprising densely-sampled functional MRI and magnetoencephalographic recordings, as well as 4.70 million similarity judgments in response to thousands of photographic images for up to 1,854 object concepts. THINGS-data is unique in its breadth of richly-annotated objects, allowing for testing countless hypotheses at scale while assessing the reproducibility of previous findings. Beyond the unique insights promised by each individual dataset, the multimodality of THINGS-data allows combining datasets for a much broader view into object processing than previously possible. Our analyses demonstrate the high quality of the datasets and provide five examples of hypothesis-driven and data-driven applications. THINGS-data constitutes the core public release of the THINGS initiative (https://things-initiative.org) for bridging the gap between disciplines and the advancement of cognitive neuroscience. |
Fumiaki Iwane; Debadatta Dash; Roberto F. Salamanca-Giron; William Hayward; Marlene Bönstrup; Ethan R. Buch; Leonardo G. Cohen Combined low-frequency brain oscillatory activity and behavior predict future errors in human motor skill Journal Article In: Current Biology, vol. 33, no. 15, pp. 3145–3154, 2023. @article{Iwane2023,Human skills are composed of sequences of individual actions performed with utmost precision. When occasional errors occur, they may have serious consequences, for example, when pilots are manually landing a plane. In such cases, the ability to predict an error before it occurs would clearly be advantageous. Here, we asked whether it is possible to predict future errors in a keyboard procedural human motor skill. We report that prolonged keypress transition times (KTTs), reflecting slower speed, and anomalous delta-band oscillatory activity in cingulate-entorhinal-precuneus brain regions precede upcoming errors in skill. Combined anomalous low-frequency activity and prolonged KTTs predicted up to 70% of future errors. Decoding strength (posterior probability of error) increased progressively approaching the errors. We conclude that it is possible to predict future individual errors in skill sequential performance. |
I. M. Dushyanthi Karunathilake; Jason L. Dunlap; Janani Perera; Alessandro Presacco; Lien Decruy; Samira Anderson; Stefanie E. Kuchinsky; Jonathan Z. Simon Effects of aging on cortical representations of continuous speech Journal Article In: Journal of Neurophysiology, vol. 129, no. 6, pp. 1359–1377, 2023. @article{Karunathilake2023,Understanding speech in a noisy environment is crucial in day-to-day interactions and yet becomes more challenging with age, even for healthy aging. Age-related changes in the neural mechanisms that enable speech-in-noise listening have been investigated previously; however, the extent to which age affects the timing and fidelity of encoding of target and interfering speech streams is not well understood. Using magnetoencephalography (MEG), we investigated how continuous speech is represented in auditory cortex in the presence of interfering speech in younger and older adults. Cortical representations were obtained from neural responses that time-locked to the speech envelopes with speech envelope reconstruction and temporal response functions (TRFs). TRFs showed three prominent peaks corresponding to auditory cortical processing stages: early (∼50 ms), middle (∼100 ms), and late (∼200 ms). Older adults showed exaggerated speech envelope representations compared with younger adults. Temporal analysis revealed both that the age-related exaggeration starts as early as ∼50 ms and that older adults needed a substantially longer integration time window to achieve their better reconstruction of the speech envelope. As expected, with increased speech masking envelope reconstruction for the attended talker decreased and all three TRF peaks were delayed, with aging contributing additionally to the reduction. Interestingly, for older adults the late peak was delayed, suggesting that this late peak may receive contributions from multiple sources. Together these results suggest that there are several mechanisms at play compensating for age-related temporal processing deficits at several stages but which are not able to fully reestablish unimpaired speech perception. |
Tamas Minarik; Barbara Berger; Ole Jensen Optimal parameters for rapid (invisible) frequency tagging using MEG Journal Article In: NeuroImage, vol. 281, pp. 1–16, 2023. @article{Minarik2023,Frequency tagging has been demonstrated to be a useful tool for identifying representational-specific neuronal activity in the auditory and visual domains. However, the slow flicker (<30 Hz) applied in conventional frequency tagging studies is highly visible and might entrain endogenous neuronal oscillations. Hence, stimulation at faster frequencies that is much less visible and does not interfere with endogenous brain oscillatory activity is a promising new tool. In this study, we set out to examine the optimal stimulation parameters of rapid frequency tagging (RFT/RIFT) with magnetoencephalography (MEG) by quantifying the effects of stimulation frequency, size and position of the flickering patch. Rapid frequency tagging using flickers above 50 Hz results in almost invisible stimulation which does not interfere with slower endogenous oscillations; however, the signal is weaker as compared to tagging at slower frequencies so certainty over the optimal parameters of stimulation delivery are crucial. The here presented results examining the frequency range between 60 Hz and 96 Hz suggest that RFT induces brain responses with decreasing strength up to about 84 Hz. In addition, even at the smallest flicker patch (2°) focally presented RFT induces a significant and measurable oscillatory brain signal (steady state visual evoked potential/field, SSVEP/F) at the stimulation frequency (66 Hz); however, the elicited response increases with patch size. While focal RFT presentation elicits the strongest response, off-centre presentations do generally mainly elicit a measureable response if presented below the horizontal midline. Importantly, the results also revealed considerable individual differences in the neuronal responses to RFT stimulation. Finally, we discuss the comparison of oscillatory measures (coherence and power) and sensor types (planar gradiometers and magnetometers) in order to achieve optimal outcomes. Based on our extensive findings we set forward concrete recommendations for using rapid frequency tagging in human cognitive neuroscience investigations. |
2022 |
Susana Mouga; Isabel Catarina Duarte; Cátia Café; Daniela Sousa; Frederico Duque; Guiomar Oliveira; Miguel Castelo-Branco Parahippocampal deactivation and hyperactivation of central executive, saliency and social cognition networks in autism spectrum disorder Journal Article In: Journal of Neurodevelopmental Disorders, vol. 14, no. 9, pp. 1–12, 2022. @article{Mouga2022,Background: The concomitant role of the Central Executive, the Saliency and the Social Cognition networks in autism spectrum disorder (ASD) in demanding ecological tasks remains unanswered. We addressed this question using a novel task-based fMRI virtual-reality task mimicking a challenging daily-life chore that may present some difficulties to individuals with ASD: the EcoSupermarketX. Methods: Participants included 29 adolescents: 15 with ASD and 15 with typical neurodevelopment (TD). They performed the EcoSupermarketX (a shopping simulation with three goal-oriented sub-tasks including “no cue”, “non-social” or “social” cues), during neuroimaging and eye-tracking. Results: ASD differed from TD only in total time and distance to complete the “social cue” sub-task with matched eye-tracking measures. Neuroimaging revealed simultaneous hyperactivation across social, executive, and saliency circuits in ASD. In contrast, ASD showed reduced activation in the parahippocampal gyrus, involved in scene recognition. Conclusions: When performing a virtual shopping task matching the performance of controls, ASD adolescents hyperactivate three core networks: executive, saliency and social cognition. Parahippocampal hypoactivation is consistent with effortless eidetic scene processing, in line with the notion of peaks and valleys of neural recruitment in individuals with ASD. These hyperactivation/hypoactivation patterns in daily life tasks provide a circuit-level signature of neural diversity in ASD, a possible intervention target. |
Poppy Sharp; Tjerk Gutteling; David Melcher; Clayton Hickey Spatial attention tunes temporal processing in early visual cortex by speeding and slowing alpha oscillations Journal Article In: Journal of Neuroscience, vol. 42, no. 41, pp. 7824–7832, 2022. @article{Sharp2022,The perception of dynamic visual stimuli relies on two apparently conflicting perceptual mechanisms: rapid visual input must sometimes be integrated into unitary percepts but at other times must be segregated or parsed into separate objects or events. Though they have opposite effects on our perceptual experience, the deployment of spatial attention benefits both operations. Little is known about the neural mechanisms underlying this impact of spatial attention on temporal perception. Here, we record magnetoencephalography (MEG) in male and female humans to demonstrate that the deployment of spatial attention for the purpose of segregating or integrating visual stimuli impacts prestimulus oscillatory activity in retinotopic visual brain areas where the attended location is represented. Alpha band oscillations contralateral to an attended location are therefore faster than ipsilateral oscillations when stimuli appearing at this location will need to be segregated, but slower in expectation of the need for integration, consistent with the idea that a frequency is linked to perceptual sampling rate. These results demonstrate a novel interaction between temporal visual processing and the allocation of attention in space. |
Jordana S. Wynn; Zhong-Xu Liu; Jennifer D. Ryan Neural correlates of subsequent memory-related gaze reinstatement Journal Article In: Journal of Cognitive Neuroscience, vol. 34, no. 9, pp. 1547–1562, 2022. @article{Wynn2022,Mounting evidence linking gaze reinstatement—the recapitulation of encoding-related gaze patterns during retrieval—to behavioral measures of memory suggests that eye movements play an important role in mnemonic processing. Yet, the nature of the gaze scanpath, including its informational content and neural correlates, has remained in question. In this study, we examined eye movement and neural data from a recognition memory task to further elucidate the behavioral and neural bases of functional gaze reinstatement. Consistent with previous work, gaze reinstatement during retrieval of freely viewed scene images was greater than chance and predictive of recognition memory performance. Gaze reinstatement was also associated with viewing of informationally salient image regions at encoding, suggesting that scanpaths may encode and contain high-level scene content. At the brain level, gaze reinstatement was predicted by encoding-related activity in the occipital pole and BG, neural regions associated with visual processing and oculomotor control. Finally, cross-voxel brain pattern similarity analysis revealed overlapping subsequent memory and subsequent gaze reinstatement modulation effects in the parahippocampal place area and hippocampus, in addition to the occipital pole and BG. Together, these findings suggest that encoding-related activity in brain regions associated with scene processing, oculomotor control, and memory supports the formation, and subsequent recapitulation, of functional scanpaths. More broadly, these findings lend support to Scanpath Theory's assertion that eye movements both encode, and are themselves embedded in, mnemonic representations. |
Christoph Helmchen; Philipp J. Koch; Gabriel Girard; Norbert Brüggemann; Björn Machner; Andreas Sprenger NPTX1-related oculomotor apraxia: An intra-hemispheric disconnection disorder Journal Article In: Journal of Neurology, vol. 269, no. 7, pp. 3931–3936, 2022. @article{Helmchen2022a,Oculomotor apraxia (OMA) is a rare and heavily disabling neurological disorder causing severe difficulties in the initia- tion and maintenance of voluntary eye movements when the head is stationary. If patients try to initiate saccades, they are grossly delayed and hypometric (stair-case). .. The aim of this study was to test competing pathophysiological hypotheses by functional and structural MRI, stating that OMA is related to either abnormal (i) inter-hemispheric or (ii) intra-hemispheric connectivity between the FEF and related oculomotor structures (oculomotor network) or (iii) both mechanisms. |
Angela Radetz; Markus Siegel Spectral fingerprints of cortical neuromodulation Journal Article In: Journal of Neuroscience, vol. 42, no. 18, pp. 3836–3846, 2022. @article{Radetz2022,Pupil size has been established as a versatile marker of noradrenergic and cholinergic neuromodulation, which has profound effects on neuronal processing, cognition, and behavior. However, little is known about the cortical control and effects of pupil-linked neuromodulation. Here, we show that pupil dynamics are tightly coupled to temporally, spectrally, and spatially specific modulations of local and large-scale cortical population activity in the human brain. We quantified the dynamics of band-limited cortical population activity in resting human subjects using magnetoencephalography and investigated how neural dynamics were linked to simultaneously recorded pupil dynamics. Our results show that pupil-linked neuromodulation does not merely affect cortical population activity in a stereotypical fashion. Instead, we identified three frontal, precentral, and occipitoparietal networks, in which local population activity with distinct spectral profiles in the theta, beta, and alpha bands temporally preceded and followed changes in pupil size. Furthermore, we found that amplitude coupling at;16 Hz in a large-scale frontoparietal network predicted pupil dynamics. Our results unravel network-specific spectral fingerprints of cortical neuromodulation in the human brain that likely reflect both the causes and effects of neuromodulation. |
Thomas Pfeffer; Christian Keitel; Daniel S. Kluger; Anne Keitel; Alena Russmann; Gregor Thut; Tobias H. Donner; Joachim Gross Coupling of pupil-and neuronal population dynamics reveals diverse influences of arousal on cortical processing Journal Article In: eLife, vol. 11, pp. 1–28, 2022. @article{Pfeffer2022,Fluctuations in arousal, controlled by subcortical neuromodulatory systems, continuously shape cortical state, with profound consequences for information processing. Yet, how arousal signals influence cortical population activity in detail has so far only been characterized for a few selected brain regions. Traditional accounts conceptualize arousal as a homogeneous modulator of neural population activity across the cerebral cortex. Recent insights, however, point to a higher specificity of arousal effects on different components of neural activity and across cortical regions. Here, we provide a comprehensive account of the relationships between fluctuations in arousal and neuronal population activity across the human brain. Exploiting the established link between pupil size and central arousal systems, we performed concurrent magnetoencephalographic (MEG) and pupillographic recordings in a large number of participants, pooled across three laboratories. We found a cascade of effects relative to the peak timing of spontaneous pupil dilations: Decreases in low-frequency (2–8 Hz) activity in temporal and lateral frontal cortex, followed by increased highfrequency (>64 Hz) activity in mid-frontal regions, followed by monotonic and inverted U relationships with intermediate frequency-range activity (8–32 Hz) in occipito-parietal regions. Pupil-linked arousal also coincided with widespread changes in the structure of the aperiodic component of cortical population activity, indicative of changes in the excitation-inhibition balance in underlying microcircuits. Our results provide a novel basis for studying the arousal modulation of cognitive computations in cortical circuits. |
Kati Roesmann; Ida Wessing; Sophia Kraß; Elisabeth J. Leehr; Tim Klucken; Thomas Straube; Markus Junghöfer Developmental aspects of fear generalization – A MEG study on neurocognitive correlates in adolescents versus adults Journal Article In: Developmental Cognitive Neuroscience, vol. 58, pp. 1–12, 2022. @article{Roesmann2022,Background: Fear generalization is pivotal for the survival-promoting avoidance of potential danger, but, if too pronounced, it promotes pathological anxiety. Similar to adult patients with anxiety disorders, healthy children tend to show overgeneralized fear responses. Objective: This study aims to investigate neuro-developmental aspects of fear generalization in adolescence – a critical age for the development of anxiety disorders. Methods: We compared healthy adolescents (14–17 years) with healthy adults (19–34 years) regarding their fear responses towards tilted Gabor gratings (conditioned stimuli, CS; and slightly differently titled generalization stimuli, GS). In the conditioning phase, CS were paired (CS+) or remained unpaired (CS-) with an aversive stimulus (unconditioned stimuli, US). In the test phase, behavioral, peripheral and neural responses to CS and GS were captured by fear- and UCS expectancy ratings, a perceptual discrimination task, pupil dilation and source estimations of event-related magnetic fields. Results: Closely resembling adults, adolescents showed robust generalization gradients of fear ratings, pupil dilation, and estimated neural source activity. However, in the UCS expectancy ratings, adolescents revealed shallower generalization gradients indicating overgeneralization. Moreover, adolescents showed stronger visual cortical activity after as compared to before conditioning to all stimuli. Conclusion: Various aspects of fear learning and generalization appear to be mature in healthy adolescents. Yet, cognitive aspects might show a slower course of development. |
Benjamin J. Stauch; Alina Peter; Isabelle Ehrlich; Zora Nolte; Pascal Fries Human visual gamma for color stimuli Journal Article In: eLife, vol. 11, pp. 1–18, 2022. @article{Stauch2022,Strong gamma-band oscillations in primate early visual cortex can be induced by homogeneous color surfaces (Peter et al., 2019; Shirhatti and Ray, 2018). Compared to other hues, particularly strong gamma oscillations have been reported for red stimuli. However, precortical color processing and the resultant strength of input to V1 have often not been fully controlled for. Therefore, stronger responses to red might be due to differences in V1 input strength. We presented stimuli that had equal luminance and cone contrast levels in a color coordinate system based on responses of the lateral geniculate nucleus, the main input source for area V1. With these stimuli, we recorded magnetoencephalography in 30 human participants. We found gamma oscillations in early visual cortex which, contrary to previous reports, did not differ between red and green stimuli of equal L-M cone contrast. Notably, blue stimuli with contrast exclusively on the S-cone axis induced very weak gamma responses, as well as smaller event-related fields and poorer change-detection performance. The strength of human color gamma responses for stimuli on the L-M axis could be well explained by L-M cone contrast and did not show a clear red bias when L-M cone contrast was properly equalized. |
Lina Teichmann; Denise Moerel; Anina N. Rich; Chris I. Baker The nature of neural object representations during dynamic occlusion Journal Article In: Cortex, vol. 153, pp. 66–86, 2022. @article{Teichmann2022,Objects disappearing briefly from sight due to occlusion is an inevitable occurrence in everyday life. Yet we generally have a strong experience that occluded objects continue to exist, despite the fact that they objectively disappear. This indicates that neural object representations must be maintained during dynamic occlusion. However, it is unclear what the nature of such representation is and in particular whether it is perception-like or more abstract, for example, reflecting limited features such as position or movement direction only. In this study, we address this question by examining how different object features such as object shape, luminance, and position are represented in the brain when a moving object is dynamically occluded. We apply multivariate decoding methods to Magnetoencephalography (MEG) data to track how object representations unfold over time. Our methods allow us to contrast the representations of multiple object features during occlusion and enable us to compare the neural responses evoked by visible and occluded objects. The results show that object position information is represented during occlusion to a limited extent while object identity features are not maintained through the period of occlusion. Together, this suggests that the nature of object representations during dynamic occlusion is different from visual representations during perception. |
Stephen Whitmarsh; Christophe Gitton; Veikko Jousmäki; Jérôme Sackur; Catherine Tallon-Baudry Neuronal correlates of the subjective experience of attention Journal Article In: European Journal of Neuroscience, vol. 55, no. 11-12, pp. 3465–3482, 2022. @article{Whitmarsh2022,The effect of top–down attention on stimulus-evoked responses and alpha oscillations and the association between arousal and pupil diameter are well established. However, the relationship between these indices, and their contribution to the subjective experience of attention, remains largely unknown. Participants performed a sustained (10–30 s) attention task in which rare (10%) targets were detected within continuous tactile stimulation (16 Hz). Trials were followed by attention ratings on an 8-point visual scale. Attention ratings correlated negatively with contralateral somatosensory alpha power and positively with pupil diameter. The effect of pupil diameter on attention ratings extended into the following trial, reflecting a sustained aspect of attention related to vigilance. The effect of alpha power did not carry over to the next trial and furthermore mediated the association between pupil diameter and attention ratings. Variations in steady-state amplitude reflected stimulus processing under the influence of alpha oscillations but were only weakly related to subjective ratings of attention. Together, our results show that both alpha power and pupil diameter are reflected in the subjective experience of attention, albeit on different time spans, while continuous stimulus processing might not contribute to the experience of attention. |
Anne E. Urai; Tobias H. Donner Persistent activity in human parietal cortex mediates perceptual choice repetition bias Journal Article In: Nature Communications, vol. 13, no. 1, pp. 1–15, 2022. @article{Urai2022,Humans and other animals tend to repeat or alternate their previous choices, even when judging sensory stimuli presented in a random sequence. It is unclear if and how sensory, associative, and motor cortical circuits produce these idiosyncratic behavioral biases. Here, we combined behavioral modeling of a visual perceptual decision with magnetoencephalographic (MEG) analyses of neural dynamics, across multiple regions of the human cerebral cortex. We identified distinct history-dependent neural signals in motor and posterior parietal cortex. Gamma-band activity in parietal cortex tracked previous choices in a sustained fashion, and biased evidence accumulation toward choice repetition; sustained beta-band activity in motor cortex inversely reflected the previous motor action, and biased the accumulation starting point toward alternation. The parietal, not motor, signal mediated the impact of previous on current choice and reflected individual differences in choice repetition. In sum, parietal cortical signals seem to play a key role in shaping choice sequences. |
Mats W. J. Es; Tom R. Marshall; Eelke Spaak; Ole Jensen; Jan-Mathijs Schoffelen Phasic modulation of visual representations during sustained attention Journal Article In: European Journal of Neuroscience, vol. 55, no. 11-12, pp. 3191–3208, 2022. @article{Es2022,Sustained attention has long been thought to benefit perception in a continuous fashion, but recent evidence suggests that it affects perception in a discrete, rhythmic way. Periodic fluctuations in behavioral performance over time, and modulations of behavioral performance by the phase of spontaneous oscillatory brain activity point to an attentional sampling rate in the theta or alpha frequency range. We investigated whether such discrete sampling by attention is reflected in periodic fluctuations in the decodability of visual stimulus orientation from magnetoencephalographic (MEG) brain signals. In this exploratory study, human subjects attended one of the two grating stimuli, while MEG was being recorded. We assessed the strength of the visual representation of the attended stimulus using a support vector machine (SVM) to decode the orientation of the grating (clockwise vs. counterclockwise) from the MEG signal. We tested whether decoder performance depended on the theta/alpha phase of local brain activity. While the phase of ongoing activity in the visual cortex did not modulate decoding performance, theta/alpha phase of activity in the frontal eye fields and parietal cortex, contralateral to the attended stimulus did modulate decoding performance. These findings suggest that phasic modulations of visual stimulus representations in the brain are caused by frequency-specific top-down activity in the frontoparietal attention network, though the behavioral relevance of these effects could not be established. |
Aspen H. Yoo; Alfredo Bolaños; Grace E. Hallenbeck; Masih Rahmati; Thomas C. Sprague; Clayton E. Curtis Behavioral prioritization enhances working memory precision and neural population gain Journal Article In: Journal of Cognitive Neuroscience, vol. 34, no. 2, pp. 365–379, 2022. @article{Yoo2022,Humans allocate visual working memory (WM) resource according to behavioral relevance, resulting in more precise memories for more important items. Theoretically, items may be maintained by feature-tuned neural populations, where the relative gain of the populations encoding each item determines precision. To test this hypothesis, we compared the amplitudes of delay period activity in the different parts of retinotopic maps representing each of several WM items, predicting the amplitudes would track behavioral priority. Using fMRI, we scanned participants while they remembered the location of multiple items over a WM delay and then reported the location of one probed item using a memory-guided saccade. Importantly, items were not equally probable to be probed (0.6, 0.3, 0.1, 0.0), which was indicated with a precue. We analyzed fMRI activity in 10 visual field maps in occipital, parietal, and frontal cortex known to be important for visual WM. In early visual cortex, but not association cortex, the amplitude of BOLD activation within voxels corresponding to the retinotopic location of visual WM items increased with the priority of the item. Interestingly, these results were contrasted with a common finding that higher-level brain regions had greater delay period activity, demonstrating a dissociation between the absolute amount of activity in a brain area and the activity of different spatially selective populations within it. These results suggest that the distribution of WM resources according to priority sculpts the relative gains of neural populations that encode items, offering a neural mechanism for how prioritization impacts memory precision. |
Farnaz Zamani Esfahlani; Lisa Byrge; Jacob Tanner; Olaf Sporns; Daniel P. Kennedy; Richard F. Betzel Edge-centric analysis of time-varying functional brain networks with applications in autism spectrum disorder Journal Article In: NeuroImage, vol. 263, pp. 1–12, 2022. @article{ZamaniEsfahlani2022,The interaction between brain regions changes over time, which can be characterized using time-varying functional connectivity (tvFC). The common approach to estimate tvFC uses sliding windows and offers limited temporal resolution. An alternative method is to use the recently proposed edge-centric approach, which enables the tracking of moment-to-moment changes in co-fluctuation patterns between pairs of brain regions. Here, we first examined the dynamic features of edge time series and compared them to those in the sliding window tvFC (sw-tvFC). Then, we used edge time series to compare subjects with autism spectrum disorder (ASD) and healthy controls (CN). Our results indicate that relative to sw-tvFC, edge time series captured rapid and bursty network-level fluctuations that synchronize across subjects during movie-watching. The results from the second part of the study suggested that the magnitude of peak amplitude in the collective co-fluctuations of brain regions (estimated as root sum square (RSS) of edge time series) is similar in CN and ASD. However, the trough-to-trough duration in RSS signal is greater in ASD, compared to CN. Furthermore, an edge-wise comparison of high-amplitude co-fluctuations showed that the within-network edges exhibited greater magnitude fluctuations in CN. Our findings suggest that high-amplitude co-fluctuations captured by edge time series provide details about the disruption of functional brain dynamics that could potentially be used in developing new biomarkers of mental disorders. |
Bo Zhang; Yuji Naya A dataset of human fMRI/MEG experiments with eye tracking for spatial memory research using virtual reality Journal Article In: Data in Brief, vol. 43, pp. 1–8, 2022. @article{Zhang2022a,A dataset consisting of whole-brain fMRI (functional magnetic resonance imaging)/MEG (magnetoencephalography) images, eye tracking files, and behavioral records from healthy adult human participants when they performed a spatial-memory paradigm in a virtual environment was collected to investigate the neural representation of the cognitive map defined by unique spatial relationship of three objects, as well as the neural dynamics of the cognitive map following the task demand from localizing self-location to remembering the target location relative to the self-body. The dataset, including both fMRI and MEG, was also used to investigate the neural networks involved in representing a target within and outside the visual field. The dataset included 19 and 12 university students at Peking University for fMRI and MEG experiments, respectively (fMRI: 12 women, 7 men; MEG: 4 women, 8 men). The average ages of those participants were 24.9 years (MRI: 18–30 years) and 22.5 years (MEG: 19–25 years), respectively. fMRI BOLD and T1-weighted images were acquired using a 3T Siemens Prisma scanner (Siemens, Erlangen, Germany) equipped with a 20-channel receiver head coil. MEG neuromagnetic data were acquired using a 275-channel MEG system (CTF MEG, Canada). The dataset could be further used to investigate a range of neural mechanisms involved in human spatial cognition or to develop a bioinspired deep neural network to enhance machines' abilities in spatial processing. |
Ying Zhou; Clayton E. Curtis; Kartik K. Sreenivasan; Daryl Fougnie Common neural mechanisms control attention and working memory Journal Article In: Journal of Neuroscience, vol. 42, no. 37, pp. 7110–7120, 2022. @article{Zhou2022h,Although previous studies point to qualitative similarities between working memory (WM) and attention, the degree to which these two constructs rely on shared neural mechanisms remains unknown. Focusing on one such potentially shared mechanism, we tested the hypothesis that selecting an item within WM utilizes similar neural mechanisms as selecting a visible item via a shift of attention. We used fMRI and machine learning to decode both the selection among items visually available and the selection among items stored in WM in human subjects (both sexes). Patterns of activity in visual, parietal, and to a lesser extent frontal cortex predicted the locations of the selected items. Critically, these patterns were strikingly interchangeable; classifiers trained on data during attentional selection predicted selection from WM, and classifiers trained on data during selection from memory predicted attentional selection. Using models of voxel receptive fields, we visualized topographic population activity that revealed gain enhancements at the locations of the externally and internally selected items. Our results suggest that selecting among perceived items and selecting among items in WM share a common mechanism. This common mechanism, analogous to a shift of spatial attention, controls the relative gains of neural populations that encode behaviorally relevant information. |
Kristijan Armeni; Umut Güçlü; Marcel Gerven; Jan-Mathijs Schoffelen A 10-hour within-participant magnetoencephalography narrative dataset to test models of language comprehension Journal Article In: Scientific Data, vol. 9, pp. 1–18, 2022. @article{Armeni2022,Recently, cognitive neuroscientists have increasingly studied the brain responses to narratives. At the same time, we are witnessing exciting developments in natural language processing where large-scale neural network models can be used to instantiate cognitive hypotheses in narrative processing. Yet, they learn from text alone and we lack ways of incorporating biological constraints during training. To mitigate this gap, we provide a narrative comprehension magnetoencephalography (MEG) data resource that can be used to train neural network models directly on brain data. We recorded from 3 participants, 10 separate recording hour-long sessions each, while they listened to audiobooks in English. After story listening, participants answered short questions about their experience. To minimize head movement, the participants wore MEG-compatible head casts, which immobilized their head position during recording. We report a basic evoked-response analysis showing that the responses accurately localize to primary auditory areas. The responses are robust and conserved across 10 sessions for every participant. We also provide usage notes and briefly outline possible future uses of the resource. |
Sven Braeutigam; Jessica Clare Scaife; Tipu Aziz; Rebecca J. Park A longitudinal magnetoencephalographic study of the effects of deep brain stimulation on neuronal dynamics in severe anorexia nervosa Journal Article In: Frontiers in Behavioral Neuroscience, vol. 16, pp. 1–12, 2022. @article{Braeutigam2022,Anorexia Nervosa (AN) is a debilitating psychiatric disorder characterized by the relentless pursuit of thinness, leading to severe emaciation. Magnetoencephalography (MEG)was used to record the neuronal response in seven patients with treatment-resistant AN while completing a disorder-relevant food wanting task. The patients underwent a 15-month protocol, where MEG scans were conducted pre-operatively, post-operatively prior to deep brain stimulation (DBS) switch on, twice during a blind on/off month and at protocol end. Electrodes were implanted bilaterally into the nucleus accumbens with stimulation at the anterior limb of the internal capsule using rechargeable implantable pulse generators. Three patients met criteria as responders at 12 months of stimulation, showing reductions of eating disorder psychopathology of over 35%. An increase in alpha power, as well as evoked power at latencies typically associated with visual processing, working memory, and contextual integration was observed in ON compared to OFF sessions across all seven patients. Moreover, an increase in evoked power at P600-like latencies as well as an increase in γ-band phase-locking over anterior-to-posterior regions were observed for high- compared to low-calorie food image only in ON sessions. These findings indicate that DBS modulates neuronal process in regions far outside the stimulation target site and at latencies possibly reflecting task specific processing, thereby providing further evidence that deep brain stimulation can play a role in the treatment of otherwise intractable psychiatric disorders. |
Marion Brickwedde; Yulia Bezsudnova; Anna Kowalczyk; Ole Jensen; Alexander Zhigalov Application of rapid invisible frequency tagging for brain computer interfaces Journal Article In: Journal of Neuroscience Methods, vol. 382, pp. 1–9, 2022. @article{Brickwedde2022,Background: Brain-computer interfaces (BCI) based on steady-state visual evoked potentials (SSVEPs/SSVEFs) are among the most commonly used BCI systems. They require participants to covertly attend to visual objects flickering at specified frequencies. The attended location is decoded online by analysing the power of neuronal responses at the flicker frequency. New method: We implemented a novel rapid invisible frequency-tagging technique, utilizing a state-of-the-art projector with refresh rates of up to 1440 Hz. We flickered the luminance of visual objects at 56 and 60 Hz, which was invisible to participants but produced strong neuronal responses measurable with magnetoencephalography (MEG). The direction of covert attention, decoded from frequency-tagging responses, was used to control an online BCI PONG game. Results: Our results show that seven out of eight participants were able to play the pong game controlled by the frequency-tagging signal, with average accuracies exceeding 60 %. Importantly, participants were able to modulate the power of the frequency-tagging response within a 1-second interval, while only seven occipital sensors were required to reliably decode the neuronal response. Comparison with existing methods: In contrast to existing SSVEP-based BCI systems, rapid frequency-tagging does not produce a visible flicker. This extends the time-period participants can use it without fatigue, by avoiding distracting visual input. Furthermore, higher frequencies increase the temporal resolution of decoding, resulting in higher communication rates. Conclusion: Using rapid invisible frequency-tagging opens new avenues for fundamental research and practical applications. In combination with novel optically pumped magnetometers (OPMs), it could facilitate the development of high-speed and mobile next-generation BCI systems. |
Marwa El Zein; Ray J. Dolan; Bahador Bahrami Shared responsibility decreases the sense of agency in the human brain Journal Article In: Journal of Cognitive Neuroscience, vol. 34, pp. 2065–2081, 2022. @article{ElZein2022,Sharing responsibility in social decision-making helps individuals use the flexibility of the collective context to benefit them-selves by claiming credit for good outcomes or avoiding the blame for bad outcomes. Using magnetoencephalography, we examined the neuronal basis of the impact that social context has on this flexible sense of responsibility. Participants performed a gambling task in various social contexts and reported feeling less responsibility when playing as a member of a team. A reduced magnetoencephalography outcome processing effect was observed as a function of decreasing responsibility at 200 msec post outcome onset and was centered over parietal, central, and frontal brain regions. Before outcome revelation in socially made decisions, an attenuated motor preparation signature at 500 msec after stimulus onset was found. A boost in reported responsibility for positive outcomes in social contexts was associated with increased activity in regions related to social and reward processing. Together, these results show that sharing responsibility with others reduces agency, influencing pre-outcome motor preparation and post-outcome processing, and provides opportunities to flexibly claim credit for positive outcomes. |
Hesham A. Elshafei; Corinne Orlemann; Saskia Haegens The impact of eye closure on anticipatory α activity in a tactile discrimination task Journal Article In: eNeuro, vol. 9, no. 1, pp. 1–11, 2022. @article{Elshafei2022,One of the very first observations made regarding α oscillations (8–14 Hz), is that they increase in power over posterior areas when awake participants close their eyes. Recent work, especially in the context of (spatial) attention, suggests that α activity reflects a mechanism of functional inhibition. However, it remains unclear how eye closure impacts anticipatory α modulation observed in attention paradigms, and how this affects subsequent behavioral performance. Here, we recorded magnetoencephalography (MEG) in 33 human participants performing a tactile discrimination task with their eyes open versus closed. We replicated the hallmarks of previous somatosensory spatial attention studies: α lateralization across the somatosensory cortices as well as α increase over posterior (visual) regions. Furthermore, we found that eye closure leads to (1) reduced task performance; (2) widespread increase in α power; and (3) reduced anticipatory visual α modulation (4) with no effect on somatosensory α lateralization. Regardless of whether participants had their eyes open or closed, increased visual α power and somatosensory α lateralization improved their performance. Thus, we provide evidence that eye closure does not alter the impact of anticipatory α modulations on behavioral performance. We propose there is an optimal visual α level for somatosensory task performance, which can be achieved through a combination of eye closure and top-down anticipatory attention. |
Erin Goddard; Thomas A. Carlson; Alexandra Woolgar Spatial and feature-selective attention have distinct, interacting effects on population-level tuning Journal Article In: Journal of Cognitive Neuroscience, vol. 34, no. 2, pp. 290–312, 2022. @article{Goddard2022,Attention can be deployed in different ways: When searching for a taxi in New York City, we can decide where to attend (e.g., to the street) and what to attend to (e.g., yellow cars). Although we use the same word to describe both processes, nonhuman primate data suggest that these produce distinct effects on neural tuning. This has been challenging to assess in humans, but here we used an opportunity afforded by multivariate decoding of MEG data. We found that attending to an object at a particular location and attending to a particular object feature produced effects that interacted multiplicatively. The two types of attention induced distinct patterns of enhancement in occipital cortex, with feature-selective attention producing relatively more enhancement of small feature differences and spatial attention producing relatively larger effects for larger feature differences. An information flow analysis further showed that stimulus representations in occipital cortex were Granger-caused by coding in frontal cortices earlier in time and that the timing of this feedback matched the onset of attention effects. The data suggest that spatial and feature-selective attention rely on distinct neural mechanisms that arise from frontal-occipital information exchange, interacting multiplicatively to selectively enhance task-relevant information. |
Tjerk P. Gutteling; Lonieke Sillekens; Nilli Lavie; Ole Jensen Alpha oscillations reflect suppression of distractors with increased perceptual load Journal Article In: Progress in Neurobiology, vol. 214, pp. 1–13, 2022. @article{Gutteling2022,Attention serves an essential role in cognition and behavior allowing us to focus on behaviorally-relevant objects while ignoring distraction. Perceptual load theory states that attentional resources are allocated according to the requirements of the task, i.e., its ‘load'. The theory predicts that the resources left to process irrelevant, possibly distracting stimuli, are reduced when the perceptual load is high. However, it remains unclear how this allocation of attentional resources specifically relates to neural excitability and suppression mechanisms. In this magnetoencephalography (MEG) study, we show that brain oscillations in the alpha band (8–13 Hz) implemented the suppression of distracting objects when the perceptual load was high. In parallel, high load increased the neuronal excitability for target objects, as reflected by rapid invisible frequency tagging. We suggest that the allocation of resources in tasks with high perceptual load is implemented by a gain increase for targets, complemented by distractor suppression reflected by alpha-band oscillations closing the ‘gate' for interference. |
Katherine L. Hermann; Shridhar R. Singh; Isabelle A. Rosenthal; Dimitrios Pantazis; Bevil R. Conway Temporal dynamics of the neural representation of hue and luminance polarity Journal Article In: Nature Communications, vol. 13, pp. 1–19, 2022. @article{Hermann2022,Hue and luminance contrast are basic visual features. Here we use multivariate analyses of magnetoencephalography data to investigate the timing of the neural computations that extract them, and whether they depend on common neural circuits. We show that hue and luminance-contrast polarity can be decoded from MEG data and, with lower accuracy, both features can be decoded across changes in the other feature. These results are consistent with the existence of both common and separable neural mechanisms. The decoding time course is earlier and more temporally precise for luminance polarity than hue, a result that does not depend on task, suggesting that luminance contrast is an updating signal that separates visual events. Meanwhile, cross-temporal generalization is slightly greater for representations of hue compared to luminance polarity, providing a neural correlate of the preeminence of hue in perceptual grouping and memory. Finally, decoding of luminance polarity varies depending on the hues used to obtain training and testing data. The pattern of results is consistent with observations that luminance contrast is mediated by both L-M and S cone sub-cortical mechanisms. |
Ilmari Kurki; Aapo Hyvärinen; Linda Henriksson Dynamics of retinotopic spatial attention revealed by multifocal MEG Journal Article In: NeuroImage, vol. 263, pp. 1–13, 2022. @article{Kurki2022,Visual focal attention is both fast and spatially localized, making it challenging to investigate using human neuroimaging paradigms. Here, we used a new multivariate multifocal mapping method with magnetoencephalography (MEG) to study how focal attention in visual space changes stimulus-evoked responses across the visual field. The observer's task was to detect a color change in the target location, or at the central fixation. Simultaneously, 24 regions in visual space were stimulated in parallel using an orthogonal, multifocal mapping stimulus sequence. First, we used univariate analysis to estimate stimulus-evoked responses in each channel. Then we applied multivariate pattern analysis to look for attentional effects on the responses. We found that attention to a target location causes two spatially and temporally separate effects. Initially, attentional modulation is brief, observed at around 60–130 ms post stimulus, and modulates responses not only at the target location but also in adjacent regions. A later modulation was observed from around 200 ms, which was specific to the location of the attentional target. The results support the idea that focal attention employs several processing stages and suggest that early attentional modulation is less spatially specific than late. |
Timo L. Kvamme; Mesud Sarmanlu; Christopher Bailey; Morten Overgaard In: Neuroscience, vol. 482, pp. 1–17, 2022. @article{Kvamme2022,Spontaneous neural oscillations are key predictors of perceptual decisions to bind multisensory sig- nals into a unified percept. Research links decreased alpha power in the posterior cortices to attention and audio- visual binding in the sound-induced flash illusion (SIFI) paradigm. This suggests that controlling alpha oscillations would be a way of controlling audiovisual binding. In the present feasibility study we used MEG- neurofeedback to train one group of subjects to increase left/right and another to increase right/left alpha power ratios in the parietal cortex. We tested for changes in audiovisual binding in a SIFI paradigm where flashes appeared in both hemifields. Results showed that the neurofeedback induced a significant asymmetry in alpha power for the left/right group, not seen for the right/left group. Corresponding asymmetry changes in audiovisual binding in illusion trials (with 2, 3, and 4 beeps paired with 1 flash) were not apparent. Exploratory analyses showed that neurofeedback training effects were present for illusion trials with the lowest numeric disparity (i.e., 2 beeps and 1 flash trials) only if the previous trial had high congruency (2 beeps and 2 flashes). Our data suggest that the relation between parietal alpha power (an index of attention) and its effect on audiovisual binding is dependent on the learned causal structure in the previous stimulus. The present results suggests that low alpha power biases observers towards audiovisual binding when they have learned that audiovisual signals orig- inate from a common origin, consistent with a Bayesian causal inference account of multisensory perception. |
Timo L. Kvamme; Mesud Sarmanlu; Morten Overgaard Doubting the double-blind: Introducing a questionnaire for awareness of experimental purposes in neurofeedback studies Journal Article In: Consciousness and Cognition, vol. 104, pp. 1–13, 2022. @article{Kvamme2022a,Double-blinding subjects to the experiment's purpose is an important standard in neurofeedback studies. However, it is difficult to provide evidence that humans are entirely unaware of certain information. This study used insights from consciousness studies and neurophenomenology to develop a contingency awareness questionnaire for neurofeedback. We assessed whether participants had an awareness of experimental purposes to manipulate their attention and multisensory perception. A subset of subjects (5 out of 20) gained a degree of awareness of experimental purposes as evidenced by their correct guess about the purposes of the experiment to affect their attention and multisensory perceptions specific to their double-blinded group assignment. The results warrant replication before they are applied to clinical neurofeedback studies, given the considerable time taken to perform the questionnaire (∼25 min). We discuss the strengths and limitations of our contingency awareness questionnaire and the growing appeal of the double-blinded standard in clinical neurofeedback studies. |
Sasu Mäkelä; Jan Kujala; Riitta Salmelin Removing ocular artifacts from magnetoencephalographic data on naturalistic reading of continuous texts Journal Article In: Frontiers in Neuroscience, vol. 16, pp. 1–18, 2022. @article{Maekelae2022,Naturalistic reading paradigms and stimuli consisting of long continuous texts are essential for characterizing the cortical basis of reading. Due to the highly dynamic nature of the reading process, electrophysiological brain imaging methods with high spatial and temporal resolution, such as magnetoencephalography (MEG), are ideal for tracking them. However, as electrophysiological recordings are sensitive to electromagnetic artifacts, data recorded during naturalistic reading is confounded by ocular artifacts. In this study, we evaluate two different pipelines for removing ocular artifacts from MEG data collected during continuous, naturalistic reading, with the focus on saccades and blinks. Both pipeline alternatives are based on blind source separation methods but differ fundamentally in their approach. The first alternative is a multi-part process, in which saccades are first extracted by applying Second-Order Blind Identification (SOBI) and, subsequently, FastICA is used to extract blinks. The other alternative uses a single powerful method, Adaptive Mixture ICA (AMICA), to remove all artifact types at once. The pipelines were tested, and their effects compared on MEG data recorded from 13 subjects in a naturalistic reading task where the subjects read texts with the length of multiple pages. Both pipelines performed well, extracting the artifacts in a single component per artifact type in most subjects. Signal power was reduced across the whole cortex in all studied frequency bands from 1 to 90 Hz, but especially in the frontal cortex and temporal pole. The results were largely similar for the two pipelines, with the exception that SOBI-FastICA reduced signal in the right frontal cortex in all studied frequency bands more than AMICA. However, there was considerable interindividual variation in the effects of the pipelines. As a holistic conclusion, we choose to recommend AMICA for removing artifacts from MEG data on naturalistic reading but note that the SOBI-FastICA pipeline has also various favorable characteristics. |
Sharif I. Kronemer; Mark Aksen; Julia Z. Ding; Jun Hwan Ryu; Qilong Xin; Zhaoxiong Ding; Jacob S. Prince; Hunki Kwon; Aya Khalaf; Sarit Forman; David S. Jin; Kevin Wang; Kaylie Chen; Claire Hu; Akshar Agarwal; Erik Saberski; Syed Mohammad Adil Wafa; Owen P. Morgan; Jia Wu; Kate L. Christison-Lagay; Nicholas Hasulak; Martha Morrell; Alexandra Urban; R. Todd Constable; Michael Pitts; R. Mark Richardson; Michael J. Crowley; Hal Blumenfeld Human visual consciousness involves large scale cortical and subcortical networks independent of task report and eye movement activity Journal Article In: Nature Communications, vol. 13, pp. 1–17, 2022. @article{Kronemer2022,The full neural circuits of conscious perception remain unknown. Using a visual perception task, we directly recorded a subcortical thalamic awareness potential (TAP). We also developed a unique paradigm to classify perceived versus not perceived stimuli using eye measurements to remove confounding signals related to reporting on conscious experiences. Using fMRI, we discovered three major brain networks driving conscious visual perception independent of report: first, increases in signal detection regions in visual, fusiform cortex, and frontal eye fields; and in arousal/salience networks involving midbrain, thalamus, nucleus accumbens, anterior cingulate, and anterior insula; second, increases in frontoparietal attention and executive control networks and in the cerebellum; finally, decreases in the default mode network. These results were largely maintained after excluding eye movement-based fMRI changes. Our findings provide evidence that the neurophysiology of consciousness is complex even without overt report, involving multiple cortical and subcortical networks overlapping in space and time. |
Kiri Kuroda; Yukiko Ogura; Akitoshi Ogawa; Tomoya Tamei; Kazushi Ikeda; Tatsuya Kameda Behavioral and neuro-cognitive bases for emergence of norms and socially shared realities via dynamic interaction Journal Article In: Communications Biology, vol. 5, no. 1, pp. 1–13, 2022. @article{Kuroda2022,In the digital era, new socially shared realities and norms emerge rapidly, whether they are beneficial or harmful to our societies. Although these are emerging properties from dynamic interaction, most research has centered on static situations where isolated individuals face extant norms. We investigated how perceptual norms emerge endogenously as shared realities through interaction, using behavioral and fMRI experiments coupled with computational modeling. Social interactions fostered convergence of perceptual responses among people, not only overtly but also at the covert psychophysical level that generates overt responses. Reciprocity played a critical role in increasing the stability (reliability) of the psychophysical function within each individual, modulated by neural activity in the mentalizing network during interaction. These results imply that bilateral influence promotes mutual cognitive anchoring of individual views, producing shared generative models at the collective level that enable endogenous agreement on totally new targets–one of the key functions of social norms. |
Natalia Ladyka-Wojcik; Zhong-Xu Liu; Jennifer D. Ryan Unrestricted eye movements strengthen effective connectivity from hippocampal to oculomotor regions during scene construction Journal Article In: NeuroImage, vol. 260, pp. 1–15, 2022. @article{LadykaWojcik2022,Scene construction is a key component of memory recall, navigation, and future imagining, and relies on the medial temporal lobes (MTL). A parallel body of work suggests that eye movements may enable the imagination and construction of scenes, even in the absence of external visual input. There are vast structural and functional connections between regions of the MTL and those of the oculomotor system. However, the directionality of connections between the MTL and oculomotor control regions, and how it relates to scene construction, has not been studied directly in human neuroimaging. In the current study, we used dynamic causal modeling (DCM) to interrogate effective connectivity between the MTL and oculomotor regions using a scene construction task in which participants' eye movements were either restricted (fixed-viewing) or unrestricted (free-viewing). By omitting external visual input, and by contrasting free- versus fixed- viewing, the directionality of neural connectivity during scene construction could be determined. As opposed to when eye movements were restricted, allowing free-viewing during construction of scenes strengthened top-down connections from the MTL to the frontal eye fields, and to lower-level cortical visual processing regions, suppressed bottom-up connections along the visual stream, and enhanced vividness of the constructed scenes. Taken together, these findings provide novel, non-invasive evidence for the underlying, directional, connectivity between the MTL memory system and oculomotor system associated with constructing vivid mental representations of scenes. |
Armien Lanssens; Dante Mantini; Hans Op Beeck; Celine R. Gillebert Activity in the fronto-parietal and visual cortex is modulated by feature-based attentional weighting Journal Article In: Frontiers in Neuroscience, vol. 16, pp. 1–15, 2022. @article{Lanssens2022,In day-to-day dynamic activities where sensory input is abundant, stimulus representations in the visual cortex are modulated based on their attentional priority. Several studies have established the top-down role of a fronto-parietal dorsal attention network in selective attention. In the current study, we aimed to investigate whether activity of subregions of this network and the visual cortex is modulated by feature-based attentional weighting, and if so, whether their timecourses of activity are correlated. To this end, we analyzed fMRI data of 28 healthy subjects, who performed a feature-based go/no-go task. Participants had to attend to one or two colored streams of sinusoidal gratings and respond to each grating in the task-relevant stream(s) except to a single non-target grating. Univariate and multivariate fMRI results indicated that activity in bilateral fronto-parietal (frontal eye fields, intraparietal sulcus and superior parietal lobe) and visual (V1–V4, lateral occipital cortex and fusiform gyrus) regions was modulated by selecting one instead of attending to two gratings. Functional connectivity was not significantly different between fronto-parietal and visual regions when attending to one as opposed to two gratings. Our study demonstrates that activity in subregions of both the fronto-parietal and visual cortex is modified by feature-based attentional weighting. |
Kangjoo Lee; Corey Horien; David O'Connor; Bronwen Garand-Sheridan; Fuyuze Tokoglu; Dustin Scheinost; Evelyn M. R. Lake; R. Todd Constable Arousal impacts distributed hubs modulating the integration of brain functional connectivity Journal Article In: NeuroImage, vol. 258, pp. 1–17, 2022. @article{Lee2022c,Even when subjects are at rest, it is thought that brain activity is organized into distinct brain states during which reproducible patterns are observable. Yet, it is unclear how to define or distinguish different brain states. A potential source of brain state variation is arousal, which may play a role in modulating functional interactions between brain regions. Here, we use simultaneous resting state functional magnetic resonance imaging (fMRI) and pupillometry to study the impact of arousal levels indexed by pupil area on the integration of large-scale brain networks. We employ a novel sparse dictionary learning-based method to identify hub regions participating in between-network integration stratified by arousal, by measuring k-hubness, the number (k) of functionally overlapping networks in each brain region. We show evidence of a brain-wide decrease in between-network integration and inter-subject variability at low relative to high arousal, with differences emerging across regions of the frontoparietal, default mode, motor, limbic, and cerebellum networks. State-dependent changes in k-hubness relate to the actual patterns of network integration within these hubs, suggesting a brain state transition from high to low arousal characterized by global synchronization and reduced network overlaps. We demonstrate that arousal is not limited to specific brain areas known to be directly associated with arousal regulation, but instead has a brain-wide impact that involves high-level between-network communications. Lastly, we show a systematic change in pairwise fMRI signal correlation structures in the arousal state-stratified data, and demonstrate that the choice of global signal regression could result in different conclusions in conventional graph theoretical analysis and in the analysis of k-hubness when studying arousal modulations. Together, our results suggest the presence of global and local effects of pupil-linked arousal modulations on resting state brain functional connectivity. |