EyeLink fMRI/MEG出版物
所有EyeLink功能磁共振成像和MEG研究出版物(同时进行眼睛跟踪)至2023年(一些早于2024年)均按年份列出。您可以使用Visual Cortex、Neural Plasticity、MEG等关键词搜索出版物。您还可以搜索个人作者姓名。如果我们错过了任何EyeLink功能磁共振成像或MEG文章,请给我们发电子邮件!
2022 |
R. T. Pramod; Michael A. Cohen; Joshua B. Tenenbaum; Nancy Kanwisher Invariant representation of physical stability in the human brain Journal Article In: eLife, vol. 11, pp. 1–19, 2022. @article{Pramod2022, Successful engagement with the world requires the ability to predict what will happen next. Here, we investigate how the brain makes a fundamental prediction about the physical world: whether the situation in front of us is stable, and hence likely to stay the same, or unstable, and hence likely to change in the immediate future. Specifically, we ask if judgments of stability can be supported by the kinds of representations that have proven to be highly effective at visual object recognition in both machines and brains, or instead if the ability to determine the physical stability of natural scenes may require generative algorithms that simulate the physics of the world. To find out, we measured responses in both convolutional neural networks (CNNs) and the brain (using fMRI) to natural images of physically stable versus unstable scenarios. We find no evidence for generalizable representations of physical stability in either standard CNNs trained on visual object and scene classification (ImageNet), or in the human ventral visual pathway, which has long been implicated in the same process. However, in frontoparietal regions previously implicated in intuitive physical reasoning we find both scenario-invariant representations of physical stability, and higher univariate responses to unstable than stable scenes. These results demonstrate abstract representations of physical stability in the dorsal but not ventral pathway, consistent with the hypothesis that the computations underlying stability entail not just pattern classification but forward physical simulation. |
Sophia Antonia Press; Stefanie C. Biehl; C. Carolyn Vatheuer; Gregor Domes; Jennifer Svaldi Neural correlates of body image processing in binge eating disorder Journal Article In: Journal of Psychopathology and Clinical Science, vol. 131, no. 4, pp. 350–364, 2022. @article{Press2022, Although body image disturbances play a central role in the development, maintenance and relapse of binge eating disorder (BED), studies investigating the neural basis underlying body processing in BED are still missing. To address this gap, we conducted a preregistered (German Clinical Trials Register [Deutsches Register Klinischer Studien; DRKS], Registration DRKS00008107) combined functional magnetic resonance (fMRI)/eye tracking study in which 38 women with BED and 22 healthy controls weight-matched for overall equivalence processed images of their own bodies, an unfamiliar weight- matched body, and visually matched nonbody control stimuli while performing a one-back task. Women with BED responded with higher left fusiform body area (FBA) activity than controls during body image processing. Despite higher levels of self-reported body dissatisfaction, women with BED did not show overactivation in emotion-processing areas in response to their own body. The eye-track- ing results indicated that visual attention toward the presented stimuli was associated with increased ac- tivity in the extrastriate body area (EBA) and FBA across groups. Our results thus provide evidence for an aberrant neural processing of body images in BED and highlight the importance of controlling for visual attention in future studies assessing neuronal body processing. |
Estelle Raffin; Adrien Witon; Roberto F. Salamanca-Giron; Krystel R. Huxlin; Friedhelm C. Hummel Functional segregation within the dorsal frontoparietal network: A multimodal dynamic causal modeling study Journal Article In: Cerebral Cortex, vol. 32, no. 15, pp. 3187–3205, 2022. @article{Raffin2022, Discrimination and integration of motion direction requires the interplay of multiple brain areas. Theoretical accounts of perception suggest that stimulus-related (i.e., exogenous) and decision-related (i.e., endogenous) factors affect distributed neuronal processing at different levels of the visual hierarchy. To test these predictions, we measured brain activity of healthy participants during a motion discrimination task, using electroencephalography (EEG) and functional magnetic resonance imaging (fMRI). We independently modeled the impact of exogenous factors (task demand) and endogenous factors (perceptual decision-making) on the activity of the motion discrimination network and applied Dynamic Causal Modeling (DCM) to both modalities. DCM for event-related potentials (DCM-ERP) revealed that task demand impacted the reciprocal connections between the primary visual cortex (V1) and medial temporal areas (V5). With practice, higher visual areas were increasingly involved, as revealed by DCM-fMRI. Perceptual decision-making modulated higher levels (e.g., V5-to-Frontal Eye Fields, FEF), in a manner predictive of performance. Our data suggest that lower levels of the visual network support early, feature-based selection of responses, especially when learning strategies have not been implemented. In contrast, perceptual decision-making operates at higher levels of the visual hierarchy by integrating sensory information with the internal state of the subject. |
Johannes Rennig; Michael S. Beauchamp Intelligibility of audiovisual sentences drives multivoxel response patterns in human superior temporal cortex Journal Article In: NeuroImage, vol. 247, pp. 1–9, 2022. @article{Rennig2022, Regions of the human posterior superior temporal gyrus and sulcus (pSTG/S) respond to the visual mouth movements that constitute visual speech and the auditory vocalizations that constitute auditory speech, and neural responses in pSTG/S may underlie the perceptual benefit of visual speech for the comprehension of noisy auditory speech. We examined this possibility through the lens of multivoxel pattern responses in pSTG/S. BOLD fMRI data was collected from 22 participants presented with speech consisting of English sentences presented in five different formats: visual-only; auditory with and without added auditory noise; and audiovisual with and without auditory noise. Participants reported the intelligibility of each sentence with a button press and trials were sorted post-hoc into those that were more or less intelligible. Response patterns were measured in regions of the pSTG/S identified with an independent localizer. Noisy audiovisual sentences with very similar physical properties evoked very different response patterns depending on their intelligibility. When a noisy audiovisual sentence was reported as intelligible, the pattern was nearly identical to that elicited by clear audiovisual sentences. In contrast, an unintelligible noisy audiovisual sentence evoked a pattern like that of visual-only sentences. This effect was less pronounced for noisy auditory-only sentences, which evoked similar response patterns regardless of intelligibility. The successful integration of visual and auditory speech produces a characteristic neural signature in pSTG/S, highlighting the importance of this region in generating the perceptual benefit of visual speech. |
Noam Saadon-Grosman; Peter A. Angeli; Lauren M. DiNicola; Randy L. Buckner A third somatomotor representation in the human cerebellum Journal Article In: Journal of Neurophysiology, vol. 128, no. 5, pp. 1051–1073, 2022. @article{SaadonGrosman2022, Seminal neurophysiological studies in the 1940s discovered two somatomotor maps in the cerebellum-an inverted anterior lobe map and an upright posterior lobe map. Both maps have been confirmed in the human using noninvasive neuroimaging with additional hints of a third map within and near to the cerebellar vermis. Here, we sought direct evidence for the third somatomotor map by using intensive, repeated functional MRI (fMRI) scanning of individuals performing movements across multiple body parts (tongue, hands, glutes, and feet). An initial discovery sample (n = 4, 4 sessions per individual including 576 separate blocks of body movements) yielded evidence for the two established cerebellar somatomotor maps, as well as evidence for a third discontinuous foot representation within the vermis. When the left versus right foot movements were directly contrasted, the third representation could be clearly distinguished from the second representation in multiple individuals. Functional connectivity from seed regions in the third somatomotor representation confirmed anatomically specific connectivity with the cerebral cortex, paralleling the patterns observed for the two well-established maps. All results were prospectively replicated in an independent dataset with new individuals (n = 4). These collective findings provide direct support for a third somatomotor representation in the vermis of the cerebellum that may be part of a third map. We discuss the relations of this candidate third map to the broader topography of the cerebellum as well as its implications for understanding the specific organization of the human cerebellar vermis where distinct zones appear functionally specialized for somatomotor and visual domains. |
Patrick Sadil; Rosemary A. Cowell; David E. Huber A modeling framework for determining modulation of neural-level tuning from non-invasive human fMRI data Journal Article In: Communications Biology, vol. 5, no. 1, pp. 1–12, 2022. @article{Sadil2022, Many neuroscience theories assume that tuning modulation of individual neurons underlies changes in human cognition. However, non-invasive fMRI lacks sufficient resolution to visualize this modulation. To address this limitation, we developed an analysis framework called Inferring Neural Tuning Modulation (INTM) for “peering inside” voxels. Precise specification of neural tuning from the BOLD signal is not possible. Instead, INTM compares theoretical alternatives for the form of neural tuning modulation that might underlie changes in BOLD across experimental conditions. The most likely form is identified via formal model comparison, with assumed parametric Normal tuning functions, followed by a non-parametric check of conclusions. We validated the framework by successfully identifying a well-established form of modulation: visual contrast-induced multiplicative gain for orientation tuned neurons. INTM can be applied to any experimental paradigm testing several points along a continuous feature dimension (e.g., direction of motion, isoluminant hue) across two conditions (e.g., with/without attention, before/after learning). |
Arunava Samaddar; Brooke S. Jackson; Christopher J. Helms; Nicole A. Lazar; Jennifer E. McDowell; Cheolwoo Park A group comparison in fMRI data using a semiparametric model under shape invariance Journal Article In: Computational Statistics and Data Analysis, vol. 167, pp. 1–18, 2022. @article{Samaddar2022, In the analysis of functional magnetic resonance imaging (fMRI) data, a common type of analysis is to compare differences across scanning sessions. A challenge to direct comparisons of this type is the low signal-to-noise ratio in fMRI data. By using the property that brain signals from a task-related experiment may exhibit a similar pattern in regions of interest across participants, a semiparametric approach under shape invariance to quantify and test the differences in sessions and groups is developed. The common function is estimated with local polynomial regression and the shape invariance model parameters are estimated using evolutionary optimization methods. The efficacy of the semi-parametric approach is demonstrated on a study of brain activation changes across two sessions associated with practice-related cognitive control. The objective of the study is to evaluate neural circuitry supporting a cognitive control task, and associated practice-related changes via acquisition of blood oxygenation level dependent (BOLD) signal collected using fMRI. By using the proposed approach, BOLD signals in multiple regions of interest for control participants and participants with schizophrenia are compared as they perform a cognitive control task (known as the antisaccade task) at two sessions, and the effects of task practice in these groups are quantified. |
Takafumi Sasaoka; Tokiko Harada; Daichi Sato; Nanae Michida; Hironobu Yonezawa; Masatoshi Takayama; Takahide Nouzawa; Shigeto Yamawaki Neural basis for anxiety and anxiety-related physiological responses during a driving situation: An fMRI study Journal Article In: Cerebral Cortex, vol. 3, pp. 1–19, 2022. @article{Sasaoka2022, Although the exteroceptive and interoceptive prediction of a negative event increases a person's anxiety in daily life situations, the relationship between the brain mechanism of anxiety and the anxiety-related autonomic response has not been fully understood. In this functional magnetic resonance imaging (fMRI) study, we examined the neural basis of anxiety and anxiety-related autonomic responses in a daily driving situation. Participants viewed a driving video clip in the first-person perspective. During the video clip, participants were presented with a cue to indicate whether a subsequent crash could occur (attention condition) or not (safe condition). Enhanced activities in the anterior insula, bed nucleus of the stria terminalis, thalamus, and periaqueductal gray, and higher sympathetic nerve responses (pupil dilation and peripheral arterial stiffness) were triggered by the attention condition but not with the safe condition. Autonomic response-related functional connectivity was detected in the visual cortex, cerebellum, brainstem, and MCC/PCC with the right anterior insula and its adjacent regions as seed regions. Thus, the right anterior insula and adjacent regions, in collaboration with other regions play a role in eliciting anxiety based on the prediction of negative events, by mediating anxiety-related autonomic responses according to interoceptive information. |
Rebekka Schröder; Eliana Faiola; Maria Fernanda Urquijo; Katharina Bey; Inga Meyhöfer; Maria Steffens; Anna-Maria Kasparbauer; Anne Ruef; Hanna Högenauer; René Hurlemann; Joseph Kambeitz; Alexandra Philipsen; Michael Wagner; Nikolaos Koutsouleris; Ulrich Ettinger Neural correlates of smooth pursuit eye movements in schizotypy and recent onset psychosis: A multivariate pattern classification approach Journal Article In: Schizophrenia Bulletin Open, vol. 3, no. 1, pp. 1–13, 2022. @article{Schroeder2022, Schizotypy refers to a set of personality traits that bear resemblance, at subclinical level, to psychosis. Despite evidence of similarity at multiple levels of analysis, direct comparisons of schizotypy and clinical psychotic disorders are rare. Therefore, we used functional magnetic resonance imaging (fMRI) to examine the neural correlates and task-based functional connectivity (psychophysiological interactions; PPI) of smooth pursuit eye movements (SPEM) in patients with recent onset psychosis (ROP; n = 34), participants with high levels of negative (HNS; n = 46) or positive (HPS; n = 41) schizotypal traits, and low-schizotypy control participants (LS; n = 61) using machine-learning. Despite strong previous evidence that SPEM is a highly reliable marker of psychosis, patients and controls could not be significantly distinguished based on SPEM performance or blood oxygen level dependent (BOLD) signal during SPEM. Classification was, however, significant for the right frontal eye field (FEF) seed region in the PPI analyses but not for seed regions in other key areas of the SPEM network. Applying the right FEF classifier to the schizotypal samples yielded decision scores between the LS and ROP groups, suggesting similarities and dissimilarities of the HNS and HPS samples with the LS and ROP groups. The very small difference between groups is inconsistent with previous studies that showed significant differences between patients with ROP and controls in both SPEM performance and underlying neural mechanisms with large effect sizes. As the current study had sufficient power to detect such differences, other reasons are discussed. |
Timo L. Kvamme; Mesud Sarmanlu; Christopher Bailey; Morten Overgaard In: Neuroscience, vol. 482, pp. 1–17, 2022. @article{Kvamme2022, Spontaneous neural oscillations are key predictors of perceptual decisions to bind multisensory sig- nals into a unified percept. Research links decreased alpha power in the posterior cortices to attention and audio- visual binding in the sound-induced flash illusion (SIFI) paradigm. This suggests that controlling alpha oscillations would be a way of controlling audiovisual binding. In the present feasibility study we used MEG- neurofeedback to train one group of subjects to increase left/right and another to increase right/left alpha power ratios in the parietal cortex. We tested for changes in audiovisual binding in a SIFI paradigm where flashes appeared in both hemifields. Results showed that the neurofeedback induced a significant asymmetry in alpha power for the left/right group, not seen for the right/left group. Corresponding asymmetry changes in audiovisual binding in illusion trials (with 2, 3, and 4 beeps paired with 1 flash) were not apparent. Exploratory analyses showed that neurofeedback training effects were present for illusion trials with the lowest numeric disparity (i.e., 2 beeps and 1 flash trials) only if the previous trial had high congruency (2 beeps and 2 flashes). Our data suggest that the relation between parietal alpha power (an index of attention) and its effect on audiovisual binding is dependent on the learned causal structure in the previous stimulus. The present results suggests that low alpha power biases observers towards audiovisual binding when they have learned that audiovisual signals orig- inate from a common origin, consistent with a Bayesian causal inference account of multisensory perception. |
Mats W. J. Es; Tom R. Marshall; Eelke Spaak; Ole Jensen; Jan-Mathijs Schoffelen Phasic modulation of visual representations during sustained attention Journal Article In: European Journal of Neuroscience, vol. 55, no. 11-12, pp. 3191–3208, 2022. @article{Es2022, Sustained attention has long been thought to benefit perception in a continuous fashion, but recent evidence suggests that it affects perception in a discrete, rhythmic way. Periodic fluctuations in behavioral performance over time, and modulations of behavioral performance by the phase of spontaneous oscillatory brain activity point to an attentional sampling rate in the theta or alpha frequency range. We investigated whether such discrete sampling by attention is reflected in periodic fluctuations in the decodability of visual stimulus orientation from magnetoencephalographic (MEG) brain signals. In this exploratory study, human subjects attended one of the two grating stimuli, while MEG was being recorded. We assessed the strength of the visual representation of the attended stimulus using a support vector machine (SVM) to decode the orientation of the grating (clockwise vs. counterclockwise) from the MEG signal. We tested whether decoder performance depended on the theta/alpha phase of local brain activity. While the phase of ongoing activity in the visual cortex did not modulate decoding performance, theta/alpha phase of activity in the frontal eye fields and parietal cortex, contralateral to the attended stimulus did modulate decoding performance. These findings suggest that phasic modulations of visual stimulus representations in the brain are caused by frequency-specific top-down activity in the frontoparietal attention network, though the behavioral relevance of these effects could not be established. |
Raphael Vallat; Başak Türker; Alain Nicolas; Perrine Ruby High dream recall frequency is associated with increased creativity and default mode network connectivity Journal Article In: Nature and Science of Sleep, vol. 14, pp. 265–275, 2022. @article{Vallat2022, Introduction: Several results suggest that the frequency of dream recall is positively correlated with personality traits such as creativity and openness to experience. In addition, neuroimaging results have evidenced different neurophysiological profiles in high dream recallers (HR) and low dream recallers (LR) during both sleep and wakefulness, specifically within regions of the default mode network (DMN). These findings are consistent with the emerging view that dreaming and mind wandering pertain to the same family of spontaneous mental processes, subserved by the DMN. Methods: To further test this hypothesis, we measured the DMN functional connectivity during resting wakefulness, together with personality and cognitive abilities (including creativity) in 28 HR and 27 LR. Results: As expected, HR demonstrated a greater DMN connectivity than LR, higher scores of creativity, and no significant difference in memory abilities. However, there was no significant correlation between creativity scores and DMN connectivity. Discussion: These results further demonstrate that there are trait neurophysiological and psychological differences between individuals who frequently recall their dreams and those who do not. They support the forebrain and the DMN hypotheses of dreaming and leave open the possibility that increased activity in the DMN promotes creative-thinking during both wakefulness and sleep. Further work is needed to test whether activity in the DMN is causally associated with creative-thinking. |
Mirjam C. M. Wever; Lisanne A. E. M. Houtum; Loes H. C. Janssen; Wilma G. M. Wentholt; Iris M. Spruit; Marieke S. Tollenaar; Geert Jan Will; Bernet M. Elzinga Neural and affective responses to prolonged eye contact with one's own adolescent child and unfamiliar others Journal Article In: NeuroImage, vol. 260, pp. 1–12, 2022. @article{Wever2022, Eye contact is crucial for the formation and maintenance of social relationships, and plays a key role in facilitating a strong parent-child bond. However, the precise neural and affective mechanisms through which eye contact impacts on parent-child relationships remain elusive. We introduce a task to assess parents' neural and affective responses to prolonged direct and averted gaze coming from their own child, and an unfamiliar child and adult. While in the scanner, 79 parents (n = 44 mothers and n = 35 fathers) were presented with prolonged (16-38 s) videos of their own child, an unfamiliar child, an unfamiliar adult, and themselves (i.e., targets), facing the camera with a direct or an averted gaze. We measured BOLD-responses, tracked parents' eye movements during the videos, and asked them to report on their mood and feelings of connectedness with the targets after each video. Parents reported improved mood and increased feelings of connectedness after prolonged exposure to direct versus averted gaze and these effects were amplified for unfamiliar targets compared to their own child, due to high affect and connectedness ratings after videos of their own child. Neuroimaging results showed that the sight of one's own child was associated with increased activity in middle occipital gyrus, fusiform gyrus and inferior frontal gyrus relative to seeing an unfamiliar child or adult. While we found no robust evidence of specific neural correlates of eye contact (i.e., contrast direct > averted gaze), an exploratory parametric analysis showed that dorsomedial prefrontal cortex (dmPFC) activity increased linearly with duration of eye contact (collapsed across all “other” targets). Eye contact-related dmPFC activity correlated positively with increases in feelings of connectedness, suggesting that this region may drive feelings of connectedness during prolonged eye contact with others. These results underline the importance of prolonged eye contact for affiliative processes and provide first insights into its neural correlates. This may pave the way for new research in individuals or pairs in whom affiliative processes are disrupted. |
Antonius Wiehler; Francesca Branzoli; Isaac Adanyeguh; Fanny Mochel; Mathias Pessiglione A neuro-metabolic account of why daylong cognitive work alters the control of economic decisions Journal Article In: Current Biology, vol. 32, no. 16, pp. 3564–3575, 2022. @article{Wiehler2022, Behavioral activities that require control over automatic routines typically feel effortful and result in cognitive fatigue. Beyond subjective report, cognitive fatigue has been conceived as an inflated cost of cognitive control, objectified by more impulsive decisions. However, the origins of such control cost inflation with cognitive work are heavily debated. Here, we suggest a neuro-metabolic account: the cost would relate to the necessity of recycling potentially toxic substances accumulated during cognitive control exertion. We validated this account using magnetic resonance spectroscopy (MRS) to monitor brain metabolites throughout an approximate workday, during which two groups of participants performed either high-demand or low-demand cognitive control tasks, interleaved with economic decisions. Choice-related fatigue markers were only present in the high-demand group, with a reduction of pupil dilation during decision-making and a preference shift toward short-delay and little-effort options (a low-cost bias captured using computational modeling). At the end of the day, high-demand cognitive work resulted in higher glutamate concentration and glutamate/glutamine diffusion in a cognitive control brain region (lateral prefrontal cortex [lPFC]), relative to low-demand cognitive work and to a reference brain region (primary visual cortex [V1]). Taken together with previous fMRI data, these results support a neuro-metabolic model in which glutamate accumulation triggers a regulation mechanism that makes lPFC activation more costly, explaining why cognitive control is harder to mobilize after a strenuous workday. |
Marilena Wilding; Christof Körner; Anja Ischebeck; Natalia Zaretskaya Increased insula activity precedes the formation of subjective illusory Gestalt Journal Article In: NeuroImage, vol. 257, pp. 1–10, 2022. @article{Wilding2022, The constructive nature of human perception sometimes leads us to perceiving rather complex impressions from simple sensory input: for example, recognizing animal contours in cloud formations or seeing living creatures in shadows of objects. A special type of bistable stimuli gives us a rare opportunity to study the neural mechanisms behind this process. Such stimuli can be visually interpreted either as simple or as more complex illusory content on the basis of the same sensory input. Previous studies demonstrated increased activity in the superior parietal cortex during the perception of an illusory Gestalt impression compared to a simpler interpretation. Here, we examined the role of slow fluctuations of resting-state fMRI activity in shaping the subsequent illusory interpretation by investigating activity related to the illusory Gestalt not only during, but also prior to its perception. We presented 31 participants with a bistable motion stimulus, which can be perceived either as four moving dot pairs (local) or two moving illusory squares (global). fMRI was used to measure brain activity in a slow event-related design. We observed stronger IPS and putamen responses to the stimulus when participants perceived the global interpretation compared to the local, confirming the findings of previous studies. Most importantly, we also observed that the global stimulus interpretation was preceded by an increased activity of the bilateral dorsal insula, which is known to process saliency and gate information for conscious access. Our data suggest an important role of the dorsal insula in shaping complex illusory interpretations of the sensory input. |
Aspen H. Yoo; Alfredo Bolaños; Grace E. Hallenbeck; Masih Rahmati; Thomas C. Sprague; Clayton E. Curtis Behavioral prioritization enhances working memory precision and neural population gain Journal Article In: Journal of Cognitive Neuroscience, vol. 34, no. 2, pp. 365–379, 2022. @article{Yoo2022, Humans allocate visual working memory (WM) resource according to behavioral relevance, resulting in more precise memories for more important items. Theoretically, items may be maintained by feature-tuned neural populations, where the relative gain of the populations encoding each item determines precision. To test this hypothesis, we compared the amplitudes of delay period activity in the different parts of retinotopic maps representing each of several WM items, predicting the amplitudes would track behavioral priority. Using fMRI, we scanned participants while they remembered the location of multiple items over a WM delay and then reported the location of one probed item using a memory-guided saccade. Importantly, items were not equally probable to be probed (0.6, 0.3, 0.1, 0.0), which was indicated with a precue. We analyzed fMRI activity in 10 visual field maps in occipital, parietal, and frontal cortex known to be important for visual WM. In early visual cortex, but not association cortex, the amplitude of BOLD activation within voxels corresponding to the retinotopic location of visual WM items increased with the priority of the item. Interestingly, these results were contrasted with a common finding that higher-level brain regions had greater delay period activity, demonstrating a dissociation between the absolute amount of activity in a brain area and the activity of different spatially selective populations within it. These results suggest that the distribution of WM resources according to priority sculpts the relative gains of neural populations that encode items, offering a neural mechanism for how prioritization impacts memory precision. |
Farnaz Zamani Esfahlani; Lisa Byrge; Jacob Tanner; Olaf Sporns; Daniel P. Kennedy; Richard F. Betzel Edge-centric analysis of time-varying functional brain networks with applications in autism spectrum disorder Journal Article In: NeuroImage, vol. 263, pp. 1–12, 2022. @article{ZamaniEsfahlani2022, The interaction between brain regions changes over time, which can be characterized using time-varying functional connectivity (tvFC). The common approach to estimate tvFC uses sliding windows and offers limited temporal resolution. An alternative method is to use the recently proposed edge-centric approach, which enables the tracking of moment-to-moment changes in co-fluctuation patterns between pairs of brain regions. Here, we first examined the dynamic features of edge time series and compared them to those in the sliding window tvFC (sw-tvFC). Then, we used edge time series to compare subjects with autism spectrum disorder (ASD) and healthy controls (CN). Our results indicate that relative to sw-tvFC, edge time series captured rapid and bursty network-level fluctuations that synchronize across subjects during movie-watching. The results from the second part of the study suggested that the magnitude of peak amplitude in the collective co-fluctuations of brain regions (estimated as root sum square (RSS) of edge time series) is similar in CN and ASD. However, the trough-to-trough duration in RSS signal is greater in ASD, compared to CN. Furthermore, an edge-wise comparison of high-amplitude co-fluctuations showed that the within-network edges exhibited greater magnitude fluctuations in CN. Our findings suggest that high-amplitude co-fluctuations captured by edge time series provide details about the disruption of functional brain dynamics that could potentially be used in developing new biomarkers of mental disorders. |
Bo Zhang; Yuji Naya A dataset of human fMRI/MEG experiments with eye tracking for spatial memory research using virtual reality Journal Article In: Data in Brief, vol. 43, pp. 1–8, 2022. @article{Zhang2022a, A dataset consisting of whole-brain fMRI (functional magnetic resonance imaging)/MEG (magnetoencephalography) images, eye tracking files, and behavioral records from healthy adult human participants when they performed a spatial-memory paradigm in a virtual environment was collected to investigate the neural representation of the cognitive map defined by unique spatial relationship of three objects, as well as the neural dynamics of the cognitive map following the task demand from localizing self-location to remembering the target location relative to the self-body. The dataset, including both fMRI and MEG, was also used to investigate the neural networks involved in representing a target within and outside the visual field. The dataset included 19 and 12 university students at Peking University for fMRI and MEG experiments, respectively (fMRI: 12 women, 7 men; MEG: 4 women, 8 men). The average ages of those participants were 24.9 years (MRI: 18–30 years) and 22.5 years (MEG: 19–25 years), respectively. fMRI BOLD and T1-weighted images were acquired using a 3T Siemens Prisma scanner (Siemens, Erlangen, Germany) equipped with a 20-channel receiver head coil. MEG neuromagnetic data were acquired using a 275-channel MEG system (CTF MEG, Canada). The dataset could be further used to investigate a range of neural mechanisms involved in human spatial cognition or to develop a bioinspired deep neural network to enhance machines' abilities in spatial processing. |
Ying Zhou; Clayton E. Curtis; Kartik K. Sreenivasan; Daryl Fougnie Common neural mechanisms control attention and working memory Journal Article In: Journal of Neuroscience, vol. 42, no. 37, pp. 7110–7120, 2022. @article{Zhou2022h, Although previous studies point to qualitative similarities between working memory (WM) and attention, the degree to which these two constructs rely on shared neural mechanisms remains unknown. Focusing on one such potentially shared mechanism, we tested the hypothesis that selecting an item within WM utilizes similar neural mechanisms as selecting a visible item via a shift of attention. We used fMRI and machine learning to decode both the selection among items visually available and the selection among items stored in WM in human subjects (both sexes). Patterns of activity in visual, parietal, and to a lesser extent frontal cortex predicted the locations of the selected items. Critically, these patterns were strikingly interchangeable; classifiers trained on data during attentional selection predicted selection from WM, and classifiers trained on data during selection from memory predicted attentional selection. Using models of voxel receptive fields, we visualized topographic population activity that revealed gain enhancements at the locations of the externally and internally selected items. Our results suggest that selecting among perceived items and selecting among items in WM share a common mechanism. This common mechanism, analogous to a shift of spatial attention, controls the relative gains of neural populations that encode behaviorally relevant information. |
Erin Goddard; Thomas A. Carlson; Alexandra Woolgar Spatial and feature-selective attention have distinct, interacting effects on population-level tuning Journal Article In: Journal of Cognitive Neuroscience, vol. 34, no. 2, pp. 290–312, 2022. @article{Goddard2022, Attention can be deployed in different ways: When searching for a taxi in New York City, we can decide where to attend (e.g., to the street) and what to attend to (e.g., yellow cars). Although we use the same word to describe both processes, nonhuman primate data suggest that these produce distinct effects on neural tuning. This has been challenging to assess in humans, but here we used an opportunity afforded by multivariate decoding of MEG data. We found that attending to an object at a particular location and attending to a particular object feature produced effects that interacted multiplicatively. The two types of attention induced distinct patterns of enhancement in occipital cortex, with feature-selective attention producing relatively more enhancement of small feature differences and spatial attention producing relatively larger effects for larger feature differences. An information flow analysis further showed that stimulus representations in occipital cortex were Granger-caused by coding in frontal cortices earlier in time and that the timing of this feedback matched the onset of attention effects. The data suggest that spatial and feature-selective attention rely on distinct neural mechanisms that arise from frontal-occipital information exchange, interacting multiplicatively to selectively enhance task-relevant information. |
2021 |
Nathan Tardiff; John D. Medaglia; Danielle S. Bassett; Sharon L. Thompson-Schill The modulation of brain network integration and arousal during exploration Journal Article In: NeuroImage, vol. 240, pp. 118369, 2021. @article{Tardiff2021, There is growing interest in how neuromodulators shape brain networks. Recent neuroimaging studies provide evidence that brainstem arousal systems, such as the locus coeruleus-norepinephrine system (LC-NE), influence functional connectivity and brain network topology, suggesting they have a role in flexibly reconfiguring brain networks in order to adapt behavior and cognition to environmental demands. To date, however, the relationship between brainstem arousal systems and functional connectivity has not been assessed within the context of a task with an established relationship between arousal and behavior, with most prior studies relying on incidental variations in arousal or pharmacological manipulation and static brain networks constructed over long periods of time. These factors have likely contributed to a heterogeneity of effects across studies. To address these issues, we took advantage of the association between LC-NE-linked arousal and exploration to probe the relationships between exploratory choice, arousal—as measured indirectly via pupil diameter—and brain network dynamics. Exploration in a bandit task was associated with a shift toward fewer, more weakly connected modules that were more segregated in terms of connectivity and topology but more integrated with respect to the diversity of cognitive systems represented in each module. Functional connectivity strength decreased, and changes in connectivity were correlated with changes in pupil diameter, in line with the hypothesis that brainstem arousal systems influence the dynamic reorganization of brain networks. More broadly, we argue that carefully aligning dynamic network analyses with task designs can increase the temporal resolution at which behaviorally- and cognitively-relevant modulations can be identified, and offer these results as a proof of concept of this approach. |
Hamid B. Turker; Elizabeth Riley; Wen Ming Luh; Stan J. Colcombe; Khena M. Swallow In: NeuroImage, vol. 236, pp. 1–17, 2021. @article{Turker2021, The locus coeruleus (LC) plays a central role in regulating human cognition, arousal, and autonomic states. Efforts to characterize the LC's function in humans using functional magnetic resonance imaging have been hampered by its small size and location near a large source of noise, the fourth ventricle. We tested whether the ability to characterize LC function is improved by employing neuromelanin-T1 weighted images (nmT1) for LC localization and multi-echo functional magnetic resonance imaging (ME-fMRI) for estimating intrinsic functional connectivity (iFC). Analyses indicated that, relative to a probabilistic atlas, utilizing nmT1 images to individually localize the LC increases the specificity of seed time series and clusters in the iFC maps. When combined with independent components analysis (ME-ICA), ME-fMRI data provided significant improvements in the temporal signal to noise ratio and DVARS relative to denoised single echo data (1E-fMRI). The effects of acquiring nmT1 images and ME-fMRI data did not appear to only reflect increases in power: iFC maps for each approach overlapped only moderately. This is consistent with findings that ME-fMRI offers substantial advantages over 1E-fMRI acquisition and denoising. It also suggests that individually identifying LC with nmT1 scans is likely to reduce the influence of other nearby brainstem regions on estimates of LC function. |
Renée M. Visser; Joe Bathelt; H. Steven Scholte; Merel Kindt Robust BOLD responses to faces but not to conditioned threat: Challenging the amygdala's reputation in human fear and extinction learning Journal Article In: Journal of Neuroscience, vol. 41, no. 50, pp. 10278–10292, 2021. @article{Visser2021, Most of our knowledge about human emotional memory comes from animal research. Based on this work, the amygdala is often labelled the brain's "fear center", but it is unclear to what degree neural circuitries underlying fear and extinction learning are conserved across species. Neuroimaging studies in humans yield conflicting findings, with many studies failing to show amygdala activation in response to learned threat. Such null-findings are often treated as resulting from MRI-specific problems related to measuring deep brain structures. Here we test this assumption in a mega-analysis of three studies on fear acquisition (n=98; 68 female) and extinction learning (n=79; 53 female). The conditioning procedure involved presentation of two pictures of faces and two pictures of houses: one of each pair was followed by an electric shock (CS+), the other one was never followed by a shock (CS-), and participants were instructed to learn these contingencies. Results revealed widespread responses to the CS+ compared to CS- in the fear network, including anterior insula, midcingulate cortex, thalamus and bed nucleus of the stria terminalis, but not the amygdala, which actually responded stronger to the CS-. Results were independent of spatial smoothing, and individual differences in trait anxiety and conditioned pupil responses. In contrast, robust amygdala activation distinguished faces from houses, refuting the idea that poor signal could account for the absence of effects. Moving forward, we suggest that apart from imaging larger samples at higher resolution, alternative statistical approaches may be employed to identify cross-species similarities in fear and extinction learning. |
Tianlu Wang; Lena M. Hofbauer; Dante Mantini; Céline R. Gillebert Behavioural and neural effects of eccentricity and visual field during covert visuospatial attention Journal Article In: Neuroimage: Reports, vol. 1, no. 3, pp. 1–11, 2021. @article{Wang2021g, The attentional priority map plays a key role in the distribution of attention, and is modulated by bottom-up sensory as well as top-down task-dependent factors. The intraparietal sulcus (IPS) is a key candidate to hold a neural representation of the attentional priority map. In the current study, we examined the role of the IPS during covert attention to spatial locations with high or low eccentricity in one or both visual hemifields. To this end, eighteen neurologically healthy participants performed a cued letter discrimination task in which they were endogenously cued to attend to a location at a 5 or 10◦ eccentricity in the left and/or right visual field. We briefly presented a four-letter target array and subsequently probed perceptual performance while acquiring event- related functional MRI data. While behavioural results showed greater letter discrimination performance at the low eccentricity compared to the high eccentricity location, no neural effect of eccentricity was observed. The results further showed that attending to one visual hemifield produced higher activation in the left parietal and occipital cortex compared to attending bilaterally. Future studies may consider increasing the involvement of top-down control of attention to the cued location to study the neural effect of eccentricity, e.g., through manipulating the task difficulty. |
Bo Yao; Jason R. Taylor; Briony Banks; Sonja A. Kotz Reading direct speech quotes increases theta phase-locking: Evidence for cortical tracking of inner speech? Journal Article In: NeuroImage, vol. 239, pp. 118313, 2021. @article{Yao2021a, Growing evidence shows that theta-band (4–7 Hz) activity in the auditory cortex phase-locks to rhythms of overt speech. Does theta activity also encode the rhythmic dynamics of inner speech? Previous research established that silent reading of direct speech quotes (e.g., Mary said: “This dress is lovely!”) elicits more vivid inner speech than indirect speech quotes (e.g., Mary said that the dress was lovely). As we cannot directly track the phase alignment between theta activity and inner speech over time, we used EEG to measure the brain's phase-locked responses to the onset of speech quote reading. We found that direct (vs. indirect) quote reading was associated with increased theta phase synchrony over trials at 250–500 ms post-reading onset, with sources of the evoked activity estimated in the speech processing network. An eye-tracking control experiment confirmed that increased theta phase synchrony in direct quote reading was not driven by eye movement patterns, and more likely reflects synchronous phase resetting at the onset of inner speech. These findings suggest a functional role of theta phase modulation in reading-induced inner speech. |
Nicole H. Yuen; Fred Tam; Nathan W. Churchill; Tom A. Schweizer; Simon J. Graham Driving with distraction: Measuring brain activity and oculomotor behavior using fMRI and eye-tracking Journal Article In: Frontiers in Human Neuroscience, vol. 15, pp. 1–20, 2021. @article{Yuen2021, Introduction: Driving motor vehicles is a complex task that depends heavily on how visual stimuli are received and subsequently processed by the brain. The potential impact of distraction on driving performance is well known and poses a safety concern – especially for individuals with cognitive impairments who may be clinically unfit to drive. The present study is the first to combine functional magnetic resonance imaging (fMRI) and eye-tracking during simulated driving with distraction, providing oculomotor metrics to enhance scientific understanding of the brain activity that supports driving performance. Materials and Methods: As initial work, twelve healthy young, right-handed participants performed turns ranging in complexity, including simple right and left turns without oncoming traffic, and left turns with oncoming traffic. Distraction was introduced as an auditory task during straight driving, and during left turns with oncoming traffic. Eye-tracking data were recorded during fMRI to characterize fixations, saccades, pupil diameter and blink rate. Results: Brain activation maps for right turns, left turns without oncoming traffic, left turns with oncoming traffic, and the distraction conditions were largely consistent with previous literature reporting the neural correlates of simulated driving. When the effects of distraction were evaluated for left turns with oncoming traffic, increased activation was observed in areas involved in executive function (e.g., middle and inferior frontal gyri) as well as decreased activation in the posterior brain (e.g., middle and superior occipital gyri). Whereas driving performance remained mostly unchanged (e.g., turn speed, time to turn, collisions), the oculomotor measures showed that distraction resulted in more consistent gaze at oncoming traffic in a small area of the visual scene; less time spent gazing at off-road targets (e.g., speedometer, rear-view mirror); more time spent performing saccadic eye movements; and decreased blink rate. Conclusion: Oculomotor behavior modulated with driving task complexity and distraction in a manner consistent with the brain activation features revealed by fMRI. The results suggest that eye-tracking technology should be included in future fMRI studies of simulated driving behavior in targeted populations, such as the elderly and individuals with cognitive complaints – ultimately toward developing better technology to assess and enhance fitness to drive. |
Shengnan Zhu; Yang Zhang; Junli Dong; Lihong Chen; Wenbo Luo Low-spatial-frequency information facilitates threat detection in a response-specific manner Journal Article In: Journal of Vision, vol. 21, no. 4, pp. 1–9, 2021. @article{Zhu2021a, The role of different spatial frequency bands in threat detection has been explored extensively. However, most studies use manual responses and the results are mixed. Here, we aimed to investigate the contribution of spatial frequency information to threat detection by using three response types, including manual responses, eye movements, and reaching movements, together with a priming paradigm. The results showed that both saccade and reaching responses were significantly faster to threatening stimuli than to nonthreatening stimuli when primed by low-spatial-frequency gratings rather than by high-spatial-frequency gratings. However, the manual response times to threatening stimuli were comparable to nonthreatening stimuli, irrespective of the spatial frequency content of the primes. The findings provide clear evidence that low-spatial-frequency information can facilitate threat detection in a response-specific manner, possibly through the subcortical magnocellular pathway dedicated to processing threat-related signals, which is automatically prioritized in the oculomotor system and biases behavior. |
Kristin Marie Zimmermann; Kirsten Daniela Schmidt; Franziska Gronow; Jens Sommer; Frank Leweke; Andreas Jansen Seeing things differently: Gaze shapes neural signal during mentalizing according to emotional awareness Journal Article In: NeuroImage, vol. 238, pp. 1–14, 2021. @article{Zimmermann2021, Studies on social cognition often use complex visual stimuli to asses neural processes attributed to abilities like “mentalizing” or “Theory of Mind” (ToM). During the processing of these stimuli, eye gaze, however, shapes neural signal patterns. Individual differences in neural operations on social cognition may therefore be obscured if individuals' gaze behavior differs systematically. These obstacles can be overcome by the combined analysis of neural signal and natural viewing behavior. Here, we combined functional magnetic resonance imaging (fMRI) with eye-tracking to examine effects of unconstrained gaze on neural ToM processes in healthy individuals with differing levels of emotional awareness, i.e. alexithymia. First, as previously described for emotional tasks, people with higher alexithymia levels look less at eyes in both ToM and task-free viewing contexts. Further, we find that neural ToM processes are not affected by individual differences in alexithymia per se. Instead, depending on alexithymia levels, gaze on critical stimulus aspects reversely shapes the signal in medial prefrontal cortex (MPFC) and anterior temporoparietal junction (TPJ) as distinct nodes of the ToM system. These results emphasize that natural selective attention affects fMRI patterns well beyond the visual system. Our study implies that, whenever using a task with multiple degrees of freedom in scan paths, ignoring the latter might obscure important conclusions. |
Anna M. Monk; Daniel N. Barry; Vladimir Litvak; Gareth R. Barnes; Eleanor A. Maguire Watching movies unfold, a frame-by-frame analysis of the associated neural dynamics Journal Article In: eNeuro, vol. 8, no. 4, pp. 1–12, 2021. @article{Monk2021, Our lives unfold as sequences of events. We experience these events as seamless, although they are composed of individual images captured in between the interruptions imposed by eye blinks and saccades. Events typically involve visual imagery from the real world (scenes), and the hippocampus is frequently en-gaged in this context. It is unclear, however, whether the hippocampus would be similarly responsive to unfolding events that involve abstract imagery. Addressing this issue could provide insights into the nature of its contribution to event processing, with relevance for theories of hippocampal function. Consequently, during magnetoencephalography (MEG), we had female and male humans watch highly matched unfolding movie events composed of either scene image frames that reflected the real world, or frames depicting abstract pat-terns. We examined the evoked neuronal responses to each image frame along the time course of the movie events. Only one difference between the two conditions was evident, and that was during the viewing of the first image frame of events, detectable across frontotemporal sensors. Further probing of this difference using source reconstruction revealed greater engagement of a set of brain regions across parietal, frontal, premotor, and cerebellar cortices, with the largest change in broadband (1–30 Hz) power in the hippocampus during scene-based movie events. Hippocampal engagement during the first image frame of scene-based events could reflect its role in registering a recognizable context perhaps based on templates or schemas. The hippo-campus, therefore, may help to set the scene for events very early on. |
Anna M. Monk; Marshall A. Dalton; Gareth R. Barnes; Eleanor A. Maguire The role of hippocampal-ventromedial prefrontal cortex neural dynamics in building mental representations Journal Article In: Journal of Cognitive Neuroscience, vol. 33, no. 1, pp. 89–103, 2021. @article{Monk2021a, The hippocampus and ventromedial prefrontal cortex (vmPFC) play key roles in numerous cognitive domains including mind-wandering, episodic memory and imagining the future. Perspectives differ on precisely how they support these diverse functions, but there is general agreement that it involves constructing representations comprised of numerous elements. Visual scenes have been deployed extensively in cognitive neuroscience because they are paradigmatic multi-element stimuli. However, it remains unclear whether scenes, rather than other types of multi-feature stimuli, preferentially engage hippocampus and vmPFC. Here we leveraged the high temporal resolution of magnetoencephalography to test participants as they gradually built scene imagery from three successive auditorily-presented object descriptions and an imagined 3D space. This was contrasted with constructing mental images of non-scene arrays that were composed of three objects and an imagined 2D space. The scene and array stimuli were, therefore, highly matched, and this paradigm permitted a closer examination of step-by-step mental construction than has been undertaken previously. We observed modulation of theta power in our two regions of interest -anterior hippocampus during the initial stage, and in vmPFC during the first two stages, of scene relative to array construction. Moreover, the scene-specific anterior hippocampal activity during the first construction stage was driven by the vmPFC, with mutual entrainment between the two brain regions thereafter. These findings suggest that hippocampal and vmPFC neural activity is especially tuned to scene representations during the earliest stage of their formation, with implications for theories of how these brain areas enable cognitive functions such as episodic memory. |
Peter R. Murphy; Niklas Wilming; Diana C. Hernandez-Bocanegra; Genis Prat-Ortega; Tobias H. Donner Adaptive circuit dynamics across human cortex during evidence accumulation in changing environments Journal Article In: Nature Neuroscience, vol. 24, no. 7, pp. 987–997, 2021. @article{Murphy2021, Many decisions under uncertainty entail the temporal accumulation of evidence that informs about the state of the environment. When environments are subject to hidden changes in their state, maximizing accuracy and reward requires non-linear accumulation of evidence. How this adaptive, non-linear computation is realized in the brain is unknown. We analyzed human behavior and cortical population activity (measured with magnetoencephalography) recorded during visual evidence accumulation in a changing environment. Behavior and decision-related activity in cortical regions involved in action planning exhibited hallmarks of adaptive evidence accumulation, which could also be implemented by a recurrent cortical microcircuit. Decision dynamics in action-encoding parietal and frontal regions were mirrored in a frequency-specific modulation of the state of the visual cortex that depended on pupil-linked arousal and the expected probability of change. These findings link normative decision computations to recurrent cortical circuit dynamics and highlight the adaptive nature of decision-related feedback to the sensory cortex. |
J. A. Nij Bijvank; E. M. M. Strijbis; I. M. Nauta; S. D. Kulik; L. J. Balk; C. J. Stam; A. Hillebrand; J. J. G. Geurts; B. M. J. Uitdehaag; L. J. Rijn; A. Petzold; M. M. Schoonheim Impaired saccadic eye movements in multiple sclerosis are related to altered functional connectivity of the oculomotor brain network Journal Article In: NeuroImage: Clinical, vol. 32, pp. 102848, 2021. @article{NijBijvank2021, Background: Impaired eye movements in multiple sclerosis (MS) are common and could represent a non-invasive and accurate measure of (dys)functioning of interconnected areas within the complex brain network. The aim of this study was to test whether altered saccadic eye movements are related to changes in functional connectivity (FC) in patients with MS. Methods: Cross-sectional eye movement (pro-saccades and anti-saccades) and magnetoencephalography (MEG) data from the Amsterdam MS cohort were included from 176 MS patients and 33 healthy controls. FC was calculated between all regions of the Brainnetome atlas in six conventional frequency bands. Cognitive function and disability were evaluated by previously validated measures. The relationships between saccadic parameters and both FC and clinical scores in MS patients were analysed using multivariate linear regression models. Results: In MS pro- and anti-saccades were abnormal compared to healthy controls A relationship of saccadic eye movements was found with FC of the oculomotor network, which was stronger for regional than global FC. In general, abnormal eye movements were related to higher delta and theta FC but lower beta FC. Strongest associations were found for pro-saccadic latency and FC of the precuneus (beta band β = -0.23 |
Anastasia O. Ovchinnikova; Anatoly N. Vasilyev; Ivan P. Zubarev; Bogdan L. Kozyrskiy; Sergei L. Shishkin MEG-based detection of voluntary eye fixations used to control a computer Journal Article In: Frontiers in Neuroscience, vol. 15, pp. 619591, 2021. @article{Ovchinnikova2021, Gaze-based input is an efficient way of hand-free human-computer interaction. However, it suffers from the inability of gaze-based interfaces to discriminate voluntary and spontaneous gaze behaviors, which are overtly similar. Here, we demonstrate that voluntary eye fixations can be discriminated from spontaneous ones using short segments of magnetoencephalography (MEG) data measured immediately after the fixation onset. Recently proposed convolutional neural networks (CNNs), linear finite impulse response filters CNN (LF-CNN) and vector autoregressive CNN (VAR-CNN), were applied for binary classification of the MEG signals related to spontaneous and voluntary eye fixations collected in healthy participants (n = 25) who performed a game-like task by fixating on targets voluntarily for 500 ms or longer. Voluntary fixations were identified as those followed by a fixation in a special confirmatory area. Spontaneous vs. voluntary fixation-related single-trial 700 ms MEG segments were non-randomly classified in the majority of participants, with the group average cross-validated ROC AUC of 0.66 ± 0.07 for LF-CNN and 0.67 ± 0.07 for VAR-CNN (M ± SD). When the time interval, from which the MEG data were taken, was extended beyond the onset of the visual feedback, the group average classification performance increased up to 0.91. Analysis of spatial patterns contributing to classification did not reveal signs of significant eye movement impact on the classification results. We conclude that the classification of MEG signals has a certain potential to support gaze-based interfaces by avoiding false responses to spontaneous eye fixations on a single-trial basis. Current results for intention detection prior to gaze-based interface's feedback, however, are not sufficient for online single-trial eye fixation classification using MEG data alone, and further work is needed to find out if it could be used in practical applications. |
Fosca Al Roumi; Sébastien Marti; Liping Wang; Marie Amalric; Stanislas Dehaene Mental compression of spatial sequences in human working memory using numerical and geometrical primitives Journal Article In: Neuron, vol. 109, no. 16, pp. 2627–2639, 2021. @article{AlRoumi2021, How does the human brain store sequences of spatial locations? We propose that each sequence is internally compressed using an abstract, language-like code that captures its numerical and geometrical regularities. We exposed participants to spatial sequences of fixed length but variable regularity while their brain activity was recorded using magneto-encephalography. Using multivariate decoders, each successive location could be decoded from brain signals, and upcoming locations were anticipated prior to their actual onset. Crucially, sequences with lower complexity, defined as the minimal description length provided by the formal language, led to lower error rates and to increased anticipations. Furthermore, neural codes specific to the numerical and geometrical primitives of the postulated language could be detected, both in isolation and within the sequences. These results suggest that the human brain detects sequence regularities at multiple nested levels and uses them to compress long sequences in working memory. |
Damiano Azzalini; Anne Buot; Stefano Palminteri; Catherine Tallon-Baudry Responses to heartbeats in ventromedial prefrontal cortex contribute to subjective preference-based decisions Journal Article In: Journal of Neuroscience, vol. 41, no. 23, pp. 5102–5114, 2021. @article{Azzalini2021, Forrest Gump or The Matrix? Preference-based decisions are subjective and entail self-reflection. However, these self-related features are unaccounted for by known neural mechanisms of valuation and choice. Self-related processes have been linked to a basic interoceptive biological mechanism, the neural monitoring of heartbeats, in particular in ventromedial prefrontal cortex (vmPFC), a region also involved in value encoding. We thus hypothesized a functional coupling between the neural monitoring of heartbeats and the precision of value encoding in vmPFC. Human participants of both sexes were presented with pairs of movie titles. They indicated either which movie they preferred or performed a control objective visual discrimination that did not require self-reflection. Using magnetoencephalography, we measured heartbeat-evoked responses (HERs) before option presentation and confirmed that HERs in vmPFC were larger when preparing for the subjective, self-related task. We retrieved the expected cortical value network during choice with time-resolved statistical modeling. Crucially, we show that larger HERs before option presentation are followed by stronger value encoding during choice in vmPFC. This effect is independent of overall vmPFC baseline activity. The neural interaction between HERs and value encoding predicted preference-based choice consistency over time, accounting for both interindividual differences and trial-to-trial fluctuations within individuals. Neither cardiac activity nor arousal fluctuations could account for any of the effects. HERs did not interact with the encoding of perceptual evidence in the discrimination task. Our results show that the self-reflection underlying preference-based decisions involves HERs, and that HER integration to subjective value encoding in vmPFC contributes to preference stability. |
Anne Buot; Damiano Azzalini; Maximilien Chaumon; Catherine Tallon-Baudry Does stroke volume influence heartbeat evoked responses? Journal Article In: Biological Psychology, vol. 165, pp. 108165, 2021. @article{Buot2021, We know surprisingly little on how heartbeat-evoked responses (HERs) vary with cardiac parameters. Here, we measured both stroke volume, or volume of blood ejected at each heartbeat, with impedance cardiography, and HER amplitude with magneto-encephalography, in 21 male and female participants at rest with eyes open. We observed that HER co-fluctuates with stroke volume on a beat-to-beat basis, but only when no correction for cardiac artifact was performed. This highlights the importance of an ICA correction tailored to the cardiac artifact. We also observed that easy-to-measure cardiac parameters (interbeat intervals, ECG amplitude) are sensitive to stroke volume fluctuations and can be used as proxies when stroke volume measurements are not available. Finally, interindividual differences in stroke volume were reflected in MEG data, but whether this effect is locked to heartbeats is unclear. Altogether, our results question assumptions on the link between stroke volume and HERs. |
Jonathan Daume; Peng Wang; Alexander Maye; Dan Zhang; Andreas K. Engel Non-rhythmic temporal prediction involves phase resets of low-frequency delta oscillations Journal Article In: NeuroImage, vol. 224, pp. 117376, 2021. @article{Daume2021, The phase of neural oscillatory signals aligns to the predicted onset of upcoming stimulation. Whether such phase alignments represent phase resets of underlying neural oscillations or just rhythmically evoked activity, and whether they can be observed in a rhythm-free visual context, however, remains unclear. Here, we recorded the magnetoencephalogram while participants were engaged in a temporal prediction task, judging the visual or tactile reappearance of a uniformly moving stimulus. The prediction conditions were contrasted with a control condition to dissociate phase adjustments of neural oscillations from stimulus-driven activity. We observed stronger delta band inter-trial phase consistency (ITPC) in a network of sensory, parietal and frontal brain areas, but no power increase reflecting stimulus-driven or prediction-related evoked activity. Delta ITPC further correlated with prediction performance in the cerebellum and visual cortex. Our results provide evidence that phase alignments of low-frequency neural oscillations underlie temporal predictions in a non-rhythmic visual and crossmodal context. |
Linda Drijvers; Ole Jensen; Eelke Spaak Rapid invisible frequency tagging reveals nonlinear integration of auditory and visual information Journal Article In: Human Brain Mapping, vol. 42, no. 4, pp. 1138–1152, 2021. @article{Drijvers2021, During communication in real-life settings, the brain integrates information from auditory and visual modalities to form a unified percept of our environment. In the current magnetoencephalography (MEG) study, we used rapid invisible frequency tagging (RIFT) to generate steady-state evoked fields and investigated the integration of audiovisual information in a semantic context. We presented participants with videos of an actress uttering action verbs (auditory; tagged at 61 Hz) accompanied by a gesture (visual; tagged at 68 Hz, using a projector with a 1,440 Hz refresh rate). Integration difficulty was manipulated by lower-order auditory factors (clear/degraded speech) and higher-order visual factors (congruent/incongruent gesture). We identified MEG spectral peaks at the individual (61/68 Hz) tagging frequencies. We furthermore observed a peak at the intermodulation frequency of the auditory and visually tagged signals (fvisual − fauditory = 7 Hz), specifically when lower-order integration was easiest because signal quality was optimal. This intermodulation peak is a signature of nonlinear audiovisual integration, and was strongest in left inferior frontal gyrus and left temporal regions; areas known to be involved in speech-gesture integration. The enhanced power at the intermodulation frequency thus reflects the ease of lower-order audiovisual integration and demonstrates that speech-gesture information interacts in higher-order language areas. Furthermore, we provide a proof-of-principle of the use of RIFT to study the integration of audiovisual stimuli, in relation to, for instance, semantic context. |
Stefan Dürschmid; Andre Maric; Marcel S. Kehl; Robert T. Knight; Hermann Hinrichs; Hans-Jochen Heinze Fronto-temporal regulation of subjective value to suppress impulsivity in intertemporal choices Journal Article In: Journal of Neuroscience, vol. 41, pp. 1727–1737, 2021. @article{Duerschmid2021, Impulsive decisions arise from preferring smaller but sooner rewards compared to larger but later rewards. How neural activity and attention to choice alternatives contribute to reward decisions during temporal discounting is not clear. Here we probed (i) attention to and (ii) neural representation of delay and reward information in humans (both sexes) engaged in choices. We studied behavioral and frequency specific dynamics supporting impulsive decisions on a fine-grained temporal scale using eye tracking and magnetoencephalographic (MEG) recordings. In one condition participants had to decide for themselves but pretended to decide for their best friend in a second prosocial condition, which required perspective taking. Hence, conditions varied in the value for themselves versus that pretending to choose for another person. Stronger impulsivity was reliably found across three independent groups for prosocial decisions. Eye tracking revealed a systematic shift of attention from the delay to the reward information and differences in eye tracking between conditions predicted differences in discounting. High frequency activity (HFA: 175-250 Hz) distributed over right fronto-temporal sensors correlated with delay and reward information in consecutive temporal intervals for high value decisions for oneself but not the friend. Collectively the results imply that the HFA recorded over fronto-temporal MEG sensors plays a critical role in choice option integration. |
Florian Krause; Nikos Kogias; Martin Krentz; Michael Lührs; Rainer Goebel; Erno J. Hermans Self-regulation of stress-related large-scale brain network balance using real-time fMRI neurofeedback Journal Article In: NeuroImage, vol. 243, pp. 118527, 2021. @article{Krause2021, It has recently been shown that acute stress affects the allocation of neural resources between large-scale brain networks, and the balance between the executive control network and the salience network in particular. Maladaptation of this dynamic resource reallocation process is thought to play a major role in stress-related psychopathology, suggesting that stress resilience may be determined by the retained ability to adaptively reallocate neural resources between these two networks. Actively training this ability could hence be a potentially promising way to increase resilience in individuals at risk for developing stress-related symptomatology. Using real-time functional Magnetic Resonance Imaging, the current study investigated whether individuals can learn to self-regulate stress-related large-scale network balance. Participants were engaged in a bidirectional and implicit real-time fMRI neurofeedback paradigm in which they were intermittently provided with a visual representation of the difference signal between the average activation of the salience and executive control networks, and tasked with attempting to self-regulate this signal. Our results show that, given feedback about their performance over three training sessions, participants were able to (1) learn strategies to differentially control the balance between SN and ECN activation on demand, as well as (2) successfully transfer this newly learned skill to a situation where they (a) did not receive any feedback anymore, and (b) were exposed to an acute stressor in form of the prospect of a mild electric stimulation. The current study hence constitutes an important first successful demonstration of neurofeedback training based on stress-related large-scale network balance – a novel approach that has the potential to train control over the central response to stressors in real-life and could build the foundation for future clinical interventions that aim at increasing resilience. |
Irma T. Kurniawan; Marcus Grueschow; Christian C. Ruff Anticipatory energization revealed by pupil and brain activity guides human effort-based decision making Journal Article In: Journal of Neuroscience, vol. 41, no. 29, pp. 6328–6342, 2021. @article{Kurniawan2021, An organism's fitness is determined by how it chooses to adapt to effort in response to challenges. Exertion of effort correlates with activity in dorsomedial prefrontal cortex (dmPFC) and noradrenergic pupil dilation, but little is known about the role of these neurophysiological processes for decisions about future efforts, they may provide anticipatory energization to help us accept the challenge or a cost representation that is weighted against the expected rewards. Here, we provide evidence for the former, by measuring pupil and functional magnetic resonance imaging (fMRI) brain responses while 52 human participants (29 females) chose whether to exert efforts to obtain rewards. Both pupil-dilation rate and dmPFC fMRI activity increased with anticipated effort level, and these increases differ depending on the choice outcome: they were stronger when participants chose to accept the challenge compared with when the challenge was declined. Crucially, the choice-dependent modulation of pupil and brain-activity effort representations were stronger in participants whose behavioral choices were more sensitive to effort. Our results identify a process involving the peripheral and central human nervous system that simulates the required energization before overt response, suggesting a role in guiding effort-based decisions. |
Hsin-Hung Li; Thomas C. Sprague; Aspen H. Yoo; Wei Ji Ma; Clayton E. Curtis Joint representation of working memory and uncertainty in human cortex Journal Article In: Neuron, vol. 109, no. 22, pp. 3699–3712, 2021. @article{Li2021c, Neural representations of visual working memory (VWM) are noisy, and thus, decisions based on VWM are inevitably subject to uncertainty. However, the mechanisms by which the brain simultaneously represents the content and uncertainty of memory remain largely unknown. Here, inspired by the theory of probabilistic population codes, we test the hypothesis that the human brain represents an item maintained in VWM as a probability distribution over stimulus feature space, thereby capturing both its content and uncertainty. We used a neural generative model to decode probability distributions over memorized locations from fMRI activation patterns. We found that the mean of the probability distribution decoded from retinotopic cortical areas predicted memory reports on a trial-by-trial basis. Moreover, in several of the same mid-dorsal stream areas, the spread of the distribution predicted subjective trial-by-trial uncertainty judgments. These results provide evidence that VWM content and uncertainty are jointly represented by probabilistic neural codes. |
Björn Machner; Jonathan Imholz; Lara Braun; Philipp J. Koch; Tobias Bäumer; Thomas F. Münte; Christoph Helmchen; Andreas Sprenger In: Neuroimage: Reports, vol. 1, no. 2, pp. 100013, 2021. @article{Machner2021, Disruption of resting-state functional connectivity (RSFC) between core regions of the dorsal attention network (DAN), including the bilateral superior parietal lobule (SPL), and structural damage of the right-lateralized ventral attention network (VAN), including the temporo-parietal junction (TPJ), have been described as neural basis for hemispatial neglect. Pursuing a virtual lesion model, we aimed to perturbate the attention networks of 22 healthy subjects by applying continuous theta burst stimulation (cTBS) to the right SPL or TPJ. We first created network masks of the DAN and VAN based on RSFC analyses from a RS-fMRI baseline session and determined the SPL and TPJ stimulation site within the respective mask. We then performed RS-fMRI immediately after cTBS of the SPL, TPJ (active sites) or vertex (control site). RSFC between SPL/TPJ and whole brain as well as between predefined regions of interest (ROI) in the attention networks was analyzed in a within-subject design. Contrary to our hypothesis, seed-based RSFC did not differ between the four experimental conditions. The individual change in ROI-to-ROI RSFC from baseline to post-stimulation did also not differ between active (SPL, TPJ) and control (vertex) cTBS. In our study, a single session offline cTBS over the right SPL or TPJ could not alter RSFC in the attention networks as compared to a control stimulation, maybe because effects wore off too early. Future studies should consider a modified cTBS protocol, concurrent TMS-fMRI or transcranial direct current stimulation. |
Jennifer E. Mack; Colleen Ward; Sofia Stratford Impact of the fMRI environment on eye-tracking measures in a linguistic prediction task Journal Article In: Language, Cognition and Neuroscience, vol. 36, no. 6, pp. 675–693, 2021. @article{Mack2021, The present study investigated the impact of the MRI environment on eye-movement measures in the visual-world paradigm. 24 neurotypical young adults performed a linguistic prediction task in a typical lab setting (Lab) and 22 did so during MRI scanning (Scanner). Data analyses focused on eye-tracking data quality and the time course and magnitude of prediction effects. Data quality was reduced in the Scanner as compared to the Lab, as indicated by a higher rate of track loss and saccades/fixations of atypical duration. Predictive eye movement patterns were generally similar in timing and magnitude between the Lab and Scanner, although there was modest evidence for increased prediction effects in the Scanner. In the Scanner environment only, predictive eye movements were linked to better task performance. Evidently, the MRI environment can enhance prediction effects and their relationship to task performance, possibly due to increased deployment of cognitive control mechanisms. |
Verónica Mäki-Marttunen Pupil-based states of brain integration across cognitive states Journal Article In: Neuroscience, vol. 471, pp. 61–71, 2021. @article{MaekiMarttunen2021, Arousal is a potent mechanism that provides the brain with functional flexibility and adaptability to external conditions. Within the wake state, arousal levels driven by activity in the neuromodulatory systems are related to specific signatures of neural activation and brain synchrony. However, direct evidence is still lacking on the varying effects of arousal on macroscopic brain characteristics and across a variety of cognitive states in humans. Using a concurrent fMRI-pupillometry approach, we used pupil size as a proxy for arousal and obtained patterns of brain integration associated with increasing arousal levels. We carried out this analysis on resting-state data and data from two attentional tasks implicating different cognitive processes. We found that an increasing level of arousal was related to a state of increased brain integration. This effect was prominent in the salience, visual and default-mode networks in all conditions, while other regions showed task-specificity. Increased integration in the salience network was also related to faster pupil dilation in the two attentional tasks. Furthermore, task performance was related to arousal level, with lower accuracy at higher level of arousal. Taken together, our study provides evidence in humans for pupil size as an index of brain network state, and supports the role of arousal as a switch that drives brain coordination in specific brain regions according to the cognitive state. |
Cornelia McCormick; Marshall A. Dalton; Peter Zeidman; Eleanor A. Maguire Characterising the hippocampal response to perception, construction and complexity Journal Article In: Cortex, vol. 137, pp. 1–17, 2021. @article{McCormick2021, The precise role played by the hippocampus in supporting cognitive functions such as episodic memory and future thinking is debated, but there is general agreement that it involves constructing representations comprised of numerous elements. Visual scenes have been deployed extensively in cognitive neuroscience because they are paradigmatic multi-element stimuli. However, questions remain about the specificity and nature of the hippocampal response to scenes. Here, we devised a paradigm in which we had participants search pairs of images for either colour or layout differences, thought to be associated with perceptual or spatial constructive processes respectively. Importantly, images depicted either naturalistic scenes or phase-scrambled versions of the same scenes, and were either simple or complex. Using this paradigm during functional MRI scanning, we addressed three questions: 1. Is the hippocampus recruited specifically during scene processing? 2. If the hippocampus is more active in response to scenes, does searching for colour or layout differences influence its activation? 3. Does the complexity of the scenes affect its response? We found that, compared to phase-scrambled versions of the scenes, the hippocampus was more responsive to scene stimuli. Moreover, a clear anatomical distinction was evident, with colour detection in scenes engaging the posterior hippocampus whereas layout detection in scenes recruited the anterior hippocampus. The complexity of the scenes did not influence hippocampal activity. These findings seem to align with perspectives that propose the hippocampus is especially attuned to scenes, and its involvement occurs irrespective of the cognitive process or the complexity of the scenes. |
Cornelia McCormick; Eleanor A. Maguire The distinct and overlapping brain networks supporting semantic and spatial constructive scene processing Journal Article In: Neuropsychologia, vol. 158, pp. 107912, 2021. @article{McCormick2021a, Scene imagery features prominently when we recall autobiographical memories, imagine the future and navigate around in the world. Consequently, in this study we sought to better understand how scene representations are supported by the brain. Processing scenes involves a variety of cognitive processes that in the real world are highly interactive. Here, however, our goal was to separate semantic and spatial constructive scene processes in order to identify the brain areas that were distinct to each process, those they had in common, and the connectivity between regions. To this end, participants searched for either semantic or spatial constructive impossibilities in scenes during functional MRI. We focussed our analyses on only those scenes that were possible, thus removing any error detection that would evoke reactions such as surprise or novelty. Importantly, we also counterbalanced possible scenes across participants, enabling us to examine brain activity and connectivity for the same possible scene images under two different conditions. We found that participants adopted different cognitive strategies, which were reflected in distinct oculomotor behaviour, for each condition. These were in turn associated with increased engagement of lateral temporal and parietal cortices for semantic scene processing, the hippocampus for spatial constructive scene processing, and increased activation of the ventromedial prefrontal cortex (vmPFC) that was common to both. Connectivity analyses showed that the vmPFC switched between semantic and spatial constructive brain networks depending on the task at hand. These findings further highlight the well-known semantic functions of lateral temporal areas, while providing additional support for the previously-asserted contribution of the hippocampus to scene construction, and recent suggestions that the vmPFC may play a key role in orchestrating scene processing. |
Heath R. Pardoe; Samantha P. Martin; Yijun Zhao; Allan George; Hui Yuan; Jingjie Zhou; Wei Liu; Orrin Devinsky Estimation of in-scanner head pose changes during structural MRI using a convolutional neural network trained on eye tracker video Journal Article In: Magnetic Resonance Imaging, vol. 81, pp. 101–108, 2021. @article{Pardoe2021, Introduction: In-scanner head motion is a common cause of reduced image quality in neuroimaging, and causes systematic brain-wide changes in cortical thickness and volumetric estimates derived from structural MRI scans. There are few widely available methods for measuring head motion during structural MRI. Here, we train a deep learning predictive model to estimate changes in head pose using video obtained from an in-scanner eye tracker during an EPI-BOLD acquisition with participants undertaking deliberate in-scanner head movements. The predictive model was used to estimate head pose changes during structural MRI scans, and correlated with cortical thickness and subcortical volume estimates. Methods: 21 healthy controls (age 32 ± 13 years, 11 female) were studied. Participants carried out a series of stereotyped prompted in-scanner head motions during acquisition of an EPI-BOLD sequence with simultaneous recording of eye tracker video. Motion-affected and motion-free whole brain T1-weighted MRI were also obtained. Image coregistration was used to estimate changes in head pose over the duration of the EPI-BOLD scan, and used to train a predictive model to estimate head pose changes from the video data. Model performance was quantified by assessing the coefficient of determination (R2). We evaluated the utility of our technique by assessing the relationship between video-based head pose changes during structural MRI and (i) vertex-wise cortical thickness and (ii) subcortical volume estimates. Results: Video-based head pose estimates were significantly correlated with ground truth head pose changes estimated from EPI-BOLD imaging in a hold-out dataset. We observed a general brain-wide overall reduction in cortical thickness with increased head motion, with some isolated regions showing increased cortical thickness estimates with increased motion. Subcortical volumes were generally reduced in motion affected scans. Conclusions: We trained a predictive model to estimate changes in head pose during structural MRI scans using in-scanner eye tracker video. The method is independent of individual image acquisition parameters and does not require markers to be to be fixed to the patient, suggesting it may be well suited to clinical imaging and research environments. Head pose changes estimated using our approach can be used as covariates for morphometric image analyses to improve the neurobiological validity of structural imaging studies of brain development and disease. |
Gabriel Pelletier; Nadav Aridan; Lesley K. Fellows; Tom Schonberg A preferential role for ventromedial prefrontal cortex in assessing "the value of the whole" in multiattribute object evaluation Journal Article In: Journal of Neuroscience, vol. 41, no. 23, pp. 5056–5068, 2021. @article{Pelletier2021, Everyday decision-making commonly involves assigning values to complex objects with multiple value-relevant attributes. Drawing on object recognition theories, we hypothesized two routes to multiattribute evaluation: Assessing the value of the whole object based on holistic attribute configuration or summing individual attribute values. In two samples of healthy human male and female participants undergoing eye tracking and functional magnetic resonance imaging (fMRI) while evaluating novel pseudo objects, we found evidence for both forms of evaluation. Fixations to and transitions between attributes differed systematically when the value of pseudo objects was associated with individual attributes or attribute configurations. Ventromedial prefrontal cortex (vmPFC) and perirhinal cortex were engaged when configural processing was required. These results converge with our recent findings that individuals with vmPFC lesions were impaired in decisions requiring configural evaluation but not when evaluating the sum of the parts. This suggests that multiattribute decision-making engages distinct evaluation mechanisms relying on partially dissociable neural substrates, depending on the relationship between attributes and value. |
Samuel Planton; Stanislas Dehaene Cerebral representation of sequence patterns across multiple presentation formats Journal Article In: Cortex, vol. 145, pp. 13–36, 2021. @article{Planton2021, The ability to detect the abstract pattern underlying a temporal sequence of events is crucial to many human activities, including language and mathematics, but its cortical correlates remain poorly understood. It is also unclear whether repeated exposure to the same sequence of sensory stimuli is sufficient to induce the encoding of an abstract amodal representation of the pattern. Using functional MRI, we probed the existence of such abstract codes for sequential patterns, their localization in the human brain, and their relation to existing language and math-responsive networks. We used a passive sequence violation paradigm, in which a given sequence is repeatedly presented before rare deviant sequences are introduced. We presented two binary patterns, AABB and ABAB, in four presentation formats, either visual or auditory, and either cued by the identity of the stimuli or by their spatial location. Regardless of the presentation format, a habituation to the repeated pattern and a response to pattern violations were seen in a set of inferior frontal, intraparietal and temporal areas. Within language areas, such pattern-violation responses were only found in the inferior frontal gyrus (IFG), whereas all math-responsive regions responded to pattern changes. Most of these regions also responded whenever the modality or the cue changed, suggesting a general sensitivity to violation detection. Thus, the representation of sequence patterns appears to be distributed, yet to include a core set of abstract amodal regions, particularly the IFG. |
Sonia Poltoratski; Kendrick Kay; Dawn Finzi; Kalanit Grill-Spector Holistic face recognition is an emergent phenomenon of spatial processing in face-selective regions Journal Article In: Nature Communications, vol. 12, pp. 4745, 2021. @article{Poltoratski2021, Spatial processing by receptive fields is a core property of the visual system. However, it is unknown how spatial processing in high-level regions contributes to recognition behavior. As face inversion is thought to disrupt typical holistic processing of information in faces, we mapped population receptive fields (pRFs) with upright and inverted faces in the human visual system. Here we show that in face-selective regions, but not primary visual cortex, pRFs and overall visual field coverage are smaller and shifted downward in response to face inversion. From these measurements, we successfully predict the relative behavioral detriment of face inversion at different positions in the visual field. This correspondence between neural measurements and behavior demonstrates how spatial processing in face-selective regions may enable holistic perception. These results not only show that spatial processing in high-level visual regions is dynamically used towards recognition, but also suggest a powerful approach for bridging neural computations by receptive fields to behavior. |
John R. Purcell; Andrew Jahn; Justin M. Fine; Joshua W. Brown Neural correlates of visual attention during risky decision evidence integration Journal Article In: NeuroImage, vol. 234, pp. 117979, 2021. @article{Purcell2021, Value-based decision-making is presumed to involve a dynamic integration process that supports assessing the potential outcomes of different choice options. Decision frameworks assume the value of a decision rests on both the desirability and risk surrounding an outcome. Previous work has highlighted neural representations of risk in the human brain, and their relation to decision choice. Key neural regions including the insula and anterior cingulate cortex (ACC) have been implicated in encoding the effects of risk on decision outcomes, including approach and avoidance. Yet, it remains unknown whether these regions are involved in the dynamic integration processes that precede and drive choice, and their relationship with ongoing attention. Here, we used concurrent fMRI and eye-tracking to discern neural activation related to visual attention preceding choice between sure-thing (i.e. safe) and risky gamble options. We found activation in both dorsal ACC (dACC) and posterior insula (PI) scaled in opposite directions with the difference in attention to risky rewards relative to risky losses. PI activation also differentiated foveations on both risky options (rewards and losses) relative to a sure-thing option. These findings point to ACC involvement in ongoing evaluation of risky but higher value options. The role of PI in risky outcomes points to a more general evaluative role in the decision-making that compares both safe and risky outcomes, irrespective of potential for gains or losses. |
Abhijit Rajan; Sreenivasan Meyyappan; Yuelu Liu; Immanuel Babu Henry Samuel; Bijurika Nandi; George R. Mangun; Mingzhou Ding The microstructure of attentional control in the dorsal attention network Journal Article In: Journal of Cognitive Neuroscience, vol. 33, no. 6, pp. 965–983, 2021. @article{Rajan2021, The top–down control of attention involves command signals arising chiefly in the dorsal attention network (DAN) in frontal and parietal cortex and propagating to sensory cortex to enable the selective processing of incoming stimuli based on their behavioral relevance. Consistent with this view, the DAN is active during preparatory (anticipatory) attention for relevant events and objects, which, in vision, may be defined by different stimulus attributes including their spatial location, color, motion, or form. How this network is organized to support different forms of preparatory attention to different stimulus attributes remains unclear. We propose that, within the DAN, there exist functional microstructures (patterns of activity) specific for controlling attention based on the specific information to be attended. To test this, we contrasted preparatory attention to stimulus location (spatial attention) and to stimulus color (feature attention), and used multivoxel pattern analysis to characterize the corresponding patterns of activity within the DAN. We observed different multivoxel patterns of BOLD activation within the DAN for the control of spatial attention (attending left vs. right) and feature attention (attending red vs. green). These patterns of activity for spatial and feature attentional control showed limited overlap with each other within the DAN. Our findings thus support a model in which the DAN has different functional microstructures for distinctive forms of top–down control of visual attention. |
Ryan V. Raut; Abraham Z. Snyder; Anish Mitra; Dov Yellin; Naotaka Fujii; Rafael Malach; Marcus E. Raichle Global waves synchronize the brain's functional systems with fluctuating arousal Journal Article In: Science Advances, vol. 7, no. 30, pp. eabf2709, 2021. @article{Raut2021, We propose and empirically support a parsimonious account of intrinsic, brain-wide spatiotemporal organization arising from traveling waves linked to arousal. We hypothesize that these waves are the predominant physiological process reflected in spontaneous functional magnetic resonance imaging (fMRI) signal fluctuations. The correlation structure ("functional connectivity") of these fluctuations recapitulates the large-scale functional organization of the brain. However, a unifying physiological account of this structure has so far been lacking. Here, using fMRI in humans, we show that ongoing arousal fluctuations are associated with global waves of activity that slowly propagate in parallel throughout the neocortex, thalamus, striatum, and cerebellum. We show that these waves can parsimoniously account for many features of spontaneous fMRI signal fluctuations, including topographically organized functional connectivity. Last, we demonstrate similar, cortex-wide propagation of neural activity measured with electrocorticography in macaques. These findings suggest that traveling waves spatiotemporally pattern brain-wide excitability in relation to arousal. |
Mor Regev; Andrea R. Halpern; Adrian M. Owen; Aniruddh D. Patel; Robert J. Zatorre Mapping specific mental content during musical imagery Journal Article In: Cerebral Cortex, vol. 31, no. 8, pp. 3622–3640, 2021. @article{Regev2021, Humans can mentally represent auditory information without an external stimulus, but the specificity of these internal representations remains unclear. Here, we asked how similar the temporally unfolding neural representations of imagined music are compared to those during the original perceived experience. We also tested whether rhythmic motion can influence the neural representation of music during imagery as during perception. Participants first memorized six 1-min-long instrumental musical pieces with high accuracy. Functional MRI data were collected during: 1) silent imagery of melodies to the beat of a visual metronome; 2) same but while tapping to the beat; and 3) passive listening. During imagery, inter-subject correlation analysis showed that melody-specific temporal response patterns were reinstated in right associative auditory cortices. When tapping accompanied imagery, the melody-specific neural patterns were reinstated in more extensive temporal-lobe regions bilaterally. These results indicate that the specific contents of conscious experience are encoded similarly during imagery and perception in the dynamic activity of auditory cortices. Furthermore, rhythmic motion can enhance the reinstatement of neural patterns associated with the experience of complex sounds, in keeping with models of motor to sensory influences in auditory processing. |
Sarah Schuster; Nicole Alexandra; Florian Hutzler; Fabio Richlan; Martin Kronbichler; Stefan Hawelka Cloze enough? Hemodynamic effects of predictive processing during natural reading Journal Article In: NeuroImage, vol. 228, pp. 117687, 2021. @article{Schuster2021, Evidence accrues that readers form multiple hypotheses about upcoming words. The present study investigated the hemodynamic effects of predictive processing during natural reading by means of combining fMRI and eye movement recordings. In particular, we investigated the neural and behavioral correlates of precision-weighted prediction errors, which are thought to be indicative of subsequent belief updating. Participants silently read sentences in which we manipulated the cloze probability and the semantic congruency of the final word that served as an index for precision and prediction error respectively. With respect to the neural correlates, our findings indicate an enhanced activation within the left inferior frontal and middle temporal gyrus suggesting an effect of precision on prediction update in higher (lexico-)semantic levels. Despite being evident at the neural level, we did not observe any evidence that this mechanism resulted in disproportionate reading times on participants' eye movements. The results speak against discrete predictions, but favor the notion that multiple words are activated in parallel during reading. 1. |
Alyssa H. Sinclair; Grace M. Manalili; Iva K. Brunec; R. Alison Adcock; Morgan D. Barense Prediction errors disrupt hippocampal representations and update episodic memories Journal Article In: Proceedings of the National Academy of Sciences, vol. 118, no. 51, pp. 1–12, 2021. @article{Sinclair2021, The brain supports adaptive behavior by generating predictions, learning from errors, and updating memories to incorporate new information. Prediction error, or surprise, triggers learning when reality contradicts expectations. Prior studies have shown that the hippocampus signals prediction errors, but the hypothesized link to memory updating has not been demonstrated. In a human functional MRI study, we elicited mnemonic prediction errors by interrupting familiar narrative videos immediately before the expected endings. We found that prediction errors reversed the relationship between univariate hippocampal activation and memory: greater hippocampal activation predicted memory preservation after expected endings, but memory updating after surprising endings. In contrast to previous studies, we show that univariate activation was insufficient for understanding hippocampal prediction error signals. We explain this surprising finding by tracking both the evolution of hippocampal activation patterns and the connectivity between the hippocampus and neuromodulatory regions. We found that hippocampal activation patterns stabilized as each narrative episode unfolded, suggesting sustained episodic representations. Prediction errors disrupted these sustained representations and the degree of disruption predicted memory updating. The relationship between hippocampal activation and subsequent memory depended on concurrent basal forebrain activation, supporting the idea that cholinergic modulation regulates attention and memory. We conclude that prediction errors create conditions that favor memory updating, prompting the hippocampus to abandon ongoing predictions and make memories malleable. |
J. A. Elshout; D. P. Bergsma; A. V. Berg; K. V. Haak Functional MRI of visual cortex predicts training-induced recovery in stroke patients with homonymous visual field defects Journal Article In: NeuroImage: Clinical, vol. 31, pp. 102703, 2021. @article{Elshout2021, Post-chiasmatic damage to the visual system leads to homonymous visual field defects (HVDs), which can severely interfere with daily life activities. Visual Restitution Training (VRT) can recover parts of the affected visual field in patients with chronic HVDs, but training outcome is variable. An untested hypothesis suggests that training potential may be largest in regions with ‘neural reserve', where cortical responses to visual stimulation do not lead to visual awareness as assessed by Humphrey perimetry—a standard behavioural visual field test. Here, we tested this hypothesis in a sample of twenty-seven hemianopic stroke patients, who participated in an assiduous 80-hour VRT program. For each patient, we collected Humphrey perimetry and wide-field fMRI-based retinotopic mapping data prior to training. In addition, we used Goal Attainment Scaling to assess whether personal activities in daily living improved. After training, we assessed with a second Humphrey perimetry measurement whether the visual field was improved and evaluated which personal goals were attained. Confirming the hypothesis, we found significantly larger improvements of visual sensitivity at field locations with neural reserve. These visual field improvements implicated both regions in primary visual cortex and higher order visual areas. In addition, improvement in daily life activities correlated with the extent of visual field enlargement. Our findings are an important step toward understanding the mechanisms of visual restitution as well as predicting training efficacy in stroke patients with chronic hemianopia. |
Farzad V. Farahani; Magdalena Fafrowicz; Waldemar Karwowski; Bartosz Bohaterewicz; Anna Maria Sobczak; Anna Ceglarek; Aleksandra Zyrkowska; Monika Ostrogorska; Barbara Sikora-Wachowicz; Koryna Lewandowska; Halszka Oginska; Anna Beres; Magdalena Hubalewska-Mazgaj; Tadeusz Marek Identifying diurnal variability of brain connectivity patterns using graph theory Journal Article In: Brain Sciences, vol. 11, no. 1, pp. 111, 2021. @article{Farahani2021, Significant differences exist in human brain functions affected by time of day and by people's diurnal preferences (chronotypes) that are rarely considered in brain studies. In the current study, using network neuroscience and resting-state functional MRI (rs-fMRI) data, we examined the effect of both time of day and the individual's chronotype on whole-brain network organization. In this regard, 62 participants (39 women; mean age: 23.97 ± 3.26 years; half morning-versus half evening-type) were scanned about 1 and 10 h after wake-up time for morning and evening sessions, respectively. We found evidence for a time-of-day effect on connectivity profiles but not for the effect of chronotype. Compared with the morning session, we found relatively higher small-worldness (an index that represents more efficient network organization) in the evening session, which suggests the dominance of sleep inertia over the circadian and homeostatic processes in the first hours after waking. Furthermore, local graph measures were changed, predominantly across the left hemisphere, in areas such as the precentral gyrus, putamen, inferior frontal gyrus (orbital part), inferior temporal gyrus, as well as the bilateral cerebellum. These findings show the variability of the functional neural network architecture during the day and improve our understanding of the role of time of day in resting-state functional networks. |
Emily S. Finn; Peter A. Bandettini Movie-watching outperforms rest for functional connectivity-based prediction of behavior Journal Article In: NeuroImage, vol. 235, pp. 117963, 2021. @article{Finn2021, A major goal of human neuroscience is to relate differences in brain function to differences in behavior across people. Recent work has established that whole-brain functional connectivity patterns are relatively stable within individuals and unique across individuals, and that features of these patterns predict various traits. However, while functional connectivity is most often measured at rest, certain tasks may enhance individual signals and improve sensitivity to behavior differences. Here, we show that compared to the resting state, functional connectivity measured during naturalistic viewing—i.e., movie watching—yields more accurate predictions of trait-like phenotypes in the domains of both cognition and emotion. Traits could be predicted using less than three minutes of data from single video clips, and clips with highly social content gave the most accurate predictions. Results suggest that naturalistic stimuli amplify individual differences in behaviorally relevant brain networks. |
Markus Frey; Matthias Nau; Christian F. Doeller Magnetic resonance-based eye tracking using deep neural networks Journal Article In: Nature Neuroscience, vol. 24, no. 12, pp. 1772–1779, 2021. @article{Frey2021, Viewing behavior provides a window into many central aspects of human cognition and health, and it is an important variable of interest or confound in many functional magnetic resonance imaging (fMRI) studies. To make eye tracking freely and widely available for MRI research, we developed DeepMReye, a convolutional neural network (CNN) that decodes gaze position from the magnetic resonance signal of the eyeballs. It performs cameraless eye tracking at subimaging temporal resolution in held-out participants with little training data and across a broad range of scanning protocols. Critically, it works even in existing datasets and when the eyes are closed. Decoded eye movements explain network-wide brain activity also in regions not associated with oculomotor function. This work emphasizes the importance of eye tracking for the interpretation of fMRI results and provides an open source software solution that is widely applicable in research and clinical settings. |
Esther Fujiwara; Christopher R. Madan; Jeremy B. Caplan; Tobias Sommer Emotional arousal impairs association memory: Roles of prefrontal cortex regions Journal Article In: Learning and Memory, vol. 28, no. 3, pp. 76–81, 2021. @article{Fujiwara2021, The brain processes underlying impairing effects of emotional arousal on associative memory were previously attributed to two dissociable routes using high-resolution fMRI of the MTL (Madan et al. 2017). Extrahippocampal MTL regions supporting associative encoding of neutral pairs suggested unitization; conversely, associative encoding of negative pairs involved compensatory hippocampal activity. Here, whole-brain fMRI revealed prefrontal contributions: dmPFC was more involved in hippocampal-dependent negative pair learning and vmPFC in extrahippocampal neutral pair learning. Successful encoding of emotional memory associations may require emotion regulation/conflict resolution (dmPFC), while neutral memory associations may be accomplished by anchoring new information to prior knowledge (vmPFC). |
Max Garagnani; Evgeniya Kirilina; Friedemann Pulvermüller Semantic grounding of novel spoken words in the primary visual cortex Journal Article In: Frontiers in Human Neuroscience, vol. 15, pp. 1–16, 2021. @article{Garagnani2021, Embodied theories of grounded semantics postulate that, when word meaning is first acquired, a link is established between symbol (word form) and corresponding semantic information present in modality-specific—including primary—sensorimotor cortices of the brain. Direct experimental evidence documenting the emergence of such a link (i.e., showing that presentation of a previously unknown, meaningless word sound induces, after learning, category-specific reactivation of relevant primary sensory or motor brain areas), however, is still missing. Here, we present new neuroimaging results that provide such evidence. We taught participants aspects of the referential meaning of previously unknown, senseless novel spoken words (such as “Shruba” or “Flipe”) by associating them with either a familiar action or a familiar object. After training, we used functional magnetic resonance imaging to analyze the participants' brain responses to the new speech items. We found that hearing the newly learnt object-related word sounds selectively triggered activity in the primary visual cortex, as well as secondary and higher visual areas.These results for the first time directly document the formation of a link between the novel, previously meaningless spoken items and corresponding semantic information in primary sensory areas in a category-specific manner, providing experimental support for perceptual accounts of word-meaning acquisition in the brain. |
Kyle M. Gilbert; L. Martyn Klassen; Alexander Mashkovtsev; Peter Zeman; Ravi S. Menon; Joseph S. Gati Radiofrequency coil for routine ultra-high-field imaging with an unobstructed visual field Journal Article In: NMR in Biomedicine, vol. 34, no. 3, pp. e4457, 2021. @article{Gilbert2021, Many neuroscience applications have adopted functional MRI as a tool to investigate the healthy and diseased brain during the completion of a task. While ultra-high-field MRI has allowed for improved contrast and signal-to-noise ratios during functional MRI studies, it remains a challenge to create local radiofrequency coils that can accommodate an unobstructed visual field and be suitable for routine use, while at the same time not compromise performance. Performance (both during transmission and reception) can be improved by using close-fitting coils; however, maintaining sensitivity over the whole brain often requires the introduction of coil elements proximal to the eyes, thereby partially occluding the subject's visual field. This study presents a 7 T head coil, with eight transmit dipoles and 32 receive loops, that is designed to remove visual obstructions from the subject's line of sight, allowing for an unencumbered view of visual stimuli, the reduction of anxiety induced from small enclosures, and the potential for eye-tracking measurements. The coil provides a practical solution for routine imaging, including a split design (anterior and posterior halves) that facilitates subject positioning, including those with impaired mobility, and the placement of devices required for patient comfort and motion reduction. The transmit and receive coils displayed no degradation of performance due to adaptions to the design topology (both mechanical and electrical) required to create an unobstructed visual field. All computer-aided design files, electromagnetic simulation models, transmit field maps and local specific absorption rate matrices are provided to promote reproduction. |
Josephine M. Groot; Nya M. Boayue; Gábor Csifcsák; Wouter Boekel; René Huster; Birte U. Forstmann; Matthias Mittner Probing the neural signature of mind wandering with simultaneous fMRI-EEG and pupillometry Journal Article In: NeuroImage, vol. 224, pp. 117412, 2021. @article{Groot2021, Mind wandering reflects the shift in attentional focus from task-related cognition driven by external stimuli toward self-generated and internally-oriented thought processes. Although such task-unrelated thoughts (TUTs) are pervasive and detrimental to task performance, their underlying neural mechanisms are only modestly understood. To investigate TUTs with high spatial and temporal precision, we simultaneously measured fMRI, EEG, and pupillometry in healthy adults while they performed a sustained attention task with experience sampling probes. Features of interest were extracted from each modality at the single-trial level and fed to a support vector machine that was trained on the probe responses. Compared to task-focused attention, the neural signature of TUTs was characterized by weaker activity in the default mode network but elevated activity in its anticorrelated network, stronger functional coupling between these networks, widespread increase in alpha, theta, delta, but not beta, frequency power, predominantly reduced amplitudes of late, but not early, event-related potentials, and larger baseline pupil size. Particularly, information contained in dynamic interactions between large-scale cortical networks was predictive of transient changes in attentional focus above other modalities. Together, our results provide insight into the spatiotemporal dynamics of TUTs and the neural markers that may facilitate their detection. |
Marcus Grueschow; Nico Stenz; Hanna Thörn; Ulrike Ehlert; Jan Breckwoldt; Monika Brodmann Maeder; Aristomenis K. Exadaktylos; Roland Bingisser; Christian C. Ruff; Birgit Kleim Real-world stress resilience is associated with the responsivity of the locus coeruleus Journal Article In: Nature Communications, vol. 12, pp. 2275, 2021. @article{Grueschow2021, Individuals may show different responses to stressful events. Here, we investigate the neurobiological basis of stress resilience, by showing that neural responsitivity of the noradrenergic locus coeruleus (LC-NE) and associated pupil responses are related to the subsequent change in measures of anxiety and depression in response to prolonged real-life stress. We acquired fMRI and pupillometry data during an emotional-conflict task in medical residents before they underwent stressful emergency-room internships known to be a risk factor for anxiety and depression. The LC-NE conflict response and its functional coupling with the amygdala was associated with stress-related symptom changes in response to the internship. A similar relationship was found for pupil-dilation, a potential marker of LC-NE firing. Our results provide insights into the noradrenergic basis of conflict generation, adaptation and stress resilience. |
Hinke N. Halbertsma; Holly Bridge; Joana Carvalho; Frans W. Cornelissen; Sara Ajina Visual field reconstruction in hemianopia using fMRI based mapping techniques Journal Article In: Frontiers in Human Neuroscience, vol. 15, pp. 713114, 2021. @article{Halbertsma2021, Purpose: A stroke that includes the primary visual cortex unilaterally leads to a loss of visual field (VF) representation in the hemifield contralateral to the damage. While behavioral procedures for measuring the VF, such as perimetry, may indicate that a patient cannot see in a particular area, detailed psychophysical testing often detects the ability to perform detection or discrimination of visual stimuli (“blindsight”). The aim of this study was to determine whether functional magnetic resonance imaging (fMRI) could be used to determine whether perimetrically blind regions of the VF were still represented in VF maps reconstructed on the basis of visually evoked neural activity. Methods: Thirteen patients with hemianopia and nine control participants were scanned using 3T MRI while presented with visual stimulation. Two runs of a dynamic “wedge and ring” mapping stimulus, totaling approximately 10 min, were performed while participants fixated centrally. Two different analysis approaches were taken: the conventional population receptive field (pRF) analysis and micro-probing (MP). The latter is a variant of the former that makes fewer assumptions when modeling the visually evoked neural activity. Both methods were used to reconstruct the VF by projecting modeled activity back onto the VF. Following a normalization step, these “coverage maps” can be compared to the VF sensitivity plots obtained using perimetry. Results: While both fMRI-based approaches revealed regions of neural activity within the perimetrically “blind” sections of the VF, the MP approach uncovered more voxels in the lesioned hemisphere in which a modest degree of visual sensitivity was retained. Furthermore, MP-based analysis indicated that both early (V1/V2) and extrastriate visual areas contributed equally to the retained sensitivity in both patients and controls. Conclusion: In hemianopic patients, fMRI-based approaches for reconstructing the VF can pick up activity in perimetrically blind regions of the VF. Such regions of the VF may be particularly amenable for rehabilitation to regain visual function. Compared to conventional pRF modeling, MP reveals more voxels with retained visual sensitivity, suggesting it is a more sensitive approach for VF reconstruction. |
Grace E. Hallenbeck; Thomas C. Sprague; Masih Rahmati; Kartik K. Sreenivasan; Clayton E. Curtis Working memory representations in visual cortex mediate distraction effects Journal Article In: Nature Communications, vol. 12, pp. 4714, 2021. @article{Hallenbeck2021, Although the contents of working memory can be decoded from visual cortex activity, these representations may play a limited role if they are not robust to distraction. We used model-based fMRI to estimate the impact of distracting visual tasks on working memory representations in several visual field maps in visual and frontoparietal association cortex. Here, we show distraction causes the fidelity of working memory representations to briefly dip when both the memorandum and distractor are jointly encoded by the population activities. Distraction induces small biases in memory errors which can be predicted by biases in neural decoding in early visual cortex, but not other regions. Although distraction briefly disrupts working memory representations, the widespread redundancy with which working memory information is encoded may protect against catastrophic loss. In early visual cortex, the neural representation of information in working memory and behavioral performance are intertwined, solidifying its importance in visual memory. |
Anja Ischebeck; Hannah Hiebel; Joe Miller; Margit Höfler; Iain D. Gilchrist; Christof Körner Target processing in overt serial visual search involves the dorsal attention network: A fixation-based event-related fMRI study Journal Article In: Neuropsychologia, vol. 153, pp. 107763, 2021. @article{Ischebeck2021, In serial visual search we shift attention successively from location to location in search for the target. Although such search has been investigated using fMRI, overt attention (i.e., eye movements) was usually neglected or discouraged. As a result, it is unclear what happens in the instant when our gaze falls upon a target as compared to a distractor. In the present experiment, we used a multiple target search task that required eye movements and employed an analysis based on fixations as events of interest to investigate differences between target and distractor processing. Twenty young healthy adults indicated the number of targets (0–3) among distractors in a 20-item display. Compared to distractor fixations, we found that target fixations gave rise to wide-spread activation in the dorsal attention system, as well as in the visual cortex. Targets that were found later during the search activated the left inferior frontal gyrus and the left supramarginal gyrus more strongly than those that were found earlier. Finally, areas associated with visual and verbal working memory showed increased activation with a larger number of targets in the display. |
Joonyoung Kang; Hyeji Kim; Seong Hwan Hwang; Minjun Han; Sue-Hyun Lee; Hyoung F. Kim Primate ventral striatum maintains neural representations of the value of previously rewarded objects for habitual seeking Journal Article In: Nature Communications, vol. 12, pp. 2100, 2021. @article{Kang2021, The ventral striatum (VS) is considered a key region that flexibly updates recent changes in reward values for habit learning. However, this update process may not serve to maintain learned habitual behaviors, which are insensitive to value changes. Here, using fMRI in humans and single-unit electrophysiology in macaque monkeys we report another role of the primate VS: that the value memory subserving habitual seeking is stably maintained in the VS. Days after object-value associative learning, human and monkey VS continue to show increased responses to previously rewarded objects, even when no immediate reward outcomes are expected. The similarity of neural response patterns to each rewarded object increases after learning among participants who display habitual seeking. Our data show that long-term memory of high-valued objects is retained as a single representation in the VS and may be utilized to evaluate visual stimuli automatically to guide habitual behavior. |
Sabrina Karl; Ronald Sladky; Claus Lamm; Ludwig Huber Neural responses of pet dogs witnessing their caregiver's positive interactions with a conspecific: An fMRI study Journal Article In: Cerebral Cortex Communications, vol. 2, no. 3, pp. tgab047, 2021. @article{Karl2021, We have limited knowledge on how dogs perceive humans and their actions. Various researchers investigated how they process human facial expressions, but their brain responses to complex social scenarios remain unclear. While undergoing fMRI, we exposed pet dogs to videos showing positive social and neutral nonsocial interactions between their caregivers and another conspecific. Our main interest was how the dogs responded to their caregivers (compared to a stranger) engaging in a pleasant interaction with another dog that could be seen as social rival. We hypothesized that the dogs would show activation increases in limbic areas such as the amygdala, hypothalamus, and insula and likely show higher attention and arousal during the positive caregiver–dog interaction. When contrasting the social with the nonsocial interaction, we found increased activations in the left amygdala and the insular cortex. Crucially, the dogs' hypothalamus showed strongest activation when the caregiver engaged in a positive social interaction. These findings indicate that dogs are sensitive to social affective human–dog interactions and likely show higher valence attribution and arousal in a situation possibly perceived as a potential threat to their caregiver bonds. Our study provides a first window into the neural correlates of social and emotional processing in dogs. |
Haena Kim; Namrata Nanavaty; Humza Ahmed; Vani A. Mathur; Brian A. Anderson Motivational salience guides attention to valuable and threatening stimuli: Evidence from behavior and functional magnetic resonance imaging Journal Article In: Journal of Cognitive Neuroscience, vol. 33, no. 12, pp. 2440–2460, 2021. @article{Kim2021, Rewarding and aversive outcomes have opposing effects on behavior, facilitating approach and avoidance, although we need to accurately anticipate each type of outcome to behave effectively. Attention is biased toward stimuli that have been learned to predict either type of outcome, and it remains an open question whether such orienting is driven by separate systems for value-and threat-based orienting or whether there exists a common underlying mechanism of attentional control driven by motivational salience. Here, we provide a direct comparison of the neural correlates of value-and threat-based attentional capture after associative learning. Across multiple measures of behavior and brain activation, our findings overwhelmingly support a motivational salience account of the control of attention. We conclude that there exists a core mechanism of experience-dependent attentional control driven by motivational salience and that prior characterizations of attention as being value driven or supporting threat monitoring need to be revisited. |
Na Yeon Kim; Mark A. Pinsk; Sabine Kastner Neural basis of biased competition in development: sensory competition in visual cortex of school-aged children Journal Article In: Cerebral Cortex, vol. 31, no. 6, pp. 3107–3121, 2021. @article{Kim2021c, The fundamental receptive field (RF) architecture in human visual cortex becomes adult-like by age 5. However, visuo-spatial functions continue to develop until teenage years. This suggests that, despite the early maturation of the RF structure, functional interactions within and across RFs may mature slowly. Here, we used fMRI to investigate functional interactions among multiple stimuli in the visual cortex of school children (ages 8 to 12) in the context of biased competition theory. In the adult visual system, multiple objects presented in the same visual field compete for neural representation. These competitive interactions occur at the level of the RF and are therefore closely linked to the RF architecture. Like in adults, we found suppression of evoked responses in children's visual cortex when multiple stimuli were presented simultaneously. Such suppression effects were modulated by the spatial distance between the stimuli as a function of RF size across the visual system. Our findings suggest that basic competitive interactions in the visual cortex of children above age 8 operate in an adult-like manner, with subtle differences in early visual areas and area MT. Our study establishes a paradigm and provides baseline data to investigate the neural basis of visuo-spatial processing in typical and atypical development. |
Sreenivasan Meyyappan; Abhijit Rajan; George R. Mangun; Mingzhou Ding Role of inferior frontal junction (IFJ) in the control of feature versus spatial attention Journal Article In: Journal of Neuroscience, vol. 41, no. 38, pp. 8065–8074, 2021. @article{Meyyappan2021, Feature-based visual attention refers to preferential selection and processing of visual stimuli based on their nonspatial attributes, such as color or shape. Recent studies have highlighted the inferior frontal junction (IFJ) as a control region for feature but not spatial attention. However, the extent to which IFJ contributes to spatial versus feature attention control remains a topic of debate. We investigated in humans of both sexes the role of IFJ in the control of feature versus spatial attention in a cued visual spatial (attend-left or attend-right) and feature (attend-red or attend-green) attention task using fMRI. Analyzing cue-related fMRI using both univariate activation and multivoxel pattern analysis, we found the following results in IFJ. First, in line with some prior studies, the univariate activations were not different between feature and spatial attentional control. Second, in contrast, the multivoxel pattern analysis decoding accuracy was above chance level for feature attention (attend-red vs attend-green) but not for spatial attention (attend-left vs attend-right). Third, while the decoding accuracy for feature attention was above chance level during attentional control in the cue-to-target interval, it was not during target processing. Fourth, the right IFJ and visual cortex (V4) were observed to be functionally connected during feature but not during spatial attention control, and this functional connectivity was positively associated with subsequent attentional selection of targets in V4, as well as with behavioral performance. These results support a model in which IFJ plays a crucial role in topdown control of visual feature but not visual spatial attention. |
Kentaro Miyamoto; Nadescha Trudel; Kevin Kamermans; Michele C. Lim; Alberto Lazari; Lennart Verhagen; Marco K. Wittmann; Matthew F. S. Rushworth Identification and disruption of a neural mechanism for accumulating prospective metacognitive information prior to decision-making Journal Article In: Neuron, vol. 109, no. 8, pp. 1396–1408, 2021. @article{Miyamoto2021, More than one type of probability must be considered when making decisions. It is as necessary to know one's chance of performing choices correctly as it is to know the chances that desired outcomes will follow choices. We refer to these two choice contingencies as internal and external probability. Neural activity across many frontal and parietal areas reflected internal and external probabilities in a similar manner during decision-making. However, neural recording and manipulation approaches suggest that one area, the anterior lateral prefrontal cortex (alPFC), is highly specialized for making prospective, metacognitive judgments on the basis of internal probability; it is essential for knowing which decisions to tackle, given its assessment of how well they will be performed. Its activity predicted prospective metacognitive judgments, and individual variation in activity predicted individual variation in metacognitive judgments. Its disruption altered metacognitive judgments, leading participants to tackle perceptual decisions they were likely to fail. |
Viola Mocz; Maryam Vaziri-Pashkam; Marvin Chun; Yaoda Xu Predicting identity-preserving object transformations across the human ventral visual stream Journal Article In: Journal of Neuroscience, vol. 41, no. 35, pp. 7403–7419, 2021. @article{Mocz2021, In everyday life, we have no trouble categorizing objects varying in position, size, and orientation. Previous fMRI research shows that higher-level object processing regions in the human lateral occipital cortex may link object responses from different affine states (i.e. size and viewpoint) through a general linear mapping function capable of predicting responses to novel objects. In this study, we extended this approach to examine the mapping for both Euclidean (e.g. position and size) and non-Euclidean (e.g. image statistics and spatial frequency) transformations across the human ventral visual processing hierarchy, including areas V1, V2, V3, V4, ventral occipitotemporal cortex (VOT), and lateral occipitotemporal cortex (LOT). The predicted pattern generated from a linear mapping function could capture a significant amount of the changes associated with the transformations throughout the ventral visual stream. The derived linear mapping functions were not category independent, as performance was better for the categories included than those not included in training and better between two similar versus two dissimilar categories in both lower and higher visual regions. Consistent with object representations being stronger in higher than lower visual regions, pattern selectivity and object category representational structure were somewhat better preserved in the predicted patterns in higher than lower visual regions. There were no notable differences between Euclidean and non-Euclidean transformations. These findings demonstrate a near-orthogonal representation of object identity and these non-identity features throughout the human ventral visual processing pathway, with these non-identity features largely untangled from the identity features early in visual processing. |
Sophia Nestmann; Daniel Wiesen; Hans-Otto Karnath; Johannes Rennig Temporo-parietal brain regions are involved in higher order object perception Journal Article In: NeuroImage, vol. 234, pp. 117982, 2021. @article{Nestmann2021, Lesions to posterior temporo-parietal brain regions are associated with deficits in perception of global, hierarchical shapes, but also with impairments in the processing of objects presented under demanding viewing conditions. Evidence from neuroimaging studies and lesion patterns observed in patients with simultanagnosia and agnosia for object orientation suggest similar brain regions to be involved in perception of global shapes and processing of objects in atypical (‘non-canonical') orientation. In a localizer experiment, we identified individual temporo-parietal brain areas involved in global shape perception and found significantly higher BOLD signals during the processing of non-canonical compared to canonical objects. In a multivariate approach, we demonstrated that posterior temporo-parietal brain areas show distinct voxel patterns for non-canonical and canonical objects and that voxel patterns of global shapes are more similar to those of objects in non-canonical compared to canonical viewing conditions. These results suggest that temporo-parietal brain areas are not only involved in global shape perception but might serve a more general mechanism of complex object perception. Our results challenge a strict attribution of object processing to the ventral visual stream by suggesting specific dorsal contributions in more demanding viewing conditions. |
Bao N. Nguyen; Scott C. Kolbe; Ashika Verghese; Christine Nearchou; Allison M. McKendrick; Gary F. Egan; Trichur R. Vidyasagar Visual search efficiency and functional visual cortical size in children with and without dyslexia Journal Article In: Neuropsychologia, vol. 155, pp. 107819, 2021. @article{Nguyen2021, Dyslexia is characterised by poor reading ability. Its aetiology is probably multifactorial, with abnormal visual processing playing an important role. Among adults with normal reading ability, there is a larger representation of central visual field in the primary visual cortex (V1) in those with more efficient visuospatial attention. In this study, we tested the hypothesis that poor reading ability in school-aged children (17 children with dyslexia, 14 control children with normal reading ability) is associated with deficits in visuospatial attention using a visual search task. We corroborated the psychophysical findings with neuroimaging, by measuring the functional size of V1 in response to a central 12° visual stimulus. Consistent with other literature, visual search was impaired and less efficient in the dyslexic children, particularly with more distractor elements in the search array (p = 0.04). We also found atypical interhemispheric asymmetry in functional V1 size in the dyslexia group (p = 0.02). Reading impaired children showed poorer visual search efficiency (p = 0.01), needing more time per unit distractor (higher ms/item). Reading ability was also correlated with V1 size asymmetry (p = 0.03), such that poorer readers showed less left hemisphere bias relative to the right hemisphere. Our findings support the view that dyslexic children have abnormal visuospatial attention and interhemispheric V1 asymmetry, relative to chronological age-matched peers, and that these factors may contribute to inter-individual variation in reading performance in children. |
Katya Olmos-Solis; Anouk Mariette Loon; Christian N. L. Olivers Content or status: Frontal and posterior cortical representations of object category and upcoming task goals in working memory Journal Article In: Cortex, vol. 135, pp. 61–77, 2021. @article{OlmosSolis2021, To optimize task sequences, the brain must differentiate between current and prospective goals. We previously showed that currently and prospectively relevant object representations in working memory can be dissociated within object-selective cortex. Based on other recent studies indicating that a range of brain areas may be involved in distinguishing between currently relevant and prospectively relevant information in working memory, here we conducted multivoxel pattern analyses of fMRI activity in additional posterior areas (specifically early visual cortex and the intraparietal sulcus) as well as frontal areas (specifically the frontal eye fields and lateral prefrontal cortex). We assessed whether these areas represent the memory content, the current versus prospective status of the memory, or both. On each trial, participants memorized an object drawn from three different categories. The object was the target for either a first task (currently relevant), a second task (prospectively relevant), or for neither task (irrelevant). The results revealed a division of labor across brain regions: While posterior areas preferentially coded for content (i.e., the category), frontal areas carried information about the current versus prospective relevance status of the memory, irrespective of the category. Intraparietal sulcus revealed both strong category- and status-sensitivity, consistent with its hub function of combining stimulus and priority signals. Furthermore, cross-decoding analyses revealed that while current and prospective representations were similar prior to search, they became dissimilar during search, in posterior as well as frontal areas. The findings provide further evidence for a dissociation between content and control networks in working memory. |
Clement Abbatecola; Peggy Gerardin; Kim Beneyton; Henry Kennedy; Kenneth Knoblauch The role of unimodal feedback pathways in gender perception during activation of voice and face areas Journal Article In: Frontiers in Systems Neuroscience, vol. 15, pp. 669256, 2021. @article{Abbatecola2021, Cross-modal effects provide a model framework for investigating hierarchical inter-areal processing, particularly, under conditions where unimodal cortical areas receive contextual feedback from other modalities. Here, using complementary behavioral and brain imaging techniques, we investigated the functional networks participating in face and voice processing during gender perception, a high-level feature of voice and face perception. Within the framework of a signal detection decision model, Maximum likelihood conjoint measurement (MLCM) was used to estimate the contributions of the face and voice to gender comparisons between pairs of audio-visual stimuli in which the face and voice were independently modulated. Top–down contributions were varied by instructing participants to make judgments based on the gender of either the face, the voice or both modalities (N = 12 for each task). Estimated face and voice contributions to the judgments of the stimulus pairs were not independent; both contributed to all tasks, but their respective weights varied over a 40-fold range due to top–down influences. Models that best described the modal contributions required the inclusion of two different top–down interactions: (i) an interaction that depended on gender congruence across modalities (i.e., difference between face and voice modalities for each stimulus); (ii) an interaction that depended on the within modalities' gender magnitude. The significance of these interactions was task dependent. Specifically, gender congruence interaction was significant for the face and voice tasks while the gender magnitude interaction was significant for the face and stimulus tasks. Subsequently, we used the same stimuli and related tasks in a functional magnetic resonance imaging (fMRI) paradigm (N = 12) to explore the neural correlates of these perceptual processes, analyzed with Dynamic Causal Modeling (DCM) and Bayesian Model Selection. Results revealed changes in effective connectivity between the unimodal Fusiform Face Area (FFA) and Temporal Voice Area (TVA) in a fashion that paralleled the face and voice behavioral interactions observed in the psychophysical data. These findings explore the role in perception of multiple unimodal parallel feedback pathways. |
Alia Afyouni; Franziska Geringswald; Bruno Nazarian; Marie-Hélène Grosbras Brain activity during antisaccades to faces in adolescence Journal Article In: Cerebral Cortex Communications, vol. 2, pp. 1–14, 2021. @article{Afyouni2021, Cognitive control and social perception both change during adolescence, but little is known of the interaction of these 2 processes. We aimed to characterize developmental changes in brain activity related to the influence of a social stimulus on cognitive control and more specifically on inhibitory control. Children (age 8–11 |
Sara Ajina; Kristin Jünemann; Arash Sahraie; Holly Bridge Increased visual sensitivity and occipital activity in patients with hemianopia following vision rehabilitation Journal Article In: Journal of Neuroscience, vol. 41, no. 28, pp. 5994–6005, 2021. @article{Ajina2021, Hemianopia, loss of vision in half of the visual field, results from damage to the visual pathway posterior to the optic chiasm. Despite negative effects on quality of life, few rehabilitation options are currently available. Recently, several long-term training programs have been developed that show visual improvement within the blind field, although little is known of the underlying neural changes. Here, we have investigated functional and structural changes in the brain associated with visual rehabilitation. Seven human participants with occipital lobe damage enrolled in a visual training program to distinguish which of two intervals contained a drifting Gabor patch presented within the blind field. Participants performed;25 min of training each day for 3–6 months and undertook psychophysical tests and a magnetic resonance imaging scan before and after training. A control group undertook psychophysical tests before and after an equivalent period without training. Participants who were not at ceiling on baseline tests showed on average 9.6% improvement in Gabor detection, 8.3% in detection of moving dots, and 9.9% improvement in direction discrimination after training. Importantly, psychophysical improvement only correlated with improvement in Humphrey perimetry in the trained region of the visual field. Whole-brain analysis showed an increased neural response to moving stimuli in the blind visual field in motion area V5/hMT. Using a region-of-interest approach, training had a significant effect on the blood oxygenation level-dependent signal compared with baseline. Moreover, baseline V5/hMT activity was correlated to the amount of improvement in visual sensitivity using psychophysical and perimetry tests. This study, identifying a critical role for V5/hMT in boosting visual function, may allow us to determine which patients may benefit most from training and design adjunct interventions to increase training effects. |
Tara L. Alvarez; Mitchell Scheiman; Cristian Morales; Suril Gohel; Ayushi Sangoi; Elio M. Santos; Chang Yaramothu; John Vito D'Antonio-Bertagnolli; Xiaobo Li; Bharat B. Biswal Underlying neurological mechanisms associated with symptomatic convergence insufficiency Journal Article In: Scientific Reports, vol. 11, pp. 6545, 2021. @article{Alvarez2021, Convergence insufficiency (CI) is the most common binocular vision problem, associated with blurred/double vision, headaches, and sore eyes that are exacerbated when doing prolonged near work, such as reading. The Convergence Insufficiency Neuro-mechanism Adult Population Study (NCT03593031) investigates the mechanistic neural differences between 50 binocularly normal controls (BNC) and 50 symptomatic CI participants by examining the fast and slow fusional disparity vergence systems. The fast fusional system is preprogrammed and is assessed with convergence peak velocity. The slow fusional system optimizes vergence effort and is assessed by measuring the phoria adaptation magnitude and rate. For the fast fusional system, significant differences are observed between the BNC and CI groups for convergence peak velocity, final position amplitude, and functional imaging activity within the secondary visual cortex, right cuneus, and oculomotor vermis. For the slow fusional system, the phoria adaptation magnitude and rate, and the medial cuneus functional activity, are significantly different between the groups. Significant correlations are observed between vergence peak velocity and right cuneus functional activity (p = 0.002) and the rate of phoria adaptation and medial cuneus functional activity (p = 0.02). These results map the brain-behavior of vergence. Future therapeutic interventions may consider implementing procedures that increase cuneus activity for this debilitating disorder. |
Magdalena Boch; Sabrina Karl; Ronald Sladky; Ludwig Huber; Claus Lamm; Isabella C. Wagner Tailored haemodynamic response function increases detection power of fMRI in awake dogs (Canis familiaris) Journal Article In: NeuroImage, vol. 224, pp. 117414, 2021. @article{Boch2021, Functional magnetic resonance imaging (fMRI) of awake and unrestrained dogs (Canis familiaris) has been established as a novel opportunity for comparative neuroimaging, promising important insights into the evolutionary roots of human brain function and cognition. However, data processing and analysis pipelines are often derivatives of methodological standards developed for human neuroimaging, which may be problematic due to profound neurophysiological and anatomical differences between humans and dogs. Here, we explore whether dog fMRI studies would benefit from a tailored dog haemodynamic response function (HRF). In two independent experiments, dogs were presented with different visual stimuli. BOLD signal changes in the visual cortex during these experiments were used for (a) the identification and estimation of a tailored dog HRF, and (b) the independent validation of the resulting dog HRF estimate. Time course analyses revealed that the BOLD signal in the primary visual cortex peaked significantly earlier in dogs compared to humans, while being comparable in shape. Deriving a tailored dog HRF significantly improved the model fit in both experiments, compared to the canonical HRF used in human fMRI. Using the dog HRF yielded significantly increased activation during visual stimulation, extending from the occipital lobe to the caudal parietal cortex, the bilateral temporal cortex, into bilateral hippocampal and thalamic regions. In sum, our findings provide robust evidence for an earlier onset of the dog HRF in two visual stimulation paradigms, and suggest that using such an HRF will be important to increase fMRI detection power in canine neuroimaging. By providing the parameters of the tailored dog HRF and related code, we encourage and enable other researchers to validate whether our findings generalize to other sensory modalities and experimental paradigms. |
Bartosz Bohaterewicz; Anna M. Sobczak; Igor Podolak; Bartosz Wójcik; Dagmara Mȩtel; Adrian A. Chrobak; Magdalena Fa̧frowicz; Marcin Siwek; Dominika Dudek; Tadeusz Marek Machine learning-based identification of suicidal risk in patients with Schizophrenia using multi-level resting-state fMRI features Journal Article In: Frontiers in Neuroscience, vol. 14, pp. 605697, 2021. @article{Bohaterewicz2021, Background: Some studies suggest that as much as 40% of all causes of death in a group of patients with schizophrenia can be attributed to suicides and compared with the general population, patients with schizophrenia have an 8.5-fold greater suicide risk (SR). There is a vital need for accurate and reliable methods to predict the SR among patients with schizophrenia based on biological measures. However, it is unknown whether the suicidal risk in schizophrenia can be related to alterations in spontaneous brain activity, or if the resting-state functional magnetic resonance imaging (rsfMRI) measures can be used alongside machine learning (ML) algorithms in order to identify patients with SR. Methods: Fifty-nine participants including patients with schizophrenia with and without SR as well as age and gender-matched healthy underwent 13 min resting-state functional magnetic resonance imaging. Both static and dynamic indexes of the amplitude of low-frequency fluctuation (ALFF), the fractional amplitude of low-frequency fluctuations (fALFF), regional homogeneity as well as functional connectivity (FC) were calculated and used as an input for five machine learning algorithms: Gradient boosting (GB), LASSO, Logistic Regression (LR), Random Forest and Support Vector Machine. Results: All groups revealed different intra-network functional connectivity in ventral DMN and anterior SN. The best performance was reached for the LASSO applied to FC with an accuracy of 70% and AUROC of 0.76 (p < 0.05). Significant classification ability was also reached for GB and LR using fALFF and ALFF measures. Conclusion: Our findings suggest that SR in schizophrenia can be seen on the level of DMN and SN functional connectivity alterations. ML algorithms were able to significantly differentiate SR patients. Our results could be useful in developing neuromarkers of SR in schizophrenia based on non-invasive rsfMRI. |
Marie Luise Brandi; Juha M. Lahnakoski; Johannes Kopf-Beck; Tobias Nolte; Tanja M. Brückl; Leonhard Schilbach Imagery of negative interpersonal experiences influence the neural mechanisms of social interaction Journal Article In: Neuropsychologia, vol. 160, pp. 107923, 2021. @article{Brandi2021, Negative interpersonal experiences are a key contributor to psychiatric disorders. While previous research has shown that negative interpersonal experiences influence social cognition, less is known about the effects on participation in social interactions and the underlying neurobiology. To address this, we developed a new naturalistic version of a gaze-contingent paradigm using real video sequences of gaze behaviour that respond to the participants' gaze in real-time in order to create a believable and continuous interactive social situation. Additionally, participants listened to two autobiographical audio-scripts that guided them to imagine a recent stressful and a relaxing situation and performed the gaze-based social interaction task before and after the presentation of either the stressful or the relaxing audio-script. Our results demonstrate that the social interaction task robustly recruits brain areas with known involvement in social cognition, namely the medial prefrontal cortex, bilateral temporoparietal junction, superior temporal sulcus as well as the precuneus. Imagery of negative interpersonal experiences compared to relaxing imagery led to a prolonged change in affective state and to increased brain responses during the subsequent social interaction paradigm in the temporoparietal junction, medial prefrontal cortex, anterior cingulate cortex, precuneus and inferior frontal gyrus. Taken together this study presents a new naturalistic social interaction paradigm suitable to study the neural mechanisms of social interaction and the results demonstrate that the imagery of negative interpersonal experiences affects social interaction on neural levels. |
Rotem Broday-Dvir; Rafael Malach Resting-state fluctuations underlie free and creative verbal behaviors in the human brain Journal Article In: Cerebral Cortex, vol. 31, no. 1, pp. 213–232, 2021. @article{BrodayDvir2021, Resting-state fluctuations are ubiquitous and widely studied phenomena of the human brain, yet we are largely in the dark regarding their function in human cognition. Here we examined the hypothesis that resting-state fluctuations underlie the generation of free and creative human behaviors. In our experiment, participants were asked to perform three voluntary verbal tasks: a verbal fluency task, a verbal creativity task, and a divergent thinking task, during functional magnetic resonance imaging scanning. Blood oxygenation level dependent (BOLD)-activity during these tasks was contrasted with a control- deterministic verbal task, in which the behavior was fully determined by external stimuli. Our results reveal that all voluntary verbal-generation responses displayed a gradual anticipatory buildup that preceded the deterministic control-related responses. Critically, the time-frequency dynamics of these anticipatory buildups were significantly correlated with resting-state fluctuations' dynamics. These correlations were not a general BOLD-related or verbal-response related result, as they were not found during the externally determined verbal control condition. Furthermore, they were located in brain regions known to be involved in language production, specifically the left inferior frontal gyrus. These results suggest a common function of resting-state fluctuations as the neural mechanism underlying the generation of free and creative behaviors in the human cortex. |
Joana Carvalho; Remco J. Renken; Frans W. Cornelissen Predictive masking of an artificial scotoma is associated with a system-wide reconfiguration of neural populations in the human visual cortex Journal Article In: NeuroImage, vol. 245, pp. 118690, 2021. @article{Carvalho2021, The visual brain has the remarkable capacity to complete our percept of the world even when the information extracted from the visual scene is incomplete. This ability to predict missing information based on information from spatially adjacent regions is an intriguing attribute of healthy vision. Yet, it gains particular significance when it masks the perceptual consequences of a retinal lesion, leaving patients unaware of their partial loss of vision and ultimately delaying diagnosis and treatment. At present, our understanding of the neural basis of this masking process is limited which hinders both quantitative modeling as well as translational application. To overcome this, we asked the participants to view visual stimuli with and without superimposed artificial scotoma (AS). We used fMRI to record the associated cortical activity and applied model-based analyzes to track changes in cortical population receptive fields and connectivity in response to the introduction of the AS. We found that throughout the visual field and cortical hierarchy, pRFs shifted their preferred position towards the AS border. Moreover, extrastriate areas biased their sampling of V1 towards sections outside the AS projection zone, thereby effectively masking the AS with signals from spared portions of the visual field. We speculate that the signals that drive these system-wide population modifications originate in extrastriate visual areas and, through feedback, also reconfigure the neural populations in the earlier visual areas. |
Simon Majed Ceh; Sonja Annerer-Walcher; Karl Koschutnig; Christof Körner; Andreas Fink; Mathias Benedek Neurophysiological indicators of internal attention: An fMRI–eye-tracking coregistration study Journal Article In: Cortex, vol. 143, pp. 29–46, 2021. @article{Ceh2021, Many goal-directed, as well as spontaneous everyday activities (e.g., planning, mind-wandering), rely on an internal focus of attention. This fMRI–eye-tracking coregistration study investigated brain mechanisms and eye behavior related to internally versus externally directed cognition. Building on an established paradigm, we manipulated internal attention demands within tasks utilizing conditional stimulus masking. Internally directed cognition involved bilateral activation of the lingual gyrus and inferior parietal lobe areas as well as wide-spread deactivation of visual networks. Moreover, internally directed cognition was related to greater pupil diameter, pupil diameter variance, blink duration, fixation disparity variance, and smaller amounts of microsaccades. FMRI–eye-tracking covariation analyses further revealed that larger pupil diameter was related to increased activation of basal ganglia and lingual gyrus. It can be concluded that internally and externally directed cognition are characterized by distinct neurophysiological signatures. The observed neurophysiological differences indicate that internally directed cognition is associated with reduced processing of task-irrelevant information and increased mental load. These findings shed further light on the interplay between neural and perceptual mechanisms contributing to an internal focus of attention. |
Adrian Andrzej Chrobak; Bartosz Bohaterewicz; Anna Maria Sobczak; Magdalena Marszał-Wiśniewska; Anna Tereszko; Anna Krupa; Anna Ceglarek; Magdalena Fafrowicz; Amira Bryll; Tadeusz Marek; Dominika Dudek; Marcin Siwek Time-frequency characterization of resting brain in bipolar disorder during euthymia - A preliminary study Journal Article In: Brain Sciences, vol. 11, no. 5, pp. 599, 2021. @article{Chrobak2021, The goal of this paper is to investigate the baseline brain activity in euthymic bipolar disorder (BD) patients by comparing it to healthy controls (HC) with the use of a variety of resting state functional magnetic resonance imaging (rs-fMRI) analyses, such as amplitude of low frequency fluctuations (ALFF), fractional ALFF (f/ALFF), ALFF-based functional connectivity (FC), and r egional homogeneity (ReHo). We hypothesize that above-mentioned techniques will differentiate BD from HC indicating dissimilarities between the groups within different brain structures. Forty-two participants divided into two groups of euthymic BD patients (n = 21) and HC (n = 21) underwent rs-fMRI evaluation. Typical band ALFF, slow-4, slow-5, f/ALFF, as well as ReHo indexes were analyzed. Regions with altered ALFF were chosen as ROI for seed-to-voxel analysis of FC. As opposed to HC, BD patients revealed: increased ALFF in left insula; increased slow-5 in left middle temporal pole; increased f/ALFF in left superior frontal gyrus, left superior temporal gyrus, left middle occipital gyrus, right putamen, and bilateral thalamus. There were no significant differences between BD and HC groups in slow-4 band. Compared to HC, the BD group presented higher ReHo values in the left superior medial frontal gyrus and lower ReHo values in the right supplementary motor area. FC analysis revealed significant hyper-connectivity within the BD group between left insula and bilateral middle frontal gyrus, right superior parietal gyrus, right supramarginal gyrus, left inferior parietal gyrus, left cerebellum, and left supplementary motor area. To our best knowledge, this is the first rs-fMRI study combining ReHo, ALFF, f/ALFF, and subdivided frequency bands (slow-4 and slow-5) in euthymic BD patients. ALFF, f/ALFF, slow-5, as well as REHO analysis revealed significant differences between two studied groups. Although results obtained with the above methods enable to identify group-specific brain structures, no overlap between the brain regions was detected. This indicates that combination of foregoing rs-fMRI methods may complement each other, revealing the bigger picture of the complex resting state abnormalities in BD. |
Jongik Chung; Brooke S. Jackson; Jennifer E. Mcdowell; Cheolwoo Park Joint estimation and regularized aggregation of brain network in FMRI data Journal Article In: Journal of Neuroscience Methods, vol. 364, pp. 109374, 2021. @article{Chung2021, Background: In the Gaussian graphical model framework, precision matrices reveal conditional dependence structure among random variables. In functional magnetic resonance imaging (fMRI) data, estimating such precision matrices of multi-subjects and aggregating them to a group-level is an essential step for constructing a group brain network. New method: In this article, we considered joint estimation of multiple precision matrices with regularized aggregation. Also, in the construction of a group precision matrix, we integrated robust aggregation to the estimation. In the estimation of individual precision matrices, we took a regularization approach to induce sparsity, which made brain network estimation more realistic. Results: We demonstrated the effectiveness of the proposed method through simulated examples, and analyses on real fMRI data acquired during eye movement tasks assessing cognitive control. For the fMRI data, the joint estimation of multiple precision matrices (JEMP) with regularized aggregation (RA) captured more robust associations between task-relevant neural regions of interest (ROIs), compared to the analyses using JEMP alone. The JEMP with RA also was sensitive to increased neural efficiency after task practice. Comparison with existing method(s): The simple average of individual precision matrices may be affected by outliers and provide inconsistent outcomes between subject-level and group-level networks. In contrast, the proposed method yielded a robust group graph that could identify and ease the effect of outliers. Conclusions: The proposed method identified regions of practice-induced attenuation associated with reduced cognitive demand after repeat task exposure. Through simulated and real data, we demonstrated that this method does not require any distribution assumption, can identify outliers, and provides robust, representative group brain networks. This method can be applied to datasets that have extensive variability and/or multiple outliers, including applications to specific, and general, cognitive processes, as well as for studies that may require longitudinal data, such as pharmaceutical trials. |
Benjamin Haas; Martin I. Sereno; D. Samuel Schwarzkopf Inferior occipital gyrus is organized along common gradients of spatial and face-part selectivity Journal Article In: Journal of Neuroscience, vol. 41, no. 25, pp. 5511–5521, 2021. @article{Haas2021, The ventral visual stream of the human brain is subdivided into patches with categorical stimulus preferences, like faces or scenes. However, the functional organization within these areas is less clear. Here, we used functional magnetic resonance imaging and vertex-wise tuning models to independently probe spatial and face-part preferences in the inferior occipital gyrus (IOG) of healthy adult males and females. The majority of responses were well explained by Gaussian population tuning curves for both retinotopic location and the preferred relative position within a face. Parameter maps revealed a common gradient of spatial and face-part selectivity, with the width of tuning curves drastically increasing from posterior to anterior IOG. Tuning peaks clustered more idiosyncratically but were also correlated across maps of visual and face space. Preferences for the upper visual field went along with significantly increased coverage of the upper half of the face, matching recently discovered biases in human perception. Our findings reveal a broad range of neural face-part selectivity in IOG, ranging from narrow to “holistic.” IOG is functionally organized along this gradient, which in turn is correlated with retinotopy. |
Thomas Pfeffer; Adrian Ponce-Alvarez; Konstantinos Tsetsos; Thomas Meindertsma; Christoffer Julius Gahnström; Ruud Lucas Brink; Guido Nolte; Andreas Karl Engel; Gustavo Deco; Tobias Hinrich Donner Circuit mechanisms for the chemical modulation of cortex-wide network interactions and behavioral variability Journal Article In: Science Advances, vol. 7, no. 29, pp. eabf5620, 2021. @article{Pfeffer2021, Influential theories postulate distinct roles of catecholamines and acetylcholine in cognition and behavior. However, previous physiological work reported similar effects of these neuromodulators on the response properties (specifically, the gain) of individual cortical neurons. Here, we show a double dissociation between the effects of catecholamines and acetylcholine at the level of large-scale interactions between cortical areas in humans. A pharmacological boost of catecholamine levels increased cortex-wide interactions during a visual task, but not rest. An acetylcholine boost decreased interactions during rest, but not task. Cortical circuit modeling explained this dissociation by differential changes in two circuit properties: The local excitation-inhibition balance (more strongly increased by catecholamines) and intracortical transmission (more strongly reduced by acetylcholine). The inferred catecholaminergic mechanism also predicted noisier decision-making, which we confirmed for both perceptual and value-based choice behavior. Our work highlights specific circuit mechanisms for shaping cortical network interactions and behavioral variability by key neuromodulatory systems. |
Isabelle A. Rosenthal; Shridhar R. Singh; Katherine L. Hermann; Dimitrios Pantazis; Bevil R. Conway Color space geometry uncovered with magnetoencephalography Journal Article In: Current Biology, vol. 31, no. 3, pp. 515–526, 2021. @article{Rosenthal2021, The geometry that describes the relationship among colors, and the neural mechanisms that support color vision, are unsettled. Here, we use multivariate analyses of measurements of brain activity obtained with magnetoencephalography to reverse-engineer a geometry of the neural representation of color space. The analyses depend upon determining similarity relationships among the spatial patterns of neural responses to different colors and assessing how these relationships change in time. We evaluate the approach by relating the results to universal patterns in color naming. Two prominent patterns of color naming could be accounted for by the decoding results: the greater precision in naming warm colors compared to cool colors evident by an interaction of hue and lightness, and the preeminence among colors of reddish hues. Additional experiments showed that classifiers trained on responses to color words could decode color from data obtained using colored stimuli, but only at relatively long delays after stimulus onset. These results provide evidence that perceptual representations can give rise to semantic representations, but not the reverse. Taken together, the results uncover a dynamic geometry that provides neural correlates for color appearance and generates new hypotheses about the structure of color space. |
Ella Podvalny; Leana E. King; Biyu J. He Spectral signature and behavioral consequence of spontaneous shifts of pupil-linked arousal in human Journal Article In: eLife, vol. 10, pp. e68265, 2021. @article{Podvalny2021, Arousal levels perpetually rise and fall spontaneously. How markers of arousal—pupil size and frequency content of brain activity—relate to each other and influence behavior in humans is poorly understood. We simultaneously monitored magnetoencephalography and pupil in healthy volunteers at rest and during a visual perceptual decision-making task. Spontaneously varying pupil size correlates with power of brain activity in most frequency bands across large-scale resting-state cortical networks. Pupil size recorded at prestimulus baseline correlates with subsequent shifts in detection bias (c) and sensitivity (d'). When dissociated from pupil-linked state, prestimulus spectral power of resting state networks still predicts perceptual behavior. Fast spontaneous pupil constriction and dilation correlate with large-scale brain activity as well but not perceptual behavior. Our results illuminate the relation between central and peripheral arousal markers and their respective roles in human perceptual decision-making. |
Rodolfo Solís-Vivanco; Ole Jensen; Mathilde Bonnefond New insights on the ventral attention network: Active suppression and involuntary recruitment during a bimodal task Journal Article In: Human Brain Mapping, vol. 42, no. 6, pp. 1699–1713, 2021. @article{SolisVivanco2021, Detection of unexpected, yet relevant events is essential in daily life. fMRI studies have revealed the involvement of the ventral attention network (VAN), including the temporo-parietal junction (TPJ), in such process. In this MEG study with 34 participants (17 women), we used a bimodal (visual/auditory) attention task to determine the neuronal dynamics associated with suppression of the activity of the VAN during top-down attention and its recruitment when information from the unattended sensory modality is involuntarily integrated. We observed an anticipatory power increase of alpha/beta oscillations (12–20 Hz, previously associated with functional inhibition) in the VAN following a cue indicating the modality to attend. Stronger VAN power increases were associated with better task performance, suggesting that the VAN suppression prevents shifting attention to distractors. Moreover, the TPJ was synchronized with the frontal eye field in that frequency band, indicating that the dorsal attention network (DAN) might participate in such suppression. Furthermore, we found a 12–20 Hz power decrease and enhanced synchronization, in both the VAN and DAN, when information between sensory modalities was congruent, suggesting an involvement of these networks when attention is involuntarily enhanced due to multisensory integration. Our results show that effective multimodal attentional allocation includes the modulation of the VAN and DAN through upper-alpha/beta oscillations. Altogether these results indicate that the suppressing role of alpha/beta oscillations might operate beyond sensory regions. |
Benjamin J. Stauch; Alina Peter; Heike Schuler; Pascal Fries Stimulus-specific plasticity in human visual gamma-band activity and functional connectivity Journal Article In: eLife, vol. 10, pp. e68240, 2021. @article{Stauch2021, Under natural conditions, the visual system often sees a given input repeatedly. This provides an opportunity to optimize processing of the repeated stimuli. Stimulus repetition has been shown to strongly modulate neuronal-gamma band synchronization, yet crucial questions remained open. Here we used magnetoencephalography in 30 human subjects and find that gamma decreases across ≈10 repetitions and then increases across further repetitions, revealing plastic changes of the activated neuronal circuits. Crucially, increases induced by one stimulus did not affect responses to other stimuli, demonstrating stimulus specificity. Changes partially persisted when the inducing stimulus was repeated after 25 minutes of intervening stimuli. They were strongest in early visual cortex and increased interareal feedforward influences. Our results suggest that early visual cortex gamma synchronization enables adaptive neuronal processing of recurring stimuli. These and previously reported changes might be due to an interaction of oscillatory dynamics with established synaptic plasticity mechanisms. |
Yu Takagi; Laurence Tudor Hunt; Mark W. Woolrich; Timothy E. J. Behrens; Miriam C. Klein-Flügge Adapting non-invasive human recordings along multiple task-axes shows unfolding of spontaneous and over-trained choice Journal Article In: eLife, vol. 10, pp. 1–27, 2021. @article{Takagi2021, Choices rely on a transformation of sensory inputs into motor responses. Using invasive single neuron recordings, the evolution of a choice process has been tracked by projecting population neural responses into state spaces. Here, we develop an approach that allows us to recover similar trajectories on a millisecond timescale in non-invasive human recordings. We selectively suppress activity related to three task-axes, relevant and irrelevant sensory inputs and response direction, in magnetoencephalography data acquired during context-dependent choices. Recordings from premotor cortex show a progression from processing sensory input to processing the response. In contrast to previous macaque recordings, information related to choice-irrelevant features is represented more weakly than choice-relevant sensory information. To test whether this mechanistic difference between species is caused by extensive over-training common in non-human primate studies, we trained humans on >20,000 trials of the task. Choice-irrelevant features were still weaker than relevant features in premotor cortex after over-training. |
Yali Pan; Steven Frisson; Ole Jensen Neural evidence for lexical parafoveal processing Journal Article In: Nature Communications, vol. 12, pp. 5234, 2021. @article{Pan2021a, In spite of the reduced visual acuity, parafoveal information plays an important role in natural reading. However, competing models on reading disagree on whether words are previewed parafoveally at the lexical level. We find neural evidence for lexical parafoveal processing by combining a rapid invisible frequency tagging (RIFT) approach with magnetoencephalography (MEG) and eye-tracking. In a silent reading task, target words are tagged (flickered) subliminally at 60 Hz. The tagging responses measured when fixating on the pre-target word reflect parafoveal processing of the target word. We observe stronger tagging responses during pre-target fixations when followed by low compared with high lexical frequency targets. Moreover, this lexical parafoveal processing is associated with individual reading speed. Our findings suggest that reading unfolds in the fovea and parafovea simultaneously to support fluent reading. |
Aurélien Weiss; Valérian Chambon; Junseok K. Lee; Jan Drugowitsch; Valentin Wyart Interacting with volatile environments stabilizes hidden-state inference and its brain signatures Journal Article In: Nature Communications, vol. 12, pp. 2228, 2021. @article{Weiss2021, Making accurate decisions in uncertain environments requires identifying the generative cause of sensory cues, but also the expected outcomes of possible actions. Although both cognitive processes can be formalized as Bayesian inference, they are commonly studied using different experimental frameworks, making their formal comparison difficult. Here, by framing a reversal learning task either as cue-based or outcome-based inference, we found that humans perceive the same volatile environment as more stable when inferring its hidden state by interaction with uncertain outcomes than by observation of equally uncertain cues. Multivariate patterns of magnetoencephalographic (MEG) activity reflected this behavioral difference in the neural interaction between inferred beliefs and incoming evidence, an effect originating from associative regions in the temporal lobe. Together, these findings indicate that the degree of control over the sampling of volatile environments shapes human learning and decision-making under uncertainty. |