眼链接EEG/fNIRS/TMS出版物
以下列出了截至2023年(早于2024年)的所有EyeLink EEG、fNIRS和TMS研究出版物(具有并发眼动跟踪)。您可以使用P300、伽马波段、NIRS等关键词搜索出版物。您还可以搜索单个作者姓名。如果我们错过了任何EyeLink EEG、fNIRS或TMS文章,请给我们发电子邮件!
2020 |
Christina Mühlberger; Johannes Klackl; Sandra Sittenthaler; Eva Jonas The approach-motivational nature of reactance-Evidence from asymmetrical frontal cortical activation Journal Article In: Motivation Science, vol. 6, no. 3, pp. 203–220, 2020. @article{Muehlberger2020, Research has demonstrated that freedom restrictions evoke psychological reactance-a strong motivation to take action to regain the threatened freedom. We hypothesized that the underlying motivational state of reactance is approach-related. We used either a behavioral measure (line bisection task) or electroencephalography to assess relative left frontal brain activation, an indicator of approach motivation. We found increased approach motivation following imagined (Experiment 1), remembered (Experiment 2), and induced (Experiment 3) freedom threats. The results additionally revealed that only a selfexperienced freedom threat and not a vicarious freedom threat resulted in approach motivation. Overall, the findings suggest that reactance is approach motivational. |
Paul S. Muhle-Karbe; Nicholas E. Myers; Mark G. Stokes A hierarchy of functional states in working memory Journal Article In: Journal of Neuroscience, vol. 41, no. 20, pp. 4461–4475, 2020. @article{MuhleKarbe2020, Extensive research has examined how information is maintained in working memory (WM), but it remains unknown how WM is used to guide behaviour. We addressed this question using a combination of electroencephalography, pattern analyses, and cognitive modelling with a task that required maintenance of two WM items and flexible priority shifts between them. This enabled us to discern neural states coding for immediately and prospectively task-relevant items, and to examine how these states contribute to WM-based decisions. We identified two qualitatively different neural states: a functionally latent state encoded both items, was unrelated to performance on the current trial, but predictive of performance accuracy over longer time scales. In contrast, a functionally active state encoded only the immediately task-relevant item, and closely tracked the quality of evidence integration on the current trial. These results delineate a hierarchy of functional states whereby latent memories supporting general maintenance are transformed into active decision-circuits to guide WM-based behaviour. |
Niklas Wilming; Peter R. Murphy; Florent Meyniel; Tobias H. Donner Large-scale dynamics of perceptual decision information across human cortex Journal Article In: Nature Communications, vol. 11, pp. 5109, 2020. @article{Wilming2020, Perceptual decisions entail the accumulation of sensory evidence for a particular choice towards an action plan. An influential framework holds that sensory cortical areas encode the instantaneous sensory evidence and downstream, action-related regions accumulate this evidence. The large-scale distribution of this computation across the cerebral cortex has remained largely elusive. Here, we develop a regionally-specific magnetoencephalography decoding approach to exhaustively map the dynamics of stimulus- and choice-specific signals across the human cortical surface during a visual decision. Comparison with the evidence accumulation dynamics inferred from behavior disentangles stimulus-dependent and endogenous components of choice-predictive activity across the visual cortical hierarchy. We find such an endogenous component in early visual cortex (including V1), which is expressed in a low (<20 Hz) frequency band and tracks, with delay, the build-up of choice-predictive activity in (pre-) motor regions. Our results are consistent with choice- and frequency-specific cortical feedback signaling during decision formation. |
Tommy J. Wilson; John J. Foxe Cross-frequency coupling of alpha oscillatory power to the entrainment rhythm of a spatially attended input stream Journal Article In: Cognitive Neuroscience, vol. 11, no. 1-2, pp. 71–91, 2020. @article{Wilson2020, Neural entrainment and alpha oscillatory power (8–14 Hz) are mechanisms of selective attention. The extent to which these two mechanisms interact, especially in the context of visuospatial attention, is unclear. Here, we show that spatial attention to a delta-frequency, rhythmic visual stimulus in one hemifield results in phase-amplitude coupling between the delta-phase of an entrained frontal source and alpha power generated by ipsilateral visuocortical regions. The driving of ipsilateral alpha power by frontal delta also correlates with task performance. Our analyses suggest that neural entrainment may serve a previously underappreciated role in coordinating macroscale brain networks and that inhibition of processing by alpha power can be coupled to an attended temporal structure. Finally, we note that the observed coupling bolsters one dominant hypothesis of modern cognitive neuroscience, that macroscale brain networks and distributed neural computation are coordinated by oscillatory synchrony and cross-frequency interactions. |
G. Elliott Wimmer; Yunzhe Liu; Neža Vehar; Timothy E. J. Behrens; Raymond J. Dolan Episodic memory retrieval success is associated with rapid replay of episode content Journal Article In: Nature Neuroscience, vol. 23, no. 8, pp. 1025–1033, 2020. @article{Wimmer2020, Retrieval of everyday experiences is fundamental for informing our future decisions. The fine-grained neurophysiological mechanisms that support such memory retrieval are largely unknown. We studied participants who first experienced, without repetition, unique multicomponent 40–80-s episodes. One day later, they engaged in cued retrieval of these episodes while undergoing magnetoencephalography. By decoding individual episode elements, we found that trial-by-trial successful retrieval was supported by the sequential replay of episode elements, with a temporal compression factor of >60. The direction of replay supporting retrieval, either backward or forward, depended on whether the task goal was to retrieve elements of an episode that followed or preceded, respectively, a retrieval cue. This sequential replay was weaker in very-high-performing participants, in whom instead we found evidence for simultaneous clustered reactivation. Our results demonstrate that memory-mediated decisions are supported by a rapid replay mechanism that can flexibly shift in direction in response to task goals. |
Lisa Wirz; Lars Schwabe Prioritized attentional processing: Acute stress, memory and stimulus emotionality facilitate attentional disengagement Journal Article In: Neuropsychologia, vol. 138, pp. 107334, 2020. @article{Wirz2020, Rapid attentional orienting toward relevant stimuli and efficient disengagement from irrelevant stimuli are critical for survival. Here, we examined the roles of memory processes, emotional arousal and acute stress in attentional disengagement. To this end, 64 healthy participants encoded negative and neutral facial expressions and, after being exposed to a stress or control manipulation, performed an attention task in which they had to disengage from these previously encoded as well as novel face stimuli. During the attention task, electroencephalography (EEG) and pupillometry data were recorded. Our results showed overall faster reaction times after acute stress and when participants had to disengage from emotionally negative or old facial expressions. Further, pupil dilations were larger in response to neutral faces. During disengagement, our EEG data revealed a reduced N2pc amplitude when participants disengaged from neutral compared to negative facial expressions when these were not presented before, as well as earlier onset latencies for the N400f (for disengagement from negative and old faces), the N2pc, and the LPP (for disengagement from negative faces). In addition, early visual processing of negative faces, as reflected in the P1 amplitude, was enhanced specifically in stressed participants. Our findings indicate that attentional disengagement is improved for negative and familiar stimuli and that stress facilitates not only attentional disengagement but also emotional processing in general. Together, these processes may represent important mechanisms enabling efficient performance and rapid threat detection. |
Hong Zeng; Junjie Shen; Wenming Zheng; Aiguo Song; Jia Liu Toward measuring target perception: First-order and second-order deep network pipeline for classification of fixation-felated potentials Journal Article In: Journal of Healthcare Engineering, pp. 1–15, 2020. @article{Zeng2020, The topdown determined visual object perception refers to the ability of a person to identify a prespecified visual target. This paper studies the technical foundation for measuring the target-perceptual ability in a guided visual search task, using the EEG-based brain imaging technique. Specifically, it focuses on the feature representation learning problem for single-trial classification of fixation-related potentials (FRPs). The existing methods either capture only first-order statistics while ignoring second-order statistics in data, or directly extract second-order statistics with covariance matrices estimated with raw FRPs that suffer from low signal-to-noise ratio. In this paper, we propose a new representation learning pipeline involving a low-level convolution subnetwork followed by a high-level Riemannian manifold subnetwork, with a novel midlevel pooling layer bridging them. In this way, the discriminative power of the first-order features can be increased by the convolution subnetwork, while the second-order information in the convolutional features could further be deeply learned with the subsequent Riemannian subnetwork. In particular, the temporal ordering of FRPs is well preserved for the components in our pipeline, which is considered to be a valuable source of discriminant information. The experimental results show that proposed approach leads to improved classification performance and robustness to lack of data over the state-of-the-art ones, thus making it appealing for practical applications in measuring the target-perceptual ability of cognitively impaired patients with the FRP technique. |
Bin Zhao; Jinfeng Huang; Gaoyan Zhang; Jianwu Dang; Minbo Chen; Yingjian Fu; Longbiao Wang Brain network reconstruction of speech production based on electro-encephalography and eye movement Journal Article In: Acoustical Science and Technology, vol. 41, no. 1, pp. 349–350, 2020. @article{Zhao2020, To fully understand the brain mechanism associated with speech functions, it is necessary to unfold the spatiotemporal brain dynamics during the whole speech processing range [1]. However, previous functional magnetic resonance imaging (fMRI) and positron emission tomography (PET) studies focused on cerebral activation patterns and their regional functions, while lacking information of the time courses [2]. In contrast, electroencephalography (EEG) and magneto- encephalography (MEG) with high temporal resolution are inferior in source localization, and are also easily buried in electromagnetic artifacts from muscular actions in articulation, thus interfering with the analysis. In this study, we introduced a novel multimodal data acquisition system to collect EEG, eye movement, and speech in an oral reading task. The behavior data (eye movement and speech) were used for segmenting cognitive stages. EEG data went through independent component analyses (ICA), component clustering, and time-varying (adaptive) multi-variate autoregressive modeling [3] for estimating the spatiotemporal causal interactions among brain regions in each cognitive and speech process. Statistical analyses and literature review were followed to interpret the brain dynamic results for better understanding the speech functions. |
Jing Zhu; Zihan Wang; Tao Gong; Shuai Zeng; Xiaowei Li; Bin Hu; Jianxiu Li; Shuting Sun; Lan Zhang An improved classification model for depression detection using EEG and eye tracking data Journal Article In: IEEE Transactions on Nanobioscience, vol. 19, no. 3, pp. 527–537, 2020. @article{Zhu2020a, At present, depression has become a main health burden in the world. However, there are many problems with the diagnosis of depression, such as low patient cooperation, subjective bias and low accuracy. Therefore, reliable and objective evaluation method is needed to achieve effective depression detection. Electroencephalogram (EEG) and eye movements (EMs) data have been widely used for depression detection due to their advantages of easy recording and non-invasion. This research proposes a content based ensemble method (CBEM) to promote the depression detection accuracy, both static and dynamic CBEM were discussed. In the proposed model, EEG or EMs dataset was divided into subsets by the context of the experiments, and then a majority vote strategy was used to determine the subjects' label. The validation of the method is testified on two datasets which included free viewing eye tracking and resting-state EEG, and these two datasets have 36,34 subjects respectively. For these two datasets, CBEM achieves accuracies of 82.5% and 92.65% respectively. The results show that CBEM outperforms traditional classification methods. Our findings provide an effective solution for promoting the accuracy of depression identification, and provide an effective method for identification of depression, which in the future could be used for the auxiliary diagnosis of depression. |
Artyom Zinchenko; Markus Conci; Thomas Töllner; Hermann J. Müller; Thomas Geyer Automatic guidance (and misguidance) of visuospatial attention by acquired scene memory: Evidence from an N1pc polarity reversal Journal Article In: Psychological Science, vol. 31, no. 12, pp. 1–13, 2020. @article{Zinchenko2020a, Visual search is facilitated when the target is repeatedly encountered at a fixed position within an invariant (vs. randomly variable) distractor layout—that is, when the layout is learned and guides attention to the target, a phenomenon known as contextual cuing. Subsequently changing the target location within a learned layout abolishes contextual cuing, which is difficult to relearn. Here, we used lateralized event-related electroencephalogram (EEG) potentials to explore memory-based attentional guidance (N = 16). The results revealed reliable contextual cuing during initial learning and an associated EEG-amplitude increase for repeated layouts in attention-related components, starting with an early posterior negativity (N1pc, 80–180 ms). When the target was relocated to the opposite hemifield following learning, contextual cuing was effectively abolished, and the N1pc was reversed in polarity (indicative of persistent misguidance of attention to the original target location). Thus, once learned, repeated layouts trigger attentional-priority signals from memory that proactively interfere with contextual relearning after target relocation. |
Yongchun Wang; Meilin Di; Jingjing Zhao; Saisai Hu; Zhao Yao; Yonghui Wang Attentional modulation of unconscious inhibitory visuomotor processes: An EEG study Journal Article In: Psychophysiology, vol. 57, no. 8, pp. e13561, 2020. @article{Wang2020k, The present study examined the role of attention in unconscious inhibitory visuomotor processes in three experiments that employed a mixed paradigm including a spatial cueing task and masked prime task. Spatial attention to the prime was manipulated. Specifically, the valid-cue condition (in which the prime obtained more attentional resources) and invalid-cue condition (in which the prime obtained fewer attentional resources) were included. The behavioral results showed that the negative compatibility effect (a behavioral indicator of inhibitory visuomotor processing) in the valid-cue condition was larger than that in the invalid-cue condition. Most importantly, lateralized readiness potential results indicated that the prime-related activation was stronger in the valid-cue condition than in the invalid-cue condition and that the followed inhibition in the compatible trials was also stronger in the valid-cue condition than in the invalid-cue condition. In line with the proposed attentional modulation model, unconscious visuomotor inhibitory processing is modulated by attentional resources. |
Quan Wan; Ying Cai; Jason Samaha; Bradley R. Postle Tracking stimulus representation across a 2-back visual working memory task: Tracking 2-back representation Journal Article In: Royal Society Open Science, vol. 7, pp. 1–18, 2020. @article{Wan2020, How does the neural representation of visual working memory content vary with behavioural priority? To address this, we recorded electroencephalography (EEG) while subjects performed a continuous-performance 2-back working memory task with oriented-grating stimuli. We tracked the transition of the neural representation of an item (n) from its initial encoding, to the status of 'unprioritized memory item' (UMI), and back to 'prioritized memory item', with multivariate inverted encoding modelling. Results showed that the representational format was remapped from its initially encoded format into a distinctive 'opposite' representational format when it became a UMI and then mapped back into its initial format when subsequently prioritized in anticipation of its comparison with item n + 2. Thus, contrary to the default assumption that the activity representing an item in working memory might simply get weaker when it is deprioritized, it may be that a process of priority-based remapping helps to protect remembered information when it is not in the focus of attention. |
Elisa C. Dias; Abraham C. Van Voorhis; Filipe Braga; Julianne Todd; Javier Lopez-Calderon; Antigona Martinez; Daniel C. Javitt Impaired fixation-related theta modulation predicts reduced visual span and guided search deficits in schizophrenia Journal Article In: Cerebral Cortex, vol. 30, no. 5, pp. 2823–2833, 2020. @article{Dias2020, During normal visual behavior, individuals scan the environment through a series of saccades and fixations. At each fixation, the phase of ongoing rhythmic neural oscillations is reset, thereby increasing efficiency of subsequent visual processing. This phase-reset is reflected in the generation of a fixation-related potential (FRP). Here, we evaluate the integrity of theta phase-reset/FRP generation and Guided Visual Search task in schizophrenia. Subjects performed serial and parallel versions of the task. An initial study (15 healthy controls (HC)/15 schizophrenia patients (SCZ)) investigated behavioral performance parametrically across stimulus features and set-sizes. A subsequent study (25-HC/25-SCZ) evaluated integrity of search-related FRP generation relative to search performance and evaluated visual span size as an index of parafoveal processing. Search times were significantly increased for patients versus controls across all conditions. Furthermore, significantly, deficits were observed for fixation-related theta phase-reset across conditions, that fully predicted impaired reduced visual span and search performance and correlated with impaired visual components of neurocognitive processing. By contrast, overall search strategy was similar between groups. Deficits in theta phase-reset mechanisms are increasingly documented across sensory modalities in schizophrenia. Here, we demonstrate that deficits in fixation-related theta phase-reset during naturalistic visual processing underlie impaired efficiency of early visual function in schizophrenia. |
Nadine Dijkstra; Luca Ambrogioni; Diego Vidaurre; Marcel Gerven Neural dynamics of perceptual inference and its reversal during imagery Journal Article In: eLife, vol. 9, pp. 1–19, 2020. @article{Dijkstra2020, After the presentation of a visual stimulus, neural processing cascades from low-level sensory areas to increasingly abstract representations in higher-level areas. It is often hypothesised that a reversal in neural processing underlies the generation of mental images as abstract representations are used to construct sensory representations in the absence of sensory input. According to predictive processing theories, such reversed processing also plays a central role in later stages of perception. Direct experimental evidence of reversals in neural information flow has been missing. Here, we used a combination of machine learning and magnetoencephalography to characterise neural dynamics in humans. We provide direct evidence for a reversal of the perceptual feed-forward cascade during imagery and show that, during perception, such reversals alternate with feed-forward processing in an 11 Hz oscillatory pattern. Together, these results show how common feedback processes support both veridical perception and mental imagery. |
Troy Dildine; Elizabeth Necka; Lauren Yvette Atlas Confidence in subjective pain is predicted by reaction time during decision making Journal Article In: Scientific Reports, vol. 10, pp. 21373, 2020. @article{Dildine2020, Self-report is the gold standard for measuring pain. However, decisions about pain can vary substantially within and between individuals. We measured whether self-reported pain is accompanied by metacognition and variations in confidence, similar to perceptual decision-making in other modalities. Eighty healthy volunteers underwent acute thermal pain and provided pain ratings followed by confidence judgments on continuous visual analogue scales. We investigated whether eye fixations and reaction time during pain rating might serve as implicit markers of confidence. Confidence varied across trials and increased confidence was associated with faster pain rating reaction times. The association between confidence and fixations varied across individuals as a function of the reliability of individuals' association between temperature and pain. Taken together, this work indicates that individuals can provide metacognitive judgments of pain and extends research on confidence in perceptual decision-making to pain. |
Ciara Egan; Filipe Cristino; Joshua S. Payne; Guillaume Thierry; Manon W. Jones How alliteration enhances conceptual–attentional interactions in reading Journal Article In: Cortex, vol. 124, pp. 111–118, 2020. @article{Egan2020, In linguistics, the relationship between phonological word form and meaning is mostly considered arbitrary. Why, then, do literary authors traditionally craft sound relationships between words? We set out to characterise how dynamic interactions between word form and meaning may account for this literary practice. Here, we show that alliteration influences both meaning integration and attentional engagement during reading. We presented participants with adjective-noun phrases, having manipulated semantic relatedness (congruent, incongruent) and form repetition (alliterating, non-alliterating) orthogonally, as in “dazzling-diamond”; “sparkling-diamond”; “dangerous-diamond”; and “creepy-diamond”. Using simultaneous recording of event-related brain potentials and pupil dilation (PD), we establish that, whilst semantic incongruency increased N400 amplitude as expected, it reduced PD, an index of attentional engagement. Second, alliteration affected semantic evaluation of word pairs, since it reduced N400 amplitude even in the case of unrelated items (e.g., “dangerous-diamond”). Third, alliteration specifically boosted attentional engagement for related words (e.g., “dazzling-diamond”), as shown by a sustained negative correlation between N400 amplitudes and PD change after the window of lexical integration. Thus, alliteration strategically arouses attention during reading and when comprehension is challenged, phonological information helps readers link concepts beyond the level of literal semantics. Overall, our findings provide a tentative mechanism for the empowering effect of sound repetition in literary constructs. |
Thomas Geyer; Franziska Günther; Hermann J. Müller; Jim Kacian; Heinrich René Liesefeld; Stella Pierides Reading English-language haiku: An eye-movement study of the 'cut effect' Journal Article In: Journal of Eye Movement Research, vol. 13, no. 2, pp. 1–29, 2020. @article{Geyer2020, The current study, set within the larger enterprise of Neuro-Cognitive Poetics, was designed to examine how readers deal with the 'cut'-a more or less sharp semantic-conceptual break-in normative, three-line English-language haiku poems (ELH). Readers were presented with three-line haiku that consisted of two (seemingly) disparate parts, a (two-line) 'phrase' image and a one-line 'fragment' image, in order to determine how they process the conceptual gap between these images when constructing the poem's meaning-as reflected in their patterns of reading eye movements. In addition to replicating the basic 'cut effect', i.e., the extended fixation dwell time on the fragment line relative to the other lines, the present study examined (a) how this effect is influenced by whether the cut is purely implicit or explicitly marked by punctuation, and (b) whether the effect pattern could be delineated against a control condition of 'uncut', one-image haiku. For 'cut' vs. 'uncut' haiku, the results revealed the distribution of fixations across the poems to be modulated by the position of the cut (after line 1 vs. after line 2), the presence vs. absence of a cut marker, and the semanticconceptual distance between the two images (context-action vs. juxtaposition haiku). These formal-structural and conceptual-semantic properties were associated with systematic changes in how individual poem lines were scanned at first reading and then (selectively) re-sampled in second-and third-pass reading to construct and check global meaning. No such effects were found for one-image (control) haiku. We attribute this pattern to the operation of different meaning resolution processes during the comprehension of two-image haiku, which are invoked by both form-and meaning-related features of the poems. |
Maximilian F. A. Hauser; Stefanie Heba; Tobias Schmidt-Wilcke; Martin Tegenthoff; Denise Manahan-Vaughan Cerebellar-hippocampal processing in passive perception of visuospatial change: An ego- and allocentric axis? Journal Article In: Human Brain Mapping, vol. 41, no. 5, pp. 1153–1166, 2020. @article{Hauser2020, In addition to its role in visuospatial navigation and the generation of spatial representations, in recent years, the hippocampus has been proposed to support perceptual processes. This is especially the case where high-resolution details, in the form of fine-grained relationships between features such as angles between components of a visual scene, are involved. An unresolved question is how, in the visual domain, perspective-changes are differentiated from allocentric changes to these perceived feature relationships, both of which may be argued to involve the hippocampus. We conducted functional magnetic resonance imaging of the brain response (corroborated through separate event-related potential source-localization) in a passive visuospatial oddball-paradigm to examine to what extent the hippocampus and other brain regions process changes in perspective, or configuration of abstract, three-dimensional structures. We observed activation of the left superior parietal cortex during perspective shifts, and right anterior hippocampus in configuration-changes. Strikingly, we also found the cerebellum to differentiate between the two, in a way that appeared tightly coupled to hippocampal processing. These results point toward a relationship between the cerebellum and the hippocampus that occurs during perception of changes in visuospatial information that has previously only been reported with regard to visuospatial navigation. |
Simone G. Heideman; Andrew J. Quinn; Mark W. Woolrich; Freek Ede; Anna C. Nobre Dissecting beta-state changes during timed movement preparation in Parkinson's disease Journal Article In: Progress in Neurobiology, vol. 184, pp. 101731, 2020. @article{Heideman2020, An emerging perspective describes beta-band (15−28 Hz) activity as consisting of short-lived high-amplitude events that only appear sustained in conventional measures of trial-average power. This has important implications for characterising abnormalities observed in beta-band activity in disorders like Parkinson's disease. Measuring parameters associated with beta-event dynamics may yield more sensitive measures, provide more selective diagnostic neural markers, and provide greater mechanistic insight into the breakdown of brain dynamics in this disease. Here, we used magnetoencephalography in eighteen Parkinson's disease participants off dopaminergic medication and eighteen healthy control participants to investigate beta-event dynamics during timed movement preparation. We used the Hidden Markov Model to classify event dynamics in a data-driven manner and derived three parameters of beta events: (1) beta-state amplitude, (2) beta-state lifetime, and (3) beta-state interval time. Of these, changes in beta-state interval time explained the overall decreases in beta power during timed movement preparation and uniquely captured the impairment in such preparation in patients with Parkinson's disease. Thus, the increased granularity of the Hidden Markov Model analysis (compared with conventional analysis of power) provides increased sensitivity and suggests a possible reason for impairments of timed movement preparation in Parkinson's disease. |
James E. Hoffman; Minwoo Kim; Matt Taylor; Kelsey Holiday Emotional capture during emotion-induced blindness is not automatic Journal Article In: Cortex, vol. 122, pp. 140–158, 2020. @article{Hoffman2020, The present research used behavioral and event-related brain potentials (ERP) measures to determine whether emotional capture is automatic in the emotion-induced blindness (EIB) paradigm. The first experiment varied the priority of performing two concurrent tasks: identifying a negative or neutral picture appearing in a rapid serial visual presentation (RSVP) stream of pictures and multiple object tracking (MOT). Results showed that increased attention to the MOT task resulted in decreased accuracy for identifying both negative and neutral target pictures accompanied by decreases in the amplitude of the P3b component. In contrast, the early posterior negativity (EPN) component elicited by negative pictures was unaffected by variations in attention. Similarly, there was a decrement in MOT performance for dual-task versus single task conditions but no effect of picture type (negative vs neutral) on MOT accuracy which isn't consistent with automatic emotional capture of attention. However, the MOT task might simply be insensitive to brief interruptions of attention. The second experiment used a more sensitive reaction time (RT) measure to examine this possibility. Results showed that RT to discriminate a gap appearing in a tracked object was delayed by the simultaneous appearance of to-be-ignored distractor pictures even though MOT performance was once again unaffected by the distractor. Importantly, the RT delay was the same for both negative and neutral distractors suggesting that capture was driven by physical salience rather than emotional salience of the distractors. Despite this lack of emotional capture, the EPN component, which is thought to reflect emotional capture, was still present. We suggest that the EPN doesn't reflect capture but rather downstream effects of attention, including object recognition. These results show that capture by emotional pictures in EIB can be suppressed when attention is engaged in another difficult task. The results have important implications for understanding capture effects in EIB. |
Taihei Ninomiya; Atsushi Noritake; Kenta Kobayashi; Masaki Isoda A causal role for frontal cortico-cortical coordination in social action monitoring Journal Article In: Nature Communications, vol. 11, pp. 5233, 2020. @article{Ninomiya2020, Decision-making via monitoring others' actions is a cornerstone of interpersonal exchanges. Although the ventral premotor cortex (PMv) and the medial prefrontal cortex (MPFC) are cortical nodes in social brain networks, the two areas are rarely concurrently active in neuroimaging, inviting the hypothesis that they are functionally independent. Here we show in macaques that the ability of the MPFC to monitor others' actions depends on input from the PMv. We found that delta-band coherence between the two areas emerged during action execution and action observation. Information flow especially in the delta band increased from the PMv to the MPFC as the biological nature of observed actions increased. Furthermore, selective blockade of the PMv-to-MPFC pathway using a double viral vector infection technique impaired the processing of observed, but not executed, actions. These findings demonstrate that coordinated activity in the PMv-to-MPFC pathway has a causal role in social action monitoring. |
José P. Ossandón; Peter König; Tobias Heed No evidence for a role of spatially modulated a-band activity in tactile remapping and short-latency, overt orienting behavior Journal Article In: Journal of Neuroscience, vol. 40, no. 47, pp. 9088–9102, 2020. @article{Ossandon2020, Oscillatory a-band activity is commonly associated with spatial attention and multisensory prioritization. It has also been suggested to reflect the automatic transformation of tactile stimuli from a skin-based, somatotopic reference frame into an external one. Previous research has not convincingly separated these two possible roles of a-band activity. Previous experimental paradigms have used artificially long delays between tactile stimuli and behavioral responses to aid relating oscillatory activity to these different events. However, this strategy potentially blurs the temporal relationship of a-band activity relative to behavioral indicators of tactile-spatial transformations. Here, we assessed a-band modulation with massive univariate deconvolution, an analysis approach that disentangles brain signals overlapping in time and space. Thirty-one male and female human participants performed a delay-free, visual search task in which saccade behavior was unrestricted. A tactile cue to uncrossed or crossed hands was either informative or uninformative about visual target location. a-Band suppression following tactile stimulation was lateralized relative to the stimulated hand over central-parietal electrodes but relative to its external location over parieto-occipital electrodes. a-Band suppression reflected external touch location only after informative cues, suggesting that posterior a-band lateralization does not index automatic tactile transformation. Moreover, a-band suppression occurred at the time of, or after, the production of the saccades guided by tactile stimulation. These findings challenge the idea that a-band activity is directly involved in tactile-spatial transformation and suggest instead that it reflects delayed, supramodal processes related to attentional reorienting. |
Kirsten C. S. Adam; Lillian Chang; Nicole Rangan; John T. Serences In: Journal of Cognitive Neuroscience, vol. 33, no. 4, pp. 695–724, 2020. @article{Adam2020a, Feature-based attention is the ability to selectively attend to a particular feature (e.g., attend to red but not green items while looking for the ketchup bottle in your refrigerator), and steady- state visually evoked potentials (SSVEPs) measured from the human EEG signal have been used to track the neural deployment of feature-based attention. Although many published studies sug- gest that we can use trial-by-trial cues to enhance relevant feature information (i.e., greater SSVEP response to the cued color), there is ongoing debate about whether participants may likewise use trial-by-trial cues to voluntarily ignore a particular feature. Here, we report the results of a preregistered study in which participants either were cued to attend or to ignore a color. Counter to prior work, we found no attention-related modulation of the SSVEP response in either cue condition. However, positive control analyses revealed that participants paid some degree of attention to the cued color (i.e., we observed a greater P300 component to targets in the attended vs. the unattended color). In light of these unexpected null results, we conducted a focused review of methodological considerations for studies of feature- based attention using SSVEPs. In the review, we quantify potentially important stimulus parameters that have been used in the past (e.g., stimulation frequency, trial counts) and we discuss the potential importance of these and other task factors (e.g., feature-based priming) for SSVEP studies. |
Rick A. Adams; Daniel Bush; Fanfan Zheng; Sofie S. Meyer; Raphael Kaplan; Stelios Orfanos; Tiago Reis Marques; Oliver D. Howes; Neil Burgess Impaired theta phase coupling underlies frontotemporal dysconnectivity in schizophrenia Journal Article In: Brain, vol. 143, no. 3, pp. 1261–1277, 2020. @article{Adams2020a, Frontotemporal dysconnectivity is a key pathology in schizophrenia. The specific nature of this dysconnectivity is unknown, but animal models imply dysfunctional theta phase coupling between hippocampus and medial prefrontal cortex (mPFC). We tested this hypothesis by examining neural dynamics in 18 participants with a schizophrenia diagnosis, both medicated and unmedicated; and 26 age, sex and IQ matched control subjects. All participants completed two tasks known to elicit hippocampal-prefrontal theta coupling: a spatial memory task (during magnetoencephalography) and a memory integration task. In addition, an overlapping group of 33 schizophrenia and 29 control subjects underwent PET to measure the availability of GABAARs expressing the a5 subunit (concentrated on hippocampal somatostatin interneurons). We demonstrate-in the spatial memory task, during memory recall-that theta power increases in left medial temporal lobe (mTL) are impaired in schizophrenia, as is theta phase coupling between mPFC and mTL. Importantly, the latter cannot be explained by theta power changes, head movement, antipsychotics, cannabis use, or IQ, and is not found in other frequency bands. Moreover, mPFC-mTL theta coupling correlated strongly with performance in controls, but not in subjects with schizophrenia, who were mildly impaired at the spatial memory task and no better than chance on the memory integration task. Finally, mTL regions showing reduced phase coupling in schizophrenia magnetoencephalography participants overlapped substantially with areas of diminished a5-GABAAR availability in the wider schizophrenia PET sample. These results indicate that mPFC-mTL dysconnectivity in schizophrenia is due to a loss of theta phase coupling, and imply a5-GABAARs (and the cells that express them) have a role in this process. |
Carmel R. Auerbach-Asch; Oded Bein; Leon Y. Deouell Face selective neural activity: Comparisons between fixed and free viewing Journal Article In: Brain Topography, vol. 33, no. 3, pp. 336–354, 2020. @article{AuerbachAsch2020, Event Related Potentials (ERPs) are widely used to study category-selective EEG responses to visual stimuli, such as the face-selective N170 component. Typically, this is done by flashing stimuli at the point of static gaze fixation. While allowing for good experimental control, these paradigms ignore the dynamic role of eye-movements in natural vision. Fixation-related potentials (FRPs), obtained using simultaneous EEG and eye-tracking, overcome this limitation. Various studies have used FRPs to study processes such as lexical processing, target detection and attention allocation. The goal of this study was to carefully compare face-sensitive activity time-locked to an abrupt stimulus onset at fixation, with that time-locked to a self-generated fixation on a stimulus. Twelve participants participated in three experimental conditions: Free-viewing (FRPs), Cued-viewing (FRPs) and Control (ERPs). We used a multiple regression approach to disentangle overlapping activity components. Our results show that the N170 face-effect is evident for the first fixation on a stimulus, whether it follows a self-generated saccade or stimulus appearance at fixation point. The N170 face-effect has similar topography across viewing conditions, but there were major differences within each stimulus category. We ascribe these differences to an overlap of the fixation-related lambda response and the N170. We tested the plausibility of this account using dipole simulations. Finally, the N170 exhibits category-specific adaptation in free viewing. This study establishes the comparability of the free-viewing N170 face-effect with the classic event-related effect, while highlighting the importance of accounting for eye-movement related effects. |
Yasaman Bagherzadeh; Daniel Baldauf; Dimitrios Pantazis; Robert Desimone Alpha synchrony and the neurofeedback control of spatial attention Journal Article In: Neuron, vol. 105, no. 3, pp. 577–587.e5, 2020. @article{Bagherzadeh2020, During MEG neurofeedback training, subjects learned to manipulate the degree of alpha synchrony over the left versus right parietal cortex. The change in alpha synchrony was associated with a corresponding bias in visual processing and attention in the corresponding visual field. |
Sonya Bells; Silvia L. Isabella; Donald C. Brien; Brian C. Coe; Douglas P. Munoz; Donald J. Mabbott; Douglas O. Cheyne Mapping neural dynamics underlying saccade preparation and execution and their relation to reaction time and direction errors Journal Article In: Human Brain Mapping, vol. 41, no. 7, pp. 1934–1949, 2020. @article{Bells2020, Our ability to control and inhibit automatic behaviors is crucial for negotiating complex environments, all of which require rapid communication between sensory, motor, and cognitive networks. Here, we measured neuromagnetic brain activity to investigate the neural timing of cortical areas needed for inhibitory control, while 14 healthy young adults performed an interleaved prosaccade (look at a peripheral visual stimulus) and antisaccade (look away from stimulus) task. Analysis of how neural activity relates to saccade reaction time (SRT) and occurrence of direction errors (look at stimulus on antisaccade trials) provides insight into inhibitory control. Neuromagnetic source activity was used to extract stimulus-aligned and saccade-aligned activity to examine temporal differences between prosaccade and antisaccade trials in brain regions associated with saccade control. For stimulus-aligned antisaccade trials, a longer SRT was associated with delayed onset of neural activity within the ipsilateral parietal eye field (PEF) and bilateral frontal eye field (FEF). Saccade-aligned activity demonstrated peak activation 10ms before saccade-onset within the contralateral PEF for prosaccade trials and within the bilateral FEF for antisaccade trials. In addition, failure to inhibit prosaccades on anti-saccade trials was associated with increased activity prior to saccade onset within the FEF contralateral to the peripheral stimulus. This work on dynamic activity adds to our knowledge that direction errors were due, at least in part, to a failure to inhibit automatic prosaccades. These findings provide novel evidence in humans regarding the temporal dynamics within oculomotor areas needed for saccade programming and the role frontal brain regions have on top-down inhibitory control. |
Nicholas S. Bland; Jason B. Mattingley; Martin V. Sale Gamma coherence mediates interhemispheric integration during multiple object tracking Journal Article In: Journal of Neurophysiology, vol. 123, no. 5, pp. 1630–1644, 2020. @article{Bland2020, Our ability to track the paths of multiple visual objects moving between the hemifields requires effective integration of information between the two cerebral hemispheres. Coherent neural oscillations in the gamma band (35-70 Hz) are hypothesized to drive this information transfer. Here we manipulated the need for interhemispheric integration using a novel multiple object tracking (MOT) task in which stimuli either moved between the two visual hemifields, requiring interhemispheric integration, or moved within separate visual hemifields. We used electroencephalography (EEG) to measure interhemispheric coherence during the task. Human observers (21 women; 20 men) were poorer at tracking objects between versus within hemifields, reflecting a cost of interhemispheric integration. Critically, gamma coherence was greater in trials requiring interhemispheric integration, particularly between sensors over parieto-occipital areas. In approximately half of the participants, the observed cost of integration was associated with a failure of the cerebral hemispheres to become coherent in the gamma band. Moreover, individual differences in this integration cost correlated with endogenous gamma coherence at these same sensors, although with generally opposing relationships for the real and imaginary part of coherence. The real part (capturing synchronization with a near-zero phase lag) benefited between-hemifield tracking; imaginary coherence was detrimental. Finally, instantaneous phase coherence over the tracking period uniquely predicted between-hemifield tracking performance, suggesting that effective integration benefits from sustained interhemispheric synchronization. Our results show that gamma coherence mediates interhemispheric integration during MOT and add to a growing body of work demonstrating that coherence drives communication across cortically distributed neural networks. NEW & NOTEWORTHY Using a multiple object tracking paradigm, we were able to manipulate the need for interhemispheric integration on a per-trial basis, while also having an objective measure of integration efficacy (i.e., tracking performance). We show that tracking performance reflects a cost of integration, which correlates with individual differences in interhemispheric EEG coherence. Gamma coherence appears to uniquely benefit between-hemifield tracking, predicting performance both across participants and across trials. |
Louisa Bogaerts; Craig G. Richter; Ayelet N. Landau; Ram Frost Beta-band activity is a signature of statistical learning Journal Article In: Journal of Neuroscience, vol. 40, no. 39, pp. 7523–7530, 2020. @article{Bogaerts2020, Through statistical learning (SL), cognitive systems may discover the underlying regularities in the environment. Testing human adults (n = 35, 21 females), we document, in the context of a classical visual SL task, divergent rhythmic EEG activity in the interstimulus delay periods within patterns versus between patterns (i.e., pattern transitions). Our findings reveal increased oscillatory activity in the beta band (∼20 Hz) at triplet transitions that indexes learning: It emerges with increased pattern repetitions; and importantly, it is highly correlated with behavioral learning outcomes. These findings hold the promise of converging on an online measure of learning regularities and provide important theoretical insights regarding the mechanisms of SL and prediction. |
Mathieu Bourguignon; Martijn Baart; Efthymia C. Kapnoula; Nicola Molinaro Lip-reading enables the brain to synthesize auditory features of unknown silent speech Journal Article In: Journal of Neuroscience, vol. 40, no. 5, pp. 1053–1065, 2020. @article{Bourguignon2020, Lip-reading is crucial for understanding speech in challenging conditions. But how the brain extracts meaning from, silent, visual speech is still under debate. Lip-reading in silence activates the auditory cortices, but it is not known whether such activation reflects immediate synthesis of the corresponding auditory stimulus or imagery of unrelated sounds. To disentangle these possibilities, we used magnetoencephalography to evaluate how cortical activity in 28 healthy adult humans (17 females) entrained to the auditory speech envelope and lip movements (mouth opening) when listening to a spoken story without visual input (audio-only), and when seeing a silent video of a speaker articulating another story (video-only). In video-only, auditory cortical activity entrained to the absent auditory signal at frequencies <1 Hz more than to the seen lip movements. This entrainment process was characterized by an auditory-speech-to-brain delay of ~70 ms in the left hemisphere, compared with ~20 ms in audio-only. Entrainment to mouth opening was found in the right angular gyrus at <1 Hz, and in early visual cortices at 1– 8 Hz. These findings demonstrate that the brain can use a silent lip-read signal to synthesize a coarse-grained auditory speech representation in early auditory cortices. Our data indicate the following underlying oscillatory mechanism: seeing lip movements first modulates neuronal activity in early visual cortices at frequencies that match articulatory lip movements; the right angular gyrus then extracts slower features of lip movements, mapping them onto the corresponding speech sound features; this information is fed to auditory cortices, most likely facilitating speech parsing. |
Méadhbh B. Brosnan; Kristina Sabaroedin; Tim Silk; Sila Genc; Daniel P. Newman; Gerard M. Loughnane; Alex Fornito; Redmond G. O'Connell; Mark A. Bellgrove Evidence accumulation during perceptual decisions in humans varies as a function of dorsal frontoparietal organization Journal Article In: Nature Human Behaviour, vol. 4, no. 8, pp. 844–855, 2020. @article{Brosnan2020, Animal neurophysiological studies have identified neural signals within dorsal frontoparietal areas that trace a perceptual decision by accumulating sensory evidence over time and trigger action upon reaching a threshold. Although analogous accumulation-to-bound signals are identifiable on extracranial human electroencephalography, their cortical origins remain unknown. Here neural metrics of human evidence accumulation, predictive of the speed of perceptual reports, were isolated using electroencephalography and related to dorsal frontoparietal network (dFPN) connectivity using diffusion and resting-state functional magnetic resonance imaging. The build-up rate of evidence accumulation mediated the relationship between the white matter macrostructure of dFPN pathways and the efficiency of perceptual reports. This association between steeper build-up rates of evidence accumulation and the dFPN was recapitulated in the resting-state networks. Stronger connectivity between dFPN regions is thus associated with faster evidence accumulation and speeded perceptual decisions. Our findings identify an integrated network for perceptual decisions that may be targeted for neurorehabilitation in cognitive disorders. |
Maximilian Bruchmann; Sebastian Schindler; Thomas Straube The spatial frequency spectrum of fearful faces modulates early and mid-latency ERPs but not the N170 Journal Article In: Psychophysiology, vol. 57, no. 9, pp. e13597, 2020. @article{Bruchmann2020, Prioritized processing of fearful compared to neutral faces is reflected in behavioral advantages such as lower detection thresholds, but also in enhanced early and late event-related potentials (ERPs). Behavioral advantages have recently been associated with the spatial frequency spectrum of fearful faces, better fitting the human contrast sensitivity function than the spectrum of neutral faces. However, it is unclear whether and to which extent early and late ERP differences are due to low-level spatial frequency spectrum information or high-level representations of the facial expression. In this pre-registered EEG study (N = 38), the effects of fearful-specific spatial frequencies on event-related ERPs were investigated by presenting faces with fearful and neutral expressions whose spatial frequency spectra were manipulated so as to contain either the average power spectra of neutral, fearful, or both expressions combined. We found an enlarged N170 to fearful versus neutral faces, not interacting with spatial frequency. Interactions of emotional expression and spatial frequencies were observed for the P1 and Early Posterior Negativity (EPN). For both components, larger emotion differences were observed when the spectrum contained neutral as opposed to fearful frequencies. Importantly, for the EPN, fearful and neutral expressions did not differ anymore when inserting fearful frequencies into neutral expressions, whereas typical emotion differences were found when faces contained average or neutral frequencies. Our findings show that N170 emotional modulations are unaffected by expression-specific spatial frequencies. However, expression-specific spatial frequencies alter early and mid-latency ERPs. Most notably, the EPN to neutral expressions is boosted by adding fearful spectra—but not vice versa. |
Antimo Buonocore; Olaf Dimigen; David Melcher Post-saccadic face processing is modulated by pre-saccadic preview: Evidence from fixation-related potentials Journal Article In: Journal of Neuroscience, vol. 40, no. 11, pp. 2305–2313, 2020. @article{Buonocore2020, Humans actively sample their environment with saccadic eye movements to bring relevant information into high-acuity foveal vision. Despite being lower in resolution, peripheral information is also available before each saccade. How the pre-saccadic extrafoveal preview of a visual object influences its post-saccadic processing is still an unanswered question. The current study investigated this question by simultaneously recording behavior and fixation-related brain potentials while human subjects made saccades to face stimuli. We manipulated the relationship between pre-saccadic "previews" and post-saccadic images to explicitly isolate the influences of the former. Subjects performed a gender discrimination task on a newly foveated face under three preview conditions: scrambled face, incongruent face (different identity from the foveated face), and congruent face (same identity). As expected, reaction times were faster after a congruent-face preview compared with a scrambled-face preview. Importantly, intact face previews (either incongruent or congruent) resulted in a massive reduction of post-saccadic neural responses. Specifically, we analyzed the classic face-selective N170 component at occipitotemporal electroencephalogram electrodes, which was still present in our experiments with active looking. However, the post-saccadic N170 was strongly attenuated following intact-face previews compared with the scrambled condition. This large and long-lasting decrease in evoked activity is consistent with a trans-saccadic mechanism of prediction that influences category-specific neural processing at the start of a new fixation. These findings constrain theories of visual stability and show that the extrafoveal preview methodology can be a useful tool to investigate its underlying mechanisms. |
Simon Majed Ceh; Sonja Annerer-Walcher; Christof Körner; Christian Rominger; Silvia Erika Kober; Andreas Fink; Mathias Benedek Neurophysiological indicators of internal attention: An electroencephalography–eye-tracking coregistration study Journal Article In: Brain and Behavior, vol. 10, no. 10, pp. 1–14, 2020. @article{Ceh2020, Introduction: Many goal-directed and spontaneous everyday activities (e.g., planning, mind wandering) rely on an internal focus of attention. Internally directed cognition (IDC) was shown to differ from externally directed cognition in a range of neurophysiological indicators such as electroencephalogram (EEG) alpha activity and eye behavior. Methods: In this EEG–eye-tracking coregistration study, we investigated effects of attention direction on EEG alpha activity and various relevant eye parameters. We used an established paradigm to manipulate internal attention demands in the visual domain within tasks by means of conditional stimulus masking. Results: Consistent with previous research, IDC involved relatively higher EEG alpha activity (lower alpha desynchronization) at posterior cortical sites. Moreover, IDC was characterized by greater pupil diameter (PD), fewer microsaccades, fixations, and saccades. These findings show that internal versus external cognition is associated with robust differences in several indicators at the neural and perceptual level. In a second line of analysis, we explored the intrinsic temporal covariation between EEG alpha activity and eye parameters during rest. This analysis revealed a positive correlation of EEG alpha power with PD especially in bilateral parieto-occipital regions. Conclusion: Together, these findings suggest that EEG alpha activity and PD represent time-sensitive indicators of internal attention demands, which may be involved in a neurophysiological gating mechanism serving to shield internal cognition from irrelevant sensory information. |
Peter De Lissa; Roberto Caldara; Victoria Nicholls; Sebastien Miellet In pursuit of visual attention: SSVEP frequency-tagging moving targets Journal Article In: PLoS ONE, vol. 15, no. 8, pp. e0236967, 2020. @article{DeLissa2020, Previous research has shown that visual attention does not always exactly follow gaze direction, leading to the concepts of overt and covert attention. However, it is not yet clear how such covert shifts of visual attention to peripheral regions impact the processing of the targets we directly foveate as they move in our visual field. The current study utilised the coregistration of eye-position and EEG recordings while participants tracked moving targets that were embedded with a 30 Hz frequency tag in a Steady State Visually Evoked Potentials (SSVEP) paradigm. When the task required attention to be divided between the moving target (overt attention) and a peripheral region where a second target might appear (covert attention), the SSVEPs elicited by the tracked target at the 30 Hz frequency band were significantly, but transiently, lower than when participants did not have to covertly monitor for a second target. Our findings suggest that neural responses of overt attention are only briefly reduced when attention is divided between covert and overt areas. This neural evidence is in line with theoretical accounts describing attention as a pool of finite resources, such as the perceptual load theory. Altogether, these results have practical implications for many real-world situations where covert shifts of attention may discretely reduce visual processing of objects even when they are directly being tracked with the eyes. |
Andrea Desantis; Adrien Chan-Hon-Tong; Thérèse Collins; Hinze Hogendoorn; Patrick Cavanagh Decoding the temporal dynamics of covert spatial attention using multivariate EEG analysis: Contributions of raw amplitude and alpha power Journal Article In: Frontiers in Human Neuroscience, vol. 14, pp. 570419, 2020. @article{Desantis2020, Attention can be oriented in space covertly without the need of eye movements. We used multivariate pattern classification analyses (MVPA) to investigate whether the time course of the deployment of covert spatial attention leading up to the observer's perceptual decision can be decoded from both EEG alpha power and raw activity traces. Decoding attention from these signals can help determine whether raw EEG signals and alpha power reflect the same or distinct features of attentional selection. Using a classical cueing task, we showed that the orientation of covert spatial attention can be decoded by both signals. However, raw activity and alpha power may reflect different features of spatial attention, with alpha power more associated with the orientation of covert attention in space and raw activity with the influence of attention on perceptual processes. |
2019 |
Maria C. Romero; Marco Davare; Marcelo Armendariz; Peter Janssen Neural effects of transcranial magnetic stimulation at the single-cell level Journal Article In: Nature Communications, vol. 10, pp. 2642, 2019. @article{Romero2019, Transcranial magnetic stimulation (TMS) can non-invasively modulate neural activity in humans. Despite three decades of research, the spatial extent of the cortical area activated by TMS is still controversial. Moreover, how TMS interacts with task-related activity during motor behavior is unknown. Here, we applied single-pulse TMS over macaque parietal cortex while recording single-unit activity at various distances from the center of stimulation during grasping. The spatial extent of TMS-induced activation is remarkably restricted, affecting the spiking activity of single neurons in an area of cortex measuring less than 2 mm in diameter. In task-related neurons, TMS evokes a transient excitation followed by reduced activity, paralleled by a significantly longer grasping time. Furthermore, TMS-induced activity and task-related activity do not summate in single neurons. These results furnish crucial experimental evidence for the neural effects of TMS at the single-cell level and uncover the neural underpinnings of behavioral effects of TMS. |
Praghajieeth Raajhen Santhana Gopalan; Otto Loberg; Jarmo A. Hämäläinen; Paavo H. T. Leppänen In: Scientific Reports, vol. 9, pp. 2940, 2019. @article{Gopalan2019, Attention-related processes include three functional sub-components: alerting, orienting, and inhibition. We investigated these components using EEG-based, brain event-related potentials and their neuronal source activations during the Attention Network Test in typically developing school-aged children. Participants were asked to detect the swimming direction of the centre fish in a group of five fish. The target stimulus was either preceded by a cue (centre, double, or spatial) or no cue. An EEG using 128 electrodes was recorded for 83 children aged 12–13 years. RTs showed significant effects across all three sub-components of attention. Alerting and orienting (responses to double vs non-cued target stimulus and spatially vs centre-cued target stimulus, respectively) resulted in larger N1 amplitude, whereas inhibition (responses to incongruent vs congruent target stimulus) resulted in larger P3 amplitude. Neuronal source activation for the alerting effect was localized in the right anterior temporal and bilateral occipital lobes, for the orienting effect bilaterally in the occipital lobe, and for the inhibition effect in the medial prefrontal cortex and left anterior temporal lobe. Neuronal sources of ERPs revealed that sub-processes related to the attention network are different in children as compared to earlier adult fMRI studies, which was not evident from scalp ERPs. |
M. Isabel Vanegas; Annabelle Blangero; James E. Galvin; Alessandro Di Rocco; Angelo Quartarone; M. Felice Ghilardi; Simon P. Kelly Altered dynamics of visual contextual interactions in Parkinson's disease Journal Article In: npj Parkinson's Disease, vol. 5, no. 13, 2019. @article{Vanegas2019, Over the last decades, psychophysical and electrophysiological studies in patients and animal models of Parkinson's disease (PD), have consistently revealed a number of visual abnormalities. In particular, specific alterations of contrast sensitivity curves, electroretinogram (ERG), and visual-evoked potentials (VEP), have been attributed to dopaminergic retinal depletion. However, fundamental mechanisms of cortical visual processing, such as normalization or “gain control” computations, have not yet been examined in PD patients. Here, we measured electrophysiological indices of gain control in both space (surround suppression) and time (sensory adaptation) in PD patients based on steady-state VEP (ssVEP). Compared with controls, patients exhibited a significantly higher initial ssVEP amplitude that quickly decayed over time, and greater relative suppression of ssVEP amplitude as a function of surrounding stimulus contrast. Meanwhile, EEG frequency spectra were broadly elevated in patients relative to controls. Thus, contrary to what might be expected given the reduced contrast sensitivity often reported in PD, visual neural responses are not weaker; rather, they are initially larger but undergo an exaggerated degree of spatial and temporal gain control and are embedded within a greater background noise level. These differences may reflect cortical mechanisms that compensate for dysfunctional center-surround interactions at the retinal level. |
Ying Joey Zhou; Alexis Pérez-Bellido; Saskia Haegens; Floris P. Lange Perceptual expectations modulate low-frequency activity: A statistical learning magnetoencephalographystudy Journal Article In: Journal of Cognitive Neuroscience, pp. 1–12, 2019. @article{Zhou2019c, Perceptual expectations can change how a visual stimulus is perceived. Recent studies have shown mixed results in terms of whether expectations modulate sensory representations. Here, we used a statistical learning paradigm to study the temporal characteristics of perceptual expectations. We presented participants with pairs of object images organized in a predictive manner and then recorded their brain activity with magnetoencephalography while they viewed expected and unexpected image pairs on the subsequent day. We observed stronger alpha-band (7–14 Hz) activity in response to unexpected compared with expected object images. Specifically, the alpha-band modulation occurred as early as the onset of the stimuli and was most pronounced in left occipito-temporal cortex. Given that the differential response to expected versus unexpected stimuli occurred in sensory regions early in time, our results suggest that expectations modulate perceptual decision-making by changing the sensory response elicited by the stimuli. |
Moreno I. Coco; Antje Nuthmann; Olaf Dimigen Fixation-related brain potentials during semantic integration of object–scene information Journal Article In: Journal of Cognitive Neuroscience, vol. 32, no. 4, pp. 571–589, 2019. @article{Coco2019, In vision science, a particularly controversial topic is whether and how quickly the semantic information about objects is available outside foveal vision. Here, we aimed at contributing to this debate by coregistering eye movements and EEG while participants viewed photographs of indoor scenes that contained a semantically consistent or inconsistent target object. Linear deconvolution modeling was used to analyze the ERPs evoked by scene onset as well as the fixation-related potentials (FRPs) elicited by the fixation on the target object (t) and by the preceding fixation (t − 1). Object–scene consistency did not influence the probability of immediate target fixation or the ERP evoked by scene onset, which suggests that object–scene semantics was not accessed immediately. However, during the subsequent scene exploration, inconsistent objects were prioritized over consistent objects in extrafoveal vision (i.e., looked at earlier) and were more effortful to process in foveal vision (i.e., looked at longer). In FRPs, we demonstrate a fixation-related N300/N400 effect, whereby inconsistent objects elicit a larger frontocentral negativity than consistent objects. In line with the behavioral findings, this effect was already seen in FRPs aligned to the pretarget fixation t − 1 and persisted throughout fixation t, indicating that the extraction of object semantics can already begin in extrafoveal vision. Taken together, the results emphasize the usefulness of combined EEG/eye movement recordings for understanding the mechanisms of object–scene integration during natural viewing. |
Mariya E. Manahova; Eelke Spaak; Floris P. Lange Familiarity increases processing speed in the visual system Journal Article In: Journal of Cognitive Neuroscience, pp. 1–12, 2019. @article{Manahova2019, Familiarity with a stimulus leads to an attenuated neural response to the stimulus. Alongside this attenuation, recent studies have also observed a truncation of stimulus-evoked activity for familiar visual input. One proposed function of this truncation is to rapidly put neurons in a state of readiness to respond to new input. Here, we examined this hypothesis by presenting human participants with target stimuli that were embedded in rapid streams of familiar or novel distractor stimuli at different speeds of presentation, while recording brain activity using magnetoencephalography and measuring behavioral performance. We investigated the temporal and spatial dynamics of signal truncation and whether this phenomenon bears relationship to participants' ability to categorize target items within a visual stream. Behaviorally, target categorization performance was markedly better when the target was embedded within familiar distractors, and this benefit became more pronounced with increasing speed of presentation. Familiar distractors showed a truncation of neural activity in the visual system. This truncation was strongest for the fastest presentation speeds and peaked in progressively more anterior cortical regions as presentation speeds became slower. Moreover, the neural response evoked by the target was stronger when this target was preceded by familiar distractors. Taken together, these findings demonstrate that item familiarity results in a truncated neural response, is associated with stronger processing of relevant target information, and leads to superior perceptual performance. |
Christoph Huber-Huber; Antimo Buonocore; Olaf Dimigen; Clayton Hickey; David Melcher In: NeuroImage, vol. 200, pp. 344–362, 2019. @article{HuberHuber2019, The world appears stable despite saccadic eye-movements. One possible explanation for this phenomenon is that the visual system predicts upcoming input across saccadic eye-movements based on peripheral preview of the saccadic target. We tested this idea using concurrent electroencephalography (EEG) and eye-tracking. Participants made cued saccades to peripheral upright or inverted face stimuli that changed orientation (invalid preview) or maintained orientation (valid preview) while the saccade was completed. Experiment 1 demonstrated better discrimination performance and a reduced fixation-locked N170 component (fN170) with valid than with invalid preview, demonstrating integration of pre- and post-saccadic information. Moreover, the early fixation-related potentials (FRP) showed a preview face inversion effect suggesting that some pre-saccadic input was represented in the brain until around 170 ms post fixation-onset. Experiment 2 replicated Experiment 1 and manipulated the proportion of valid and invalid trials to test whether the preview effect reflects context-based prediction across trials. A whole-scalp Bayes factor analysis showed that this manipulation did not alter the fN170 preview effect but did influence the face inversion effect before the saccade. The pre-saccadic inversion effect declined earlier in the mostly invalid block than in the mostly valid block, which is consistent with the notion of pre-saccadic expectations. In addition, in both studies, we found strong evidence for an interaction between the pre-saccadic preview stimulus and the post-saccadic target as early as 50 ms (Experiment 2) or 90 ms (Experiment 1) into the new fixation. These findings suggest that visual stability may involve three temporal stages: prediction about the saccadic target, integration of pre-saccadic and post-saccadic information at around 50-90 ms post fixation onset, and post-saccadic facilitation of rapid categorization. |
Florian Sandhaeger; Constantin Nicolai; Earl K. Miller; Markus Siegel Monkey EEG links neuronal color and motion information across species and scales Journal Article In: eLife, vol. 8, pp. 1–21, 2019. @article{Sandhaeger2019, It remains challenging to relate EEG and MEG to underlying circuit processes and comparable experiments on both spatial scales are rare. To close this gap between invasive and non-invasive electrophysiology we developed and recorded human-comparable EEG in macaque monkeys during visual stimulation with colored dynamic random dot patterns. Furthermore, we performed simultaneous microelectrode recordings from 6 areas of macaque cortex and human MEG. Motion direction and color information were accessible in all signals. Tuning of the non- invasive signals was similar to V4 and IT, but not to dorsal and frontal areas. Thus, MEG and EEG were dominated by early visual and ventral stream sources. Source level analysis revealed corresponding information and latency gradients across cortex. We show how information-based methods and monkey EEG can identify analogous properties of visual processing in signals spanning spatial scales from single units to MEG – a valuable framework for relating human and animal studies. |
Karisa B. Parkington; Roxane J. Itier From eye to face: The impact of face outline, feature number, and feature saliency on the early neural response to faces Journal Article In: Brain Research, vol. 1722, pp. 1–14, 2019. @article{Parkington2019, The LIFTED model of early face perception postulates that the face-sensitive N170 event-related potential may reflect underlying neural inhibition mechanisms which serve to regulate holistic and featural processing. It remains unclear, however, what specific factors impact these neural inhibition processes. Here, N170 peak responses were recorded whilst adults maintained fixation on a single eye using a gaze-contingent paradigm, and the presence/absence of a face outline, as well as the number and type of parafoveal features within the outline, were manipulated. N170 amplitudes and latencies were reduced when a single eye was fixated within a face outline compared to fixation on the same eye in isolation, demonstrating that the simple presence of a face outline is sufficient to elicit a shift towards a more face-like neural response. A monotonic decrease in the N170 amplitude and latency was observed with increasing numbers of parafoveal features, and the type of feature(s) present in parafovea further modulated this early face response. These results support the idea of neural inhibition exerted by parafoveal features onto the foveated feature as a function of the number, and possibly the nature, of parafoveal features. Specifically, the results suggest the use of a feature saliency framework (eyes > mouth > nose) at the neural level, such that the parafoveal eye may play a role in down-regulating the response to the other eye (in fovea) more so than the nose or the mouth. These results confirm the importance of parafoveal features and the face outline in the neural inhibition mechanism, and provide further support for a feature saliency mechanism guiding early face perception. |
Thomas Parr; M. Berk Mirza; Hayriye Cagnan; Karl J. Friston Dynamic causal modelling of active vision Journal Article In: Journal of Neuroscience, vol. 39, no. 32, pp. 6265–6275, 2019. @article{Parr2019, In this paper, we draw from recent theoretical work on active perception, which suggests that the brain makes use of an internal (i.e., generative) model to make inferences about the causes of sensations. This view treats visual sensations as consequent on action (i.e., saccades) and implies that visual percepts must be actively constructed via a sequence ofeye movements. Oculomotor control calls on a distributed set ofbrain sources that includes the dorsal and ventral frontoparietal (attention) networks.Weargue that connections from the frontal eye fields to ventral parietal sources represent the mapping from “where”, fixation location to information derived from “what” representations in the ventral visual stream. During scene construction, this mapping must be learned, putatively through changes in the effective connectivityofthese synapses. Here,wetest the hypothesis that the couplingbetweenthe dorsal frontal cortexand the right temporoparietal cortex is modulated during saccadic interrogation ofa simple visual scene. Using dynamic causal modeling for magnetoencephalography with (male and female) human participants, we assess the evidence for changes in effective connectivity by comparing models that allow for this modulation with models that do not. We find strong evidence for modulation of connections between the two attention networks; namely, a disinhibition ofthe ventral network by its dorsal counterpart. |
Nathan M. Petro; Nina N. Thigpen; Steven Garcia; Maeve R. Boylan; Andreas Keil Pre-target alpha power predicts the speed of cued target discrimination Journal Article In: NeuroImage, vol. 189, pp. 878–885, 2019. @article{Petro2019, The human visual system selects information from dense and complex streams of spatiotemporal input. This selection process is aided by prior knowledge of the features, location, and temporal proximity of an upcoming stimulus. In the laboratory, this knowledge is often conveyed by cues, preceding a task-relevant target stimulus. Response speed in cued selection tasks varies within and across participants and is often thought to index efficient selection of a cued feature, location, or moment in time. The present study used a reverse correlation approach to identify neural predictors of efficient target discrimination: Participants identified the orientation of a sinusoidal grating, which was presented in one hemifield following the presentation of bilateral visual cues that carried temporal but not spatial information about the target. Across different analytic approaches, faster target responses were predicted by larger alpha power preceding the target. These results suggest that heightened pre-target alpha power during a cue period may index a state that is beneficial for subsequent target processing. Our findings are broadly consistent with models that emphasize capacity sharing across time, as well as models that link alpha oscillations to temporal predictions regarding upcoming events. |
Ella Podvalny; Matthew W. Flounders; Leana E. King; Tom Holroyd; Biyu J. He A dual role of prestimulus spontaneous neural activity in visual object recognition Journal Article In: Nature Communications, vol. 10, pp. 3910, 2019. @article{Podvalny2019, Vision relies on both specific knowledge of visual attributes, such as object categories, and general brain states, such as those reflecting arousal. We hypothesized that these phenomena independently influence recognition of forthcoming stimuli through distinct processes reflected in spontaneous neural activity. Here, we recorded magnetoencephalographic (MEG) activity in participants (N = 24) who viewed images of objects presented at recognition threshold. Using multivariate analysis applied to sensor-level activity patterns recorded before stimulus presentation, we identified two neural processes influencing subsequent subjective recognition: a general process, which disregards stimulus category and correlates with pupil size, and a specific process, which facilitates category-specific recognition. The two processes are doubly-dissociable: the general process correlates with changes in criterion but not in sensitivity, whereas the specific process correlates with changes in sensitivity but not in criterion. Our findings reveal distinct mechanisms of how spontaneous neural activity influences perception and provide a framework to integrate previous findings. |
Ulrich Pomper; Thomas Ditye; Ulrich Ansorge Contralateral delay activity during temporal order memory Journal Article In: Neuropsychologia, vol. 129, pp. 104–116, 2019. @article{Pomper2019, In everyday life, we constantly need to remember the temporal sequence of visual events over short periods of time, for example, when making sense of others' actions or watching a movie. While there is increasing knowledge available on neural mechanisms underlying visual working memory (VWM) regarding the identity and spatial location of objects, less is known about how the brain encodes and retains information on temporal sequences. Here, we investigate whether the contralateral-delay activity (CDA), a well-studied electroencephalographic (EEG) component associated with VWM of object identity, also reflects the encoding and retention of temporal order. In two independent experiments, we presented participants with a sequence of four or six images, followed by a 1 s retention period. Participants judged temporal order by indicating whether a subsequently presented probe image was originally displayed during the first or the second half of the sequence. As a main novel result, we report the emergence of a contralateral negativity already following the presentation of the first item of the sequence, which increases over the course of a trial with every presented item, up to a limit of four items. We further observed no differences in the CDA during the temporal-order task compared to one obtained during a task concerning the spatial location of the presented items. Since the characteristics of the CDA appear to be highly similar between different encoded feature dimensions and increases as additional items are being encoded, we suggest this component might be a general characteristic of various types of VWM. |
Tzvetan Popov; Bart Gips; Sabine Kastner; Ole Jensen Spatial specificity of alpha oscillations in the human visual system Journal Article In: Human Brain Mapping, vol. 40, no. 15, pp. 4432–4440, 2019. @article{Popov2019, Alpha oscillations are strongly modulated by spatial attention. To what extent, the generators of cortical alpha oscillations are spatially distributed and have selectivity that can be related to retinotopic organization is a matter of continuous scientific debate. In the present report, neuromagnetic activity was quantified by means of spatial location tuning functions from 30 participants engaged in a visuospatial attention task. A cue presented briefly in one of 16 locations directing covert spatial attention resulted in a robust modulation of posterior alpha oscillations. The distribution of the alpha sources approximated the retinotopic organization of the human visual system known from hemodynamic studies. Better performance in terms of target identification was associated with a more spatially constrained alpha modulation. The present findings demonstrate that the generators of posterior alpha oscillations are retinotopically organized when modulated by spatial attention. |
Silvan C. Quax; Nadine Dijkstra; Mariel J. Staveren; Sander E. Bosch; Marcel A. J. Gerven Eye movements explain decodability during perception and cued attention in MEG Journal Article In: NeuroImage, vol. 195, pp. 444–453, 2019. @article{Quax2019, Eye movements are an integral part of human perception, but can induce artifacts in many magneto-encephalography (MEG) and electroencephalography (EEG) studies. For this reason, investigators try to minimize eye movements and remove these artifacts from their data using different techniques. When these artifacts are not purely random, but consistent regarding certain stimuli or conditions, the possibility arises that eye movements are actually inducing effects in the MEG signal. It remains unclear how much of an influence eye movements can have on observed effects in MEG, since most MEG studies lack a control analysis to verify whether an effect found in the MEG signal is induced by eye movements. Here, we find that we can decode stimulus location from eye movements in two different stages of a working memory match-to-sample task that encompass different areas of research typically done with MEG. This means that the observed MEG effect might be (partly) due to eye movements instead of any true neural correlate. We suggest how to check for eye movement effects in the data and make suggestions on how to minimize eye movement artifacts from occurring in the first place. |
Romain Quentin; Jean Rémi King; Etienne Sallard; Nathan Fishman; Ryan Thompson; Ethan R. Buch; Leonardo G. Cohen Differential brain mechanisms of selection and maintenance of information during working memory Journal Article In: Journal of Neuroscience, vol. 39, no. 19, pp. 3728–3740, 2019. @article{Quentin2019, Working memory is our ability to select and temporarily hold information as needed for complex cognitive operations. The temporal dynamics of sustained and transient neural activity supporting the selection and holding of memory content is not known. To address this problem, we recorded magnetoencephalography in healthy participants performing a retro-cue working memory task in which the selection rule and the memory content varied independently. Multivariate decoding and source analyses showed that selecting the memory content relies on prefrontal and parieto-occipital persistent oscillatory neural activity. By contrast, the memory content was reactivated in a distributed occipitotemporal posterior network, preceding the working memory decision and in a different format than during the visual encoding. These results identify a neural signature of content selection and characterize differentiated spatiotemporal constraints for subprocesses of working memory. |
Amirsaman Sajad; David C. Godlove; Jeffrey D. Schall Cortical microcircuitry of performance monitoring Journal Article In: Nature Neuroscience, vol. 22, pp. 265–274, 2019. @article{Sajad2019, The medial frontal cortex enables performance monitoring, indexed by the error-related negativity (ERN) and manifested by performance adaptations. We recorded electroencephalogram over and neural spiking across all layers of the supplementary eye field, an agranular cortical area, in monkeys performing a saccade-countermanding (stop signal) task. Neurons signaling error production, feedback predicting reward gain or loss, and delivery of fluid reward had different spike widths and were concentrated differently across layers. Neurons signaling error or loss of reward were more common in layers 2 and 3 (L2/3), whereas neurons signaling gain of reward were more common in layers 5 and 6 (L5/6). Variation of error– and reinforcement-related spike rates in L2/3 but not L5/6 predicted response time adaptation. Variation in error-related spike rate in L2/3 but not L5/6 predicted ERN magnitude. These findings reveal novel features of cortical microcircuitry supporting performance monitoring and confirm one cortical source of the ERN. |
Sebastian Schindler; Maximilian Bruchmann; Florian Bublatzky; Thomas Straube Modulation of face- and emotion-selective ERPs by the three most common types of face image manipulations Journal Article In: Social Cognitive and Affective Neuroscience, vol. 14, no. 5, pp. 493–503, 2019. @article{Schindler2019, In neuroscientific studies, the naturalness of face presentation differs; a third of published studies makes use of close-up full coloured faces, a third uses close-up grey-scaled faces and another third employs cutout grey-scaled faces. Whether and how these methodological choices affect emotion-sensitive components of the event-related brain potentials (ERPs) is yet unclear. Therefore, this pre-registered study examined ERP modulations to close-up full-coloured and grey-scaled faces as well as cutout fearful and neutral facial expressions, while attention was directed to no-face oddballs. Results revealed no interaction of face naturalness and emotion for any ERP component, but showed, however, large main effects for both factors. Specifically, fearful faces and decreasing face naturalness elicited substantially enlarged N170 and early posterior negativity amplitudes and lower face naturalness also resulted in a larger P1.This pattern reversed for the LPP, showing linear increases in LPP amplitudes with increasing naturalness.We observed no interaction of emotion with face naturalness, which suggests that face naturalness and emotion are decoded in parallel at these early stages. Researchers interested in strong modulations of early components should make use of cutout grey-scaled faces, while those interested in a pronounced late positivity should use close-up coloured faces. |
Shirin Vafaei Shooshtari; Jamal Esmaily Sadrabadi; Zahra Azizi; Reza Ebrahimpour Confidence representation of perceptual decision by EEG and eye data in a random dot motion task Journal Article In: Neuroscience, vol. 406, pp. 510–527, 2019. @article{Shooshtari2019, The Confidence of a decision could be considered as the internal estimate of decision accuracy. This variable has been studied extensively by different types of recording data such as behavioral, electroencephalography (EEG), eye and electrophysiology data. Although the value of the reported confidence is considered as one of the most important parameters in decision making, the confidence reporting phase might be considered as a restrictive element in investigating the decision process. Thus, decision confidence should be extracted by means of other provided types of information. Here, we proposed eight confidence related properties in EEG and eye data which are significantly descriptive of the defined confidence levels in a random dot motion (RDM) task. As a matter of fact, our proposed EEG and eye data properties are capable of recognizing more than nine distinct levels of confidence. Among our proposed features, the latency of the pupil maximum diameter through the stimulus presentation was established to be the most associated one to the confidence levels. Through the time-dependent analysis of these features, we recognized the time interval of 500–600 ms after the stimulus onset as an important time in correlating features to the confidence levels. |
Lisa Stacchi; Meike Ramon; Junpeng Lao; Roberto Caldara Neural representations of faces are tuned to eye movements Journal Article In: Journal of Neuroscience, vol. 39, no. 21, pp. 4113–4123, 2019. @article{Stacchi2019, Eye movements provide a functional signature of how human vision is achieved. Many recent studies have consistently reported robust idiosyncratic visual sampling strategies during face recognition. Whether these interindividual differences are mirrored by idiosyncratic neural responses remains unknown. To this aim, we first tracked eye movements of male and female observers during face recognition. Additionally, for every observer we obtained an objective index of neural face discrimination through EEG that was recorded while they fixated different facial information. We found that foveation of facial features fixated longer during face recognition elicited stronger neural face discrimination responses across all observers. This relationship occurred independently of interindividual differences in preferential facial information sampling (e.g., eye vs mouth lookers), and started as early as the first fixation. Our data show that eye movements play a functional role during face processing by providing the neural system with the information that is diagnostic to a specific observer. The effective processing of identity involves idiosyncratic, rather than universal face representations. |
David W. Sutterer; Joshua J. Foster; Kirsten C. S. Adam; Edward K. Vogel; Edward Awh Item-specific delay activity demonstrates concurrent storage of multiple active neural representations in working memory Journal Article In: PLoS Biology, vol. 17, no. 4, pp. e3000239, 2019. @article{Sutterer2019, Persistent neural activity that encodes online mental representations plays a central role in working memory (WM). However, there has been debate regarding the number of items that can be concurrently represented in this active neural state, which is often called the “focus of attention.” Some models propose a strict single-item limit, such that just 1 item can be neurally active at once while other items are relegated to an activity-silent state. Although past studies have decoded multiple items stored in WM, these studies cannot rule out a switching account in which only a single item is actively represented at a time. Here, we directly tested whether multiple representations can be held concurrently in an active state. We tracked spatial representations in WM using alpha-band (8–12 Hz) activity, which encodes spatial positions held in WM. Human observers remembered 1 or 2 positions over a short delay while we recorded electroencephalography (EEG) data. Using a spatial encoding model, we reconstructed active stimulus-specific representations (channel-tuning functions [CTFs]) from the scalp distribution of alpha-band power. Consistent with past work, we found that the selectivity of spatial CTFs was lower when 2 items were stored than when 1 item was stored. Critically, data-driven simulations revealed that the selectivity of spatial representations in the two-item condition could not be explained by models that propose that only a single item can exist in an active state at once. Thus, our findings demonstrate that multiple items can be concurrently represented in an active neural state. |
David W. Sutterer; Joshua J. Foster; John T. Serences; Edward K. Vogel; Edward Awh Alpha-band oscillations track the retrieval of precise spatial representations from long-term memory Journal Article In: Journal of Neurophysiology, vol. 122, no. 2, pp. 539–551, 2019. @article{Sutterer2019a, A hallmark of episodic memory is the phenomenon of mentally reexperiencing the details of past events, and a well-established concept is that the neuronal activity that mediates encoding is reinstated at retrieval. Evidence for reinstatement has come from multiple modalities, including functional magnetic resonance imaging and electroencephalography (EEG). These EEG studies have shed light on the time course of reinstatement but have been limited to distinguishing between a few categories. The goal of this work was to use recently developed experimental and technical approaches, namely continuous report tasks and inverted encoding models, to determine which frequencies of oscillatory brain activity support the retrieval of precise spatial memories. In experiment 1, we establish that an inverted encoding model applied to multivariate alpha topography tracks the retrieval of precise spatial memories. In experiment 2, we demonstrate that the frequencies and patterns of multivariate activity at study are similar to the frequencies and patterns observed during retrieval. These findings highlight the broad potential for using encoding models to characterize long-term memory retrieval. NEW & NOTEWORTHY Previous EEG work has shown that category-level information observed during encoding is recapitulated during memory retrieval, but studies with this time-resolved method have not demonstrated the reinstatement of feature-specific patterns of neural activity during retrieval. Here we show that EEG alpha-band activity tracks the retrieval of spatial representations from long-term memory. Moreover, we find considerable overlap between the frequencies and patterns of activity that track spatial memories during initial study and at retrieval. |
Yuta Suzuki; Tetsuto Minami; Shigeki Nakauchi Pupil constriction in the glare illusion modulates the steady-state visual evoked potentials Journal Article In: Neuroscience, vol. 416, pp. 221–228, 2019. @article{Suzuki2019, The glare illusion enhances the perceived brightness of a central white area surrounded by a luminance gradient, without any actual change in light intensity. In this study, we measured the varied brightness and neurophysiological responses of electroencephalography (EEG) and pupil size with the several luminance contrast patterns of the glare illusion to address the question of whether the illusory brightness changes to the glare illusion process in the early visual cortex. We hypothesized that if the illusory brightness enhancement was created in the early stages of visual processing, the neural response would be similar to how it processes an actual change in light intensity. To test this, we observed the sustained visual cortical response of steady-state visual evoked potentials (SSVEPs), while participants watched flickering dots displayed in the central white area of both the varied luminance contrast of glare illusion and a control stimulus (no glare condition). We found the SSVEP amplitude was lower in the glare illusion than in the control condition, especially under high luminance contrast conditions. Furthermore, we found the probable mechanisms of the inhibited SSVEP amplitude to the high luminance contrast of glare illusion based on the greater pupil constriction, thereby decreasing the amount of light entering the pupil. Thus, the brightness enhancement in the glare illusion is already represented at the primary stage of visual processing linked to the larger pupil constriction. |
Linda Drijvers; Mircea Plas; Asli Özyürek; Ole Jensen Native and non-native listeners show similar yet distinct oscillatory dynamics when using gestures to access speech in noise Journal Article In: NeuroImage, vol. 194, pp. 55–67, 2019. @article{Drijvers2019a, Listeners are often challenged by adverse listening conditions during language comprehension induced by external factors, such as noise, but also internal factors, such as being a non-native listener. Visible cues, such as semantic information conveyed by iconic gestures, can enhance language comprehension in such situations. Using magnetoencephalography (MEG) we investigated whether spatiotemporal oscillatory dynamics can predict a listener's benefit of iconic gestures during language comprehension in both internally (non-native versus native listeners) and externally (clear/degraded speech) induced adverse listening conditions. Proficient non-native speakers of Dutch were presented with videos in which an actress uttered a degraded or clear verb, accompanied by a gesture or not, and completed a cued-recall task after every video. The behavioral and oscillatory results obtained from non-native listeners were compared to an MEG study where we presented the same stimuli to native listeners (Drijvers et al., 2018a). Non-native listeners demonstrated a similar gestural enhancement effect as native listeners, but overall scored significantly slower on the cued-recall task. In both native and non-native listeners, an alpha/beta power suppression revealed engagement of the extended language network, motor and visual regions during gestural enhancement of degraded speech comprehension, suggesting similar core processes that support unification and lexical access processes. An individual's alpha/beta power modulation predicted the gestural benefit a listener experienced during degraded speech comprehension. Importantly, however, non-native listeners showed less engagement of the mouth area of the primary somatosensory cortex, left insula (beta), LIFG and ATL (alpha) than native listeners, which suggests that non-native listeners might be hindered in processing the degraded phonological cues and coupling them to the semantic information conveyed by the gesture. Native and non-native listeners thus demonstrated similar yet distinct spatiotemporal oscillatory dynamics when recruiting visual cues to disambiguate degraded speech. |
Susanne Eisenhauer; Christian J. Fiebach; Benjamin Gagl Context-based facilitation in visual word recognition: Evidence for visual and lexical but not pre-lexical contributions Journal Article In: eNeuro, vol. 6, no. 2, pp. 1–25, 2019. @article{Eisenhauer2019, Word familiarity and predictive context facilitate visual word processing, leading to faster recognition times and reduced neuronal responses. Previously, models with and without top-down connections, including lexical-semantic, pre-lexical (e.g., orthographic/phonological), and visual processing levels were successful in accounting for these facilitation effects. Here we systematically assessed context-based facilitation with a repetition priming task and explicitly dissociated pre-lexical and lexical processing levels using a pseudoword (PW) familiarization procedure. Experiment 1 investigated the temporal dynamics of neuronal facilitation effects with magnetoencephalography (MEG; N = 38 human participants), while experiment 2 assessed behavioral facilitation effects (N = 24 human participants). Across all stimulus conditions, MEG demonstrated context-based facilitation across multiple time windows starting at 100 ms, in occipital brain areas. This finding indicates context-based facilitation at an early visual processing level. In both experiments, we furthermore found an interaction of context and lexical familiarity, such that stimuli with associated meaning showed the strongest context-dependent facilitation in brain activation and behavior. Using MEG, this facilitation effect could be localized to the left anterior temporal lobe at around 400 ms, indicating within-level (i.e., exclusively lexical-semantic) facilitation but no top-down effects on earlier processing stages. Increased pre-lexical familiarity (in PWs familiarized utilizing training) did not enhance or reduce context effects significantly. We conclude that context-based facilitation is achieved within visual and lexical processing levels. Finally, by testing alternative hypotheses derived from mechanistic accounts of repetition suppression, we suggest that the facilitatory context effects found here are implemented using a predictive coding mechanism. |
Matthew W. Flounders; Carlos González-García; Richard Hardstone; Biyu J. He Neural dynamics of visual ambiguity resolution by perceptual prior Journal Article In: eLife, vol. 8, pp. 1–25, 2019. @article{Flounders2019, Past experiences have enormous power in shaping our daily perception. Currently, dynamical neural mechanisms underlying this process remain mysterious. Exploiting a dramatic visual phenomenon, where a single experience of viewing a clear image allows instant recognition of a related degraded image, we investigated this question using MEG and 7 Tesla fMRI in humans. We observed that following the acquisition of perceptual priors, different degraded images are represented much more distinctly in neural dynamics starting from ~500 ms after stimulus onset. Content-specific neural activity related to stimulus-feature processing dominated within 300 ms after stimulus onset, while content-specific neural activity related to recognition processing dominated from 500 ms onward. Model-driven MEG-fMRI data fusion revealed the spatiotemporal evolution of neural activities involved in stimulus, attentional, and recognition processing. Together, these findings shed light on how experience shapes perceptual processing across space and time in the brain. |
Rasa Gulbinaite; Diane H. M. Roozendaal; Rufin VanRullen Attention differentially modulates the amplitude of resonance frequencies in the visual cortex Journal Article In: NeuroImage, vol. 203, pp. 116146, 2019. @article{Gulbinaite2019, Rhythmic visual stimuli (flicker) elicit rhythmic brain responses at the frequency of the stimulus, and attention generally enhances these oscillatory brain responses (steady state visual evoked potentials, SSVEPs). Although SSVEP responses have been tested for flicker frequencies up to 100 Hz [Herrmann, 2001], effects of attention on SSVEP amplitude have only been reported for lower frequencies (up to ~30 Hz), with no systematic comparison across a wide, finely sampled frequency range. Does attention modulate SSVEP amplitude at higher flicker frequencies (gamma band, 30–80 Hz), and is attentional modulation constant across frequencies? By isolating SSVEP responses from the broadband EEG signal using a multivariate spatiotemporal source separation method, we demonstrate that flicker in the alpha and gamma bands elicit strongest and maximally phase stable brain responses (resonance), on which the effect of attention is opposite: positive for gamma and negative for alpha. Finding subject-specific gamma resonance frequency and a positive attentional modulation of gamma-band SSVEPs points to the untapped potential of flicker as a non-invasive tool for studying the causal effects of interactions between visual gamma-band rhythmic stimuli and endogenous gamma oscillations on perception and attention. |
Nicole Hakim; Kirsten C. S. Adam; Eren Gunseli; Edward Awh; Edward K. Vogel Dissecting the neural focus of attention reveals distinct processes for spatial attention and object-based storage in visual working memory Journal Article In: Psychological Science, vol. 30, no. 4, pp. 526–540, 2019. @article{Hakim2019, Complex cognition relies on both on-line representations in working memory (WM), said to reside in the focus of attention, and passive off-line representations of related information. Here, we dissected the focus of attention by showing that distinct neural signals index the on-line storage of objects and sustained spatial attention. We recorded electroencephalogram (EEG) activity during two tasks that employed identical stimulus displays but varied the relative demands for object storage and spatial attention. We found distinct delay-period signatures for an attention task (which required only spatial attention) and a WM task (which invoked both spatial attention and object storage). Although both tasks required active maintenance of spatial information, only the WM task elicited robust contralateral delay activity that was sensitive to mnemonic load. Thus, we argue that the focus of attention is maintained via a collaboration between distinct processes for covert spatial orienting and object-based storage. |
Nicole Hakim; Tobias Feldmann-Wüstefeld; Edward Awh; Edward K. Vogel Perturbing neural representations of working memory with task-irrelevant interruption Journal Article In: Journal of Cognitive Neuroscience, vol. 32, no. 3, pp. 558–569, 2019. @article{Hakim2019a, Working memory maintains information so that it can be used in complex cognitive tasks. A key challenge for this system is to maintain relevant information in the face of task-irrelevant perturbations. Across two experiments, we investigated the impact of task-irrelevant interruptions on neural representations of working memory. We recorded EEG activity in humans while they performed a working memory task. On a subset of trials, we interrupted participants with salient but task-irrelevant objects. To track the impact of these task-irrelevant interruptions on neural representations of working memory, we measured two well-characterized, temporally sensitive EEG markers that reflect active, prioritized working memory representations: the contralateral delay activity and lateralized alpha power (8–12 Hz). After interruption, we found that contralateral delay activity amplitude momentarily sustained but was gone by the end of the trial. Lateralized alpha power was immediately influenced by the interrupters but recovered by the end of the trial. This suggests that dissociable neural processes contribute to the maintenance of working memory information and that brief irrelevant onsets disrupt two distinct online aspects of working memory. In addition, we found that task expectancy modulated the timing and magnitude of how these two neural signals responded to task-irrelevant interruptions, suggesting that the brain's response to task-irrelevant interruption is shaped by task context. |
Qiming Han; Huan Luo Visual crowding involves delayed frontoparietal response and enhanced top-down modulation Journal Article In: European Journal of Neuroscience, vol. 50, no. 6, pp. 2931–2941, 2019. @article{Han2019a, Crowding, the disrupted recognition of a peripheral target in the presence of nearby flankers, sets a fundamental limit on peripheral vision perception. Debates persist on whether the limit occurs at early visual cortices or is induced by top-down modulation, leaving the neural mechanism for visual crowding largely unclear. To resolve the debate, it is crucial to extract the neural signals elicited by the target from that by the target-flanker clutter, with high temporal resolution. To achieve this purpose, here we employed a temporal response function (TRF) approach to dissociate target-specific response from the overall electroencephalograph (EEG) recordings when the target was presented with (crowded) or without flankers (uncrowded) while subjects were performing a discrimination task on the peripherally presented target. Our results demonstrated two components in the target-specific contrast-tracking TRF response—an early component (100–170 ms) in occipital channels and a late component (210–450 ms) in frontoparietal channels. The late frontoparietal component, which was delayed in time under the crowded condition, was correlated with target discrimination performance, suggesting its involvement in visual crowding. Granger causality analysis further revealed stronger top-down modulation on the target stimulus under the crowded condition. Taken together, our findings support that crowding is associated with a top-down process which modulates the low-level sensory processing and delays the behavioral-relevant response in the high-level region. |
Linda Henriksson; Marieke Mur; Nikolaus Kriegeskorte Rapid invariant encoding of scene layout in human OPA Journal Article In: Neuron, vol. 103, no. 1, pp. 161–171.e3, 2019. @article{Henriksson2019, Successful visual navigation requires a sense of the geometry of the local environment. How do our brains extract this information from retinal images? Here we visually presented scenes with all possible combinations of five scene-bounding elements (left, right, and back walls; ceiling; floor) to human subjects during functional magnetic resonance imaging (fMRI) and magnetoencephalography (MEG). The fMRI response patterns in the scene-responsive occipital place area (OPA) reflected scene layout with invariance to changes in surface texture. This result contrasted sharply with the primary visual cortex (V1), which reflected low-level image features of the stimuli, and the parahippocampal place area (PPA), which showed better texture than layout decoding. MEG indicated that the texture-invariant scene layout representation is computed from visual input within ∼100 ms, suggesting a rapid computational mechanism. Taken together, these results suggest that the cortical representation underlying our instant sense of the environmental geometry is located in the OPA. |
Piril Hepsomali; Julie A. Hadwin; Simon P. Liversedge; Federica Degno; Matthew Garner In: Experimental Brain Research, vol. 237, no. 4, pp. 897–909, 2019. @article{Hepsomali2019, Anxiety has been associated with poor attentional control, as reflected in lowered performance on experimental measures of executive attention and inhibitory control. Recent conceptualisations of anxiety propose that individuals who report elevated anxiety symptoms worry about performance and will exert greater cognitive effort to complete tasks well, particularly when cognitive demands are high. Across two experiments, we examined the effect of anxiety on task performance and across two load conditions using (1) measures of inhibitory control (behavioural reaction times and eye-movement responses) and (2) task effort with pupillary and electrocortical markers of effort (CNV) and inhibitory control (N2). Experiment 1 used an oculomotor-delayed-response task that manipulated load by increasing delay duration to create a high load, relative to a low load, condition. Experiment 2 used a Go/No-Go task and load was manipulated by decreasing the No-Go probabilities (i.e., 20% No-Go in the high load condition and 50% No-Go in the low load condition). Experiment 1 showed individuals with high (vs. low) anxiety made more antisaccade errors across load conditions, and made more effort during the high load condition, as evidenced by greater frontal CNV and increased pupillary responses. In Experiment 2, individuals with high anxiety showed increased effort (irrespective of cognitive load), as characterised by larger pupillary responses. In addition, N2 amplitudes were sensitive to load only in individuals with low anxiety. Evidence of reduced performance effectiveness and efficiency across electrophysiological, pupillary, and oculomotor systems in anxiety provides some support for neurocognitive models of frontocortical attentional dysfunction in anxiety. |
Jan Herding; Simon Ludwig; Alexander Lautz; Bernhard Spitzer; Felix Blankenburg Centro-parietal EEG potentials index subjective evidence and confidence during perceptual decision making Journal Article In: NeuroImage, vol. 201, pp. 116011, 2019. @article{Herding2019, Recent studies suggest that a centro-parietal positivity (CPP) in the EEG signal tracks the absolute (unsigned) strength of accumulated evidence for choices that require the integration of noisy sensory input. Here, we investigated whether the CPP might also reflect the evidence for decisions based on a quantitative comparison between two sequentially presented stimuli (a signed quantity). We recorded EEG while participants decided whether the latter of two vibrotactile frequencies was higher or lower than the former in six variants of this task (n ¼ 116). To account for biases in sequential comparisons, we applied a behavioral model based on Bayesian inference that estimated subjectively perceived frequency differences. Immediately after the second stimulus, parietal ERPs reflected the signed value of subjectively perceived differences and afterwards their absolute value. Strikingly, the modulation by signed difference was evident in trials without any objective evidence for either choice and correlated with choice-selective premotor beta band amplitudes. Modulations by the absolute strength of subjectively perceived evidence-a direct indicator of task difficulty-exhibited all features of statistical decision confidence. Together, our data suggest that parietal EEG signals first index subjective evidence, and later include a measure of confidence in the context of perceptual decision making. |
Jim D. Herring; Sophie Esterer; Tom R. Marshall; Ole Jensen; Til O. Bergmann Low-frequency alternating current stimulation rhythmically suppresses gamma-band oscillations and impairs perceptual performance Journal Article In: NeuroImage, vol. 184, pp. 440–449, 2019. @article{Herring2019, Low frequency oscillations such as alpha (8–12 Hz) are hypothesized to rhythmically gate sensory processing, reflected by 40–100 Hz gamma band activity, via the mechanism of pulsed inhibition. We applied transcranial alternating current stimulation (TACS) at individual alpha frequency (IAF) and flanking frequencies (IAF-4 Hz, IAF+4 Hz) to the occipital cortex of healthy human volunteers during concurrent magnetoencephalography (MEG), while participants performed a visual detection task inducing strong gamma-band responses. Occipital (but not retinal) TACS phasically suppressed stimulus-induced gamma oscillations in the visual cortex and impaired target detection, with stronger phase-to-amplitude coupling predicting behavioral impairments. Retinal control TACS ruled out retino-thalamo-cortical entrainment resulting from (subthreshold) retinal stimulation. All TACS frequencies tested were effective, suggesting that visual gamma-band responses can be modulated by a range of low frequency oscillations. We propose that TACS-induced membrane potential modulations mimic the rhythmic change in cortical excitability by which spontaneous low frequency oscillations may eventually exert their impact when gating sensory processing via pulsed inhibition. |
Taylor Hornung; Wen Hsuan Chan; Ralph Axel Müller; Jeanne Townsend; Brandon Keehn Dopaminergic hypo-activity and reduced theta-band power in autism spectrum disorder: A resting-state EEG study Journal Article In: International Journal of Psychophysiology, vol. 146, pp. 101–106, 2019. @article{Hornung2019, Background: Prior studies using a variety of methodologies have reported inconsistent dopamine (DA) findings in individuals with autism spectrum disorder (ASD), ranging from dopaminergic hypo- to hyper-activity. Theta-band power derived from scalp-recorded electroencephalography (EEG), which may be associated with dopamine levels in frontal cortex, has also been shown to be atypical in ASD. The present study examined spontaneous eye-blink rate (EBR), an indirect, non-invasive measure of central dopaminergic activity, and theta power in children with ASD to determine: 1) whether ASD may be associated with atypical DA levels, and 2) whether dopaminergic dysfunction may be associated with aberrant theta-band activation. Method: Participants included thirty-two children with ASD and thirty-two age-, IQ-, and sex-matched typically developing (TD) children. Electroencephalography and eye-tracking data were acquired while participants completed an eyes-open resting-state session. Blinks were counted and EBR was determined by dividing blink frequency by session duration and theta power (4–7.5 Hz) was extracted from midline leads. Results: Eye-blink rate and theta-band activity were significantly reduced in children with ASD as compared to their TD peers. For all participants, greater midline theta power was associated with increased EBR (related to higher DA levels). Conclusions: These results suggest that ASD may be associated with dopaminergic hypo-activity, and that this may contribute to atypical theta-band power. Lastly, EBR may be a useful tool to non-invasively index dopamine levels in ASD and could potentially have many clinical applications, including selecting treatment options and monitoring treatment response. |
Judith Nicolas; Aline Bompas; Romain Bouet; Olivier Sillan; Eric Koun; Christian Urquizar; Aurélie Bidet-Caulet; Denis Pélisson Saccadic adaptation boosts ongoing gamma activity in a subsequent visuoattentional task Journal Article In: Cerebral Cortex, vol. 29, no. 9, pp. 3606–3617, 2019. @article{Nicolas2019a, Attention and saccadic adaptation (SA) are critical components of visual perception, the former enhancing sensory processing of selected objects, the latter maintaining the eye movements accuracy toward them. Recent studies propelled the hypothesis of a tight functional coupling between these mechanisms, possibly due to shared neural substrates. Here, we used magnetoencephalography to investigate for the first time the neurophysiological bases of this coupling and of SA per se. We compared visual discrimination performance of 12 healthy subjects before and after SA. Eye movements and magnetic signals were recorded continuously. Analyses focused on gamma band activity (GBA) during the pretarget period of the discrimination and the saccadic tasks. We found that GBA increases after SA. This increase was found in the right hemisphere for both postadaptation saccadic and discrimination tasks. For the latter, GBA also increased in the left hemisphere. We conclude that oculomotor plasticity involves GBA modulation within an extended neural network which persists after SA, suggesting a possible role of gamma oscillations in the coupling between SA and attention. |
Elena V. Orekhova; Tatiana A. Stroganova; Justin F. Schneiderman; Sebastian Lundström; Bushra Riaz; Darko Sarovic; Olga V. Sysoeva; Georg Brant; Christopher Gillberg; Nouchine Hadjikhani Neural gain control measured through cortical gamma oscillations is associated with sensory sensitivity Journal Article In: Human Brain Mapping, vol. 40, no. 5, pp. 1583–1593, 2019. @article{Orekhova2019, Gamma oscillations facilitate information processing by shaping the excitatory input/output of neuronal populations. Recent studies in humans and nonhuman primates have shown that strong excitatory drive to the visual cortex leads to suppression of induced gamma oscillations, which may reflect inhibitory-based gain control of network excitation. The efficiency of the gain control measured through gamma oscillations may in turn affect sensory sensitivity in everyday life. To test this prediction, we assessed the link between self-reported sensitivity and changes in magneto-encephalographic gamma oscillations as a function of motion velocity of high-contrast visual gratings. The induced gamma oscillations increased in frequency and decreased in power with increasing stimulation intensity. As expected, weaker suppression of the gamma response correlated with sensory hypersensitivity. Robustness of this result was confirmed by its replication in the two samples: neurotypical subjects and people with autism, who had generally elevated sensory sensitivity. We conclude that intensity-related suppression of gamma response is a promising biomarker of homeostatic control of the excitation–inhibition balance in the visual cortex. |
Aisling E. O'Sullivan; Chantelle Y. Lim; Edmund C. Lalor In: European Journal of Neuroscience, vol. 50, no. 8, pp. 3282–3295, 2019. @article{OSullivan2019, Recent work using electroencephalography has applied stimulus reconstruction techniques to identify the attended speaker in a cocktail party environment. The success of these approaches has been primarily based on the ability to detect cortical tracking of the acoustic envelope at the scalp level. However, most studies have ignored the effects of visual input, which is almost always present in naturalistic scenarios. In this study, we investigated the effects of visual input on envelope-based cocktail party decoding in two multisensory cocktail party situations: (a) Congruent AV—facing the attended speaker while ignoring another speaker represented by the audio-only stream and (b) Incongruent AV (eavesdropping)—attending the audio-only speaker while looking at the unattended speaker. We trained and tested decoders for each condition separately and found that we can successfully decode attention to congruent audiovisual speech and can also decode attention when listeners were eavesdropping, i.e., looking at the face of the unattended talker. In addition to this, we found alpha power to be a reliable measure of attention to the visual speech. Using parieto-occipital alpha power, we found that we can distinguish whether subjects are attending or ignoring the speaker's face. Considering the practical applications of these methods, we demonstrate that with only six near-ear electrodes we can successfully determine the attended speech. This work extends the current framework for decoding attention to speech to more naturalistic scenarios, and in doing so provides additional neural measures which may be incorporated to improve decoding accuracy. |
Luis Aguado; Karisa B. Parkington; Teresa Dieguez-Risco; José A. Hinojosa; Roxane J. Itier Joint modulation of facial expression processing by contextual congruency and task demands Journal Article In: Brain Sciences, vol. 9, pp. 1–20, 2019. @article{Aguado2019, Faces showing expressions of happiness or anger were presented together with sentences that described happiness-inducing or anger-inducing situations. Two main variables were manipulated: (i) congruency between contexts and expressions (congruent/incongruent) and (ii) the task assigned to the participant, discriminating the emotion shown by the target face (emotion task) or judging whether the expression shown by the face was congruent or not with the context (congruency task). Behavioral and electrophysiological results (event-related potentials (ERP)) showed that processing facial expressions was jointly influenced by congruency and task demands. ERP results revealed task effects at frontal sites, with larger positive amplitudes between 250–450 ms in the congruency task, reflecting the higher cognitive effort required by this task. Effects of congruency appeared at latencies and locations corresponding to the early posterior negativity (EPN) and late positive potential (LPP) components that have previously been found to be sensitive to emotion and affective congruency. The magnitude and spatial distribution of the congruency effects varied depending on the task and the target expression. These results are discussed in terms of the modulatory role of context on facial expression processing and the different mechanisms underlying the processing of expressions of positive and negative emotions. |
Máté Aller; Uta Noppeney To integrate or not to integrate: Temporal dynamics of hierarchical Bayesian causal inference Journal Article In: PLoS Biology, vol. 17, no. 4, pp. e3000210, 2019. @article{Aller2019, To form a percept of the environment, the brain needs to solve the binding problem—inferring whether signals come from a common cause and are integrated or come from independent causes and are segregated. Behaviourally, humans solve this problem near-optimally as predicted by Bayesian causal inference; but the neural mechanisms remain unclear. Combining Bayesian modelling, electroencephalography (EEG), and multivariate decoding in an audiovisual spatial localisation task, we show that the brain accomplishes Bayesian causal inference by dynamically encoding multiple spatial estimates. Initially, auditory and visual signal locations are estimated independently; next, an estimate is formed that combines information from vision and audition. Yet, it is only from 200 ms onwards that the brain integrates audiovisual signals weighted by their bottom-up sensory reliabilities and top-down task relevance into spatial priority maps that guide behavioural responses. As predicted by Bayesian causal inference, these spatial priority maps take into account the brain's uncertainty about the world's causal structure and flexibly arbitrate between sensory integration and segregation. The dynamic evolution of perceptual estimates thus reflects the hierarchical nature of Bayesian causal inference, a statistical computation, which is crucial for effective interactions with the environment. |
Roy Amit; Dekel Abeles; Marisa Carrasco; Shlomit Yuval-Greenberg Oculomotor inhibition reflects temporal expectations Journal Article In: NeuroImage, vol. 184, pp. 279–292, 2019. @article{Amit2019a, The accurate extraction of signals out of noisy environments is a major challenge of the perceptual system. Forming temporal expectations and continuously matching them with perceptual input can facilitate this process. In humans, temporal expectations are typically assessed using behavioral measures, which provide only retrospective but no real-time estimates during target anticipation, or by using electrophysiological measures, which require extensive preprocessing and are difficult to interpret. Here we show a new correlate of temporal expectations based on oculomotor behavior. Observers performed an orientation-discrimination task on a central grating target, while their gaze position and EEG were monitored. In each trial, a cue preceded the target by a varying interval (“foreperiod”). In separate blocks, the cue was either predictive or non-predictive regarding the timing of the target. Results showed that saccades and blinks were inhibited more prior to an anticipated regular target than a less-anticipated irregular one. This consistent oculomotor inhibition effect enabled a trial-by-trial classification according to interval-regularity. Additionally, in the regular condition the slope of saccade-rate and drift were shallower for longer than shorter foreperiods, indicating their adjustment according to temporal expectations. Comparing the sensitivity of this oculomotor marker with those of other common predictability markers (e.g. alpha-suppression) showed that it is a sensitive marker for cue-related anticipation. In contrast, temporal changes in conditional probabilities (hazard-rate) modulated alpha-suppression more than cue-related anticipation. We conclude that pre-target oculomotor inhibition is a correlate of temporal predictions induced by cue-target associations, whereas alpha-suppression is more sensitive to conditional probabilities across time. |
Ayelet Arazi; Yaffa Yeshurun; Ilan Dinstein Neural variability is quenched by attention Journal Article In: Journal of Neuroscience, vol. 39, no. 30, pp. 5975–5985, 2019. @article{Arazi2019, Attention can be subdivided into several components, including alertness and spatial attention. It is believed that the behavioral benefits of attention, such as increased accuracy and faster reaction times, are generated by an increase in neural activity and a decrease in neural variability, which enhance the signal-to-noise ratio of task-relevant neural populations. However, empirical evidence regarding attention-related changes in neural variability in humans is extremely rare. Here we used EEG to demonstrate that trial-by-trial neural variability was reduced by visual cues that modulated alertness and spatial attention. Reductions in neural variability were specific to the visual system and larger in the contralateral hemisphere of the attended visual field. Subjects with higher initial levels of neural variability and larger decreases in variability exhibited greater behavioral benefits from attentional cues. These findings demonstrate that both alertness and spatial attention modulate neural variability and highlight the importance of reducing/quenching neural variability for attaining the behavioral benefits of attention. |
Ryszard Auksztulewicz; Nicholas E. Myers; Jan W. Schnupp; Anna C. Nobre Rhythmic temporal expectation boosts neural activity by increasing neural gain Journal Article In: Journal of Neuroscience, vol. 39, no. 49, pp. 9806–9817, 2019. @article{Auksztulewicz2019, Temporal orienting improves sensory processing, akin to other top–down biases. However, it is unknown whether these improvements reflect increased neural gain to any stimuli presented at expected time points, or specific tuning to task-relevant stimulus aspects. Furthermore, while other top–down biases are selective, the extent of trade-offs across time is less well characterized. Here, we tested whether gain and/or tuning ofauditory frequency processing in humans is modulated by rhythmic temporal expectations, and whether these modulations are specific to time points relevant for task performance. Healthy participants (N⫽ 23) of either sex performed an auditory discrimination task while their brain activity was measured using magnetoencephalography/electroencephalography (M/EEG). Acoustic stimulation consisted ofsequences ofbriefdistractors interspersed with targets, presented in a rhythmic or jittered way. Target rhythmicity not only improved behavioral discrimination accuracy and M/EEG-based decoding oftargets, but also ofirrelevant distrac- tors preceding these targets. To explain this finding in terms ofincreased sensitivity and/or sharpened tuning to auditory frequency, we estimated tuning curves based on M/EEG decoding results, with separate parameters describing gain and sharpness. The effect of rhythmic expectation on distractor decoding was linked to gain increase only, suggesting increased neural sensitivity to any stimuli presented at relevant time points. |
Sonya Bells; Jérémie Lefebvre; Giulia Longoni; Sridar Narayanan; Douglas L. Arnold; Eleun Ann Yeh; Donald J. Mabbott White matter plasticity and maturation in human cognition Journal Article In: Glia, vol. 67, no. 11, pp. 2020–2037, 2019. @article{Bells2019, White matter plasticity likely plays a critical role in supporting cognitive development. However, few studies have used the imaging methods specific to white matter tissue structure or experimental designs sensitive to change in white matter necessary to elucidate these relations. Here we briefly review novel imaging approaches that provide more specific information regarding white matter microstructure. Furthermore, we highlight recent studies that provide greater clarity regarding the relations between changes in white matter and cognition maturation in both healthy children and adolescents and those with white matter insult. Finally, we examine the hypothesis that white matter is linked to cognitive function via its impact on neural synchro- nization. We test this hypothesis in a population of children and adolescents with recurrent demyelinating syndromes. Specifically, we evaluate group differences in white matter microstructure within the optic radiation; and neural phase synchrony in visual cortex during a visual task between 25 patients and 28 typically developing age-matched controls. Children and adolescents with demyelinating syndromes show evidence of myelin and axonal compromise and this compromise predicts reduced phase synchrony during a visual task compared to typically developing controls. We investigate one plausible mechanism at play in this relationship using a computational model of gamma generation in early visual cortical areas. Overall, our findings show a fundamental connection between white matter microstructure and neural synchronization that may be critical for cognitive processing. In the future, longitudinal or interventional studies can build upon our knowledge of these exciting relations between white matter, neural communication, and cognition. |
Nathan Caruana; Genevieve McArthur The mind minds minds: The effect of intentional stance on the neural encoding of joint attention Journal Article In: Cognitive, Affective and Behavioral Neuroscience, vol. 19, no. 6, pp. 1479–1491, 2019. @article{Caruana2019a, Recent neuroimaging studies have observed that the neural processing of social cues from a virtual reality character appears to be affected by "intentional stance" (i.e., attributing mental states, agency, and "humanness"). However, this effect could also be explained by individual differences or perceptual effects resulting from the design of these studies. The current study used a new design that measured centro-parietal P250, P350, and N170 event-related potentials (ERPs) in 20 healthy adults while they initiated gaze-related joint attention with a virtual character (“Alan”) in two conditions. In one condition, they were told that Alan was controlled by a human; in the other, they were told that he was controlled by a computer. When participants believed Alan was human, his congruent gaze shifts, which resulted in joint attention, generated significantly larger P250 ERPs than his incongruent gaze shifts. In contrast, his incongruent gaze shifts triggered significantly larger increases in P350 ERPs than his congruent gaze shifts. These findings support previous studies suggesting that intentional stance affects the neural processing of social cues from a virtual character. The outcomes also suggest the use of the P250 and P350 ERPs as objective indices of social engagement during the design of socially approachable robots and virtual agents. |
Jing Chen; Matteo Valsecchi; Karl R. Gegenfurtner Saccadic suppression measured by steady-state visual evoked potentials Journal Article In: Journal of Neurophysiology, vol. 122, no. 1, pp. 251–258, 2019. @article{Chen2019e, Visual sensitivity is severely impaired during the execution of saccadic eye movements. This phenomenon has been extensively characterized in human psychophysics and nonhuman primate single-neuron studies, but a physiological characterization in humans is less established. Here, we used a method based on steadystate visually evoked potential (SSVEP), an oscillatory brain response to periodic visual stimulation, to examine how saccades affect visual sensitivity. Observers made horizontal saccades back and forth, while horizontal black-and-white gratings flickered at 5-30 Hz in the background. We analyzed EEG epochs with a length of 0.3 s either centered at saccade onset (saccade epochs) or centered at fixations half a second before the saccade (fixation epochs). Compared with fixation epochs, saccade epochs showed a broadband power increase, which most likely resulted from saccade-related EEG activity. The execution of saccades, however, led to an average reduction of 57% in the SSVEP amplitude at the stimulation frequency. This result provides additional evidence for an active saccadic suppression in the early visual cortex in humans. Compared with previous functional MRI and EEG studies, an advantage of this approach lies in its capability to trace the temporal dynamics of neural activity throughout the time course of a saccade. In contrast to previous electrophysiological studies in nonhuman primates, we did not find any evidence for postsaccadic enhancement, even though simulation results show that our method would have been able to detect it. We conclude that SSVEP is a useful technique to investigate the neural correlates of visual perception during saccadic eye movements in humans. |
Rajib Chowdhury; A. F. M. Saifuddin Saif Efficient method to improve human brain sensor activities using proposed neuroheadset device embedded with sensors: A comprehensive study Journal Article In: International Journal of Software Engineering and Computer Systems, vol. 53, no. 1, pp. 52–56, 2019. @article{Chowdhury2019, The main purpose of this research is to investigate the human brain sensor activities related prior researches towards the needs of an efficient method to improve the human brain sensor activities. Human brain activities mainly measured by brain signal acquired from the brain sensor electrodes positioned on several parts of the brain cortex. Although previous researches investigated human brain activities in various aspects, the improvement of the human brain sensor activities is still unsolved. In today's world, it is very crucial need for improving the sensor activities of the human brain using that human brain improved signal externally. This research demonstrated a comprehensive critical analysis of human brain activities related prior researches to claim for an efficient method integrated with proposed neuroheadset device. This research presented a comprehensive review in various aspects like previous methods, existing frameworks analysis and existing results analysis with the discussion to establish an efficient method for acquiring human brain signal, improving the acquired signal and developing the sensor activities of the human brain using that human brain improved signal. Demonstrated critical review has expected for constituting an efficient method to improve the performance of maneuverability, visualization, subliminal activities and so forth on human brain activities. |
Tim H. W. Cornelissen; Jona Sassenhagen; Melissa L. -H. Võ Improving free-viewing fixation-related EEG potentials with continuous-time regression Journal Article In: Journal of Neuroscience Methods, vol. 313, pp. 77–94, 2019. @article{Cornelissen2019, Background: In the analysis of combined ET-EEG data, there are several issues with estimating FRPs by averaging. Neural responses associated with fixations will likely overlap with one another in the EEG recording and neural responses change as a function of eye movement characteristics. Especially in tasks that do not constrain eye movements in any way, these issues can become confounds. New method: Here, we propose the use of regression based estimates as an alternative to averaging. Multiple regression can disentangle different influences on the EEG and correct for overlap. It thereby accounts for potential confounds in a way that averaging cannot. Specifically, we test the applicability of the rERP framework, as proposed by Smith and Kutas (2015b), (2017), or Sassenhagen (2018) to combined eye tracking and EEG data from a visual search and a scene memorization task. Results: Results show that the method successfully estimates eye movement related confounds in real experimental data, so that these potential confounds can be accounted for when estimating experimental effects. Comparison with existing methods: The rERP method successfully corrects for overlapping neural responses in instances where averaging does not. As a consequence, baselining can be applied without risking distortions. By estimating a known experimental effect, we show that rERPs provide an estimate with less variance and more accuracy than averaged FRPs. The method therefore provides a practically feasible and favorable alternative to averaging. Conclusions: We conclude that regression based ERPs provide novel opportunities for estimating fixation related EEG in free-viewing experiments. |
Antea D'Andrea; Federico Chella; Tom R. Marshall; Vittorio Pizzella; Gian Luca Romani; Ole Jensen; Laura Marzetti In: NeuroImage, vol. 188, pp. 722–732, 2019. @article{DAndrea2019, It is well known that attentional selection of relevant information relies on local synchronization of alpha band neuronal oscillations in visual cortices for inhibition of distracting inputs. Additionally, evidence for long-range coupling of neuronal oscillations between visual cortices and regions engaged in the anticipation of upcoming stimuli has been more recently provided. Nevertheless, on the one hand the relation between long-range functional coupling and anatomical connections is still to be assessed, and, on the other hand, the specific role of the alpha and beta frequency bands in the different processes underlying visuo-spatial attention still needs further clarification. We address these questions using measures of linear (frequency-specific) and nonlinear (cross-frequency) phase-synchronization in a cohort of 28 healthy subjects using magnetoencephalography. We show that alpha band phase-synchronization is modulated by the orienting of attention according to a parieto-occipital top-down mechanism reflecting behavior, and its hemispheric asymmetry is predicted by volume's asymmetry of specific tracts of the Superior-Longitudinal-Fasciculus. We also show that a network comprising parietal regions and the right putative Frontal-Eye-Field, but not the left, is recruited in the deployment of spatial attention through an alpha-beta cross-frequency coupling. Overall, we demonstrate that the visuospatial attention network features subsystems indexed by characteristic spectral fingerprints, playing different functional roles in the anticipation of upcoming stimuli and with diverse relation to fiber tracts. |
Peter Lissa; Genevieve McArthur; Stefan Hawelka; Romina Palermo; Yatin Mahajan; Federica Degno; Florian Hutzler Peripheral preview abolishes N170 face-sensitivity at fixation: Using fixation-related potentials to investigate dynamic face processing Journal Article In: Visual Cognition, vol. 27, no. 9-10, pp. 740–759, 2019. @article{Lissa2019, The N170 ERP peak has been found to be consistently larger in response to the presentation of faces than to other objects, yet it is not clear whether this face-sensitive N170 is also elicited during fixations made subsequent to the initial presentation. To investigate this question, the current study utilised Event and Fixation-Related Potentials in two experiments, time-locking brain potentials to the presentation of faces and objects (watches) images in participants' peripheral vision, and to their first fixations on the images. Experiment 1 found that a face-sensitive N170 was elicited by the onset of images but not by a subsequent fixation on the images, and that face inversion did not modulate N170 beyond presentation. Experiment 2 found that disrupting the structure of the peripheral preview (phase-scrambling) led to a face-sensitive N170 at fixation onsets on the intact-images. Interestingly, N170 amplitudes for both faces and objects were significantly enhanced after the peripheral preview was phase-scrambled, suggesting that the N170 in part reflects a category-detection process that is elicited once when an image structure is viewed. These results indicate that neural processing during fixations will be significantly modulated when they are immediately preceded by peripheral previews, and is not specific to faces. |
Federica Degno; Otto Loberg; Chuanli Zang; Manman Zhang; Nick Donnelly; Simon P. Liversedge A co-registration investigation of inter-word spacing and parafoveal preview: Eye movements and fixation-related potentials Journal Article In: PLoS ONE, vol. 14, no. 12, pp. e0225819, 2019. @article{Degno2019, Participants' eye movements (EMs) and EEG signal were simultaneously recorded to examine foveal and parafoveal processing during sentence reading. All the words in the sentence were manipulated for inter-word spacing (intact spaces vs. spaces replaced by a random letter) and parafoveal preview (identical preview vs. random letter string preview). We observed disruption for unspaced text and invalid preview conditions in both EMs and fixation- related potentials (FRPs). Unspaced and invalid preview conditions received longer reading times than spaced and valid preview conditions. In addition, the FRP data showed that unspaced previews disrupted reading in earlier time windows of analysis, compared to string preview conditions. Moreover, the effect of parafoveal preview was greater for spaced relative to unspaced conditions, in both EMs and FRPs. These findings replicate well-established preview effects, provide novel insight into the neural correlates of reading with and without inter-word spacing and suggest that spatial selection precedes lexical processing. |
Federica Degno; Otto Loberg; Chuanli Zang; Manman Zhang; Nick Donnelly; Simon P. Liversedge Parafoveal previews and lexical frequency in natural reading: Evidence from eye movements and fixation-related potentials. Journal Article In: Journal of Experimental Psychology: General, vol. 148, no. 3, pp. 453–474, 2019. @article{Degno2019a, Participants' eye movements and electroencephalogram (EEG) signal were recorded as they read sentences displayed according to the gaze-contingent boundary paradigm. Two target words in each sentence were manipulated for lexical frequency (high vs. low frequency) and parafoveal preview of each target word (identical vs. string of random letters vs. string of Xs). Eye movement data revealed visual parafoveal-on-foveal (PoF) effects, as well as foveal visual and orthographic preview effects and word frequency effects. Fixation-related potentials (FRPs) showed visual and orthographic PoF effects as well as foveal visual and orthographic preview effects. Our results replicated the early preview positivity effect (Dimigen, Kliegl, & Sommer, 2012) in the X-string preview condition, and revealed different neural correlates associated with a preview comprised of a string of random letters relative to a string of Xs. The former effects seem likely to reflect difficulty associated with the integration of parafoveal and foveal information, as well as feature overlap, while the latter reflect inhibition, and potentially disruption, to processing underlying reading. Interestingly, and consistent with Kretzschmar, Schlesewsky, and Staub (2015), no frequency effect was reflected in the FRP measures. The findings provide insight into the neural correlates of parafoveal processing and written word recognition in reading and demonstrate the value of utilizing ecologically valid paradigms to study well established phenomena that occur as text is read naturally. |
Christ Devia; Rocio Mayol-Troncoso; Javiera Parrini; Gricel Orellana; Aida Ruiz; Pedro E. Maldonado; Jose Ignacio Egaña EEG classification during scene free-viewing for schizophrenia detection Journal Article In: IEEE Transactions on Neural Systems and Rehabilitation Engineering, vol. 27, no. 6, pp. 1193–1199, 2019. @article{Devia2019, Currently, the diagnosis of schizophrenia is made solely based on interviews and behavioral observations by a trained psychiatrist. Technologies such as electroencephalography (EEG) are used for differential diagnosis and not to support the psychiatrist's positive diagnosis. Here, we show the potential of EEG recordings as biomarkers of the schizophrenia syndrome. We recorded EEG while schizophrenia patients freely viewed natural scenes, and we analyzed the average EEG activity locked to the image onset. We found significant differences between patients and healthy controls in occipital areas approximately 500 ms after image onset. These differences were used to train a classifier to discriminate the schizophrenia patients from the controls. The best classifier had 81% sensitivity for the detection of patients and specificity of 59% for the detection of controls, with an overall accuracy of 71%. These results indicate that EEG signals from a free-viewing paradigm discriminate patients from healthy controls and have the potential to become a tool for the psychiatrist to support the positive diagnosis of schizophrenia. |
Chad C. Williams; Mitchel Kappen; Cameron D. Hassall; Bruce Wright; Olave E. Krigolson Thinking theta and alpha: Mechanisms of intuitive and analytical reasoning Journal Article In: NeuroImage, vol. 189, pp. 574–580, 2019. @article{Williams2019, Humans have a unique ability to engage in different modes of thinking. Intuitive thinking (coined System 1, see Kahneman, 2011) is fast, automatic, and effortless whereas analytical thinking (coined System 2) is slow, contemplative, and effortful. We extend seminal pupillometry research examining these modes of thinking by using electroencephalography (EEG) to decipher their respective underlying neural mechanisms. We demonstrate that System 1 thinking is characterized by an increase in parietal alpha EEG power reflecting autonomic access to long-term memory and a release of attentional resources whereas System 2 thinking is characterized by an increase in frontal theta EEG power indicative of the engagement of cognitive control and working memory processes. Consider our results in terms of an example - a child may need cognitive control and working memory when contemplating a mathematics problem yet an adullt can drive a car with little to no attention by drawing on easily accessed memories. Importantly, the unravelling of intuitive and analytical thinking mechanisms and their neural signatures will provide insight as to how different modes of thinking drive our everyday lives. |
Mats W. J. Es; Jan-Mathijs Schoffelen Stimulus-induced gamma power predicts the amplitude of the subsequent visual evoked response Journal Article In: NeuroImage, vol. 186, pp. 703–712, 2019. @article{Es2019a, The efficiency of neuronal information transfer in activated brain networks may affect behavioral performance. Gamma-band synchronization has been proposed to be a mechanism that facilitates neuronal processing of behaviorally relevant stimuli. In line with this, it has been shown that strong gamma-band activity in visual cortical areas leads to faster responses to a visual go cue. We investigated whether there are directly observable consequences of trial-by-trial fluctuations in non-invasively observed gamma-band activity on the neuronal response. Specifically, we hypothesized that the amplitude of the visual evoked response to a go cue can be predicted by gamma power in the visual system, in the window preceding the evoked response. Thirty-three human subjects (22 female) performed a visual speeded response task while their magnetoencephalogram (MEG) was recorded. The participants had to respond to a pattern reversal of a concentric moving grating. We estimated single trial stimulus-induced visual cortical gamma power, and correlated this with the estimated single trial amplitude of the most prominent event-related field (ERF) peak within the first 100 ms after the pattern reversal. In parieto-occipital cortical areas, the amplitude of the ERF correlated positively with gamma power, and correlated negatively with reaction times. No effects were observed for the alpha and beta frequency bands, despite clear stimulus onset induced modulation at those frequencies. These results support a mechanistic model, in which gamma-band synchronization enhances the neuronal gain to relevant visual input, thus leading to more efficient downstream processing and to faster responses. |
Joram Driel; Eduard Ort; Johannes J. Fahrenfort; Christian N. L. Olivers Beta and theta oscillations differentially support free versus forced control over multiple-target search Journal Article In: Journal of Neuroscience, vol. 39, no. 9, pp. 1733–1743, 2019. @article{Driel2019, Many important situations require human observers to simultaneously search for more than one object. Despite a long history of research into visual search, the behavioral and neural mechanisms associated with multiple-target search are poorly understood. Here we test the novel theory that the efficiency of looking for multiple targets critically depends on the mode of cognitive control the environment affords to the observer. We used an innovative combination of electroencephalogram (EEG) and eye tracking while participants searched for two targets, within two different contexts: either both targets were present in the search display and observers were free to prioritize either one of them, thus enabling proactive control over selection; or only one of the two targets would be present in each search display, which requires reactive control to reconfigure selection when the wrong target has been prioritized. During proactive control, both univariate and multivariate signals of beta-band (15–35 Hz) power suppression before display onset predicted switches between target selections. This signal originated over midfrontal and sensorimotor regions and has previously been associated with endogenous state changes. In contrast, imposed target selections requiring reactive control elicited prefrontal power enhancements in the delta/theta band (2– 8 Hz), but only after display onset. This signal predicted individual differences in associated oculomotor switch costs, reflecting reactive reconfiguration of target selection. The results provide compelling evidence that multiple target representations are differentially prioritized during visual search, and for the first time reveal distinct neural mechanisms underlying proactive and reactive control over multiple-target search. |
Jing Zhu; Ying Wang; Rong La; Jiawei Zhan; Junhong Niu; Shuai Zeng; Xiping Hu Multimodal mild depression recognition based on EEG-EM synchronization acquisition network Journal Article In: IEEE Access, vol. 7, pp. 28196–28210, 2019. @article{Zhu2019, In this paper, we used electroencephalography (EEG)-eye movement (EM) synchronization acquisition network to simultaneously record both EEG and EM physiological signals of the mild depression and normal controls during free viewing. Then, we consider a multimodal feature fusion method that can best discriminate between mild depression and normal control subjects as a step toward achieving our long-term aim of developing an objective and effective multimodal system that assists doctors during diagnosis and monitoring of mild depression. Based on the multimodal denoising autoencoder, we use two feature fusion strategies (feature fusion and hidden layer fusion) for fusion of the EEG and EM signals to improve the recognition performance of classifiers for mild depression. Our experimental results indicate that the EEG-EM synchronization acquisition network ensures that the recorded EM and EEG data require that both the data streams are synchronized with millisecond precision, and both fusion methods can improve the mild depression recognition accuracy, thus demonstrating the complementary nature of the modalities. Compared with the unimodal classification approach that uses only EEG or EM, the feature fusion method slightly improved the recognition accuracy by 1.88%, while the hidden layer fusion method significantly improved the classification rate by up to 7.36%. In particular, the highest classification accuracy achieved in this paper was 83.42%. These results indicate that the multimodal deep learning approaches with input data using a combination of EEG and EM signals are promising in achieving real-time monitoring and identification of mild depression. |
Leonhard Waschke; Sarah Tune; Jonas Obleser Local cortical desynchronization and pupil-linked arousal differentially shape brain states for optimal sensory performance Journal Article In: eLife, vol. 8, pp. 1–27, 2019. @article{Waschke2019, Instantaneous brain states have consequences for our sensation, perception, and behaviour. Fluctuations in arousal and neural desynchronization likely pose perceptually relevant states. However, their relationship and their relative impact on perception is unclear. We here show that, at the single-trial level in humans, local desynchronization in sensory cortex (expressed as time-series entropy) versus pupil- linked arousal differentially impact perceptual processing. While we recorded electroencephalography (EEG) and pupillometry data, stimuli of a demanding auditory discrimination task were presented into states of high or low desynchronization of auditory cortex via a real-time closed-loop setup. Desynchronization and arousal distinctly influenced stimulus-evoked activity and shaped behaviour displaying an inverted u-shaped relationship: States of intermediate desynchronization elicited minimal response bias and fastest responses, while states of intermediate arousal gave rise to highest response sensitivity. Our results speak to a model in which independent states of local desynchronization and global arousal jointly optimise sensory processing and performance. |
Raphael Vallat; David Meunier; Alain Nicolas; Perrine Ruby Hard to wake up? The cerebral correlates of sleep inertia assessed using combined behavioral, EEG and fMRI measures Journal Article In: NeuroImage, vol. 184, pp. 266–278, 2019. @article{Vallat2019, The first minutes following awakening from sleep are typically marked by reduced vigilance, increased sleepiness and impaired performance, a state referred to as sleep inertia. Although the behavioral aspects of sleep inertia are well documented, its cerebral correlates remain poorly understood. The present study aimed at filling this gap by measuring in 34 participants the changes in behavioral performance (descending subtraction task, DST), EEG spectral power, and resting-state fMRI functional connectivity across three time points: before an early-afternoon 45-min nap, 5 min after awakening from the nap and 25 min after awakening. Our results showed impaired performance at the DST at awakening and an intrusion of sleep-specific features (spectral power and functional connectivity) into wakefulness brain activity, the intensity of which was dependent on the prior sleep duration and depth for the functional connectivity (14 participants awakened from N2 sleep, 20 from N3 sleep). Awakening in N3 (deep) sleep induced the most robust changes and was characterized by a global loss of brain functional segregation between task-positive (dorsal attention, salience, sensorimotor) and task-negative (default mode) networks. Significant correlations were observed notably between the EEG delta power and the functional connectivity between the default and dorsal attention networks, as well as between the percentage of mistake at the DST and the default network functional connectivity. These results highlight (1) significant correlations between EEG and fMRI functional connectivity measures, (2) significant correlations between the behavioral aspect of sleep inertia and measures of the cerebral functioning at awakening (both EEG and fMRI), and (3) the important difference in the cerebral underpinnings of sleep inertia at awakening from N2 and N3 sleep. |
Pei -Yi Tsai; Hsiao-Ching She; Sheng-Chang Chen; Li-Yu Huang; Wen-Chi Chou; Jeng-Ren Duann; Tzyy-Ping Jung Eye fixation-related fronto-parietal neural network correlates of memory retrieval Journal Article In: International Journal of Psychophysiology, vol. 138, pp. 57–70, 2019. @article{Tsai2019, Eye movements are considered to be informative with regard to the underlying cognitive processes of human beings. Previous studies have reported that eye movements are associated with which scientific concepts are retrieved correctly. Moreover, other studies have also suggested that eye movements involve the cooperative activity of the human brain's fronto-parietal circuits. Less research has been conducted to investigate whether fronto-parietal EEG oscillations are associated with the retrieval processing of scientific concepts. Our findings in this study demonstrated that the fronto-parietal network is indeed crucial for successful memory retrieval. In short, significantly lower theta augmentation in the frontal midline and lower alpha suppression in the right parietal region were observed at the 5th eye fixation for physics concepts that were correctly retrieved than for those that were incorrectly retrieved. Moreover, the visual cortex in the occipital lobe exhibits a significantly greater theta augmentation followed by an alpha suppression following each eye fixation, while a right fronto-parietal asymmetry was also found for the successful retrieval of presentations of physics concepts. In particular, the study results showed that eye fixation-related frontal midline theta power and right parietal alpha power at the 5th eye fixation have the greatest predictive power regarding the correctness of the retrieval of physics concepts. |
Robert Jagiello; Ulrich Pomper; Makoto Yoneya; Sijia Zhao; Maria Chait Rapid brain sesponses to familiar vs. unfamiliar music-an EEG and pupillometry study Journal Article In: Scientific Reports, vol. 9, pp. 15570, 2019. @article{Jagiello2019, Human listeners exhibit marked sensitivity to familiar music, perhaps most readily revealed by popular "name that tune" games, in which listeners often succeed in recognizing a familiar song based on extremely brief presentation. In this work, we used electroencephalography (EEG) and pupillometry to reveal the temporal signatures of the brain processes that allow differentiation between a familiar, well liked, and unfamiliar piece of music. In contrast to previous work, which has quantified gradual changes in pupil diameter (the so-called "pupil dilation response"), here we focus on the occurrence of pupil dilation events. This approach is substantially more sensitive in the temporal domain and allowed us to tap early activity with the putative salience network. Participants (N = 10) passively listened to snippets (750 ms) of a familiar, personally relevant and, an acoustically matched, unfamiliar song, presented in random order. A group of control participants (N = 12), who were unfamiliar with all of the songs, was also tested. We reveal a rapid differentiation between snippets from familiar and unfamiliar songs: Pupil responses showed greater dilation rate to familiar music from 100-300 ms post-stimulus-onset, consistent with a faster activation of the autonomic salience network. Brain responses measured with EEG showed a later differentiation between familiar and unfamiliar music from 350 ms post onset. Remarkably, the cluster pattern identified in the EEG response is very similar to that commonly found in the classic old/new memory retrieval paradigms, suggesting that the recognition of brief, randomly presented, music snippets, draws on similar processes. |
Woojae Jeong; Seolmin Kim; Yee-Joon Kim; Joonyeol Lee Motion direction representation in multivariate electroencephalography activity for smooth pursuit eye movements Journal Article In: NeuroImage, vol. 202, pp. 116160, 2019. @article{Jeong2019, Visually-guided smooth pursuit eye movements are composed of initial open-loop and later steady-state periods. Feedforward sensory information dominates the motor behavior during the open-loop pursuit, and a more complex feedback loop regulates the steady-state pursuit. To understand the neural representations of motion direction during open-loop and steady-state smooth pursuits, we recorded electroencephalography (EEG) responses from human observers while they tracked random-dot kinematograms as pursuit targets. We estimated population direction tuning curves from multivariate EEG activity using an inverted encoding model. We found significant direction tuning curves as early as about 60 ms from stimulus onset. Direction tuning responses were generalized to later times during the open-loop smooth pursuit, but they became more dynamic during the later steady-state pursuit. The encoding quality of retinal motion direction information estimated from the early direction tuning curves was predictive of trial-by-trial variation in initial pursuit directions. These results suggest that the movement directions of open-loop smooth pursuit are guided by the representation of the retinal motion present in the multivariate EEG activity. |
Jianrong Jia; Fang Fang; Huan Luo Selective spatial attention involves two alpha-band components associated with distinct spatiotemporal and functional characteristics Journal Article In: NeuroImage, vol. 199, pp. 228–236, 2019. @article{Jia2019, Attention is crucial for efficiently coordinating resources over multiple objects in a visual scene. Recently, a growing number of studies suggest that attention is implemented through a temporal organization process during which resources are dynamically allocated over a multitude of objects, yet the associated neural evidence, particularly in low-level sensory areas, is still limited. Here we used EEG recordings in combination with a temporal response function (TRF) approach to examine the spatiotemporal characteristics of neuronal impulse response in covert selective attention. We demonstrate two distinct alpha-band components – one in post-central parietal area and one in contralateral occipital area – that are involved in coordinating neural representations of attended and unattended stimuli. Specifically, consistent with previous findings, the central alpha-band component showed enhanced activities for unattended versus attended stimuli within the first 200 ms temporal lag of TRF response, suggesting its inhibitory function in attention. In contrast, the contralateral occipital component displayed relatively earlier activation for the attended than unattended one in the TRF response. Furthermore, the central component but not the occipital component was correlated with attentional behavioral performance. Finally, the parietal area exerted directional influences on the occipital activity through alpha-band rhythm. Taken together, spatial attention involves two hierarchically organized alpha-band components that are associated with distinct spatiotemporal characteristics and presumably play different functions. |
Han-Gue Gue Jo; Thilo Kellermann; Conrad Baumann; Junji Ito; Barbara Schulte Holthausen; Frank Schneider; Sonja Grün; Ute Habel Distinct modes of top-down cognitive processing in the ventral visual cortex Journal Article In: NeuroImage, vol. 193, pp. 201–213, 2019. @article{Jo2019, Top-down cognitive control leads to changes in the sensory processing of the brain. In visual perception such changes can take place in the ventral visual cortex altering the functional asymmetry in forward and backward connections. Here we used fixation-related evoked responses of EEG measurement and dynamic causal modeling to examine hierarchical forward-backward asymmetry, while twenty-six healthy adults performed cognitive tasks that require different types of top-down cognitive control (memorizing or searching visual objects embedded in a natural scene image). The generative model revealed an enhanced asymmetry toward forward connections during memorizing, whereas enhanced backward connections were found during searching. This task-dependent modulation of forward and backward connections suggests two distinct modes of top-down cognitive processing in cortical networks. The alteration in forward-backward asymmetry might underlie the functional role in the cognitive control of visual information processing. |