EyeLink Usability / Applied Publications
All EyeLink usability and applied research publications up until 2023 (with some early 2024s) are listed below by year. You can search the publications using keywords such as Driving, Sport, Workload, etc. You can also search for individual author names. If we missed any EyeLink usability or applied article, please email us!
2018 |
Naoyuki Sato; Hiroaki Mizuhara Successful encoding during natural reading is associated with fixation-related potentials and large-scale network deactivation Journal Article In: eNeuro, vol. 5, no. 5, pp. 1–12, 2018. @article{Sato2018, Reading literature (e.g., an entire book) is an enriching experience that qualitatively differs from reading a single sentence; however, the brain dynamics of such context-dependent memory remains unclear. This study aimed to elucidate mnemonic neural dynamics during natural reading of literature by performing electroencephalogram (EEG) and functional magnetic resonance imaging (fMRI). Brain activities of human participants recruited on campus were correlated with their subsequent memory, which was quantified by semantic correlation between the read text and reports subsequently written by them based on state of the art natural language processing procedures. The results of the EEG data analysis showed a significant positive relationship between subsequent memory and fixation-related EEG. Sentence-length and paragraph-length mnemonic processes were associated with N1-P2 and P3 fixation-related potential (FRP) components and fixation-related θ-band (4–8 Hz) EEG power, respectively. In contrast, the results of fMRI analysis showed a significant negative relationship between subsequent memory and blood oxygenation level-dependent (BOLD) activation. Sentence-length and paragraph-length mnemonic processes were associated with networks of regions forming part of the salience network and the default mode network (DMN), respectively. Taken together with the EEG results, these memory-related deactivations in the salience network and the DMN were thought to reflect the reading of sentences characterized by low mnemonic load and the suppression of task-irreverent thoughts, respectively. It was suggested that the context-dependent mnemonic process during literature reading requires large-scale network deactivation, which might reflect coordination of a range of voluntary processes during reading. |
Brian Scally; Melanie R. Burke; David Bunce; Jean Francois Delvenne Visual and visuomotor interhemispheric transfer time in older adults Journal Article In: Neurobiology of Aging, vol. 65, pp. 69–76, 2018. @article{Scally2018, Older adults typically experience reductions in the structural integrity of the anterior channels of the corpus callosum. Despite preserved structural integrity in central and posterior channels, many studies have reported that interhemispheric transfer, a function attributed to these regions, is detrimentally affected by aging. In this study, we use a constrained event-related potential analysis in the theta and alpha frequency bands to determine whether interhemispheric transfer is affected in older adults. The crossed-uncrossed difference and lateralized visual evoked potentials were used to assess interhemispheric transfer in young (18–27) and older adults (63–80). We observed no differences in the crossed-uncrossed difference measure between young and older groups. Older adults appeared to have elongated transfer in the theta band potentials, but this effect was driven by shortened contralateral peak latencies, rather than delayed ipsilateral latencies. In the alpha band, there was a trend toward quicker transfer in older adults. We conclude that older adults do not experience elongated interhemispheric transfer in the visuomotor or visual domains and that these functions are likely attributed to posterior sections of the corpus callosum, which are unaffected by aging. |
K. Seeliger; Matthias Fritsche; U. Güçlü; S. Schoenmakers; J. M. Schoffelen; S. E. Bosch; Marcel A. J. Gerven Convolutional neural network-based encoding and decoding of visual object recognition in space and time Journal Article In: NeuroImage, vol. 180, pp. 253–266, 2018. @article{Seeliger2018, Representations learned by deep convolutional neural networks (CNNs) for object recognition are a widely investigated model of the processing hierarchy in the human visual system. Using functional magnetic resonance imaging, CNN representations of visual stimuli have previously been shown to correspond to processing stages in the ventral and dorsal streams of the visual system. Whether this correspondence between models and brain signals also holds for activity acquired at high temporal resolution has been explored less exhaustively. Here, we addressed this question by combining CNN-based encoding models with magnetoencephalography (MEG). Human participants passively viewed 1,000 images of objects while MEG signals were acquired. We modelled their high temporal resolution source-reconstructed cortical activity with CNNs, and observed a feed-forward sweep across the visual hierarchy between 75 and 200 ms after stimulus onset. This spatiotemporal cascade was captured by the network layer representations, where the increasingly abstract stimulus representation in the hierarchical network model was reflected in different parts of the visual cortex, following the visual ventral stream. We further validated the accuracy of our encoding model by decoding stimulus identity in a left-out validation set of viewed objects, achieving state-of-the-art decoding accuracy. |
Adam C. Snyder; Deepa Issar; Matthew A. Smith What does scalp electroencephalogram coherence tell us about long-range cortical networks? Journal Article In: European Journal of Neuroscience, pp. 1–16, 2018. @article{Snyder2018, Long-range interactions between cortical areas are undoubtedly a key to the computational power of the brain. For healthy human subjects, the premier method for measuring brain activity on fast timescales is electroencephalography (EEG), and coherence between EEG signals is often used to assay functional connectivity between different brain regions. However, the nature of the underlying brain activity that is reflected in EEG coherence is currently the realm of speculation, because seldom have EEG signals been recorded simultaneously with intracranial recordings near cell bodies in multiple brain areas. Here, we take the early steps towards narrowing this gap in our understanding of EEG coherence by measuring local field potentials with microelectrode arrays in two brain areas (extrastriate visual area V4 and dorsolateral prefrontal cortex) simultaneously with EEG at the nearby scalp in rhesus macaque monkeys. Although we found inter-area coherence at both scales of measurement, we did not find that scalp-level coherence was reliably related to coherence between brain areas measured intracranially on a trial-to-trial basis, despite that scalp-level EEG was related to other important features of neural oscillations, such as trial-to-trial variability in overall amplitudes. This suggests that caution must be exercised when interpreting EEG coherence effects, and new theories devised about what aspects of neural activity long-range coherence in the EEG reflects. |
Rodolfo Solís-Vivanco; Ole Jensen; Mathilde Bonnefond Top–down control of alpha phase adjustment in anticipation of temporally predictable visual stimuli Journal Article In: Journal of Cognitive Neuroscience, vol. 30, no. 8, pp. 1157–1169, 2018. @article{SolisVivanco2018, Alpha oscillations (8–14 Hz) are proposed to represent an active mechanism of functional inhibition of neuronal processing. Specifically, alpha oscillations are associated with pulses of inhibition repeating every ∼100 msec. Whether alpha phase, similar to alpha power, is under top–down control remains unclear. Moreover, the sources of such putative top–down phase control are unknown. We designed a cross-modal (visual/auditory) attention study in which we used magnetoencephalography to record the brain activity from 34 healthy participants. In each trial, a somatosensory cue indicated whether to attend to either the visual or auditory domain. The timing of the stimulus onset was predictable across trials. We found that, when visual information was attended, anticipatory alpha power was reduced in visual areas, whereas the phase adjusted just before the stimulus onset. Performance in each modality was predicted by the phase of the alpha oscillations previous to stimulus onset. Alpha oscillations in the left pFC appeared to lead the adjustment of alpha phase in visual areas. Finally, alpha phase modulated stimulus-induced gamma activity. Our results confirm that alpha phase can be top–down adjusted in anticipation of predictable stimuli and improve performance. Phase adjustment of the alpha rhythm might serve as a neurophysiological resource for optimizing visual processing when temporal predictions are possible and there is considerable competition between target and distracting stimuli. |
Tobias Staudigl; Marcin Leszczynski; Joshua Jacobs; Sameer A. Sheth; Charles E. Schroeder; Ole Jensen; Christian F. Doeller Hexadirectional modulation of high-frequency electrophysiological activity in the human anterior medial temporal lobe maps visual space Journal Article In: Current Biology, vol. 28, pp. 1–5, 2018. @article{Staudigl2018, Grid cells are one of the core building blocks of spatial navigation [1]. Single-cell recordings of grid cells in the rodent entorhinal cortex revealed hexagonal coding of the local environment during spatial navigation [1]. Grid-like activity has also been identified in human single-cell recordings during virtual navigation [2]. Human fMRI studies further provide evidence that grid-like signals are also accessible on a macroscopic level [3–7]. Studies in both nonhuman primates [8] and humans [9, 10] suggest that grid-like coding in the entorhinal cortex generalizes beyond spatial navigation during locomotion, providing evidence for grid-like mapping of visual space during visual exploration—akin to the grid cell positional code in rodents during spatial navigation. However, electrophysiological correlates of the grid code in humans remain unknown. Here, we provide evidence for grid-like, hexadirectional coding of visual space by human high-frequency activity, based on two independent datasets: non-invasive magnetoencephalography (MEG) in healthy subjects and entorhinal intracranial electroencephalography (EEG) recordings in an epileptic patient. Both datasets consistently show a hexadirectional modulation of broadband high-frequency activity (60–120 Hz). Our findings provide first evidence for a grid-like MEG signal, indicating that the human entorhinal cortex codes visual space in a grid-like manner [8–10], and support the view that grid coding generalizes beyond environmental mapping during locomotion [4–6, 11]. Due to their millisecond accuracy, MEG recordings allow linking of grid-like activity to epochs during relevant behavior, thereby opening up the possibility for new MEG-based investigations of grid coding at high temporal resolution. |
Noam Tal; Shlomit Yuval-Greenberg Reducing saccadic artifacts and confounds in brain imaging studies through experimental design Journal Article In: Psychophysiology, vol. 55, no. 11, pp. e13215, 2018. @article{Tal2018, Saccades constitute a major source of artifacts and confounds in brain imaging studies. Whereas some artifacts can be removed by omitting segments of data, saccadic artifacts cannot be typically eliminated by this method because of their high occurrence rate even during fixation (1–3 per second). Some saccadic artifacts can be alleviated by offline-correction algorithms, but these methods leave nonnegligible residuals and cannot mitigate the saccade-related visual activity. Here, we propose a novel yet simple approach for diminishing saccadic artifacts and confounds through experimental design. We suggest that specific tasks can lead to substantially less saccade occurrences around the time of stimulus presentation, starting from slightly before its onset and lasting for a few hundred milliseconds. In three experiments, we compared the frequency and size of saccades in a variety of tasks. Results of Experiment 1 showed that a foveal change-detection task reduced the number and sizes of saccades, relative to a parafoveal orientation-discrimination task. Experiment 2 replicated this finding with a parafoveal object recognition task. Experiment 3 showed that both foveal and parafoveal continuous change detection tasks induced fewer and smaller saccades than a discrete orientation-discrimination task. We conclude that adding a foveal or a parafoveal continuous task reduces saccades' number and size. This would lead to better artifact correction and enable the omission of contaminated data segments. This study may be the first step toward developing saccade-free experimental designs. |
Nina N. Thigpen; L. Forest Gruss; Steven Garcia; David R. Herring; Andreas Keil What does the dot-probe task measure? A reverse correlation analysis of electrocortical activity Journal Article In: Psychophysiology, vol. 55, no. 6, pp. e13058, 2018. @article{Thigpen2018, The dot-probe task is considered a gold standard for assessing the intrinsic attentive selection of one of two lateralized visual cues, measured by the response time to a subsequent, lateralized response probe. However, this task has recently been associated with poor reliability and conflicting results. To resolve these discrepancies, we tested the underlying assumption of the dot-probe task-that fast probe responses index heightened cue selection-using an electrophysiological measure of selective attention. Specifically, we used a reverse correlation approach in combination with frequency-tagged steady-state visual potentials (ssVEPs). Twenty-one participants completed a modified dot-probe task in which each member of a pair of lateralized face cues, varying in emotional expression (angry-angry, neutral-angry, neutral-neutral), flickered at one of two frequencies (15 or 20 Hz), to evoke ssVEPs. One cue was then replaced by a response probe, and participants indicated the probe orientation (0° or 90°). We analyzed the ssVEP evoked by the cues as a function of response speed to the subsequent probe (i.e., a reverse correlation analysis). Electrophysiological measures of cue processing varied with probe hemifield location: Faster responses to left probes were associated with weak amplification of the preceding left cue, apparent only in a median split analysis. By contrast, faster responses to right probes were systematically and parametrically predicted by diminished visuocortical selection of the preceding right cue. Together, these findings highlight the poor validity of the dot-probe task, in terms of quantifying intrinsic, nondirected attentive selection irrespective of probe/cue location. |
Nathalie Van Humbeeck; Radha Nila Meghanathan; Johan Wagemans; Cees Leeuwen; Andrey R. Nikolaev Presaccadic EEG activity predicts visual saliency in free-viewing contour integration Journal Article In: Psychophysiology, vol. 55, no. 12, pp. e13267, 2018. @article{VanHumbeeck2018, While viewing a scene, the eyes are attracted to salient stimuli. We set out to identify the brain signals controlling this process. In a contour integration task, in which participants searched for a collinear contour in a field of randomly oriented Gabor elements, a previously established model was applied to calculate a visual saliency value for each fixation location. We studied brain activity related to the modeled saliency values, using coregistered eye tracking and EEG. To disentangle EEG signals reflecting salience in free viewing from overlapping EEG responses to sequential eye movements, we adopted generalized additive mixed modeling (GAMM) to single epochs of saccade‐related EEG. We found that, when saliency at the next fixation location was high, amplitude of the presaccadic EEG activity was low. Since presaccadic activity reflects covert attention to the saccade target, our results indicate that larger attentional effort is needed for selecting less salient saccade targets than more salient ones. This effect was prominent in contour‐present conditions (half of the trials), but ambiguous in the contour‐absent condition. Presaccadic EEG activity may thus be indicative of bottom‐up factors in saccade guidance. The results underscore the utility of GAMM for EEG—eye movement coregistration research. |
Martin Völker; Lukas D. J. Fiederer; Sofie Berberich; Jiří Hammer; Joos Behncke; Pavel Kršek; Martin Tomášek; Petr Marusič; Peter C. Reinacher; Volker A. Coenen; Moritz Helias; Andreas Schulze-Bonhage; Wolfram Burgard; Tonio Ball The dynamics of error processing in the human brain as reflected by high-gamma activity in noninvasive and intracranial EEG Journal Article In: NeuroImage, vol. 173, no. 2018, pp. 564–579, 2018. @article{Voelker2018, Error detection in motor behavior is a fundamental cognitive function heavily relying on local cortical information processing. Neural activity in the high-gamma frequency band (HGB) closely reflects such local cortical processing, but little is known about its role in error processing, particularly in the healthy human brain. Here we characterize the error-related response of the human brain based on data obtained with noninvasive EEG optimized for HGB mapping in 31 healthy subjects (15 females, 16 males), and additional intracranial EEG data from 9 epilepsy patients (4 females, 5 males). Our findings reveal a multiscale picture of the global and local dynamics of error-related HGB activity in the human brain. On the global level as reflected in the noninvasive EEG, the error-related response started with an early component dominated by anterior brain regions, followed by a shift to parietal regions, and a subsequent phase characterized by sustained parietal HGB activity. This phase lasted for more than 1 s after the error onset. On the local level reflected in the intracranial EEG, a cascade of both transient and sustained error-related responses involved an even more extended network, spanning beyond frontal and parietal regions to the insula and the hippocampus. HGB mapping appeared especially well suited to investigate late, sustained components of the error response, possibly linked to downstream functional stages such as error-related learning and behavioral adaptation. Our findings establish the basic spatio-temporal properties of HGB activity as a neural correlate of error processing, complementing traditional error-related potential studies. |
Julia Habicht; Mareike Finke; Tobias Neher Auditory acclimatization to bilateral hearing aids: Effects on sentence-in-noise processing times and speech-evoked potentials Journal Article In: Ear & Hearing, vol. 39, no. 1, pp. 161–171, 2018. @article{Habicht2018, Objectives: Using a longitudinal design, the present study sought to substantiate indications from two previous cross-sectional studies that hearing aid (HA) experience leads to improved speech processing abilities as quantified using eye-gaze measurements. Another aim was to explore potential concomitant changes in event-related potentials (ERPs) to speech stimuli. Design: Groups of elderly novice (novHA) and experienced (expHA) HA users matched in terms of age and working memory capacity participated. The novHA users were acclimatized to bilateral HA fittings for up to 24 weeks. The expHA users continued to use their own HAs during the same period. The participants' speech processing abilities were assessed after 0 weeks (novHA: N = 16; expHA: N = 14), 12 weeks (novHA: N = 16; expHA: N = 14), and 24 weeks (N = 10 each). To that end, an eye-tracking paradigm was used for estimating how quickly the participants could grasp the meaning of sentences presented against background noise together with two similar pictures that either correctly or incorrectly depicted the meaning conveyed by the sentences (the “processing time”). Additionally, ERPs were measured with an active oddball paradigm requiring the participants to categorize word stimuli as living (targets) or nonliving (nontargets) entities. For all measurements, the stimuli were spectrally shaped according to individual real-ear insertion gains and presented via earphones. Results: Concerning the processing times, no changes across time were found for the expHA group. After 0 weeks of HA use, the novHA group had significantly longer (poorer) processing times than the expHA group, consistent with previous findings. After 24 weeks, a significant mean improvement of ~30% was observed for the novHA users, leading to a performance comparable with that of the expHA group. Concerning the ERPs, no changes across time were found. Conclusions: The results from this exploratory study are consistent with the view that auditory acclimatization to HAs positively impacts speech comprehension in noise. Further research is needed to substantiate them. |
Wei He; Blake W. Johnson Development of face recognition: Dynamic causal modelling of MEG data Journal Article In: Developmental Cognitive Neuroscience, vol. 30, pp. 13–22, 2018. @article{He2018, Electrophysiological studies of adults indicate that brain activity is enhanced during viewing of repeated faces, at a latency of about 250 ms after the onset of the face (M250/N250). The present study aimed to determine if this effect was also present in preschool-aged children, whose brain activity was measured in a custom-sized pediatric MEG system. The results showed that, unlike adults, face repetition did not show any significant modulation of M250 amplitude in children; however children's M250 latencies were significantly faster for repeated than non-repeated faces. Dynamic causal modelling (DCM) of the M250 in both age groups tested the effects of face repetition within the core face network including the occipital face area (OFA), the fusiform face area (FFA), and the superior temporal sulcus (STS). DCM revealed that repetition of identical faces altered both forward and backward connections in children and adults; however the modulations involved inputs to both FFA and OFA in adults but only to OFA in children. These findings suggest that the amplitude-insensitivity of the immature M250 may be due to a weaker connection between the FFA and lower visual areas. |
Simone G. Heideman; Gustavo Rohenkohl; Joshua J. Chauvin; Clare E. Palmer; Freek Ede; Anna C. Nobre Anticipatory neural dynamics of spatial-temporal orienting of attention in younger and older adults Journal Article In: NeuroImage, vol. 178, pp. 46–56, 2018. @article{Heideman2018a, Spatial and temporal expectations act synergistically to facilitate visual perception. In the current study, we sought to investigate the anticipatory oscillatory markers of combined spatial-temporal orienting and to test whether these decline with ageing. We examined anticipatory neural dynamics associated with joint spatial-temporal orienting of attention using magnetoencephalography (MEG) in both younger and older adults. Participants performed a cued covert spatial-temporal orienting task requiring the discrimination of a visual target. Cues indicated both where and when targets would appear. In both age groups, valid spatial-temporal cues significantly enhanced perceptual sensitivity and reduced reaction times. In the MEG data, the main effect of spatial orienting was the lateralised anticipatory modulation of posterior alpha and beta oscillations. In contrast to previous reports, this modulation was not attenuated in older adults; instead it was even more pronounced. The main effect of temporal orienting was a bilateral suppression of posterior alpha and beta oscillations. This effect was restricted to younger adults. Our results also revealed a striking interaction between anticipatory spatial and temporal orienting in the gamma-band (60–75 Hz). When considering both age groups separately, this effect was only clearly evident and only survived statistical evaluation in the older adults. Together, these observations provide several new insights into the neural dynamics supporting separate as well as combined effects of spatial and temporal orienting of attention, and suggest that different neural dynamics associated with attentional orienting appear differentially sensitive to ageing. |
Simone G. Heideman; Freek Ede; Anna C. Nobre Early behavioural facilitation by temporal expectations in complex visual-motor sequences Journal Article In: Neuroscience, vol. 389, pp. 74–84, 2018. @article{Heideman2018b, In daily life, temporal expectations may derive from incidental learning of recurring patterns of intervals. We investigated the incidental acquisition and utilisation of combined temporal-ordinal (spatial/effector) structure in complex visual-motor sequences using a modified version of a serial reaction time (SRT) task. In this task, not only the series of targets/responses, but also the series of intervals between subsequent targets was repeated across multiple presentations of the same sequence. Each participant completed three sessions. In the first session, only the repeating sequence was presented. During the second and third session, occasional probe blocks were presented, where a new (unlearned) spatial-temporal sequence was introduced. We first confirm that participants not only got faster over time, but that they were slower and less accurate during probe blocks, indicating that they incidentally learned the sequence structure. Having established a robust behavioural benefit induced by the repeating spatial-temporal sequence, we next addressed our central hypothesis that implicit temporal orienting (evoked by the learned temporal structure) would have the largest influence on performance for targets following short (as opposed to longer) intervals between temporally structured sequence elements, paralleling classical observations in tasks using explicit temporal cues. We found that indeed, reaction time differences between new and repeated sequences were largest for the short interval, compared to the medium and long intervals, and that this was the case, even when comparing late blocks (where the repeated sequence had been incidentally learned), to early blocks (where this sequence was still unfamiliar). We conclude that incidentally acquired temporal expectations that follow a sequential structure can have a robust facilitatory influence on visually-guided behavioural responses and that, like more explicit forms of temporal orienting, this effect is most pronounced for sequence elements that are expected at short inter-element intervals. |
Simone G. Heideman; Freek Ede; Anna C. Nobre Temporal alignment of anticipatory motor cortical beta lateralisation in hidden visual-motor sequences Journal Article In: European Journal of Neuroscience, vol. 48, no. 8, pp. 2684–2695, 2018. @article{Heideman2018, Performance improves when participants respond to events that are structured in repeating sequences, suggesting that learning can lead to proactive anticipatory preparation. Whereas most sequence-learning studies have emphasised spatial structure, most sequences also contain a prominent temporal structure. We used MEG to investigate spatial and temporal anticipatory neural dynamics in a modified serial reaction time (SRT) task. Performance and brain activity were compared between blocks with learned spatial-temporal sequences and blocks with new sequences. After confirming a strong behavioural benefit of spatial-temporal predictability, we show lateralisation of beta oscillations in anticipation of the response associated with the upcoming target location and show that this also aligns to the expected timing of these forthcoming events. This effect was found both when comparing between repeated (learned) and new (unlearned) sequences, as well as when comparing targets that were expected after short vs. long intervals within the repeated (learned) sequence. Our findings suggest that learning of spatial-temporal structure leads to proactive and dynamic modulation of motor cortical excitability in anticipation of both the location and timing of events that are relevant to guide action. |
Jenni Heikkilä; Kaisa Tiippana; Otto Loberg; Paavo H. T. Leppänen Neural processing of congruent and incongruent audiovisual speech in school-age children and adults Journal Article In: Language Learning, vol. 68, pp. 58–79, 2018. @article{Heikkilae2018, Seeing articulatory gestures enhances speech perception. Perception ofauditory speech can even be changed by incongruent visual gestures, which is known as the McGurk effect (e.g., dubbing a voice saying /mi/ onto a face articulating /ni/, observers often hear /ni/). In children, the McGurk effect is weaker than in adults, but no previous knowledge exists about the neural-level correlates of the McGurk effect in school-age children. Using brain event-related potentials, we investigated change detection responses to congruent and incongruent audiovisual speech in school-age children and adults. We used an oddball paradigm with a congruent audiovisual /mi/ as the standard stimulus and a congruent audiovisual /ni/ or McGurk A/mi/V/ni/ as the deviant stimulus. In adults, a similar change detection response was elicited by both deviant stimuli. In children, change detection responses differed between the congruent and the McGurk stimulus. This reflects a maturational difference in the influence of visual stimuli on auditory processing. |
Hannah Hiebel; Anja Ischebeck; Clemens Brunner; Andrey R. Nikolaev; Margit Höfler; Christof Körner Target probability modulates fixation-related potentials in visual search Journal Article In: Biological Psychology, vol. 138, pp. 199–210, 2018. @article{Hiebel2018, This study investigated the influence of target probability on the neural response to target detection in free viewing visual search. Participants were asked to indicate the number of targets (one or two) among distractors in a visual search task while EEG and eye movements were co-registered. Target probability was manipulated by varying the set size of the displays between 10, 22, and 30 items. Fixation-related potentials time-locked to first target fixations revealed a pronounced P300 at the centro-parietal cortex with larger amplitudes for set sizes 22 and 30 than for set size 10. With increasing set size, more distractor fixations preceded the detection of the target, resulting in a decreased target probability and, consequently, a larger P300. For distractors, no increase of P300 amplitude with set size was observed. The findings suggest that set size specifically affects target but not distractor processing in overt serial visual search. |
Rinat Hilo-Merkovich; Marisa Carrasco; Shlomit Yuval-Greenberg Task performance in covert, but not overt, attention correlates with early laterality of visual evoked potentials Journal Article In: Neuropsychologia, vol. 119, pp. 330–339, 2018. @article{HiloMerkovich2018, Attention affects visual perception at target locations via the amplification of stimuli signal strength, perceptual performance and perceived contrast. Behavioral and neural correlates of attention can be observed when attention is both covertly and overtly oriented (with or without accompanying eye movements). Previous studies have demonstrated that at the grand-average level, lateralization of Event Related Potentials (ERP) is associated with attentional facilitation at cued, relative to un-cued locations. Yet, the correspondence between ERP lateralization and behavior has not been established at the single-subject level. Specifically, it is an open question whether inter-individual differences in the neural manifestation of attentional orienting can predict differences in perception. Here, we addressed this question by examining the correlation between ERP lateralization and visual sensitivity at attended locations. Participants were presented with a cue indicating where a low-contrast grating patch target will appear, following a delay of varying durations. During this delay, while participants were waiting for the target to appear, a task-irrelevant checkerboard probe was presented briefly and bilaterally. ERP was measured relative to the onset of this probe. In separate blocks, participants were requested to report detection of a low-contrast target either by making a fast eye-movement toward the target (overt orienting), or by pressing a button (covert orienting). Results show that in the covert orienting condition, ERP lateralization of individual participants was positively correlated with their mean visual sensitivity for the target. But, no such correlation was found in the overt orienting condition. We conclude that ERP lateralization of individual participants can predict their performance on a covert, but not an overt, target detection task. |
Nora Hollenstein; Jonathan Rotsztejn; Marius Troendle; Andreas Pedroni; Ce Zhang; Nicolas Langer Data descriptor: ZuCo, a simultaneous EEG and eye-tracking resource for natural sentence reading Journal Article In: Scientific Data, vol. 5, pp. 180291, 2018. @article{Hollenstein2018, We present the Zurich Cognitive Language Processing Corpus (ZuCo), a dataset combining electroencephalography (EEG) and eye-tracking recordings from subjects reading natural sentences. ZuCo includes high-density EEG and eye-tracking data of 12 healthy adult native English speakers, each reading natural English text for 4–6 hours. The recordings span two normal reading tasks and one task-specific reading task, resulting in a dataset that encompasses EEG and eye-tracking data of 21,629 words in 1107 sentences and 154,173 fixations. We believe that this dataset represents a valuable resource for natural language processing (NLP). The EEG and eye-tracking signals lend themselves to train improved machine- learning models for various tasks, in particular for information extraction tasks such as entity and relation extraction and sentiment analysis. Moreover, this dataset is useful for advancing research into the human reading and language understanding process at the level of brain activity and eye-movement. |
Leyla Isik; Jedediah M. Singer; Joseph R. Madsen; Nancy Kanwisher; Gabriel Kreiman What is changing when: Decoding visual information in movies from human intracranial recordings Journal Article In: NeuroImage, vol. 180, pp. 147–159, 2018. @article{Isik2018, The majority of visual recognition studies have focused on the neural responses to repeated presentations of static stimuli with abrupt and well-defined onset and offset times. In contrast, natural vision involves unique renderings of visual inputs that are continuously changing without explicitly defined temporal transitions. Here we considered commercial movies as a coarse proxy to natural vision. We recorded intracranial field potential signals from 1,284 electrodes implanted in 15 patients with epilepsy while the subjects passively viewed commercial movies. We could rapidly detect large changes in the visual inputs within approximately 100 ms of their occurrence, using exclusively field potential signals from ventral visual cortical areas including the inferior temporal gyrus and inferior occipital gyrus. Furthermore, we could decode the content of those visual changes even in a single movie presentation, generalizing across the wide range of transformations present in a movie. These results present a methodological framework for studying cognition during dynamic and natural vision. |
Roxane J. Itier; Frank F. Preston Increased early sensitivity to eyes in mouthless faces: In support of the LIFTED model of early face processing Journal Article In: Brain Topography, vol. 31, no. 6, pp. 972–984, 2018. @article{Itier2018, The N170 ERP component is a central neural marker of early face perception usually thought to reflect holistic processing. However, it is also highly sensitive to eyes presented in isolation and to fixation on the eyes within a full face. The lateral inhibition face template and eye detector (LIFTED) model (Nemrodov et al. in NeuroImage 97:81–94, 2014) integrates these views by proposing a neural inhibition mechanism that perceptually glues features into a whole, in parallel to the activ- ity of an eye detector that accounts for the eye sensitivity. The LIFTED model was derived from a large number of results obtained with intact and eyeless faces presented upright and inverted. The present study provided a control condition to the original design by replacing eyeless with mouthless faces, hereby enabling testing of specific predictions derived from the model. Using the same gaze-contingent approach, we replicated the N170 eye sensitivity regardless of face orientation. Furthermore, when eyes were fixated in upright faces, the N170 was larger for mouthless compared to intact faces, while inverted mouthless faces elicited smaller amplitude than intact inverted faces when fixation was on the mouth and nose. The results are largely in line with the LIFTED model, in particular with the idea of an inhibition mechanism involved in holistic processing of upright faces and the lack of such inhibition in processing inverted faces. Some modifications to the original model are also proposed based on these results. |
Peiqing Jin; Jiajie Zou; Tao Zhou; Nai Ding Eye activity tracks task-relevant structures during speech and auditory sequence perception Journal Article In: Nature Communications, vol. 9, pp. 5374, 2018. @article{Jin2018a, The sensory and motor systems jointly contribute to complex behaviors, but whether motor systems are involved in high-order perceptual tasks such as speech and auditory comprehension remain debated. Here, we show that ocular muscle activity is synchronized to mentally constructed sentences during speech listening, in the absence of any sentence-related visual or prosodic cue. Ocular tracking of sentences is observed in the vertical electrooculogram (EOG), whether the eyes are open or closed, and in eye blinks measured by eyetracking. Critically, the phase of sentence-tracking ocular activity is strongly modulated by temporal attention, i.e., which word in a sentence is attended. Ocular activity also tracks high-level structures in non-linguistic auditory and visual sequences, and captures rapid fluctuations in temporal attention. Ocular tracking of non-visual rhythms possibly reflects global neural entrainment to task-relevant temporal structures across sensory and motor areas, which could serve to implement temporal attention and coordinate cortical networks. |
Juan E. Kamienkowski; Alexander Varatharajah; Mariano Sigman; Matias J. Ison Parsing a mental program: Fixation-related brain signatures of unitary operations and routines in natural visual search Journal Article In: NeuroImage, vol. 183, pp. 73–86, 2018. @article{Kamienkowski2018a, Visual search involves a sequence or routine of unitary operations (i.e. fixations) embedded in a larger mental global program. The process can indeed be seen as a program based on a while loop (while the target is not found), a conditional construct (whether the target is matched or not based on specific recognition algorithms) and a decision making step to determine the position of the next searched location based on existent evidence. Recent developments in our ability to co-register brain scalp potentials (EEG) during free eye movements has allowed investigating brain responses related to fixations (fixation-Related Potentials; fERPs), including the identification of sensory and cognitive local EEG components linked to individual fixations. However, the way in which the mental program guiding the search unfolds has not yet been investigated. We performed an EEG and eye tracking co-registration experiment in which participants searched for a target face in natural images of crowds. Here we show how unitary steps of the program are encoded by specific local target detection signatures and how the positioning of each unitary operation within the global search program can be pinpointed by changes in the EEG signal amplitude as well as the signal power in different frequency bands. By simultaneously studying brain signatures of unitary operations and those occurring during the sequence of fixations, our study sheds light into how local and global properties are combined in implementing visual routines in natural tasks. |
Carina Kelbsch; Archana Jalligampala; Torsten Strasser; Paul Richter; Katarina Stingl; Christoph Braun; Daniel L. Rathbun; Eberhart Zrenner; Helmut Wilhelm; Barbara Wilhelm; Tobias Peters; Krunoslav Stingl Phosphene perception and pupillary responses to sinusoidal electrostimulation - For an objective measurement of retinal function Journal Article In: Experimental Eye Research, vol. 176, pp. 210–218, 2018. @article{Kelbsch2018, The purpose was to evaluate retinal function by measuring pupillary responses to sinusoidal transcorneal electrostimulation in healthy young human subjects. This work also translates data from analogous in vitro experiments and connects it to the pupillary responses obtained in human experiments. 14 healthy human subjects participated (4 males, 10 females); for the in vitro experiments, two male healthy mouse retinas (adult wild-type C57B/6J) were used. Pupillary responses to sinusoidal transcorneal electrostimulation of varying stimulus carrier frequencies (10, 20 Hz; envelope frequency constantly kept at 1.2 Hz) and intensities (10, 20, 50 μA) were recorded and compared with those obtained with light stimulation (1.2 Hz sinusoidal blue, red light). A strong correlation between the sinusoidal stimulation (electrical as well as light) and the pupillary sinusoidal response was found. The difference between the lag of electrical and light stimulation allowed the estimation of an intensity threshold for pupillary responses to transcorneal electrostimulation (mean ± SD: 30 ± 10 μA (10 Hz); 38 ± 10 μA (20 Hz)). A comparison between the results of the two stimulation frequencies showed a not statistically significant smaller lag for 10 Hz (10 Hz: 633 ± 90 ms; 20 Hz: 725 ± 178 ms; 50 μA intensity). Analogous in vitro experiments on murine retinas indicated a selective stimulation of photoreceptors and bipolar cells (lower frequencies) and retinal ganglion cells (higher frequencies) and lower stimulation thresholds for the retinal network with sinusoidal compared to pulsatile stimulation – emphasizing that sinu- soidal waveforms are well-suited to our purposes. We demonstrate that pupillary responses to sinusoidal transcorneal electrostimulation are measurable as an objective marker in healthy young subjects, even at very low stimulus intensities. By using this unique approach, we unveil the potential for an estimation of the in- dividual intensity threshold and a selective activation of different retinal cell types in humans by varying the stimulation frequency. This technique may have broad clinical utility as well as specific relevance in the monitoring of patients with hereditary retinal disorders, especially as implemented in study protocols for novel therapies, e.g. retinal prostheses or gene therapies. |
Eline R. Kupers; Helena X. Wang; Kaoru Amano; Kendrick N. Kay; David J. Heeger; Jonathan Winawer A non-invasive, quantitative study of broadband spectral responses in human visual cortex Journal Article In: PLoS ONE, vol. 13, no. 3, pp. e0193107, 2018. @article{Kupers2018, Currently, non-invasive methods for studying the human brain do not routinely and reliably measure spike-rate-dependent signals, independent of responses such as hemodynamic coupling (fMRI) and subthreshold neuronal synchrony (oscillations and event-related potentials). In contrast, invasive methods-microelectrode recordings and electrocorticography (ECoG)-have recently measured broadband power elevation in field potentials (~50-200 Hz) as a proxy for locally averaged spike rates. Here, we sought to detect and quantify stimulus-related broadband responses using magnetoencephalography (MEG). Extracranial measurements like MEG and EEG have multiple global noise sources and relatively low signal-to-noise ratios; moreover high frequency artifacts from eye movements can be confounded with stimulus design and mistaken for signals originating from brain activity. For these reasons, we developed an automated denoising technique that helps reveal the broadband signal of interest. Subjects viewed 12-Hz contrast-reversing patterns in the left, right, or bilateral visual field. Sensor time series were separated into evoked (12-Hz amplitude) and broadband components (60-150 Hz). In all subjects, denoised broadband responses were reliably measured in sensors over occipital cortex, even in trials without microsaccades. The broadband pattern was stimulus-dependent, with greater power contralateral to the stimulus. Because we obtain reliable broadband estimates with short experiments (~20 minutes), and with sufficient signal-to-noise to distinguish responses to different stimuli, we conclude that MEG broadband signals, denoised with our method, offer a practical, non-invasive means for characterizing spike-rate-dependent neural activity for addressing scientific questions about human brain function. |
Hause Lin; Blair Saunders; Cendri A. Hutcherson; Michael Inzlicht Midfrontal theta and pupil dilation parametrically track subjective conflict (but also surprise) during intertemporal choice Journal Article In: NeuroImage, vol. 172, pp. 838–852, 2018. @article{Lin2018b, Many everyday choices are based on personal, subjective preferences. When choosing between two options, we often feel conflicted, especially when trading off costs and benefits occurring at different times (e.g., saving for later versus spending now). Although previous work has investigated the neurophysiological basis of conflict during inhibitory control tasks, less is known about subjective conflict resulting from competing subjective preferences. In this pre-registered study, we investigated subjective conflict during intertemporal choice, whereby participants chose between smaller immediate versus larger delayed rewards (e.g., $15 today vs. $22 in 30 days). We used economic modeling to parametrically vary eleven different levels of conflict, and recorded EEG data and pupil dilation. Midfrontal theta power, derived from EEG, correlated with pupil responses, and our results suggest that these signals track different gradations of subjective conflict. Unexpectedly, both signals were also maximally enhanced when decisions were surprisingly easy. Therefore, these signals may track events requiring increased attention and adaptive shifts in behavioral responses, with subjective conflict being only one type of such event. Our results suggest that the neural systems underlying midfrontal theta and pupil responses interact when weighing costs and benefits during intertemporal choice. Thus, understanding these interactions might elucidate how individuals resolve self-control conflicts. |
Mariya E. Manahova; Pim Mostert; Peter Kok; Jan-Mathijs Schoffelen; Floris P. Lange Stimulus familiarity and expectation jointly modulate neural activity in the visual ventral stream Journal Article In: Journal of Cognitive Neuroscience, vol. 30, no. 9, pp. 1366–1377, 2018. @article{Manahova2018, Prior knowledge about the visual world can change how a visual stimulus is processed. Two forms of prior knowledge are often distinguished: stimulus familiarity (i.e., whether a stimulus has been seen before) and stimulus expectation (i.e., whether a stimulus is expected to occur, based on the context). Neurophysiological studies in monkeys have shown suppression of spiking activity both for expected and for familiar items in object-selective inferotemporal cortex. It is an open question, however, if and how these types of knowledge interact in their modulatory effects on the sensory response. To address this issue and to examine whether previous findings generalize to noninvasively measured neural activity in humans, we separately manipulated stimulus familiarity and expectation while noninvasively recording human brain activity using magnetoencephalography. We observed independent suppression of neural activity by familiarity and expectation, specifically in the lateral occipital complex, the putative human homologue of monkey inferotemporal cortex. Familiarity also led to sharpened response dynamics, which was predominantly observed in early visual cortex. Together, these results show that distinct types of sensory knowledge jointly determine the amount of neural resources dedicated to object processing in the visual ventral stream. |
Anna Marzecová; Antonio Schettino; Andreas Widmann; Iria SanMiguel; Sonja A. Kotz; Erich Schröger Attentional gain is modulated by probabilistic feature expectations in a spatial cueing task: ERP evidence Journal Article In: Scientific Reports, vol. 8, pp. 54, 2018. @article{Marzecova2018, Several theoretical and empirical studies suggest that attention and perceptual expectations influence perception in an interactive manner, whereby attentional gain is enhanced for predicted stimuli. The current study assessed whether attention and perceptual expectations interface when they are fully orthogonal, i.e., each of them relates to different stimulus features. We used a spatial cueing task with block-wise spatial attention cues that directed attention to either left or right visual field, in which Gabor gratings of either predicted (more likely) or unpredicted (less likely) orientation were presented. The lateralised posterior N1pc component was additively influenced by attention and perceptual expectations. Bayesian analysis showed no reliable evidence for the interactive effect of attention and expectations on the N1pc amplitude. However, attention and perceptual expectations interactively influenced the frontally distributed anterior N1 component (N1a). The attention effect (i.e., enhanced N1a amplitude in the attended compared to the unattended condition) was observed only for the gratings of predicted orientation, but not in the unpredicted condition. These findings suggest that attention and perceptual expectations interactively influence visual processing within 200 ms after stimulus onset and such joint influence may lead to enhanced endogenous attentional control in the dorsal fronto-parietal attention network. |
Sarah D. McCrackin; Roxane J. Itier Is it about me? Time-course of self-relevance and valence effects on the perception of neutral faces with direct and averted gaze Journal Article In: Biological Psychology, vol. 135, pp. 47–64, 2018. @article{McCrackin2018, Most face processing research has investigated how we perceive faces presented by themselves, but we view faces everyday within a rich social context. Recent ERP research has demonstrated that context cues, including self-relevance and valence, impact electrocortical and emotional responses to neutral faces. However, the time-course of these effects is still unclear, and it is unknown whether these effects interact with the face gaze direction, a cue that inherently contains self-referential information and triggers emotional responses. We primed direct and averted gaze neutral faces (gaze manipulation) with contextual sentences that contained positive or negative opinions (valence manipulation) about the participants or someone else (self-relevance manipulation). In each trial, participants rated how positive or negative, and how affectively aroused, the face made them feel. Eye-tracking ensured sentence reading and face fixation while ERPs were recorded to face presentations. Faces put into self-relevant contexts were more arousing than those in other-relevant contexts, and elicited ERP differences from 150 to 750 ms post-face, encompassing EPN and LPP components. Self-relevance interacted with valence at both the behavioural and ERP level starting 150 ms post-face. Finally, faces put into positive, self-referential contexts elicited different N170 ERP amplitudes depending on gaze direction. Behaviourally, direct gaze elicited more positive valence ratings than averted gaze during positive, self-referential contexts. Thus, self-relevance and valence contextual cues impact visual perception of neutral faces and interact with gaze direction during the earliest stages of face processing. The results highlight the importance of studying face processing within contexts mimicking the complexities of real world interactions. |
Hyojin Park; Robin A. A. Ince; Philippe G. Schyns; Gregor Thut; Joachim Gross In: PLoS Biology, vol. 16, no. 8, pp. e2006558, 2018. @article{Park2018, Integration of multimodal sensory information is fundamental to many aspects of human behavior, but the neural mechanisms underlying these processes remain mysterious. For example, during face-to-face communication, we know that the brain integrates dynamic auditory and visual inputs, but we do not yet understand where and how such integration mechanisms support speech comprehension. Here, we quantify representational interactions between dynamic audio and visual speech signals and show that different brain regions exhibit different types of representational interaction. With a novel information theoretic measure, we found that theta (3-7 Hz) oscillations in the posterior superior temporal gyrus/sulcus (pSTG/S) represent auditory and visual inputs redundantly (i.e., represent common features of the two), whereas the same oscillations in left motor and inferior temporal cortex represent the inputs synergistically (i.e., the instantaneous relationship between audio and visual inputs is also represented). Importantly, redundant coding in the left pSTG/S and synergistic coding in the left motor cortex predict behavior-i.e., speech comprehension performance. Our findings therefore demonstrate that processes classically described as integration can have different statistical properties and may reflect distinct mechanisms that occur in different brain regions to support audiovisual speech comprehension. |
Karisa B. Parkington; Roxane J. Itier One versus two eyes makes a difference! Early face perception is modulated by featural fixation and feature context Journal Article In: Cortex, vol. 109, pp. 35–49, 2018. @article{Parkington2018, The N170 event-related potential component is an early marker of face perception that is particularly sensitive to isolated eye regions and to eye fixations within a face. Here, this eye sensitivity was tested further by measuring the N170 to isolated facial features and to the same features fixated within a face, using a gaze-contingent procedure. The neural response to single isolated eyes and eye regions (two eyes) was also compared. Pixel intensity and contrast were controlled at the global (image) and local (featural) levels. Consistent with previous findings, larger N170 amplitudes were elicited when the left or right eye was fixated within a face, compared to the mouth or nose, demonstrating that the N170 eye sensitivity reflects higher-order perceptual processes and not merely low-level perceptual effects. The N170 was also largest and most delayed for isolated features, compared to equivalent fixations within a face. Specifically, mouth fixation yielded the largest amplitude difference, and nose fixation yielded the largest latency difference between these two contexts, suggesting the N170 may reflect a complex interplay between holistic and featural processes. Critically, eye regions elicited consistently larger and shorter N170 responses compared to single eyes, with enhanced responses for contralat-eral eye content, irrespective of eye or nasion fixation. These results confirm the importance of the eyes in early face perception, and provide novel evidence of an increased sensitivity to the presence of two symmetric eyes compared to only one eye, consistent with a neural eye region detector rather than an eye detector per se. |
Thomas Pfeffer; Arthur Ervin Avramiea; Guido Nolte; Andreas K. Engel; Klaus Linkenkaer-Hansen; Tobias H. Donner Catecholamines alter the intrinsic variability of cortical population activity and perception Journal Article In: PLoS Biology, vol. 16, no. 2, pp. e2003453, 2018. @article{Pfeffer2018, The ascending modulatory systems of the brain stem are powerful regulators of global brain state. Disturbances of these systems are implicated in several major neuropsychiatric disorders. Yet, how these systems interact with specific neural computations in the cerebral cortex to shape perception, cognition, and behavior remains poorly understood. Here, we probed into the effect of two such systems, the catecholaminergic (dopaminergic and noradrenergic) and cholinergic systems, on an important aspect of cortical computation: its intrinsic variability. To this end, we combined placebo-controlled pharmacological intervention in humans, recordings of cortical population activity using magnetoencephalography (MEG), and psychophysical measurements of the perception of ambiguous visual input. A low-dose catecholaminergic, but not cholinergic, manipulation altered the rate of spontaneous perceptual fluctuations as well as the temporal structure of “scale-free” population activity of large swaths of the visual and parietal cortices. Computational analyses indicate that both effects were consistent with an increase in excitatory relative to inhibitory activity in the cortical areas underlying visual perceptual inference. We propose that catecholamines regulate the variability of perception and cognition through dynamically changing the cortical excitation–inhibition ratio. The combined readout of fluctuations in perception and cortical activity we established here may prove useful as an efficient and easily accessible marker of altered cortical computation in neuropsychiatric disorders. |
Anthony J. Ries; David Slayback; Jon Touryan The fixation-related lambda response: Effects of saccade magnitude, spatial frequency, and ocular artifact removal Journal Article In: International Journal of Psychophysiology, vol. 134, pp. 1–8, 2018. @article{Ries2018, Fixation-related potentials (FRPs) enable examination of electrophysiological signatures of visual perception under naturalistic conditions, providing a neural snapshot of the fixated scene. The most prominent FRP component, commonly referred to as the lambda response, is a large deflection over occipital electrodes (O1, Oz, O2) peaking 80–100 ms post fixation, reflecting afferent input to visual cortex. The lambda response is affected by bottom-up stimulus features and the size of the preceding saccade; however, prior research has not adequately controlled for these influences in free viewing paradigms. The current experiment (N = 16, 1 female) addresses these concerns by systematically manipulating spatial frequency in a free-viewing task requiring a range of saccade sizes. Given the close temporal proximity between saccade related activity and the onset of the lambda response, we evaluate how removing independent components (IC) associated with ocular motion artifacts affects lambda response amplitude. Our results indicate that removing ocular artifact ICs based on the covariance with gaze position did not significantly affect the amplitude of this occipital potential. Moreover, the results showed that spatial frequency and saccade magnitude each produce significant effects on lambda amplitude, where amplitude decreased with increasing spatial frequency and increased as a function of saccade size for small and medium-sized saccades. The amplitude differences between spatial frequencies were maintained across all saccade magnitudes suggesting these effects are produced from distinctly different and uncorrelated mechanisms. The current results will inform future analyses of the lambda potential in natural scenes where saccade magnitudes and spatial frequencies ultimately vary. |
Andreas Widmann; Erich Schröger; Nicole Wetzel In: Biological Psychology, vol. 133, pp. 10–17, 2018. @article{Widmann2018, Novel sounds in the auditory oddball paradigm elicit a biphasic dilation of the pupil (PDR) and P3a as well as novelty P3 event-related potentials (ERPs). The biphasic PDR has been hypothesized to reflect the relaxation of the iris sphincter muscle due to parasympathetic inhibition and the constriction of the iris dilator muscle due to sympathetic activation. We measured the PDR and the P3 to neutral and to emotionally arousing negative novels in dark and moderate lighting conditions. By means of principal component analysis (PCA) of the PDR data we extracted two components: the early one was absent in darkness and, thus, presumably reflects parasympathetic inhibition, whereas the late component occurred in darkness and light and presumably reflects sympathetic activation. Importantly, only this sympathetic late component was enhanced for emotionally arousing (as compared to neutral) sounds supporting the hypothesis that emotional arousal specifically activates the sympathetic nervous system. In the ERPs we observed P3a and novelty P3 in response to novel sounds. Both components were enhanced for emotionally arousing (as compared to neutral) novels. Our results demonstrate that sympathetic and parasympathetic contributions to the PDR can be separated and link emotional arousal to sympathetic nervous system activation. |
Tommy J. Wilson; Michael J. Gray; Jan Willem Van Klinken; Melissa Kaczmarczyk; John J. Foxe Macronutrient composition of a morning meal and the maintenance of attention throughout the morning Journal Article In: Nutritional Neuroscience, vol. 21, no. 10, pp. 729–743, 2018. @article{Wilson2018, At present, the impact of macronutrient composition and nutrient intake on sustained attention in adults is unclear, although some prior work suggests that nutritive interventions that engender slow, steady glucose availability support sustained attention after consumption. A separate line of evidence suggests that nutrient consumption may alter electroencephalographic markers of neurophysiological activity, including neural oscillations in the alpha-band (8-14 Hz), which are known to be richly interconnected with the allocation of attention. It is here investigated whether morning ingestion of foodstuffs with differing macronutrient compositions might differentially impact the allocation of sustained attention throughout the day as indexed by both behavior and the deployment of attention-related alpha-band activity. METHODS: Twenty-four adult participants were recruited into a three-day study with a cross-over design that employed a previously validated sustained attention task (the Spatial CTET). On each experimental day, subjects consumed one of three breakfasts with differing carbohydrate availabilities (oatmeal, cornflakes, and water) and completed blocks of the Spatial CTET throughout the morning while behavioral performance, subjective metrics of hunger/fullness, and electroencephalographic (EEG) measurements of alpha oscillatory activity were recorded. RESULTS: Although behavior and electrophysiological metrics changed over the course of the day, no differences in their trajectories were observed as a function of breakfast condition. However, subjective metrics of hunger/fullness revealed that caloric interventions (oatmeal and cornflakes) reduced hunger across the experimental day with respect to the non-caloric, volume-matched control (water). Yet, no differences in hunger/fullness were observed between the oatmeal and cornflakes interventions. CONCLUSION: Observation of a relationship between macronutrient intervention and sustained attention (if one exists) will require further standardization of empirical investigations to aid in the synthesis and replicability of results. In addition, continued implementation of neurophysiological markers in this domain is encouraged, as they often produce nuanced insight into cognition even in the absence of overt behavioral changes. |
2017 |
Theresa Wildegger; Freek Ede; Mark W. Woolrich; Céline R. Gillebert; Anna C. Nobre Preparatory α-band oscillations reflect spatial gating independently of predictions regarding target identity Journal Article In: Journal of Neurophysiology, vol. 117, no. 3, pp. 1385–1394, 2017. @article{Wildegger2017, Preparatory modulations of cortical alpha-band oscillations are a reliable index of the voluntary allocation of covert spatial attention. It is currently unclear whether attentional cues containing information about a target's identity (such as its visual orientation), in addition to its location, might additionally shape preparatory alpha modulations. Here, we explore this question by directly comparing spatial and feature-based attention in the same visual detection task while recording brain activity using magneto-encephalography (MEG). At the behavioural level, preparatory feature-based and spatial attention cues both improved performance, and did so independently of each other. Using MEG, we replicated robust alpha lateralisation following spatial cues: in preparation for a visual target, alpha power decreased contralaterally, and increased ipsilaterally to the attended location. Critically, however, preparatory alpha lateralisation was not significantly modulated by predictions regarding target identity, as carried via the behaviourally effective feature-based attention cues. Furthermore, non-lateralised alpha power during the cue-target interval did not differentiate between uninformative cues and cues carrying feature-based predictions either. Based on these results we propose that preparatory alpha modulations play a role in the gating of information between spatially segregated cortical regions, and are therefore particularly well suited for spatial gating of information. |
Joseph Schmidt; Gregory J. Zelinsky Adding details to the attentional template offsets search difficulty: Evidence from contralateral delay activity Journal Article In: Journal of Experimental Psychology: Human Perception and Performance, vol. 43, no. 3, pp. 429–437, 2017. @article{Schmidt2017a, We investigated how expected search difficultly affects the attentional template by having participants search for a teddy bear target among either other teddy bears (difficult search, high target-distractor similarity) or random nonbear objects (easy search, low target-distractor similarity). Target previews were identical in these 2 blocked conditions, and target-related visual working memory (VWM) load was measured using contralat- eral delay activity (CDA), an event-related potential indicating VWM load. CDA was assessed after target designation but before search display onset. Shortly after preview offset, the expectation of a difficult search produced a target-related CDA, suggesting the encoding and maintenance of target details inVWM.However, no differences in CDA were found immediately before search onset, suggesting a flexible and efficient weighting of the templates' features to reflect the expected demands of the search task. Moreover, CDA amplitude correlated with eye movement measures of search guidance in difficult search trials but not easy trials, suggesting that the utility of the attentional template is greater for more difficult searches. These findings are evidence that attentional templates depend on expected task difficulty, and that people may compensate for a more difficult search by adding details to their target representation in VWM, as measured by CDA. |
Hossein Seidkhani; Andrey R. Nikolaev; Radha Nila Meghanathan; Hamid Pezeshk; Ali Masoudi-Nejad; Cees Leeuwen Task modulates functional connectivity networks in free viewing behavior Journal Article In: NeuroImage, vol. 159, pp. 289–301, 2017. @article{Seidkhani2017, In free visual exploration, eye-movement is immediately followed by dynamic reconfiguration of brain functional connectivity. We studied the task-dependency of this process in a combined visual search-change detection experiment. Participants viewed two (nearly) same displays in succession. First time they had to find and remember multiple targets among distractors, so the ongoing task involved memory encoding. Second time they had to determine if a target had changed in orientation, so the ongoing task involved memory retrieval. From multichannel EEG recorded during 200 ms intervals time-locked to fixation onsets, we estimated the functional connectivity using a weighted phase lag index at the frequencies of theta, alpha, and beta bands, and derived global and local measures of the functional connectivity graphs. We found differences between both memory task conditions for several network measures, such as mean path length, radius, diameter, closeness and eccentricity, mainly in the alpha band. Both the local and the global measures indicated that encoding involved a more segregated mode of operation than retrieval. These differences arose immediately after fixation onset and persisted for the entire duration of the lambda complex, an evoked potential commonly associated with early visual perception. We concluded that encoding and retrieval differentially shape network configurations involved in early visual perception, affecting the way the visual input is processed at each fixation. These findings demonstrate that task requirements dynamically control the functional connectivity networks involved in early visual perception. |
Alon Shapira; Anna Sterkin; Moshe Fried; Oren Yehezkel; Zeev Zalevsky; Uri Polat Increased gamma band activity for lateral interactions in humans Journal Article In: PLoS ONE, vol. 12, no. 12, pp. e0187520, 2017. @article{Shapira2017, Collinear facilitation of contrast sensitivity supported by lateral interactions within primary visual cortex is implicated in contour and object perception, with neural correlates in several frequency bands. Although higher component of the ERP power spectrum, the gamma-band, is postulated to reflect object representation, attention and memory, its neuronal source has been questioned, suggesting it is an artifact reflecting saccadic eye movements. Here we explored the gamma-band activity during collinear facilitation with no saccade-related confounds. We used single-trial spectral analysis of ERP in occipital channels in a time-window of nearly complete saccadic suppression and discarded sporadic trials containing saccades, in order to avoid saccadic artifacts. Although converging evidence suggests that gamma-band oscillations emerge from local excitatory–inhibitory balance involving GABAergic inhibition, here we show activity amplification during facilitatory collinear interactions, presumably dominated by excitations, in the gamma-band 150–350 milliseconds following onset of low near-threshold contrast stimulus. This result highlights the potential role of gamma-band oscillations in neuronal encoding of basic processes in visual perception. Thus, our findings suggest that gamma-band ERP spectrum analysis may serve as a useful and reliable tool for exploring basic perception, both in normal adults and in special populations. |
Talia Shrem; Micah M. Murray; Leon Y. Deouell Auditory-visual integration modulates location-specific repetition suppression of auditory responses Journal Article In: Psychophysiology, vol. 54, no. 11, pp. 1663–1675, 2017. @article{Shrem2017a, Space is a dimension shared by different modalities, but at what stage spatial encoding is affected by multisensory processes is unclear. Early studies observed attenuation of N1/P2 auditory evoked responses following repetition of sounds from the same location. Here, we asked whether this effect is modulated by audiovisual interactions. In two experiments, using a repetition-suppression paradigm, we presented pairs of tones in free field, where the test stimulus was a tone presented at a fixed lateral location. Experiment 1 established a neural index of auditory spatial sensitivity, by comparing the degree of attenuation of the response to test stimuli when they were preceded by an adapter sound at the same location versus 30° or 60° away. We found that the degree of attenuation at the P2 latency was inversely related to the spatial distance between the test stimulus and the adapter stimulus. In Experiment 2, the adapter stimulus was a tone presented from the same location or a more medial location than the test stimulus. The adapter stimulus was accompanied by a simultaneous flash displayed orthogonally from one of the two locations. Sound-flash incongruence reduced accuracy in a same-different location discrimination task (i.e., the ventriloquism effect) and reduced the location-specific repetition-suppression at the P2 latency. Importantly, this multisensory effect included topographic modulations, indicative of changes in the relative contribution of underlying sources across conditions. Our findings suggest that the auditory response at the P2 latency is affected by spatially selective brain activity, which is affected crossmodally by visual information. |
P. Sotnikov; K. Finagin; S. Vidunova Selection of optimal frequency bands of the electroencephalogram signal in eye-brain-computer interface Journal Article In: Procedia Computer Science, vol. 103, pp. 168–175, 2017. @article{Sotnikov2017, An eye-brain-computer interface (EBCI) is a hybrid system that combines properties of eye tracking systems and brain-computer interfaces, based on the analysis of the electroencephalogram (EEG). In the hybrid interface the object of interest on a screen is determined by tracking the user's gaze direction. At the same time, the EEG signal is used to detect the user's intent to give a command. This article discusses the recognition of EEG patterns that correspond to spontaneous and control gaze fixations. We propose to extract the most informative features of the EEG signal by selecting optimal frequency bands of the signal. The method is based on solving one-criterion optimization task, in which variable parameters are the boundaries of frequency bands, and the quality of the class separation acts as an objective function. To find optimal values of variable parameters we suggest using the particle swarm optimization. We evaluate the efficiency of the proposed method on EEG recordings obtained at the Kurchatov Complex of NBICS Technologies for users working with a hybrid interface. It is shown that for all users our method improves classification accuracy in comparison with other methods of feature extraction. |
Bernhard Spitzer; Leonhard Waschke; Christopher Summerfield Selective overweighting of larger magnitudes during noisy numerical comparison Journal Article In: Nature Human Behaviour, vol. 1, no. 8, pp. 1–8, 2017. @article{Spitzer2017, Humans are often required to compare average magnitudes in numerical data; for example, when comparing product prices on two rival consumer websites. However, the neural and com- putational mechanisms by which numbers are weighted, inte- grated and compared during categorical decisions are largely unknown1–5 . Here, we show a systematic deviation from ‘opti- mality' in both visual and auditory tasks requiring averaging of symbolic numbers. Participants comparing numbers drawn from two categories selectively overweighted larger numbers when making a decision, and larger numbers evoked dispro- portionately stronger decision-related neural signals over the parietal cortex. A representational similarity analysis6 showed that neural (dis)similarity in patterns of electroencephalo- gram activity reflected numerical distance, but that encod- ing of number in neural data was systematically distorted in a way predicted by the behavioural weighting profiles, with greater neural distance between adjacent larger numbers. Finally, using a simple computational model, we show that although it is suboptimal for a lossless observer, this selective overweighting policy paradoxically maximizes expected accu- racy by making decisions more robust to noise arising during approximate numerical integration2 . In other words, although selective overweighting discards decision information, it can be beneficial for limited-capacity agents engaging in rapid numerical numerical averaging. |
Tobias Staudigl; Elisabeth Hartl; Soheyl Noachtar; Christian F. Doeller; Ole Jensen Saccades are phase-locked to alpha oscillations in the occipital and medial temporal lobe enhance memory encoding Journal Article In: PLoS Biology, vol. 15, no. 12, pp. e2003404, 2017. @article{Staudigl2017, Efficient sampling of visual information requires a coordination of eye movements and ongoing brain oscillations. Using intracranial and MEG recordings, we show that saccades are locked to the phase of visual alpha oscillations, and that this coordination supports mnemonic encoding of visual scenes. Furthermore, parahippocampal and retrosplenial cortex involvement in this coordination reflects effective vision-to-memory mapping, highlighting the importance of neural oscillations for the interaction between visual and memory domains. |
Jan-philipp Tauscher; Maryam Mustafa; Marcus Magnor; T. U. Braunschweig Comparative analysis of three different modalities for perception of artifacts in videos Journal Article In: ACM Transactions on Applied Perception, vol. 14, no. 4, pp. 1–12, 2017. @article{Tauscher2017, This study compares three popular modalities for analyzing perceived video quality; user ratings, eye tracking, and EEG. We contrast these three modalities for a given video sequence to determine if there is a gap between what humans consciously see and what we implicitly perceive. Participants are shown a video sequence with different artifacts appearing at specific distances in their field of vision; near foveal, middle peripheral, and far peripheral. Our results show distinct differences between what we saccade to (eye tracking), howwe consciously rate video quality, and our neural responses (EEG data). Our findings indicate that the measurement of perceived quality depends on the specific modality used. |
Tahereh Toosi; Ehsan K. Tousi; Hossein Esteky Learning temporal context shapes prestimulus alpha oscillations and improves visual discrimination performance Journal Article In: Journal of Neurophysiology, vol. 118, no. 2, pp. 771–777, 2017. @article{Toosi2017, Time is an inseparable component of every physical event that we perceive, yet it is not clear how the brain processes time or how the neuronal representation of time affects our perception of events. Here, we asked subjects to perform a visual discrimination task, while we changed the temporal context in which the stimuli were presented. We collected electroencephalography (EEG) signals in two temporal contexts. Predictable blocks: stimuli were presented after a constant delay relative to a visual cue, and unpredictable blocks: stimuli were presented after variable delays relative to the visual cue. Four sub-second delays of 83, 150, 400 and 800 ms were used in the predictable and unpredictable blocks. We observed that predictability modulated the power of prestimulus alpha oscillations in the parieto-occipital sites and this modulation only occurred in the longest delay period, 800 ms, in which the predictability also improved the behavioral performance of the subjects. Moreover, learning the temporal context shaped the prestimulus alpha power: modulation of prestimulus alpha power grew during the predictable block and correlated with performance enhancement. These results suggest that the brain is able to learn the sub-second temporal context of stimuli and use this to enhance the sensory processing. Furthermore, the neural correlate of this temporal prediction is reflected in the alpha oscillations. |
Diana M. E. Torta; Emanuel N. Broeke; Lieve Filbrich; Benvenuto Jacob; Julien Lambert; André Mouraux Intense pain influences the cortical processing of visual stimuli projected onto the sensitized skin Journal Article In: Pain, vol. 158, no. 4, pp. 691–697, 2017. @article{Torta2017, Sensitization is a form of implicit learning produced by the exposure to a harmful stimulus. In humans and other mammals, sensitization after skin injury increases the responsiveness of peripheral nociceptors and enhances the synaptic transmission of nociceptive input in the central nervous system. Here, we show that sensitization-related changes in the central nervous system are not restricted to nociceptive pathways and, instead, also affect other sensory modalities, especially if that modality conveys information relevant for the sensitized body part. Specifically, we show that after sensitizing the forearm using high-frequency electrical stimulation (HFS) of the skin, visual stimuli projected onto the sensitized forearm elicit significantly enhanced brain responses. Whereas mechanical hyperalgesia was present both 20 and 45 minutes after HFS, the enhanced responsiveness to visual stimuli was present only 20 minutes after HFS. Taken together, our results indicate that sensitization involves both nociceptive-specific and multimodal mechanisms, having distinct time courses. |
Marjolein Waal; Jason Farquhar; Luciano Fasotti; Peter Desain Preserved and attenuated electrophysiological correlates of visual spatial attention in elderly subjects Journal Article In: Behavioural Brain Research, vol. 317, pp. 415–423, 2017. @article{Waal2017, Healthy aging is associated with changes in many neurocognitive functions. While on the behavioral level, visual spatial attention capacities are relatively stable with increasing age, the underlying neural processes change. In this study, we investigated attention-related modulations of the stimulus-locked event-related potential (ERP) and occipital oscillations in the alpha band (8–14 Hz) in young and elderly participants. Both groups performed a visual attention task equally well and the ERP showed comparable attention-related modulations in both age groups. However, in elderly subjects, oscillations in the alpha band were massively reduced both during the task and in the resting state and the typical task-related lateralized pattern of alpha activity was not observed. These differences between young and elderly participants were observed on the group level as well as on the single trial level. The results indicate that younger and older adults use different neural strategies to reach the same performance in a covert visual spatial attention task. |
Matthew David Weaver; Clayton Hickey; Wieske Zoest The impact of salience and visual working memory on the monitoring and control of saccadic behavior: An eye-tracking and EEG study Journal Article In: Psychophysiology, vol. 54, no. 4, pp. 544–554, 2017. @article{Weaver2017, In a concurrent eye-tracking and EEG study, we investigated the impact of salience on the monitoring and control of eye movement behavior and the role of visual working memory (VWM) capacity in mediating this effect. Participants made eye movements to a unique line-segment target embedded in a search display also containing a unique distractor. Target and distractor salience was manipulated by varying degree of orientation offset from a homogenous background. VWM capacity was measured using a change-detection task. Results showed greater likelihood of incorrect saccades when the distractor was relatively more salient than when the target was salient. Misdirected saccades to salient distractors were strongly represented in the error-monitoring system by rapid and robust errorrelated negativity (ERN), which predicted a significant adjustment of oculomotor behavior. Misdirected saccades to less-salient distractors, while arguably representing larger errors, were not as well detected or utilized by the error/ performance-monitoring system. This system was instead better engaged in tasks requiring greater cognitive control and by individuals with higher VWM capacity. Our findings show that relative salience of task-relevant and taskirrelevant stimuli can define situations where an increase in cognitive control is necessary, with individual differences in VWM capacity explaining significant variance in the degree of monitoring and control of goal-directed eye movement behavior. The present study supports a conflict-monitoring interpretation of the ERN, whereby the level of competition between different responses, and the stimuli that define these responses, was more important in the generation of an enhanced ERN than the error commission itself. |
Matthew David Weaver; Wieske Zoest; Clayton Hickey A temporal dependency account of attentional inhibition in oculomotor control Journal Article In: NeuroImage, vol. 147, pp. 880–894, 2017. @article{Weaver2017a, We used concurrent electroencephalogram (EEG) and eye tracking to investigate the role of covert attentional mechanisms in the control of oculomotor behavior. Human participants made speeded saccades to targets that were presented alongside salient distractors. By subsequently sorting trials based on whether the distractor was strongly represented or suppressed by the visual system – as evident in the accuracy (Exp. 1) or quality of the saccade (Exp. 2) – we could characterize and contrast pre-saccadic neural activity as a function of whether oculomotor control was established. Results show that saccadic behavior is strongly linked to the operation of attentional mechanisms in visual cortex. In Experiment 1, accurate saccades were preceded by attentional selection of the target – indexed by a target-elicited N2pc component – and by attentional suppression of the distractor – indexed by early and late distractor-elicited distractor positivity (Pd) components. In Experiment 2, the strength of distractor suppression predicted the degree to which the path of slower saccades would deviate away from the distractor en route to the target. However, results also demonstrated clear dissociations of covert and overt selective control, with saccadic latency in particular showing no relationship to the latency of covert selective mechanisms. Eye movements could thus be initiated prior to the onset of attentional ERP components, resulting in stimulus-driven behaviour. Taken together, the results indicate that attentional mechanisms play a role in determining saccadic behavior, but that saccade timing is not contingent on the deployment of attention. This creates a temporal dependency, whereby attention fosters oculomotor control only when attentional mechanisms are given sufficient opportunity to impact stimuli representations before an eye movement is executed. |
Nathan Caruana; Peter Lissa; Genevieve McArthur Beliefs about human agency influence the neural processing of gaze during joint attention Journal Article In: Social Neuroscience, vol. 12, no. 2, pp. 194–206, 2017. @article{Caruana2017b, The current study measured adults' P350 and N170 ERPs while they interacted with a character in a virtual reality paradigm. Some participants believed the character was controlled by a human ("avatar" condition |
Jing Chen; Matteo Valsecchi; Karl R. Gegenfurtner Enhanced brain responses to color during smooth-pursuit eye movements Journal Article In: Journal of Neurophysiology, vol. 118, pp. 749–754, 2017. @article{Chen2017a, Eye movements alter visual perceptions in a number of ways. During smooth pursuit eye movements, previous studies reported decreased detection threshold for colored stimuli and for high-spatial-frequency luminance stimuli, suggesting a boost in the parvocellular system. The present study investigated the underlying neural mechanism using EEG in human participants. Participants followed a moving target with smooth pursuit eye movements while steady-state visually Evoked potentials (SSVEPs) were elicited by equiluminant red-green flickering gratings in the background. SSVEP responses to color gratings were 18.9% higher during smooth pursuit than during fixation. There was no enhancement of SSVEPs by smooth pursuit when the flickering grating was defined by luminance instead of color. This result provides physiological evidence that the chromatic response in the visual system is boosted by the execution of smooth pursuit eye movements in humans. Since the response improvement is thought to be due to an improved response in the parvocellular system, SSVEPs to equiluminant stimuli could provide a direct test of parvocellular signaling, especially in populations where an explicit behavioral response from the participant is not feasible. |
Hui-Yan Chiau; Neil G. Muggleton; Chi-Hung Juan Exploring the contributions of the supplementary eye field to subliminal inhibition using double-pulse transcranial magnetic stimulation Journal Article In: Human Brain Mapping, vol. 38, pp. 339–351, 2017. @article{Chiau2017, It is widely accepted that the supplementary eye fields (SEF) are involved in the control of voluntary eye movements. However, recent evidence suggests that SEF may also be important for unconscious and involuntary motor processes. Indeed, Sumner et al. ([2007]: Neuron 54:697-711) showed that patients with micro-lesions of the SEF demonstrated an absence of subliminal inhibition as evoked by masked-prime stimuli. Here, we used double-pulse transcranial magnetic stimulation (TMS) in healthy volunteers to investigate the role of SEF in subliminal priming. We applied double-pulse TMS at two time windows in a masked-prime task: the first during an early phase, 20-70 ms after the onset of the mask but before target presentation, during which subliminal inhibition is present; and the second during a late phase, 20-70 ms after target onset, during which the saccade is being prepared. We found no effect of TMS with the early time window of stimulation, whereas a reduction in the benefit of an incompatible subliminal prime stimulus was found when SEF TMS was applied at the late time window. These findings suggest that there is a role for SEF related to the effects of subliminal primes on eye movements, but the results do not support a role in inhibiting the primed tendency. |
Sergio Delle Monache; Francesco Lacquaniti; Gianfranco Bosco In: Journal of Neurophysiology, vol. 118, no. 3, pp. 1809–1823, 2017. @article{DelleMonache2017, The ability to catch objects when tran- siently occluded from view suggests their motion can be extrapolated. Intraparietal cortex (IPS) plays a major role in this process along with other brain structures, depending on the task. For example, intercep- tion of objects under Earth's gravity effects may depend on time-to-contact predictions derived from integration of visual signals processed by hMT/V5⫹ with a priori knowledge of gravity residing in the temporoparietal junction (TPJ). To investigate this issue further, we disrupted TPJ, hMT/V5⫹, and IPS activities with transcranial magnetic stimulation (TMS) while subjects intercepted computer- simulated projectile trajectories perturbed randomly with either hypo- or hypergravity effects. In experiment 1, trajectories were occluded either 750 or 1,250 ms before landing. Three subject groups underwent triple-pulse TMS (tpTMS, 3 pulses at 10 Hz) on one target area (TPJ | hMT/V5⫹ | IPS) and on the vertex (control site), timed at either trajectory perturbation or occlusion. In experiment 2, trajectories were entirely visible and participants received tpTMS on TPJ and hMT/ V5+ with same timing as experiment 1. tpTMS of TPJ, hMT/V5⫹, and IPS affected differently the interceptive timing. TPJ stimulation affected preferentially responses to 1-g motion, hMT/V5+ all response types, and IPS stimulation induced opposite effects on 0-g and 2-g responses, being ineffective on 1-g responses. Only IPS stimulation was effective when applied after target disappearance, implying this area might elaborate memory representations of occluded target motion. Results are compatible with the idea that IPS, TPJ, and hMT/V5+ contribute to distinct aspects of visual motion extrapolation, perhaps through parallel processing. |
Grace Edwards; Céline Paeye; Philippe Marque; Rufin VanRullen; Patrick Cavanagh Predictive position computations mediated by parietal areas: TMS evidence Journal Article In: NeuroImage, vol. 153, pp. 49–57, 2017. @article{Edwards2017, When objects move or the eyes move, the visual system can predict the consequence and generate a percept of the target at its new position. This predictive localization may depend on eye movement control in the frontal eye fields (FEF) and the intraparietal sulcus (IPS) and on motion analysis in the medial temporal area (MT). Across two experiments we examined whether repetitive transcranial magnetic stimulation (rTMS) over right FEF, right IPS, right MT, and a control site, peripheral V1/V2, diminished participants' perception of two cases of predictive position perception: trans-saccadic fusion, and the flash grab illusion, both presented in the contralateral visual field. In trans-saccadic fusion trials, participants saccade toward a stimulus that is replaced with another stimulus during the saccade. Frequently, predictive position mechanisms lead to a fused percept of pre- and post-saccade stimuli (Paeye et al., 2017). We found that rTMS to IPS significantly decreased the frequency of perceiving trans-saccadic fusion within the first 10 min after stimulation. In the flash grab illusion, a target is flashed on a moving background leading to the percept that the target has shifted in the direction of the motion after the flash (Cavanagh and Anstis, 2013). In the first experiment, the reduction in the flash grab illusion after rTMS to IPS and FEF did not reach significance. In the second experiment, using a stronger version of the flash grab, the illusory shift did decrease significantly after rTMS to IPS although not after rTMS to FEF or to MT. These findings suggest that right IPS contributes to predictive position perception during saccades and motion processing in the contralateral visual field. |
John M. Egan; Gerard M. Loughnane; Helen Fletcher; Emma Meade; Edmund C. Lalor A gaze independent hybrid-BCI based on visual spatial attention Journal Article In: Journal of Neural Engineering, vol. 14, no. 4, pp. 1–8, 2017. @article{Egan2017, Objective. Brain-computer interfaces (BCI) use measures of brain activity to convey a user's intent without the need for muscle movement. Hybrid designs, which use multiple measures of brain activity, have been shown to increase the accuracy of BCIs, including those based on EEG signals reflecting covert attention. Our study examined whether incorporating a measure of the P3 response improved the performance of a previously reported attention-based BCI design that incorporates measures of steady-state visual evoked potentials (SSVEP) and alpha band modulations. Approach. Subjects viewed stimuli consisting of two bi-laterally located flashing white boxes on a black background. Streams of letters were presented sequentially within the boxes, in random order. Subjects were cued to attend to one of the boxes without moving their eyes, and they were tasked with counting the number of target-letters that appeared within. P3 components evoked by target appearance, SSVEPs evoked by the flashing boxes, and power in the alpha band are modulated by covert attention, and the modulations can be used to classify trials as left-attended or right-attended. Main Results. We showed that classification accuracy was improved by including a P3 feature along with the SSVEP and alpha features (the inclusion of a P3 feature lead to a 9% increase in accuracy compared to the use of SSVEP and Alpha features alone). We also showed that the design improves the robustness of BCI performance to individual subject differences. Significance. These results demonstrate that incorporating multiple neurophysiological indices of covert attention can improve performance in a gaze-independent BCI. |
Joshua J. Foster; Emma M. Bsales; Russell J. Jaffe; Edward Awh Alpha-band activity reveals spontaneous representations of spatial position in visual working memory Journal Article In: Current Biology, vol. 27, no. 20, pp. 3216–3223, 2017. @article{Foster2017, An emerging view suggests that spatial position is an integral component of working memory (WM), such that non-spatial features are bound to locations regardless of whether space is relevant [1, 2]. For instance, past work has shown that stimulus position is spontaneously remembered when non-spatial fea- tures are stored. Item recognition is enhanced when memoranda appear at the same location where they were encoded [3–5], and accessing non-spatial infor- mation elicits shifts of spatial attention to the original position of the stimulus [6, 7]. However, these find- ings do not establish that a persistent, active repre- sentation of stimulus position is maintained in WM because similar effects have also been documented following storage in long-termmemory [8, 9]. Here we show that the spatial position of the memorandum is actively coded by persistent neural activity during a non-spatial WM task. We used a spatial encoding model in conjunction with electroencephalogram (EEG) measurements of oscillatory alpha-band (8– 12 Hz) activity to track active representations of spatial position. The position of the stimulus varied trial to trial but was wholly irrelevant to the tasks. We nevertheless observed active neural representa- tions of the original stimulus position that persisted throughout the retention interval. Further experi- ments established that these spatial representations are dependent on the volitional storage of non- spatial features rather than being a lingering effect of sensory energy or initial encoding demands. These findings provide strong evidence that online spatial representations are spontaneously main- tained in WM—regardless of task relevance—during the storage of non-spatial features. |
Matthew A. Gannon; Stephanie M. Long; Nathan A. Parks Homeostatic plasticity in human extrastriate cortex following a simulated peripheral scotoma Journal Article In: Experimental Brain Research, vol. 235, no. 11, pp. 3391–3401, 2017. @article{Gannon2017, Neuroimaging and patient work over the past decade have indicated that, following retinal deafferenta- tion, the human visual cortex undergoes a large-scale and enduring reorganization of its topography such that the clas- sical retinotopic organization of deafferented visual cortex remaps to represent non-classical regions of visual space. Such long-term visual reorganization is proposed to occur through changes in the functional balance of deafferented visual circuits that engage more lasting changes through activity-dependent neuroplasticity. Here, we investigated the short-term changes in functional balance (short-term plastic- ity; homeostatic plasticity) that occur within deafferented human visual cortices. We recorded electroencephalogram (EEG) while observers were conditioned for 6 s with a simu- lated retinal scotoma (artificial scotoma) positioned 8.0° in the periphery. Visual evoked potentials (VEPs) evoked by the onset of sinusoidal visual probes that varied in their tilt were used to examine changes in cortical excitability within and around cortical representations of the simulated sco- toma. Psychophysical orientation functions obtained from discrimination of visual probe tilt were used to examine alterations in the stimulus selectivity within the scotoma representations. Consistent with a mechanism of homeo- static disinhibition, an early extrastriate component of the VEP (the early phase P1) exhibited increased amplitude fol- lowing the condition with a simulated scotoma relative to a stimulus-matched control condition. This increased visual cortical response was associated with a reduction in the slope of the psychophysical orientation function, suggesting a broader tuning of neural populations within scotoma repre- sentations. Together, these findings support a mechanism of disinhibition in promoting visual plasticity and topographi- cal reorganization. |
Nigel Gebodh; M. Isabel Vanegas; Simon P. Kelly Effects of stimulus size and contrast on the initial primary visual cortical response in humans Journal Article In: Brain Topography, vol. 30, no. 4, pp. 450–460, 2017. @article{Gebodh2017, Decades of intracranial electrophysiological investigation into the primary visual cortex (V1) have produced many fundamental insights into the computations carried out in low-level visual circuits of the brain. Some of the most important work has been simply concerned with the precise measurement of neural response variations as a function of elementary stimulus attributes such as contrast and size. Surprisingly, such simple but fundamental characterization of V1 responses has not been carried out in human electrophysiology. Here we report such a detailed characterization for the initial “C1” component of the scalp-recorded visual evoked potential (VEP). The C1 is known to be dominantly generated by initial afferent activation in V1, but is difficult to record reliably due to interindividual anatomical variability. We used pattern-pulse multifocal VEP mapping to identify a stimulus position that activates the left lower calcarine bank in each individual, and afterwards measured robust negative C1s over posterior midline scalp to gratings presented sequentially at that location. We found clear and systematic increases in C1 peak amplitude and decreases in peak latency with increasing size as well as with increasing contrast. With a sample of 15 subjects and ~180 trials per condition, reliable C1 amplitudes of −0.46 µV were evoked at as low a contrast as 3.13% and as large as −4.82 µV at 100% contrast, using stimuli of 3.33° diameter. A practical implication is that by placing sufficiently-sized stimuli to target favorable calcarine cortical loci, robust V1 responses can be measured at contrasts close to perceptual thresholds, which could greatly facilitate principled studies of early visual perception and attention. |
Edden M. Gerber; Tal Golan; Robert T. Knight; Leon Y. Deouell Cortical representation of persistent visual stimuli Journal Article In: NeuroImage, vol. 161, pp. 67–79, 2017. @article{Gerber2017, Research into visual neural activity has focused almost exclusively on onset- or change-driven responses and little is known about how information is encoded in the brain during sustained periods of visual perception. We used intracranial recordings in humans to determine the degree to which the presence of a visual stimulus is persistently encoded by neural activity. The correspondence between stimulus duration and neural response duration was strongest in early visual cortex and gradually diminished along the visual hierarchy, such that is was weakest in inferior-temporal category-selective regions. A similar posterior-anterior gradient was found within inferior temporal face-selective regions, with posterior but not anterior sites showing persistent face-selective activity. The results suggest that regions that appear uniform in terms of their category selectivity are dissociated by how they temporally represent a stimulus in support of ongoing visual perception, and delineate a large-scale organizing principle of the ventral visual stream. |
Paul Metzner; Titus Malsburg; Shravan Vasishth; Frank Rösler The importance of reading naturally: Evidence from combined recordings of eye movements and electric brain potentials Journal Article In: Cognitive Science, vol. 41, pp. 1232–1263, 2017. @article{Metzner2017, How important is the ability to freely control eye movements for reading comprehension? And how does the parser make use of this freedom? We investigated these questions using coregistration of eye movements and event-related brain potentials (ERPs) while participants read either freely or in a computer-controlled word-by-word format (also known as RSVP). Word-by-word presentation and natural reading both elicited qualitatively similar ERP effects in response to syntactic and semantic violations (N400 and P600 effects). Comprehension was better in free reading but only in trials in which the eyes regressed to previous material upon encountering the anomaly. A more fine-grained ERP analysis revealed that these regressions were strongly associated with the well-known P600 effect. In trials without regressions, we instead found sustained centro-parietal negativities starting at around 320 ms post-onset; however, these negativities were only found when the violation occurred in sentence-final position. Taken together, these results suggest that the sentence processing system engages in strategic choices: In response to words that don't match built-up expectations, it can either explore alternative interpretations (reflected by regressions, P600 effects, and good com-prehension) or pursue a " good-enough " processing strategy that tolerates a deficient interpretation (reflected by progressive saccades, sustained negativities, and relatively poor comprehension). |
Kelly Miles; Catherine M. McMahon; Isabelle Boisvert; Ronny Ibrahim; Peter Lissa; Petra L. Graham; Björn Lyxell Objective assessment of listening effort: Coregistration of pupillometry and EEG Journal Article In: Trends in Hearing, vol. 21, 2017. @article{Miles2017, Listening to speech in noise is effortful, particularly for people with hearing impairment. While it is known that effort is related to a complex interplay between bottom-up and top-down processes, the cognitive and neurophysiological mechan-isms contributing to effortful listening remain unknown. Therefore, a reliable physiological measure to assess effort remains elusive. This study aimed to determine whether pupil dilation and alpha power change, two physiological measures suggested to index listening effort, assess similar processes. Listening effort was manipulated by parametrically varying spectral reso-lution (16-and 6-channel noise vocoding) and speech reception thresholds (SRT; 50% and 80%) while 19 young, normal-hearing adults performed a speech recognition task in noise. Results of off-line sentence scoring showed discrepancies between the target SRTs and the true performance obtained during the speech recognition task. For example, in the SRT80% condition, participants scored an average of 64.7%. Participants' true performance levels were therefore used for subsequent statistical modelling. Results showed that both measures appeared to be sensitive to changes in spectral reso-lution (channel vocoding), while pupil dilation only was also significantly related to their true performance levels (%) and task accuracy (i.e., whether the response was correctly or partially recalled). The two measures were not correlated, suggesting they each may reflect different cognitive processes involved in listening effort. This combination of findings contributes to a growing body of research aiming to develop an objective measure of listening effort. |
Sorato Minami; Kaoru Amano Illusory jitter perceived at the frequency of alpha oscillations Journal Article In: Current Biology, vol. 27, no. 15, pp. 1–13, 2017. @article{Minami2017, Neural oscillations, such as alpha (8–13 Hz), beta (13–30 Hz), and gamma (30–100 Hz), are widespread across cortical areas, and their possible functional roles include feature binding [1], neuronal communication [2, 3], and memory [1, 4]. The most prominent signal among these neural oscillations is the alpha oscillation. Although accumulating evidence suggests that alpha oscillations correlate with various aspects of visual processing [5–18], the number of studies proving their causal contribution in visual perception is limited [11, 16–18]. Here we report that illusory visual vibrations are consciously experienced at the frequency of intrinsic alpha oscillations. We employed an illusory jitter perception termed the motion-induced spatial conflict [19] that originates from the cyclic interaction between motion and shape processing. Comparison between the perceived frequency of illusory jitter and the peak alpha frequency (PAF) measured using magnetoencephalography (MEG) revealed that the inter- and intra-participant variations of the PAF are mirrored by an illusory jitter perception. More crucially, psychophysical and MEG measurements during amplitude-modulated current stimulation [20] showed that the PAF can be artificially manipulated, which results in a corresponding change in the perceived jitter frequency. These results suggest the causal contribution of neural oscillations at the alpha frequency in creating temporal characteristics of visual perception. Our results suggest that cortical areas, dorsal and ventral visual areas in this case, are interacting at the frequency of alpha oscillations [2, 3, 21–27]. |
Daniel P. Newman; Gerard M. Loughnane; Simon P. Kelly; Redmond G. O'Connell; Mark A. Bellgrove Visuospatial asymmetries arise from differences in the onset time of perceptual evidence accumulation Journal Article In: Journal of Neuroscience, vol. 37, no. 12, pp. 3378–3385, 2017. @article{Newman2017, Healthy subjects tend to exhibit a bias of visual attention whereby left hemifield stimuli are processed more quickly and accurately than stimuli appearing in the right hemifield. It has long been held that this phenomenon arises from the dominant role of the right cerebral hemisphere in regulating attention. However, methods that would enable more precise understanding of the mechanisms underpinning visuospatial bias have remained elusive. We sought to finely trace the temporal evolution of spatial biases by leveraging a novel bilateral dot motion detection paradigm. In combination with electroencephalography, this paradigm enables researchers to isolate discrete neural signals reflecting the key neural processes needed for making these detection decisions. These include signals for spatial attention, early target selection, evidence accumulation, and motor preparation. Using this method, we established that three key neural markers accounted for unique between-subject variation in visuospatial bias: hemispheric asymmetry in posterior α power measured before target onset, which is related to the distribution of preparatory attention across the visual field; asymmetry in the peak latency of the early N2c target-selection signal; and, finally, asymmetry in the onset time of the subsequent neural evidence-accumulation process with earlier onsets for left hemifield targets. Our development of a single paradigm to dissociate distinct processing components that track the temporal evolution of spatial biases not only advances our understanding of the neural mechanisms underpinning normal visuospatial attention bias, but may also in the future aid differential diagnoses in disorders of spatial attention. |
C. J. Aine; H. J. Bockholt; J. R. Bustillo; J. M. Cañive; A. Caprihan; C. Gasparovic; F. M. Hanlon; J. M. Houck; R. E. Jung; J. Lauriello; J. Liu; A. R. Mayer; N. I. Perrone-Bizzozero; S. Posse; Julia M. Stephen; J. A. Turner; V. P. Clark; Vince D. Calhoun Multimodal neuroimaging in schizophrenia: Description and dissemination Journal Article In: Neuroinformatics, vol. 15, no. 4, pp. 343–364, 2017. @article{Aine2017, In this paper we describe an open-access collection ofmultimodal neuroimaging data in schizophrenia for release to the community. Data were acquired from approximately 100 patients with schizophrenia and 100 age-matched controls during rest as well as several task activation paradigms targeting a hierarchy of cognitive constructs. Neuroimaging data include structural MRI, functional MRI, diffusion MRI, MR spectroscopic imaging, and magnetoencephalography. For three of the hypothesis-driven projects, task activation paradigms were acquired on subsets of~200 volunteers which examined a range of sensory and cognitive processes (e.g., auditory sensory gating, auditory/visual multisensory integration, visual transverse patterning). Neuropsychological data were also acquired and genetic material via saliva samples were collected from most of the participants and have been typed for both genome-wide polymorphism data as well as genome-wide methylation data. Some results are also present- ed from the individual studies as well as from our data-driven multimodal analyses (e.g., multimodal examinations of network structure and network dynamics and multitask fMRI data analysis across projects). All data will be released through the Mind Research Network's collaborative informatics and neuroimaging suite (COINS). |
Lucía Amoruso; Agustín Ibáñez; Bruno Fonseca; Sebastián Gadea; Lucas Sedeño; Mariano Sigman; Adolfo M. García; Ricardo Fraiman; Daniel Fraiman Variability in functional brain networks predicts expertise during action observation Journal Article In: NeuroImage, vol. 146, pp. 690–700, 2017. @article{Amoruso2017, Observing an action performed by another individual activates, in the observer, similar circuits as those involved in the actual execution of that action. This activation is modulated by prior experience; indeed, sustained training in a particular motor domain leads to structural and functional changes in critical brain areas. Here, we capitalized on a novel graph-theory approach to electroencephalographic data (Fraiman et al., 2016) to test whether variability in functional brain networks implicated in Tango observation can discriminate between groups differing in their level of expertise. We found that experts and beginners significantly differed in the functional organization of task-relevant networks. Specifically, networks in expert Tango dancers exhibited less variability and a more robust functional architecture. Notably, these expertise-dependent effects were captured within networks derived from electrophysiological brain activity recorded in a very short time window (2 s). In brief, variability in the organization of task-related networks seems to be a highly sensitive indicator of long-lasting training effects. This finding opens new methodological and theoretical windows to explore the impact of domain-specific expertise on brain plasticity, while highlighting variability as a fruitful measure in neuroimaging research. |
Ayelet Arazi; Gil Gonen-Yaacovi; Ilan Dinstein The magnitude of trial-by-trial neural variability Is reproducible over time and across tasks in humans Journal Article In: eNeuro, vol. 4, no. 6, pp. 1–12, 2017. @article{Arazi2017, Numerous studies have shown that neural activity in sensory cortices is remarkably variable over time and across trials even when subjects are presented with an identical repeating stimulus or task. This trial-by-trial neural variability is relatively large in the prestimulus period and considerably smaller (quenched) following stimulus presentation. Previous studies have suggested that the magnitude of neural variability affects behavior such that perceptual performance is better on trials and in individuals where variability quenching is larger. To what degree are neural variability magnitudes of individual subjects flexible or static? Here, we used EEG recordings from adult humans to demonstrate that neural variability magnitudes in visual cortex are remarkably consistent across different tasks and recording sessions. While magnitudes of neural variability differed dramatically across individual subjects, they were surprisingly stable across four tasks with different stimuli, temporal structures, and attentional/cognitive demands as well as across experimental sessions separated by one year. These experiments reveal that, in adults, neural variability magnitudes are mostly solidified individual characteristics that change little with task or time, and are likely to predispose individual subjects to exhibit distinct behavioral capabilities. |
Cathleen Bache; Anne Springer; Hannes Noack; Waltraud Stadler; Franziska Kopp; Ulman Lindenberger; Markus Werkle-Bergner 10-month-old infants are sensitive to the time course of perceived actions: Eye-tracking and EEG evidence Journal Article In: Frontiers in Psychology, vol. 8, pp. 1170, 2017. @article{Bache2017, Research has shown that infants are able to track a moving target efficiently – even if it is transiently occluded from sight. This basic ability allows prediction of when and where events happen in everyday life. Yet, it is unclear whether, and how, infants internally represent the time course of ongoing movements to derive predictions. In this study, 10-month-old crawlers observed the video of a same-aged crawling baby that was transiently occluded and reappeared in either a temporally continuous or non-continuous manner (i.e., delayed by 500 ms vs. forwarded by 500 ms relative to the real-time movement). Eye movement and rhythmic neural brain activity (EEG) were measured simultaneously. Eye movement analyses showed that infants were sensitive to slight temporal shifts in movement continuation after occlusion. Furthermore, brain activity associated with sensorimotor processing differed between observation of continuous and non-continuous movements. Early sensitivity to an action's timing may hence be explained within the internal real-time simulation account of action observation. Overall, the results support the hypothesis that 10-month-old infants are well prepared for internal representation of the time course of observed movements that are within the infants' current motor repertoire. |
Mareike Bayer; Valentina Rossi; Naomi Vanlessen; Annika Grass; Annekathrin Schacht; Gilles Pourtois Independent effects of motivation and spatial attention in the human visual cortex Journal Article In: Social Cognitive and Affective Neuroscience, vol. 12, no. 1, pp. 146–156, 2017. @article{Bayer2017a, Motivation and attention constitute major determinants of human perception and action. Nonetheless, it remains a matter of debate whether motivation effects on the visual cortex depend on the spatial attention system, or rely on independent pathways. This study investigated the impact of motivation and spatial attention on the activity of the human primary and extrastriate visual cortex by employing a factorial manipulation of the two factors in a cued pattern discrimination task. During stimulus presentation, we recorded event-related potentials and pupillary responses. Motivational relevance increased the amplitudes of the C1 component at ∼70 ms after stimulus onset. This modulation occurred independently of spatial attention effects, which were evident at the P1 level. Furthermore, motivation and spatial attention had independent effects on preparatory activation as measured by the contingent negative variation; and pupil data showed increased activation in response to incentive targets. Taken together, these findings suggest independent pathways for the influence of motivation and spatial attention on the activity of the human visual cortex. |
Mareike Bayer; Katja Ruthmann; Annekathrin Schacht The impact of personal relevance on emotion processing: Evidence from event-related potentials and pupillary responses Journal Article In: Social Cognitive and Affective Neuroscience, vol. 12, no. 9, pp. 1470–1479, 2017. @article{Bayer2017, Emotional stimuli attract attention and lead to increased activity in the visual cortex. The present study investigated the impact of personal relevance on emotion processing by presenting emotional words within sentences that referred to participants' significant others or to unknown agents. In event-related potentials, personal relevance increased visual cortex activity within 100 ms after stimulus onset and the amplitudes of the Late Positive Complex (LPC). Moreover, personally relevant contexts gave rise to augmented pupillary responses and higher arousal ratings, suggesting a general boost of attention and arousal. Finally, personal relevance increased emotion-related ERP effects starting around 200 ms after word onset; effects for negative words compared to neutral words were prolonged in duration. Source localizations of these interactions revealed activations in prefrontal regions, in the visual cortex and in the fusiform gyrus. Taken together, these results demonstrate the high impact of personal relevance on reading in general and on emotion processing in particular. |
Annabelle Blangero; Simon P. Kelly Neural signature of value-based sensorimotor prioritization in humans Journal Article In: Journal of Neuroscience, vol. 37, no. 44, pp. 10725–10737, 2017. @article{Blangero2017, In situations in which impending sensory events demand fast action choices, we must be ready to prioritize higher-value courses of action to avoid missed opportunities. When such a situation first presents itself, stimulus-action contingencies and their relative value must be encoded to establish a value-biased state of preparation for an impending sensorimotor decision. Here, we sought to identify neurophysiological signatures of such processes in the human brain (both female and male). We devised a task requiring fast action choices based on the discrimination of a simple visual cue in which the differently valued sensory alternatives were presented 750-800 ms before as peripheral "targets" that specified the stimulus-action mapping for the upcoming decision. In response to the targets, we identified a discrete, transient, spatially selective signal in the event-related potential (ERP), which scaled with relative value and strongly predicted the degree of behavioral bias in the upcoming decision both across and within subjects. This signal is not compatible with any hitherto known ERP signature of spatial selection and also bears novel distinctions with respect to characterizations of value-sensitive, spatially selective activity found in sensorimotor areas of nonhuman primates. Specifically, a series of follow-up experiments revealed that the signal was reliably invoked regardless of response laterality, response modality, sensory feature, and reward valence. It was absent, however, when the response deadline was relaxed and the strategic need for biasing removed. Therefore, more than passively representing value or salience, the signal appears to play a versatile and active role in adaptive sensorimotor prioritization. |
Qingxiao Liu; Bo Tan; Jing Zhou; Zhong Zheng; Ling Li; Yanchun Yang Pathophysiology of refractory obsessive-compulsive disorder Journal Article In: Medicine, pp. 1–11, 2017. @article{Liu2017d, Based on both functional and structural studies of excessive activity, fronto-striatal-thalamic-cortical and cortico-striatal circuits have been hypothesized to underlie the pathophysiology of obsessive-compulsive disorder (OCD). However, the neurobiological underpinnings of OCD refractory to medication and therapy remain controversial. This study aimed to evaluate neuroanatomical abnormalities of the whole brain and to evaluate visual processing in patients with refractory OCD. This study was comprised of 2 experiments. The neuroanatomical abnormalities of the whole brain were evaluated using a visual search in combination with overactive performance monitoring (Experiment I), and visual processing was evaluated using event- related potentials recorded from subjects during performance of a visual search task. We also examined the amplitudes and latency of the error-related negativity (ERN) using a modified flanker task (Experiment II). Standard low-resolution electromagnetic tomography analysis was applied to determine the special areas. Patients with refractory OCD had a significantly greater number of saccades and prolonged latencies relative to the healthy controls. Scalp map topography confirmed that visual cognitive and executive dysfunction was localized to the fusiform gyrus. Furthermore, we found that during a modified flanker task, ERNs had a greater amplitude and a prolonged latency relative to those of the healthy controls. Further data analysis suggested that cognitive dysfunction and compulsive behavior in OCD patients were linked to abnormalities within the dorsolateral prefrontal cortex (DLPFC). We identified abnormal activities within the fusiform gyrus and DLPFC that likely play important roles in the pathophysiology of OCD. |
Wayne E. MacKey; Clayton E. Curtis Distinct contributions by frontal and parietal cortices support working memory Journal Article In: Scientific Reports, vol. 7, pp. 6188, 2017. @article{MacKey2017, Although subregions of frontal and parietal cortex both contribute and coordinate to support working memory (WM) functions, their distinct contributions remain elusive. Here, we demonstrate that perturbations to topographically organized human frontal and parietal cortex during WM maintenance cause distinct but systematic distortions in WM. The nature of these distortions supports theories positing that parietal cortex mainly codes for retrospective sensory information, while frontal cortex codes for prospective action. |
Anna Marzecová; Andreas Widmann; Iria SanMiguel; Sonja A. Kotz; Erich Schröger Interrelation of attention and prediction in visual processing: Effects of task-relevance and stimulus probability Journal Article In: Biological Psychology, vol. 125, pp. 76–90, 2017. @article{Marzecova2017, The potentially interactive influence of attention and prediction was investigated by measuring event-related potentials (ERPs) in a spatial cueing task with attention (task-relevant) and prediction (probabilistic) cues. We identified distinct processing stages of this interactive influence. Firstly, in line with the attentional gain hypothesis, a larger amplitude response of the contralateral N1, and Nd1 for attended gratings was observed. Secondly, conforming to the attenuation-by-prediction hypothesis, a smaller negativity in the time window directly following the peak of the N1 component for predicted compared to unpredicted gratings was observed. In line with the hypothesis that attention and prediction interface, unpredicted/unattended stimuli elicited a larger negativity at central-parietal sites, presumably reflecting an increased prediction error signal. Thirdly, larger P3 responses to unpredicted stimuli pointed to the updating of an internal model. Attention and prediction can be considered as differentiated mechanisms that may interact at different processing stages to optimise perception. |
James Mathew; Alexandre Eusebio; Frederic R. Danion Limited contribution of primary motor cortex in eye-hand coordination: A TMS study Journal Article In: Journal of Neuroscience, vol. 37, no. 40, pp. 9730 –9740, 2017. @article{Mathew2017, The ability to track a moving target with the eye is substantially improved when the target is self-moved compared with when it is moved by an external agent. To account for this observation, it has been postulated that the oculomotor system has access to hand efference copy, thereby allowing to predict the motion of the visual target. Along this scheme, we tested the effect of transcranial magnetic stimulation (TMS) over the hand area of the primary motor cortex (M1) when human participants (50% females) are asked to track with their eyes a visual target whose horizontal motion is driven by their grip force. We reasoned that, if the output of M1 is used by the oculomotor system to keep track of the target, on top of inducing short latency disturbance of grip force, single-pulse TMS should also quickly disrupt ongoing eye motion. For comparison purposes, the effect of TMS over M1 was monitored when subjects tracked an externally moved target (while keeping their hand at rest or not). In both cases, results showed no alterations in smooth pursuit, meaning that its velocity was unaffected within the 25-125 ms epoch that followed TMS. Overall, our results imply that the output of M1 has limited contribution in driving the eye motion during our eye-hand coordination task. This study suggests that, if hand motor signals are accessed by the oculomotor system, this is upstream of M1. |
Thomas Meindertsma; Niels A. Kloosterman; Guido Nolte; Andreas K. Engel; Tobias H. Donner Multiple transient signals in human visual cortex associated with an elementary decision Journal Article In: Journal of Neuroscience, vol. 37, no. 23, pp. 5744–5757, 2017. @article{Meindertsma2017, The cerebral cortex continuously undergoes changes in its state, which are manifested in transient modulations of the cortical power spectrum. Cortical state changes also occur at full wakefulness and during rapid cognitive acts, such as perceptual decisions. Previous studies found a global modulation of beta-band (12–30 Hz) activity in human and monkey visual cortex during an elementary visual decision: reporting the appearance or disappearance of salient visual targets surrounded by a distractor. The previous studies disentangled neither the motor action associated with behavioral report nor other secondary processes, such as arousal, from perceptual decision processing per se. Here, we used magnetoencephalography in humans to pinpoint the factors underlying the beta-band modulation.We found that disappearances of a salient target were associated with beta-band suppression, and target reappearances with beta-band enhancement. This was true for both overt behavioral reports (immediate button presses) and silent counting of the perceptual events. This finding indicates that the beta-band modulation was unrelated to the execution of the motor act associated with a behavioral report of the perceptual decision. Further, changes in pupil-linked arousal, fixational eye movements, or gamma-band responses were not necessary for the beta-band modulation. Together, our results suggest that the beta-band modulation was a top-down signal associated with the process of converting graded perceptual signals into a categorical format underlying flexible behavior. This signal may have been fed back from brain regions involved in decision processing to visual cortex, thus enforcing a “decision-consistent” cortical state. |
Rebecca E. Paladini; René M. Müri; Jurka Meichtry; Tobias Nef; Fred W. Mast; Urs P. Mosimann; Thomas Nyffeler; Dario Cazzoli The influence of alertness on the spatial deployment of visual attention is mediated by the excitability of the posterior parietal cortices Journal Article In: Cerebral Cortex, vol. 27, no. 1, pp. 233–243, 2017. @article{Paladini2017, With a reduced level of alertness, healthy individuals typically show a rightward shift when deploying visual attention in space. The impact of alertness on the neural networks governing visuospatial attention is, however, poorly understood. By using a transcranial magnetic stimulation twin-coil approach, the present study aimed at investigating the effects of an alertness manipulation on the excitability of the left and the right posterior parietal cortices (PPCs), crucial nodes of the visuospatial attentional network. Participants' visuospatial attentional deployment was assessed with a free visual exploration task and concurrent eye tracking. Their alertness level was manipulated through the time of the day, that is, by testing chronotypically defined evening types both during their circadian on- and off-peak times. The results revealed an increased excitability of the left compared with the right PPC during low alertness. On the horizontal dimension, these results were accompanied by a significant rightward shift in the center and a bilateral narrowing in the periphery of the visual exploration field, as well as a central upward shift on the vertical dimension. The findings show that the manipulation of non-spatial attentional aspects (i.e., alertness) can affect visuospatial attentional deployment and modulate the excitability of areas subtending spatial attentional control. |
Ulrich Pomper; Maria Chait The impact of visual gaze direction on auditory object tracking Journal Article In: Scientific Reports, vol. 7, pp. 4640, 2017. @article{Pomper2017, Subjective experience suggests that we are able to direct our auditory attention independent of our visual gaze, e.g when shadowing a nearby conversation at a cocktail party. But what are the consequences at the behavioural and neural level? While numerous studies have investigated both auditory attention and visual gaze independently, little is known about their interaction during selective listening. In the present EEG study, we manipulated visual gaze independently of auditory attention while participants detected targets presented from one of three loudspeakers. We observed increased response times when gaze was directed away from the locus of auditory attention. Further, we found an increase in occipital alpha-band power contralateral to the direction of gaze, indicative of a suppression of distracting input. Finally, this condition also led to stronger central theta-band power, which correlated with the observed effect in response times, indicative of differences in top-down processing. Our data suggest that a misalignment between gaze and auditory attention both reduce behavioural performance and modulate underlying neural processes. The involvement of central theta-band and occipital alpha-band effects are in line with compensatory neural mechanisms such as increased cognitive control and the suppression of task irrelevant inputs. |
Tzvetan Popov; Sabine Kastner; Ole Jensen FEF-controlled alpha delay activity precedes stimulus-induced gamma-band activity in visual cortex Journal Article In: Journal of Neuroscience, vol. 37, no. 15, pp. 4117–4127, 2017. @article{Popov2017, Recent findings in the visual system of nonhuman primates have demonstrated an important role of gamma-band activity (40–100 Hz) in the feedforward flow of sensory information, whereas feedback control appears to be established dynamically by oscillations in the alpha (8–13 Hz) and beta (13–18 Hz) bands (van Kerkoerle et al., 2014; Bastos et al., 2015). It is not clear, however, how alpha oscillations are controlled and how they interact with the flow of visual information mediated by gamma-band activity. Using noninvasive human MEG recordings in subjects performing a visuospatial attention task, we show that fluctuations in alpha power during a delay period in a spatial attention task preceded subsequent stimulus-driven gamma-band activity. Importantly, these interactions correlated with behavioral performance. Using Granger analysis, we further show that the right frontal-eye field (rFEF) exerted feedback control of the visual alpha oscillations. Our findings suggest that alpha oscillations controlled by the FEF route cortical information flow by modulating gamma-band activity. |
Malcolm Proudfoot; Gustavo Rohenkohl; Andrew Quinn; Giles L. Colclough; Joanne Wuu; Kevin Talbot; Mark W. Woolrich; Michael Benatar; Anna C. Nobre; Martin R. Turner Altered cortical beta-band oscillations reflect motor system degeneration in amyotrophic lateral sclerosis Journal Article In: Human Brain Mapping, vol. 38, pp. 237–254, 2017. @article{Proudfoot2017, Continuous rhythmic neuronal oscillations underpin local and regional cortical communication. The impact of the motor system neurodegenerative syndrome amyotrophic lateral sclerosis (ALS) on the neuronal oscillations subserving movement might therefore serve as a sensitive marker of disease activity. Movement preparation and execution are consistently associated with modulations to neuronal oscillation beta (15–30 Hz) power. Cortical beta-band oscillations were measured using magnetoencephalography (MEG) during preparation for, execution, and completion of a visually cued, lateralized motor task that included movement inhibition trials. Eleven “classical” ALS patients, 9 with the primary lateral sclerosis (PLS) phenotype, and 12 asymptomatic carriers of ALS-associated gene mutations were compared with age-similar healthy control groups. Augmented beta desynchronization was observed in both contra- and ipsilateral motor cortices of ALS patients during motor preparation. Movement execution coincided with excess beta desynchronization in asymptomatic mutation carriers. Movement completion was followed by a slowed rebound of beta power in all symptomatic patients, further reflected in delayed hemispheric lateralization for beta rebound in the PLS group. This may correspond to the particular involvement of interhemispheric fibers of the corpus callosum previously demonstrated in diffusion tensor imaging studies. We conclude that the ALS spectrum is characterized by intensified cortical beta desynchronization followed by delayed rebound, concordant with a broader concept of cortical hyperexcitability, possibly through loss of inhibitory interneuronal influences. MEG may potentially detect cortical dysfunction prior to the development of overt symptoms, and thus be able to contribute to the assessment of future neuroprotective strategies. |
Craig G. Richter; Mariana Babo-Rebelo; Denis Schwartz; Catherine Tallon-Baudry In: NeuroImage, vol. 146, pp. 951–958, 2017. @article{Richter2017, A fundamental feature of the temporal organization of neural activity is phase-amplitude coupling between brain rhythms at different frequencies, where the amplitude of a higher frequency varies according to the phase of a lower frequency. Here, we show that this rule extends to brain-organ interactions. We measured both the infra-slow (~0.05 Hz) rhythm intrinsically generated by the stomach – the gastric basal rhythm – using electrogastrography, and spontaneous brain dynamics with magnetoencephalography during resting-state with eyes open. We found significant phase-amplitude coupling between the infra-slow gastric phase and the amplitude of the cortical alpha rhythm (10–11 Hz), with gastric phase accounting for 8% of the variance of alpha rhythm amplitude fluctuations. Gastric-alpha coupling was localized to the right anterior insula, and bilaterally to occipito-parietal regions. Transfer entropy, a measure of directionality of information transfer, indicates that gastric-alpha coupling is due to an ascending influence from the stomach to both the right anterior insula and occipito-parietal regions. Our results show that phase-amplitude coupling so far only observed within the brain extends to brain-viscera interactions. They further reveal that the temporal structure of spontaneous brain activity depends not only on neuron and network properties endogenous to the brain, but also on the slow electrical rhythm generated by the stomach. |
Siobhán Harty; Peter R. Murphy; Ian H. Robertson; Redmond G. O'Connell Parsing the neural signatures of reduced error detection in older age Journal Article In: NeuroImage, vol. 161, pp. 43–55, 2017. @article{Harty2017, Recent work has demonstrated that explicit error detection relies on a neural evidence accumulation process that can be traced in the human electroencephalogram (EEG). Here, we sought to establish the impact of natural aging on this process by recording EEG from young (18–35 years) and older adults (65–88 years) during the performance of a Go/No-Go paradigm in which participants were required to overtly signal their errors. Despite performing the task with equivalent accuracy, older adults reported substantially fewer errors, and the timing of their reports were both slower and more variable. These behavioral differences were linked to three key neurophysiological changes reflecting distinct parameters of the error detection decision process: a reduction in medial frontal delta/theta (2–7 Hz) activity, indicating diminished top-down input to the decision process; a slower rate of evidence accumulation as indexed by the rate of rise of a centro-parietal signal, known as the error positivity; and a higher motor execution threshold as indexed by lateralized beta-band (16–30 Hz) activity. Our data provide novel insight into how the natural aging process affects the neural underpinnings of error detection. |
Philipp N. Hesse; Constanze Schmitt; Steffen Klingenhoefer; Frank Bremmer Preattentive processing of numerical visual information Journal Article In: Frontiers in Human Neuroscience, vol. 11, pp. 70, 2017. @article{Hesse2017, Humans can perceive and estimate approximate numerical information, even when accurate counting is impossible e.g. due to short presentation time. If the number of objects to be estimated is small, typically around one to four items, observers are able to give very fast and precise judgments with high confidence – an effect that is called subitizing. Due to its speed and effortless nature subitizing has usually been assumed to be preattentive, putting it into the same category as other low level visual features like color or orientation. More recently, however, a number of studies have suggested that subitizing might be dependent on attentional resources. In our current study we investigated the potentially preattentive nature of visual numerical perception in the subitizing range by means of EEG. We presented peripheral, task irrelevant sequences of stimuli consisting of a certain number of circular patches while participants were engaged in a demanding, non-numerical detection task at the fixation point drawing attention away from the number stimuli. Within a sequence of stimuli of a given number of patches (called ‘standards') we interspersed some stimuli of different numerosity (‘oddballs'). We compared the evoked responses to visually identical stimuli that had been presented in two different conditions, serving as standard in one condition and as oddball in the other. We found significant visual mismatch negativity (vMMN) responses over parieto-occipital electrodes. In addition to the ERP analysis, we performed a time-frequency analysis to investigate whether the vMMN was accompanied by additional oscillatory processes. We found a concurrent increase in evoked theta power of similar strength over both hemispheres. Our results provide clear evidence for a preattentive processing of numerical visual information in the subitizing range. |
Roxane J. Itier; Karly N. Neath-Tavares Effects of task demands on the early neural processing of fearful and happy facial expressions Journal Article In: Brain Research, vol. 1663, pp. 38–50, 2017. @article{Itier2017, Task demands shape how we process environmental stimuli but their impact on the early neural processing of facial expressions remains unclear. In a within-subject design, ERPs were recorded to the same fearful, happy and neutral facial expressions presented during a gender discrimination, an explicit emotion discrimination and an oddball detection tasks, the most studied tasks in the field. Using an eye tracker, fixation on the face nose was enforced using a gaze-contingent presentation. Task demands modulated amplitudes from 200 to 350 ms at occipito-temporal sites spanning the EPN component. Amplitudes were more negative for fearful than neutral expressions starting on N170 from 150 to 350 ms, with a temporo-occipital distribution, whereas no clear effect of happy expressions was seen. Task and emotion effects never interacted in any time window or for the ERP components analyzed (P1, N170, EPN). Thus, whether emotion is explicitly discriminated or irrelevant for the task at hand, neural correlates of fearful and happy facial expressions seem immune to these task demands during the first 350 ms of visual processing. |
Syaheed B. Jabar; Alex Filipowicz; Britt Anderson Tuned by experience: How orientation probability modulates early perceptual processing Journal Article In: Vision Research, vol. 138, pp. 86–96, 2017. @article{Jabar2017a, Probable stimuli are more often and more quickly detected. While stimulus probability is known to affect decision-making, it can also be explained as a perceptual phenomenon. Using spatial gratings, we have previously shown that probable orientations are also more precisely estimated, even while participants remained naive to the manipulation. We conducted an electrophysiological study to investigate the effect that probability has on perception and visual-evoked potentials. In line with previous studies on oddballs and stimulus prevalence, low-probability orientations were associated with a greater late positive ‘P300' component which might be related to either surprise or decision-making. However, the early ‘C1' component, thought to reflect V1 processing, was dampened for high-probability orientations while later P1 and N1 components were unaffected. Exploratory analyses revealed a participant-level correlation between C1 and P300 amplitudes, suggesting a link between perceptual processing and decision-making. We discuss how these probability effects could be indicative of sharpening of neurons preferring the probable orientations, due either to perceptual learning, or to feature-based attention. |
Jianrong Jia; Ling Liu; Fang Fang; Huan Luo Sequential sampling of visual objects during sustained attention Journal Article In: PLoS Biology, vol. 15, no. 6, pp. e2001903, 2017. @article{Jia2017b, In a crowded visual scene, attention must be distributed efficiently and flexibly over time and space to accommodate different contexts. It is well established that selective attention enhances the corresponding neural responses, presumably implying that attention would persistently dwell on the task-relevant item. Meanwhile, recent studies, mostly in divided attentional contexts, suggest that attention does not remain stationary but samples objects alternately over time, suggesting a rhythmic view of attention. However, it remains unknown whether the dynamic mechanism essentially mediates attentional processes at a general level. Importantly, there is also a complete lack of direct neural evidence reflecting whether and how the brain rhythmically samples multiple visual objects during stimulus processing. To address these issues, in this study, we employed electroencephalography (EEG) and a temporal response function (TRF) approach, which can dissociate responses that exclusively represent a single object from the overall neuronal activity, to examine the spatiotemporal characteristics of attention in various attentional contexts. First, attention, which is characterized by inhibitory alpha-band (approximately 10 Hz) activity in TRFs, switches between attended and unattended objects every approximately 200 ms, suggesting a sequential sampling even when attention is required to mostly stay on the attended object. Second, the attentional spatiotemporal pattern is modulated by the task context, such that alpha-mediated switching becomes increasingly prominent as the task requires a more uniform distribution of attention. Finally, the switching pattern correlates with attentional behavioral performance. Our work provides direct neural evidence supporting a generally central role of temporal organization mechanism in attention, such that multiple objects are sequentially sorted according to their priority in attentional contexts. The results suggest that selective attention, in addition to the classically posited attentional “focus,” involves a dynamic mechanism for monitoring all objects outside of the focus. Our findings also suggest that attention implements a space (object)-to-time transformation by acting as a series of concatenating attentional chunks that operate on 1 object at a time. |
Elizabeth L. Johnson; Callum D. Dewar; Anne Kristin Solbakk; Tor Endestad; Torstein R. Meling; Robert T. Knight Bidirectional frontoparietal oscillatory systems support working memory Journal Article In: Current Biology, vol. 27, no. 12, pp. 1829–1835, 2017. @article{Johnson2017a, The ability to represent and select information in working memory provides the neurobiological infrastructure for human cognition. For 80 years, dominant views of working memory have focused on the key role of prefrontal cortex (PFC) [1–8]. However, more recent work has implicated posterior cortical regions [9–12], suggesting that PFC engagement during working memory is dependent on the degree of executive demand. We provide evidence from neurological patients with discrete PFC damage that challenges the dominant models attributing working memory to PFC-dependent systems. We show that neural oscillations, which provide a mechanism for PFC to communicate with posterior cortical regions [13], independently subserve communications both to and from PFC—uncovering parallel oscillatory mechanisms for working memory. Fourteen PFC patients and 20 healthy, age-matched controls performed a working memory task where they encoded, maintained, and actively processed information about pairs of common shapes. In controls, the electroencephalogram (EEG) exhibited oscillatory activity in the low-theta range over PFC and directional connectivity from PFC to parieto-occipital regions commensurate with executive processing demands. Concurrent alpha-beta oscillations were observed over parieto-occipital regions, with directional connectivity from parieto-occipital regions to PFC, regardless of processing demands. Accuracy, PFC low-theta activity, and PFC → parieto-occipital connectivity were attenuated in patients, revealing a PFC-independent, alpha-beta system. The PFC patients still demonstrated task proficiency, which indicates that the posterior alpha-beta system provides sufficient resources for working memory. Taken together, our findings reveal neurologically dissociable PFC and parieto-occipital systems and suggest that parallel, bidirectional oscillatory systems form the basis of working memory. |
Tim C. Kietzmann; Anna L. Gert; Frank Tong; Peter König Representational dynamics of facial viewpoint encoding Journal Article In: Journal of Cognitive Neuroscience, vol. 29, no. 4, pp. 637–651, 2017. @article{Kietzmann2017, Faces provide a wealth of information, including the identity of the seen person and social cues, such as the direction of gaze. Crucially, different aspects of face processing require distinct forms of information encoding. Another person's attentional focus can be derived based on a view-dependent code. In contrast, identification benefits from invariance across all view-points. Different cortical areas have been suggested to subserve these distinct functions. However, little is known about the temporal aspects of differential viewpoint encoding in the human brain. Here, we combine EEG with multivariate data analyses to resolve the dynamics of face processing with high temporal resolution. This revealed a distinct sequence of view-point encoding. Head orientations were encoded first, starting after around 60 msec of processing. Shortly afterward, peaking around 115 msec after stimulus onset, a different encoding scheme emerged. At this latency, mirror-symmetric viewing angles elicited highly similar cortical responses. Finally, about 280 msec after visual onset, EEG response patterns demon-strated a considerable degree of viewpoint invariance across all viewpoints tested, with the noteworthy exception of the front-facing view. Taken together, our results indicate that the processing of facial viewpoints follows a temporal sequence of encoding schemes, potentially mirroring different levels of computational complexity. |
Emmanuelle Kristensen; Anne Guerin-Dugué; Bertrand Rivet Regularization and a general linear model for event-related potential estimation Journal Article In: Behavior Research Methods, vol. 49, no. 6, pp. 2255–2274, 2017. @article{Kristensen2017, The usual event-related potential (ERP) estimation is the average across epochs time-locked on stimuli of interest. These stimuli are repeated several times to improve the signal-to-noise ratio (SNR) and only one evoked potential is estimated inside the temporal window of interest. Consequently, the average estimation does not take into account other neural responses within the same epoch that are due to short inter stimuli intervals. These adjacent neural responses may overlap and distort the evoked potential of interest. This overlapping process is a significant issue for the eye fixation-related potential (EFRP) technique in which the epochs are time-locked on the ocular fixations. The inter fixation intervals are not experimentally controlled and can be shorter than the neural response's latency. To begin, the Tikhonov regularization, applied to the classical average estimation, was introduced to improve the SNR for a given number of trials. The generalized cross validation was chosen to obtain the optimal value of the ridge parameter. Then, to deal with the issue of overlapping, the general linear model (GLM), was used to extract all neural responses inside an epoch. Finally, the regularization was also applied to it. The models (the classical average and the GLM with and without regularization) were compared on both simulated data and real datasets from a visual scene exploration in co-registration with an eye-tracker, and from a P300 Speller experiment. The regularization was found to improve the estimation by average for a given number of trials. The GLM was more robust and efficient, its efficiency actually reinforced by the regularization. |
Emmanuelle Kristensen; Bertrand Rivet; Anne Guérin-Dugué Estimation of overlapped Eye Fixation Related Potentials: The General Linear Model, a more flexible framework than the ADJAR algorithm Journal Article In: Journal of Eye Movement Research, vol. 10, no. 1, pp. 1–27, 2017. @article{Kristensen2017a, The Eye Fixation Related Potential (EFRP) estimation is the average of EEG signals across epochs at ocular fixation onset. Its main limitation is the overlapping issue. Inter Fixation Intervals (IFI) - typically around 300 ms in the case of unrestricted eye movement- depend on participants' oculomotor patterns, and can be shorter than the latency of the components of the evoked potential. If the duration of an epoch is longer than the IFI value, more than one fixation can occur, and some overlapping between adjacent neural responses ensues. The classical average does not take into account either the presence of several fixations during an epoch or overlapping. The Adjacent Response algorithm (ADJAR), which is popular for event-related potential estimation, was compared to the General Linear Model (GLM) on a real dataset from a conjoint EEG and eye-tracking experiment to address the overlapping issue. The results showed that the ADJAR algorithm was based on assumptions that were too restrictive for EFRP estimation. The General Linear Model appeared to be more robust and efficient. Different configurations of this model were compared to estimate the potential elicited at image onset, as well as EFRP at the beginning of exploration. These configurations took into account the overlap between the event-related potential at stimulus presentation and the following EFRP, and the distinction between the potential elicited by the first fixation onset and subsequent ones. The choice of the General Linear Model configuration was a tradeoff between assumptions about expected behavior and the quality of the EFRP estimation: the number of different potentials estimated by a given model must be controlled to avoid erroneous estimations with large variances. |
2016 |
Tjerk P. Gutteling; W. Pieter Medendorp Role of alpha-band oscillations in spatial updating across whole body motion Journal Article In: Frontiers in Psychology, vol. 7, pp. 671, 2016. @article{Gutteling2016, When moving around in the world, we have to keep track of important locations in our surroundings. In this process, called spatial updating, we must estimate our body motion and correct representations of memorized spatial locations in accordance with this motion. While the behavioral characteristics of spatial updating across whole body motion have been studied in detail, its neural implementation lacks detailed study. Here we use electro-encephalography (EEG) to distinguish various spectral components of this process. Subjects gazed at a central body-fixed point in otherwise complete darkness, while a target was briefly flashed, either left or right from this point. Subjects had to remember the location of this target as either moving along with the body or remaining fixed in the world while being translated sideways on a passive motion platform. After the motion, subjects had to indicate the remembered target location in the instructed reference frame using a mouse response. While the body motion, as detected by the vestibular system, should not affect the representation of body-fixed targets, it should interact with the representation of a world-centered target to update its location relative to the body. We show that the initial presentation of the visual target induced a reduction of alpha band power in contralateral parieto-occipital areas, which evolved to a sustained increase during the subsequent memory period. Motion of the body led to a reduction of alpha band power in central parietal areas extending to lateral parieto-temporal areas, irrespective of whether the targets had to be memorized relative to world or body. When updating a world-fixed target, its internal representation shifts hemispheres, only when subjects' behavioral responses suggested an update across the body midline. Our results suggest that parietal cortex is involved in both self-motion estimation and the selective application of this motion information to maintaining target locations as fixed in the world or fixed to the body. |
Karin Heidlmayr; Karine Dore-Mazars; Xavier Aparico; Frederic Isel In: PLoS ONE, vol. 11, no. 11, pp. e0165029, 2016. @article{Heidlmayr2016, In the present electroencephalographical study, we asked to which extent executive control processes are shared by both the language and motor domain. The rationale was to examine whether executive control processes whose efficiency is reinforced by the frequent use of a second language can lead to a benefit in the control of eye movements, i.e. a non-linguistic activity. For this purpose, we administrated to 19 highly proficient late French-German bilingual participants and to a control group of 20 French monolingual participants an antisaccade task, i.e. a specific motor task involving control. In this task, an automatic saccade has to be suppressed while a voluntary eye movement in the opposite direction has to be carried out. Here, our main hypothesis is that an advantage in the antisaccade task should be observed in the bilinguals if some properties of the control processes are shared between linguistic and motor domains. ERP data revealed clear differences between bilinguals and monolinguals. Critically, we showed an increased N2 effect size in bilinguals, thought to reflect better efficiency to monitor conflict, combined with reduced effect sizes on markers reflecting inhibitory control, i.e. cue-locked positivity, the target-locked P3 and the saccade-locked presaccadic positivity (PSP). Moreover, effective connectivity analyses (dynamic causal modelling; DCM) on the neuronal source level indicated that bilinguals rely more strongly on ACC-driven control while monolinguals rely on PFC-driven control. Taken together, our combined ERP and effective connectivity findings may reflect a dynamic interplay between strengthened conflict monitoring, associated with subsequently more efficient inhibition in bilinguals. Finally, L2 proficiency and immersion experience constitute relevant factors of the language background that predict efficiency of inhibition. To conclude, the present study provided ERP and effective connectivity evidence for domain-general executive control involvement in handling multiple language use, leading to a control advantage in bilingualism. |
Christoph Huber-Huber; Thomas Ditye; María Marchante Fernández; Ulrich Ansorge Using temporally aligned event-related potentials for the investigation of attention shifts prior to and during saccades Journal Article In: Neuropsychologia, vol. 92, pp. 129–141, 2016. @article{HuberHuber2016, According to the pre-motor theory of attention, attention is shifted to a saccade's landing position before the saccade is executed. Such pre-saccadic attention shifts are usually studied in psychophysical dual-task conditions, with a target-discrimination task before saccade onset. Here, we present a novel approach to investigate pre-saccadic attention shifts with the help of event-related potentials (ERPs). Participants executed one or two saccades to color-defined targets while ERPs and eye-movements were recorded. In single-target blocks participants executed a single saccade. In two-targets blocks participants made either a single saccade to one of the targets, or two successive saccades to both targets. Importantly, in two-targets blocks, targets could appear on the same or on opposite sides of the vertical midline. This allowed us to study contra-to-ipsilateral ERP differences (such as the N2pc or PCN) that reflect attention shifts to the targets, prior to saccade onset and during saccades. If pre-saccadic attention shifts to saccade target locations are necessary for saccade execution and if searched-for saccade targets capture attention, there should be enhanced attentional competition (1) between two targets compared to single targets; (2) between two opposite-sides targets compared to two same-side targets; and (3) in two saccades rather than one saccade conditions: More attentional competition was expected to delay saccade latency and to weaken pre-saccadic laterality effects in ERPs. Hypotheses were tested by means of temporally aligned ERPs that were simultaneously time-locked to stimulus onsets, saccade onsets, and saccade offsets. Predictions (1) and (2) were partly and fully confirmed, respectively, but no evidence was found for (3). We explain the implications of our results for the role of attention during saccade preparation, and we point out how temporally aligned ERPs compare to ICA-based electroencephalogram (EEG) artifact correction procedures and to psychophysical dual-task approaches. |
Akiko Ikkai; Sangita Dandekar; Clayton E. Curtis Lateralization in alpha-band oscillations predicts the locus and spatial distribution of attention Journal Article In: PLoS ONE, vol. 11, no. 5, pp. e0154796, 2016. @article{Ikkai2016, Attending to a task-relevant location changes how neural activity oscillates in the alpha band (8-13Hz) in posterior visual cortical areas. However, a clear understanding of the relationships between top-down attention, changes in alpha oscillations in visual cortex, and attention performance are still poorly understood. Here, we tested the degree to which the posterior alpha power tracked the locus of attention, the distribution of attention, and how well the topography of alpha could predict the locus of attention. We recorded magnetoencephalographic (MEG) data while subjects performed an attention demanding visual discrimination task that dissociated the direction of attention from the direction of a saccade to indicate choice. On some trials, an endogenous cue predicted the target's location, while on others it contained no spatial information. When the target's location was cued, alpha power decreased in sensors over occipital cortex contralateral to the attended visual field. When the cue did not predict the target's location, alpha power again decreased in sensors over occipital cortex, but bilaterally, and increased in sensors over frontal cortex. Thus, the distribution and the topography of alpha reliably indicated the locus of covert attention. Together, these results suggest that alpha synchronization reflects changes in the excitability of populations of neurons whose receptive fields match the locus of attention. This is consistent with the hypothesis that alpha oscillations reflect the neural mechanisms by which top-down control of attention biases information processing and modulate the activity of neurons in visual cortex. |
Sarah C. Krall; Lukas J. Volz; Eileen Oberwelland; Christian Grefkes; Gereon R. Fink; Kerstin Konrad The right temporoparietal junction in attention and social interaction: A transcranial magnetic stimulation study Journal Article In: Human Brain Mapping, vol. 37, no. 2, pp. 796–807, 2016. @article{Krall2016, The right temporoparietal junction (rTPJ) has been associated with the ability to reorient attention to unexpected stimuli and the capacity to understand others' mental states (theory of mind [ToM]/false belief). Using activation likelihood estimation meta-analysis we previously unraveled that the anterior rTPJ is involved in both, reorienting of attention and ToM, possibly indicating a more general role in attention shifting. Here, we used neuronavigated transcranial magnetic stimulation to directly probe the role of the rTPJ across attentional reorienting and false belief. Task performance in a visual cueing paradigm and false belief cartoon task was investigated after application of continuous theta burst stimulation (cTBS) over anterior rTPJ (versus vertex, for control). We found that attentional reorienting was significantly impaired after rTPJ cTBS compared with control. For the false belief task, error rates in trials demanding a shift in mental state significantly increased. Of note, a significant positive correlation indicated a close relation between the stimulation effect on attentional reorienting and false belief trials. Our findings extend previous neuroimaging evidence by indicating an essential overarching role of the anterior rTPJ for both cognitive functions, reorienting of attention and ToM. |
Florence Campana; Ignacio Rebollo; Anne E. Urai; Valentin Wyart; Catherine Tallon-Baudry Conscious vision proceeds from global to local content in goal-directed tasks and spontaneous vision Journal Article In: Journal of Neuroscience, vol. 36, no. 19, pp. 5200–5213, 2016. @article{Campana2016, The reverse hierarchy theory (Hochstein and Ahissar, 2002) makes strong, but so far untested, predictions on conscious vision. In this theory, local details encoded in lower-order visual areas are unconsciously processed before being automatically and rapidly combined into global information in higher-order visual areas, where conscious percepts emerge. Contingent on current goals, local details can afterward be consciously retrieved. This model therefore predicts that (1) global information is perceived faster than local details, (2) global information is computed regardless of task demands during early visual processing, and (3) spontaneous vision is dominated by global percepts. We designed novel textured stimuli that are, as opposed to the classic Navon's letters, truly hierarchical (i.e., where global information is solely defined by local information but where local and global orientations can still be manipulated separately). In line with the predictions, observers were systematically faster reporting global than local properties of those stimuli. Second, global information could be decoded from magneto-encephalographic data during early visual processing regardless of task demands. Last, spontaneous subjective reports were dominated by global information and the frequency and speed of spontaneous global perception correlated with the accuracy and speed in the global task. No such correlation was observed for local information. We therefore show that information at different levels of the visual hierarchy is not equally likely to become conscious; rather, conscious percepts emerge preferentially at a global level. We further show that spontaneous reports can be reliable and are tightly linked to objective performance at the global level. |
Jing Chen; Matteo Valsecchi; Karl R. Gegenfurtner LRP predicts smooth pursuit eye movement onset during the ocular tracking of self-generated movements Journal Article In: Journal of Neurophysiology, vol. 116, no. 1, pp. 18–29, 2016. @article{Chen2016c, Several studies indicated that human observers are very efficient at tracking self-generated hand movements with their gaze, yet it is not clear whether this is simply a byproduct of the predictability of self-generated actions or if it results from a deeper coupling of the somatomotor and oculomotor systems. In a first behavioral experiment we compared pursuit performance as observers either followed their own finger or tracked a dot whose motion was externally generated but mimicked their finger motion. We found that even when the dot motion was completely predictable both in terms of onset time and in terms of kinematics, pursuit was not identical to the one produced as the observers tracked their finger, as evidenced by increased rate of catch-up saccades and by the fact that in the initial phase of the movement gaze was lagging behind the dot, whereas it was ahead of the finger. In a second experiment we recorded EEG in the attempt to find a direct link between the finger motor preparation, indexed by the lateralized readiness potential (LRP), and the latency of smooth pursuit. After taking into account finger movement onset variability, we observed larger LRP amplitudes associated with earlier smooth pursuit onset across trials. The same held across subjects, where average LRP onset correlated with average eye latency. The evidence from both experiments concurs to indicate that a strong coupling exists between the motor systems leading to eye and finger movements and that simple top-down predictive signals are unlikely to support optimal coordination. |
Hak Soo Choi; Shinjung Kim; Donghoon Lee; Chang Seok Kim; Myung Yung Jeong Synchronized tracking of brain cognitive processing using EEG and vision signals Journal Article In: Applied Spectroscopy Reviews, vol. 51, no. 7-9, pp. 592–602, 2016. @article{Choi2016, Many efforts have been made to understand the neural mechanisms of the human brain. However, visualization of human brain processing has been a main challenge in the field. It is still largely unknown how the human brain allocates attention to target objects while excluding unrelated information in a complex visual environment. Using simultaneous electroencephalogram and eye tracking measurements, in this study, we analyzed two brain regions separately to detect the brain wave activity during visual information processing. We observed an activation difference between sensory (P100) and cognitive (P300) processing, and the behavioral response was improved by providing valid cue-target location information. Furthermore, neural processing was evaluated according to the specific area of brain activation and eye movements during cognitive processing. Our results demonstrate the correlation between behavior performance and visual stimuli and suggest an advantage of combined paradigms for efficient visual information processing. |
Lauren R. Godier; Jessica C. Scaife; Sven Braeutigam; Rebecca J. Park Enhanced early neuronal processing of food pictures in Anorexia Nervosa: A magnetoencephalography study Journal Article In: Psychiatry Journal, vol. 2016, pp. 1–13, 2016. @article{Godier2016, Neuroimaging studies in Anorexia Nervosa (AN) have shown increased activation in reward and cognitive control regions in response to food, and a behavioral attentional bias (AB) towards food stimuli is reported. This study aimed to further investigate the neural processing of food using magnetoencephalography (MEG). Participants were 13 females with restricting-type AN, 14 females recovered from restricting-type AN, and 15 female healthy controls. MEG data was acquired whilst participants viewed high- and low-calorie food pictures. Attention was assessed with a reaction time task and eye tracking. Time-series analysis suggested increased neural activity in response to both calorie conditions in the AN groups, consistent with an early AB. Increased activity was observed at 150 ms in the current AN group. Neuronal activity at this latency was at normal level in the recovered group; however, this group exhibited enhanced activity at 320 ms after stimulus. Consistent with previous studies, analysis in source space and behavioral data suggested enhanced attention and cognitive control processes in response to food stimuli in AN. This may enable avoidance of salient food stimuli and maintenance of dietary restraint in AN. A later latency of increased activity in the recovered group may reflect a reversal of this avoidance, with source space and behavioral data indicating increased visual and cognitive processing of food stimuli. |
Tal Golan; Ido Davidesco; Meir Meshulam; David M. Groppe; Pierre Mégevand; Erin M. Yeagle; Matthew S. Goldfinger; Michal Harel; Lucia Melloni; Charles E. Schroeder; D. L. Deouell; Ashesh D. Mehta; Rafael Malach Human intracranial recordings link suppressed transients rather than 'filling-in' to perceptual continuity across blinks Journal Article In: eLife, vol. 5, pp. 1–28, 2016. @article{Golan2016, We hardly notice our eye blinks, yet an externally generated retinal interruption of a similar duration is perceptually salient. We examined the neural correlates of this perceptual distinction using intracranially measured ECoG signals from human visual cortex in 14 patients. In early visual areas (V1 and V2), the disappearance of the stimulus due to either invisible blinks or salient blank video frames ('gaps') led to a similar drop in activity level, followed by a positive overshoot beyond baseline, triggered by stimulus reappearance. Ascending the visual hierarchy, the reappearance-related overshoot gradually subsided for blinks but not for gaps. By contrast, the disappearance-related drop did not follow the perceptual distinction - it was actually slightly more pronounced for blinks than for gaps. These findings suggest that blinks' limited visibility compared with gaps is correlated with suppression of blink-related visual activity transients, rather than with 'filling-in' of the occluded content during blinks. |
Gil Gonen-Yaacovi; Ayelet Arazi; Nitzan Shahar; Anat Karmon; Shlomi Haar; Nachshon Meiran; Ilan Dinstein Increased ongoing neural variability in ADHD Journal Article In: Cortex, vol. 81, pp. 50–63, 2016. @article{GonenYaacovi2016, Attention Deficit Hyperactivity Disorder (ADHD) has been described as a disorder where frequent lapses of attention impair the ability of an individual to focus/attend in a sustained manner, thereby generating abnormally large intra-individual behavioral variability across trials. Indeed, increased reaction time (RT) variability is a fundamental behavioral characteristic of individuals with ADHD found across a large number of cognitive tasks. But what is the underlying neurophysiology that might generate such behavioral instability? Here, we examined trial-by-trial EEG response variability to visual and auditory stimuli while subjects' attention was diverted to an unrelated task at the fixation cross. Comparisons between adult ADHD and control participants revealed that neural response variability was significantly larger in the ADHD group as compared with the control group in both sensory modalities. Importantly, larger trial-by-trial variability in ADHD was apparent before and after stimulus presentation as well as in trials where the stimulus was omitted, suggesting that ongoing (rather than stimulus-evoked) neural activity is continuously more variable (noisier) in ADHD. While the patho-physiological mechanisms causing this increased neural variability remain unknown, they appear to act continuously rather than being tied to a specific sensory or cognitive process. |