EyeLink fMRI/MEG出版物
所有EyeLink功能磁共振成像和MEG研究出版物(同时进行眼睛跟踪)至2023年(一些早于2024年)均按年份列出。您可以使用Visual Cortex、Neural Plasticity、MEG等关键词搜索出版物。您还可以搜索个人作者姓名。如果我们错过了任何EyeLink功能磁共振成像或MEG文章,请给我们发电子邮件!
2023 |
William Narhi-Martinez; Jiageng Chen; Julie D. Golomb Probabilistic visual attentional guidance triggers “feature avoidance” response errors Journal Article In: Journal of Experimental Psychology: Human Perception and Performance, vol. 49, no. 6, pp. 802–820, 2023. @article{NarhiMartinez2023, Spatial attention affects not only where we look, but also what we perceive and remember in attended and unattended locations. Previous work has shown that manipulating attention via top-down cues or bottom-up capture leads to characteristic patterns of feature errors. Here we investigated whether experience-driven attentional guidance—and probabilistic attentional guidance more generally—leads to similar feature errors. We conducted a series of pre-registered experiments employing a learned spatial probability or probabilistic pre-cue; all experiments involved reporting the color of one of four simultaneously presented stimuli using a continuous response modality. When the probabilistic cues guided attention to an invalid (nontarget) location, participants were less likely to report the target color, as expected. But strikingly, their errors tended to be clustered around a nontarget color opposite the color of the invalidly-cued nontarget. This “feature avoidance” was found for both experience-driven and top-down probabilistic cues, and appears to be the product of a strategic—but possibly subconscious—behavior, occurring when information about the features and/or feature-location bindings outside the focus of attention is limited. The findings emphasize the importance of considering how different types of attentional guidance can exert different effects on feature perception and memory reports. |
William Narhi-Martinez; Blaire Dube; Jiageng Chen; Andrew B. Leber; Julie D. Golomb Suppression of a salient distractor protects the processing of target features Journal Article In: Psychonomic Bulletin & Review, pp. 1–11, 2023. @article{NarhiMartinez2023a, We are often bombarded with salient stimuli that capture our attention and distract us from our current goals. Decades of research have shown the robust detrimental impacts of salient distractors on search performance and, of late, in leading to altered feature perception. These feature errors can be quite extreme, and thus, undesirable. In search tasks, salient distractors can be suppressed if they appear more frequently in one location, and this learned spatial suppression can lead to reductions in the cost of distraction as measured by reaction time slowing. Can learned spatial suppression also protect against visual feature errors? To investigate this question, participants were cued to report one of four briefly presented colored squares on a color wheel. On two-thirds of trials, a salient distractor appeared around one of the nontarget squares, appearing more frequently in one location over the course of the experiment. Participants' responses were fit to a model estimating performance parameters and compared across conditions. Our results showed that general performance (guessing and precision) improved when the salient distractor appeared in a likely location relative to elsewhere. Critically, feature swap errors (probability of misreporting the color at the salient distractor's location) were also significantly reduced when the distractor appeared in a likely location, suggesting that learned spatial suppression of a salient distractor helps protect the processing of target features. This study provides evidence that, in addition to helping us avoid salient distractors, suppression likely plays a larger role in helping to prevent distracting information from being encoded. |
Amir Assouline; Avi Mendelsohn Weaving a story: Narrative formation over prolonged time scales engages social cognition and frontoparietal networks Journal Article In: European Journal of Neuroscience, vol. 57, no. 5, pp. 1–15, 2023. @article{Assouline2023, Forming narratives is of key importance to human experience, enabling one to render large amounts of information into relatively compacted stories for future retrieval, giving meaning to otherwise fragmented occurrences. The neural mechanisms that underlie coherent narrative construction of causally connected information over prolonged temporal periods are yet unclear. Participants in this fMRI study observed consecutive scenes from a full-length movie either in their original order, enabling causal inferences over time, or in reverse order, impeding a key component of coherent narratives—causal inference. In between scenes, we presented short periods of blank screens for examining post-encoding processing effects. Using multivariate pattern analysis (MVPA) followed by seed-base correlation analysis, we hypothesized that net- works involved in online monitoring of incoming information on the one hand, and offline processing of previous occurrences on the other would differ between the groups. We found that despite the exposure to the same scenes, the chronological-order condition exhibited enhanced functional connectivity in frontoparietal regions associated with information integration and working memory. The reverse-order condition yielded offline, post-scene coactivation of neural networks involved in social cognition and particularly theory of mind and action comprehension. These findings shed light on offline processes of narrative construction efforts, highlighting the role of social cognition networks in seeking for narrative coherence. |
Emily Atkinson; Akira Omaki Adaptation of gap predictions in filler-gap dependency processing during reading Journal Article In: Languages, vol. 8, no. 4, pp. 1–28, 2023. @article{Atkinson2023, Syntactic adaptation effects have been demonstrated for an expanding list of structure types, but the mechanism underlying this effect is still being explored. In the current work on filler-gap dependency processing, we examined whether exposing participants to a less common gap location—prepositional object (PO) gaps—altered their gap predictions, and whether these effects would transfer across tasks when this input was presented in a quasi-naturalistic way (i.e., by reading stories). In Experiment 1, we demonstrated that comprehenders dampened their direct object (DO) gap predictions following exposure to PO gaps. However, Experiments 2A and 2B suggest that these adaptation effects did not transfer when the quasi-naturalistic exposure phase was presented as a separate task (Experiment 2A) and when they also needed to generalize from a syntactic to a semantic measure of direct object gap predictions (i.e., filled gap vs. plausibility mismatch sentences; Experiment 2B). Overall, these experiments add filler-gap dependency processing, as well as the gap predictions associated with it, to the growing list of structures demonstrating adaptation effects, while also suggesting that this effect may be specific to a singular experimental task environment. |
Naila Ayala; Abdullah Zafar; Suzanne Kearns; Elizabeth Irving; Shi Cao; Ewa Niechwiej-Szwedo The effects of task difficulty on gaze behaviour during landing with visual flight rules in low-time pilots Journal Article In: Journal of Eye Movement Research, vol. 16, no. 1, pp. 1–16, 2023. @article{Ayala2023, Eye movements have been used to examine the cognitive function of pilots and understand how information processing abilities impact performance. Traditional and advanced measures of gaze behaviour effectively reflect changes in cognitive load, situational awareness, and expert-novice differences. However, the extent to which gaze behaviour changes during the early stages of skill development has yet to be addressed. The current study investigated the impact of task difficulty on gaze behaviour in low-time pilots (N=18) while they completed simulated landing scenarios. An increase in task difficulty resulted in longer fixation of the runway, and a reduction in the stationary gaze entropy (gaze dispersion) and gaze transition entropy (sequence complexity). These findings suggest that pilots' gaze became less complex and more focused on fewer areas of interest when task difficulty increased. Additionally, a novel approach to identify and track instances when pilots restrict their attention outside the cockpit (i.e., gaze tunneling) was explored and shown to be sensitive to changes in task difficulty. Altogether, the gaze-related metrics used in the present study provide valuable information for assessing pilots gaze behaviour and help further understand how gaze contributes to better performance in low-time pilots |
Eve C. Ayar; Michelle R. Heusser; Clara Bourrelly; Neeraj J. Gandhi Distinct context- and content- dependent population codes in superior colliculus during sensation and action Journal Article In: Proceedings of the National Academy of Sciences, vol. 120, no. 40, pp. 1–12, 2023. @article{Ayar2023, Sensorimotor transformation is the process of first sensing an object in the environment and then producing a movement in response to that stimulus. For visually guided saccades, neurons in the superior colliculus (SC) emit a burst of spikes to register the appearance of stimulus, and many of the same neurons discharge another burst to initiate the eye movement. We investigated whether the neural signatures of sensation and action in SC depend on context. Spiking activity along the dorsoventral axis was recorded with a laminar probe as Rhesus monkeys generated saccades to the same stimulus location in tasks that require either executive control to delay saccade onset until permission is granted or the production of an immediate response to a target whose onset is predictable. Using dimensionality reduction and discriminability methods, we show that the subspaces occupied during the visual and motor epochs were both distinct within each task and differentiable across tasks. Single-unit analyses, in contrast, show that the movement-related activity of SC neurons was not different between tasks. These results demonstrate that statistical features in neural activity of simultaneously recorded ensembles provide more insight than single neurons. They also indicate that cognitive processes associated with task requirements are multiplexed in SC population activity during both sensation and action and that downstream structures could use this activity to extract context. Additionally, the entire manifolds associated with sensory and motor responses, respectively, may be larger than the subspaces explored within a certain set of experiments. |
Reza Azadi; Simon Bohn; Emily Lopez; Rosa Lafer-Sousa; Karen Wang; Mark A. G. G. Eldridge; Arash Afraz Image-dependence of the detectability of optogenetic stimulation in macaque inferotemporal cortex Journal Article In: Current Biology, vol. 33, no. 3, pp. 581–588, 2023. @article{Azadi2023, Artificial activation of neurons in early visual areas induces perception of simple visual flashes.1,2 Accordingly, stimulation in high-level visual cortices is expected to induce perception of complex features.3,4 However, results from studies in human patients challenge this expectation. Stimulation rarely induces any detectable visual event, and never a complex one, in human subjects with closed eyes.2 Stimulation of the face-selective cortex in a human patient led to remarkable hallucinations only while the subject was looking at faces.5 In contrast, stimulations of color- and face-selective sites evoke notable hallucinations independent of the object being viewed.6 These anecdotal observations suggest that stimulation of high-level visual cortex can evoke perception of complex visual features, but these effects depend on the availability and content of visual input. In this study, we introduce a novel psychophysical task to systematically investigate characteristics of the perceptual events evoked by optogenetic stimulation of macaque inferior temporal (IT) cortex. We trained macaque monkeys to detect and report optogenetic impulses delivered to their IT cortices7,8,9 while holding fixation on object images. In a series of experiments, we show that detection of cortical stimulation is highly dependent on the choice of images presented to the eyes and it is most difficult when fixating on a blank screen. These findings suggest that optogenetic stimulation of high-level visual cortex results in easily detectable distortions of the concurrent contents of vision. |
Zahra Azizi; Reza Ebrahimpour Explaining integration of evidence separated by temporal gaps with frontoparietal circuit models Journal Article In: Neuroscience, vol. 509, pp. 74–95, 2023. @article{Azizi2023, Perceptual decisions rely on accumulating sensory evidence over time. However, the accumulation process is complicated in real life when evidence resulted from separated cues over time. Previous studies demonstrate that participants are able to integrate information from two separated cues to improve their performance invariant to an interval between the cues. However, there is no neural model that can account for accuracy and confidence in decisions when there is a time interval in evidence. We used behavioral and EEG datasets from a visual choice task —Random dot motion— with separated evidence to investigate three candid distributed neural networks. We showed that decisions based on evidence accumulation by separated cues over time are best explained by the interplay of recurrent cortical dynamics of centro-parietal and frontal brain areas while an uncertainty-monitoring module included in the model. |
Anisha S. Babu; Paul S. Scotti; Julie D. Golomb The dominance of spatial information in object identity judgments: A persistent congruency bias even amidst conflicting statistical regularities Journal Article In: Journal of Experimental Psychology: Human Perception and Performance, vol. 49, no. 5, pp. 672–686, 2023. @article{Babu2023, Previous studies have posited that spatial location plays a special role in object recognition. Notably, the “spatial congruency bias (SCB)” is a tendency to report objects as the same identity if they are presented at the same location, compared to different locations. Here we found that even when statistical regularities were manipulated in the opposite direction (objects in the same location were three times more likely to be different identities), subjects still exhibited a robust SCB (more likely to report them as the same identity). We replicated this finding across two preregistered experiments. Only in a third experiment where we explicitly informed subjects of the manipulation did the SCB disappear, though the lack of a significantly reversed bias suggests the ingrained congruency bias was not completely overcome. The inclusion of catch trials where the second object was completely masked further bolsters previous evidence that the congruency bias is perceptual, not simply a guessing strategy. These results reinforce the dominant role of spatial information during object recognition and present the SCB as a strong perceptual phenomenon that is incredibly hard to overcome even in the face of opposing regularities and explicit instruction. |
Leah Bakst; Joseph T. McGuire Experience-driven recalibration of learning from surprising events Journal Article In: Cognition, vol. 232, no. 2023, pp. 1–11, 2023. @article{Bakst2023, Different environments favor different patterns of adaptive learning. A surprising event that in one context would accelerate belief updating might, in another context, be downweighted as a meaningless outlier. Here, we investigated whether people would spontaneously regulate the influence of surprise on learning in response to event-by-event experiential feedback. Across two experiments, we examined whether participants performing a perceptual judgment task under spatial uncertainty (n = 29 |
Zuzanna Z. Balewski; Thomas W. Elston; Eric B. Knudsen; Joni D. Wallis Value dynamics affect choice preparation during decision-making Journal Article In: Nature Neuroscience, vol. 26, no. 9, pp. 1575–1583, 2023. @article{Balewski2023, During decision-making, neurons in the orbitofrontal cortex (OFC) sequentially represent the value of each option in turn, but it is unclear how these dynamics are translated into a choice response. One brain region that may be implicated in this process is the anterior cingulate cortex (ACC), which strongly connects with OFC and contains many neurons that encode the choice response. We investigated how OFC value signals interacted with ACC neurons encoding the choice response by performing simultaneous high-channel count recordings from the two areas in nonhuman primates. ACC neurons encoding the choice response steadily increased their firing rate throughout the decision-making process, peaking shortly before the time of the choice response. Furthermore, the value dynamics in OFC affected ACC ramping—when OFC represented the more valuable option, ACC ramping accelerated. Because OFC tended to represent the more valuable option more frequently and for a longer duration, this interaction could explain how ACC selects the more valuable response. |
Andreas Bär; Hannah E. Bär; Max Schneider; Fritz Renner The pupil as a window to the mind's eye: Greater emotionality of episodic imagery than verbal visualisation of rewarding activities Journal Article In: Journal of Experimental Psychopathology, vol. 14, no. 2, pp. 1–11, 2023. @article{Baer2023, Episodic imagery has been shown to amplify emotion more than abstract verbal representations. This may prove useful for clinical interventions aiming to motivate adaptive behaviours. However, most findings rely on self-report measures and verbal control conditions not designed to actively prevent automatic engagement in episodic imagery. We thus investigated the difference in emotionality between Episodic Imagery (EI) and Verbal Visualisation (VV) using pupil dilation as a physiological measure of emotional arousal. A sample of 75 participants listened to audio recordings describing activities in a positive manner. Subjects were randomly assigned to the EI or VV condition. Participants in the EI condition imagined performing the described activity, while participants in the VV condition visualised the words constituting the descriptions. As predicted, EI led to greater pupil dilation than VV, independent of mental effort. Self-reported anticipatory reward assessed throughout the task was also greater for EI than VV, yet no difference was found for arousal, anticipated reward or motivation. Our findings extend previous work demonstrating the property of episodic imagery to amplify emotion to a physiological level using pupillometry. However, we did not find a transfer to motivation, which is in line with previous studies using verbal control conditions for episodic imagery. |
Hannah E. Bär; Jessica Werthmann; Andreas Paetsch; Fritz Renner The traces of imagination: Early attention bias toward positively imagined stimuli Journal Article In: Psychological Research, vol. 87, no. 5, pp. 1475–1483, 2023. @article{Baer2023a, Positively imagined activities may capture visual attention due to an increase in positive value. Increasing attention toward activities, in turn, may prove useful for clinical interventions aiming to motivate behavioral engagement. Employing a within-subject experimental design, we examined the effect of positive imagery on attention using a visual probe task with concurrent eye tracking. Adults from the general population (N = 54) imagined performing activities involving visually presented objects in a positive (focusing on the positive emotional impact) or neutral (focusing on a neutral circumstance) manner. They then completed a visual probe task using picture stimuli depicting one object per type of imagery. Positive compared to neutral imagery increased self-reported behavioral motivation and biased the direction, but not the duration, of gaze toward objects associated with the imagined activities. An exploratory analysis showed a positive association between the direction bias and depressive symptoms. Our findings build on existing literature on positive imagery as a motivational amplifier by highlighting early attention as an underlying cognitive mechanism. |
David L. Barack; Akram Bakkour; Daphna Shohamy; C. Daniel Salzman Visuospatial information foraging describes search behavior in learning latent environmental features Journal Article In: Scientific Reports, vol. 13, no. 1, pp. 1–18, 2023. @article{Barack2023, In the real world, making sequences of decisions to achieve goals often depends upon the ability to learn aspects of the environment that are not directly perceptible. Learning these so-called latent features requires seeking information about them. Prior efforts to study latent feature learning often used single decisions, used few features, and failed to distinguish between reward-seeking and information-seeking. To overcome this, we designed a task in which humans and monkeys made a series of choices to search for shapes hidden on a grid. On our task, the effects of reward and information outcomes from uncovering parts of shapes could be disentangled. Members of both species adeptly learned the shapes and preferred to select tiles expected to be informative earlier in trials than previously rewarding ones, searching a part of the grid until their outcomes dropped below the average information outcome—a pattern consistent with foraging behavior. In addition, how quickly humans learned the shapes was predicted by how well their choice sequences matched the foraging pattern, revealing an unexpected connection between foraging and learning. This adaptive search for information may underlie the ability in humans and monkeys to learn latent features to support goal-directed behavior in the long run. |
Riccardo Barbieri; Felix M. Töpfer; Joram Soch; Carsten Bogler; Henning Sprekeler; John Dylan Haynes Encoding of continuous perceptual choices in human early visual cortex Journal Article In: Frontiers in Human Neuroscience, vol. 17, pp. 1–18, 2023. @article{Barbieri2023, Introduction: Research on the neural mechanisms of perceptual decision-making has typically focused on simple categorical choices, say between two alternative motion directions. Studies on such discrete alternatives have often suggested that choices are encoded either in a motor-based or in an abstract, categorical format in regions beyond sensory cortex. Methods: In this study, we used motion stimuli that could vary anywhere between 0° and 360° to assess how the brain encodes choices for features that span the full sensory continuum. We employed a combination of neuroimaging and encoding models based on Gaussian process regression to assess how either stimuli or choices were encoded in brain responses. Results: We found that single-voxel tuning patterns could be used to reconstruct the trial-by-trial physical direction of motion as well as the participants' continuous choices. Importantly, these continuous choice signals were primarily observed in early visual areas. The tuning properties in this region generalized between choice encoding and stimulus encoding, even for reports that reflected pure guessing. Discussion: We found only little information related to the decision outcome in regions beyond visual cortex, such as parietal cortex, possibly because our task did not involve differential motor preparation. This could suggest that decisions for continuous stimuli take can place already in sensory brain regions, potentially using similar mechanisms to the sensory recruitment in visual working memory. |
Monica Barbira; Mireille J. Babineaua; Anne-Caroline Fiévét; Anne Christophe; Anne-Caroline Fiéveta; Anne Christophe Rapid infant learning of syntactic–semantic links Journal Article In: Proceedings of the National Academy of Sciences, vol. 120, no. 1, pp. 1–6, 2023. @article{Barbira2023, In the second year of life, infants begin to rapidly acquire the lexicon of their native lan- guage. A key learning mechanism underlying this acceleration is syntactic bootstrapping: the use of hidden cues in grammar to facilitate vocabulary learning. How infants forge the syntactic–semantic links that underlie this mechanism, however, remains specula- tive. A hurdle for theories is identifying computationally light strategies that have high precision within the complexity of the linguistic signal. Here, we presented 20-mo-old infants with novel grammatical elements in a complex natural language environment and measured their resultant vocabulary expansion. We found that infants can learn and exploit a natural language syntactic–semantic link in less than 30 min. The rapid speed of acquisition of a new syntactic bootstrap indicates that even emergent syntactic–semantic links can accelerate language learning. The results suggest that infants employ a cognitive network of efficient learning strategies to self-supervise language development. |
Naomi N. Odean; Mehdi Sanayei; Michael N. Shadlen Transient oscillations of neural firing rate associated with routing of evidence in a perceptual decision Journal Article In: Journal of Neuroscience, vol. 43, no. 37, pp. 6369–6383, 2023. @article{Odean2023, To form a perceptual decision, the brain must acquire samples of evidence from the environment and incorporate them in computations that mediate choice behavior. While much is known about the neural circuits that process sensory information and those that form decisions, less is known about the mechanisms that establish the functional linkage between them. We trained monkeys of both sexes to make difficult decisions about the net direction of visual motion under conditions that required trial-by-trial control of functional connectivity. In one condition, the motion appeared at different locations on different trials. In the other, two motion patches appeared, only one of which was informative. Neurons in the parietal cortex produced brief oscillations in their firing rate at the time routing was established: upon onset of the motion display when its location was unpredictable across trials, and upon onset of an attention cue that indicated in which of two locations an informative patch of dots would appear. The oscillation was absent when the stimulus location was fixed across trials. We interpret the oscillation as a manifestation of the mechanism that establishes the source and destination of flexibly routed information, but not the transmission of the information per se. |
Sven Ohl; Lisa M. Kroell; Martin Rolfs In: Journal of Experimental Psychology: General, pp. 1–20, 2023. @article{Ohl2023, Visual working memory and actions are closely intertwined. Memory can guide our actions, but actions also impact what we remember. Even during memory maintenance, actions such as saccadic eye movements select content in visual working memory, resulting in better memory at locations that are congruent with the action goal as compared to incongruent locations. Here, we further substantiate the claim that saccadic eye movements are fundamentally linked to visual working memory by analyzing a large data set (.100k trials) of nine experiments (eight of them previously published). Using Bayesian hierarchical models, we demonstrate robust saccadic selection across the full range of probed saccade directions, manifesting as better memory performance at the saccade goal irrespective of its location in the visual field. By inspecting individual differences in saccadic selection, we show that saccadic selection was highly prevalent in the population. Moreover, both saccade metrics and visual working memory performance varied considerably across the visual field. Crucially, however, both idiosyncratic and systematic visual field anisotropies were not correlated between visual working memory and the oculomotor system, suggesting that they resulted from different sources (e.g., rely on separate spatial maps). In stark contrast, trial-by-trial variations in saccade metrics were strongly associated with memory performance: At any given location, shorter saccade latencies and more accurate saccades were associated with better memory performance, undergirding a robust link between action selection and visual memory. |
Kosuke Okazaki; Kenichiro Miura; Junya Matsumoto; Naomi Hasegawa; Michiko Fujimoto; Hidenaga Yamamori; Yuka Yasuda; Manabu Makinodan; Ryota Hashimoto Discrimination in the clinical diagnosis between patients with schizophrenia and healthy controls using eye movement and cognitive functions Journal Article In: Psychiatry and Clinical Neurosciences, vol. 77, no. 7, pp. 393–400, 2023. @article{Okazaki2023, Aim: Eye movements and cognitive functions are significantly impaired in patients with schizophrenia. The authors aimed to develop promising clinical diagnostic markers that fit practical digital health applications in psychiatry using eye movement and cognitive function data from 1254 healthy individuals and 336 patients with schizophrenia. Methods: Multivariate analyses using logistic regression were performed to confirm net performance of eye movements and cognitive functions scored using the Wechsler Adult Intelligence Scale, Third Edition, and Wechsler Memory Scale-Revised. The authors then examined the discrimination performance of pairs containing an eye movement and a cognitive function measure to search the pairs that would be effective in practical application for the discrimination according to the diagnostic criterion between the groups. Results: Multivariate analyses confirmed that eye movements and cognitive functions were effective modalities for discriminating between patients with schizophrenia and healthy controls. The discriminant analyses of the pairs demonstrated that seven eye movement measures and seven scores from cognitive function tests showed high discrimination performance when paired with one measure from the other modality. Moreover, seven pairs of digit-symbol coding or symbol-search and eye movement measures had high and robust discrimination performance. Conclusion: Seven pairs of an eye movement and a cognitive function measure were effective, robust, and less time-consuming in assisting with clinical diagnosis by categorizing healthy individuals or patients with schizophrenia. These findings may help develop an objective auxiliary diagnosis method working even on portable devices, which facilitates the consistency of diagnosis, earlier intervention, and shared decision-making. |
Emily E. Oor; Terrence R. Stanford; Emilio Salinas Stimulus salience conflicts and colludes with endogenous goals during urgent choices Journal Article In: iScience, vol. 26, no. 3, pp. 1–17, 2023. @article{Oor2023, Selecting where to look next depends on both the salience of objects and current goals (what we are looking for), but discerning their relative contributions over the time frame of typical visuomotor decisions (200–250 ms) has been difficult. Here we investigate this problem using an urgent choice task with which the two contributions can be dissociated and tracked moment by moment. Behavioral data from three monkeys corresponded with model-based predictions: when salience favored the target, perceptual performance evolved rapidly and steadily toward an asymptotic level; when salience favored the distracter, many rapid errors were produced and the rise in performance took more time—effects analogous to oculomotor and attentional capture. The results show that salience has a brief (∼50 ms) but inexorable impact that leads to exogenous, involuntary capture, and this can either help or hinder performance, depending on the alignment between salience and ongoing internal goals. |
Michael Ortiz-Rios; Beshoy Agayby; Fabien Balezeau; Marcus Haag; Samy Rima; Jaime Cadena-Valencia; Michael C. Schmid Optogenetic stimulation of the primary visual cortex drives activity in the visual association cortex Journal Article In: Current Research in Neurobiology, vol. 4, pp. 1–13, 2023. @article{OrtizRios2023, Developing optogenetic methods for research in non-human primates (NHP) is important for translational neuroscience and for delineating brain function with unprecedented specificity. Here we assess, in macaque monkeys, the selectivity by which optogenetic stimulation of the primary visual cortex (V1) drives the local laminar and widespread cortical connectivity related to visual perception. Towards this end, we transfected neurons with light-sensitive channelrhodopsin in dorsal V1. fMRI revealed that optogenetic stimulation of V1 using blue light at 40 Hz increased functional activity in the visual association cortex, including areas V2/V3, V4, motion-sensitive area MT and frontal eye fields, although nonspecific heating and eye movement contributions to this effect could not be ruled out. Neurophysiology and immunohistochemistry analyses confirmed optogenetic modulation of spiking activity and opsin expression with the strongest expression in layer 4-B in V1. Stimulating this pathway during a perceptual decision task effectively elicited a phosphene percept in the receptive field of the stimulated neurons in one monkey. Taken together, our findings demonstrate the great potential of optogenetic methods to drive the large-scale cortical circuits of the primate brain with high functional and spatial specificity. |
Corinna Osterbrink; Arvid Herwig What determines location specificity or generalization of transsaccadic learning? Journal Article In: Journal of Vision, vol. 23, no. 1, pp. 1–18, 2023. @article{Osterbrink2023, Humans incorporate knowledge of transsaccadic associations into peripheral object perception. Several studies have shown that learning of new manipulated transsaccadic associations leads to a presaccadic perceptual bias. However, there was still disagreement whether this learning effect was location specific (Herwig, Weiß, & Schneider, 2018) or generalizes to new locations (Valsecchi & Gegenfurtner, 2016). The current study investigated under what conditions location generalization of transsaccadic learning occurs. In all experiments, there were acquisition phases in which the spatial frequency (Experiment 1) or the size (Experiment 2 and 3) of objects was changed transsaccadically. In the test phases, participants judged the respective feature of peripheral objects. These could appear either at the location where learning had taken place or at new locations. All experiments replicated the perceptual bias effect at the old learning locations. In two experiments, transsaccadic learning remained location specific even when learning occurred at multiple locations (Experiment 1) or with the feature of size (Experiment 2) for which a transfer had previously been shown. Only in Experiment 3 was a transfer of the learning effect to new locations observable. Here, learning only took place for one object and not for several objects that had to be discriminated. Therefore, one can conclude that, when specific associations are learned for multiple objects, transsaccadic learning stays location specific and when a transsaccadic association is learned for only one object it allows a generalization to other locations. |
Julie Ouerfelli-Ethier; Isabella Comtois Bona; Romain Fournet; Laure Pisella; Aarlenne Z. Khan; Isabella Comtois Bona; Romain Fournet; Laure Pisella; Aarlenne Z. Khan Pre-saccadic attention relies more on suppression than does covert attention Journal Article In: Journal of Vision, vol. 23, no. 1, pp. 1–19, 2023. @article{OuerfelliEthier2023, During covert and pre-saccadic attentional shifts, it is unclear how facilitation and suppression processes interact for target selection. A recent countermanding task pointed to greater suppression at unattended locations during trials with saccades compared to trials without saccades (i.e., fixation and successful stop trials), whereas target facilitation did not differ. It is unknown whether this finding is restricted to countermanding paradigms that involve inhibitory processes. To test this, we adapted Gaspelin and colleagues (2015)'s attention capture task where, within the same block, one location was primed with frequent line discrimination trials, and all locations were occasionally probed using letters report trials. Participants also performed a baseline condition without priming.We tested 15 participants and examined how performance at non-primed locations was affected by covert versus pre-saccadic attention in blocks of four or six items, as well as by position from the primed location and timing from saccade onset. For both attention conditions, letter report at non-primed locations was worse compared to baseline, demonstrating suppression, and letter report at primed location was better, demonstrating facilitation. In saccades trials, letter report was better at primed locations and worse at non-primed locations compared to fixation trials. The timing of this additional pre-saccadic suppression differed from saccadic suppression. In both attention conditions, suppression was greater when primed and non-primed locations were within the same hemifield or in diagonal opposite quadrants. These results confirmed that attention preceding saccade execution suppressed non-primed locations to a larger extent than covert attention, with the same spatial quadrant effect. |
Julie Ouerfelli-Ethier; Romain Fournet; Aarlenne Z. Khan; Laure Pisella Spatial bias in anti-saccade endpoints following bilateral dorsal posterior parietal lesions Journal Article In: European Journal of Neuroscience, vol. 58, no. 6, pp. 3488–3502, 2023. @article{OuerfelliEthier2023a, Anti-saccades are eye movements in which the saccade is executed in the opposite direction of a visual target and are often hypometric. Because the visual target and saccade goal are decoupled, it has been suggested that competition between the two locations occurs and needs to be resolved. It has been hypothesized that the hypometria of anti-saccades reflects this spatial competition by revealing a bias towards the visual target. To confirm that this hypometria is not simply due to reduced gain, we tested 10 healthy subjects on three different anti-saccade spatial configuration tasks: 90° away across hemifields, 90° away within the same hemifield and 180° away (classic, diagonally opposite). Specifically, we examined whether saccade endpoints showed evidence for the visual target location's interference with anti-saccade programming and execution processes. Among other neural substrates involved in anti-saccades production, the dorsal posterior parietal cortex (PPC) has been implicated in the spatial inhibition of contralateral visual target. To gain insight into the neural processes involved in spatial competition during anti-saccades, we also tested one patient with a bilateral dorsal PPC lesion. In all spatial configurations, we observed that anti-saccade endpoints demonstrated a spatial bias towards the visual target for all participants, likely due to an incomplete inhibition of the visual target location. This spatial bias was exacerbated in our patient, which suggests that the dorsal PPC contributes to the amalgamation of the two competing spatial representations. |
Mojtaba Abbaszadeh; Armin Panjehpour; Seyyed Mohammad Amin Alemohammad; Ali Ghavampour; Ali Ghazizadeh Prefrontal cortex encodes value pop-out in visual search Journal Article In: iScience, vol. 26, no. 9, pp. 1–15, 2023. @article{Abbaszadeh2023, Recent evidence demonstrates that long-term object value association can enhance visual search efficiency, a phenomenon known as value pop-out. However, the neural mechanism underlying this effect is not fully understood. Given the known role of the ventrolateral prefrontal cortex (vlPFC) in visual search and value memory, we recorded its single-unit activity (n = 526) in two macaque monkeys while they engaged in the value-driven search. Monkeys had to determine whether a high-value target was present within a variable number of low-value objects. Differential neural firing, as well as gamma-band power, indicated the presence of a target within ∼150ms of display onset. Notably, this differential activity was negatively correlated with search time and had reduced set-size dependence during efficient search. On the other hand, neural firing and its variability were higher in inefficient search. These findings implicate vlPFC in rapid detection of valuable targets which would be a crucial skill in competitive environments. |
Aslan Abivardi; Christoph W. Korn; Ivan Rojkov; Samuel Gerster; Rene Hurlemann; Dominik R. Bach Acceleration of inferred neural responses to oddball targets in an individual with bilateral amygdala lesion compared to healthy controls Journal Article In: Scientific Reports, vol. 13, no. 1, pp. 1–13, 2023. @article{Abivardi2023, Detecting unusual auditory stimuli is crucial for discovering potential threat. Locus coeruleus (LC), which coordinates attention, and amygdala, which is implicated in resource prioritization, both respond to deviant sounds. Evidence concerning their interaction, however, is sparse. Seeking to elucidate if human amygdala affects estimated LC activity during this process, we recorded pupillary responses during an auditory oddball and an illuminance change task, in a female with bilateral amygdala lesions (BG) and in n = 23 matched controls. Neural input in response to oddballs was estimated via pupil dilation, a reported proxy of LC activity, harnessing a linear-time invariant system and individual pupillary dilation response function (IRF) inferred from illuminance responses. While oddball recognition remained intact, estimated LC input for BG was compacted to an impulse rather than the prolonged waveform seen in healthy controls. This impulse had the earliest response mean and highest kurtosis in the sample. As a secondary finding, BG showed enhanced early pupillary constriction to darkness. These findings suggest that LC-amygdala communication is required to sustain LC activity in response to anomalous sounds. Our results provide further evidence for amygdala involvement in processing deviant sound targets, although it is not required for their behavioral recognition. |
Jordan C. Abramowitz; Matthew J. Goupell; Kristina DeRoy Milvae Cochlear–implant simulated signal degradation exacerbates listening effort in older listeners Journal Article In: Ear & Hearing, pp. 1–10, 2023. @article{Abramowitz2023, Objectives: Individuals with cochlear implants (CIs) often report that listening requires high levels of effort. Listening effort can increase with decreasing spectral resolution, which occurs when listening with a CI, and can also increase with age. What is not clear is whether these factors interact; older CI listeners potentially experience even higher listening effort with greater signal degradation than younger CI listeners. This study used pupillometry as a physiological index of listening effort to examine whether age, spectral resolution, and their interaction affect listening effort in a simulation of CI listening. Design: Fifteen younger normal-hearing listeners (ages 18 to 31 years) and 15 older normal-hearing listeners (ages 65 to 75 years) participated in this experiment; they had normal hearing thresholds from 0.25 to 4 kHz. Participants repeated sentences presented in quiet that were either unprocessed or vocoded, simulating CI listening. Stimuli frequency spectra were limited to below 4 kHz (to control for effects of age-related high-frequency hearing loss), and spectral resolution was decreased by decreasing the number of vocoder channels, with 32-, 16-, and 8-channel conditions. Behavioral speech recognition scores and pupil dilation were recorded during this task. In addition, cognitive measures of working memory and processing speed were obtained to examine if individual differences in these measures predicted changes in pupil dilation. Results: For trials where the sentence was recalled correctly, there was a significant interaction between age and spectral resolution, with significantly greater pupil dilation in the older normal-hearing listeners for the 8- and 32-channel vocoded conditions. Cognitive measures did not predict pupil dilation. Conclusions: There was a significant interaction between age and spectral resolution, such that older listeners appear to exert relatively higher listening effort than younger listeners when the signal is highly degraded, with the largest effects observed in the eight-channel condition. The clinical implication is that older listeners may be at higher risk for increased listening effort with a CI. |
Nika Adamian; Stuart Anstis; Patrick Cavanagh Motion-induced distortion of shape Journal Article In: Journal of Vision, vol. 23, no. 12, pp. 1–7, 2023. @article{Adamian2023, Motion, position, and form are intricately intertwined in perception. Motion distorts visual space, resulting in illusory position shifts such as flash-drag and flash-grab effects. The flash-grab displaces a test by up to several times its size. This lets us use it to investigate where the motion-induced shift operates in the processing stream from photoreceptor activation to feature activation to object recognition. We present several canonical, highly familiar forms and ask whether the motion-induced shift operates uniformly across the form. If it did, we could conclude that the effect occurred after the elements of the form are bound. However, we find that motion-induced distortion affects not only the position, but also the appearance of briefly presented, canonical shapes (square, circle, and letter T). Features of the flashed target that were closest to its center were shifted in the direction of motion more than those further from its center. Outline shapes were affected more than filled shapes, and the strength of the distortion increased with the contrast of the moving background. This not only supports a nonuniform spatial profile for the motion-induced shift but also indicates that the shift operates before the shape is established, even for highly familiar shapes like squares, circles, and letters. |
Owen J. Adams; Eric Ruthruff; Nicholas Gaspelin Oculomotor suppression of abrupt onsets versus color singletons Journal Article In: Attention, Perception, & Psychophysics, vol. 85, no. 3, pp. 613–633, 2023. @article{Adams2023, There is considerable evidence that salient items can be suppressed in order to prevent attentional capture. However, this evidence has relied almost exclusively on paradigms using color singletons as salient distractors. It is therefore unclear whether other kinds of salient stimuli, such as abrupt onsets, can also be suppressed. Using an additional singleton paradigm optimized for detecting oculomotor suppression, we directly compared color singletons with abrupt onsets. Participants searched for a target shape (e.g., green diamond) and attempted to ignore salient distractors that were either abrupt onsets or color singletons. First eye movements were used to assess whether salient distractors captured attention or were instead suppressed. Initial experiments using a type of abrupt onset from classic attentional capture studies (four white dots) revealed that abrupt onsets strongly captured attention whereas color singletons were suppressed. After controlling for important differences between the onsets and color singletons – such as luminance and color – abrupt-onset capture was reduced but not eliminated. We ultimately conclude that abrupt onsets are not suppressed like color singletons. |
Srishty Aggarwal; Supratim Ray In: Cerebral Cortex Communications, vol. 4, no. 2, pp. 1–12, 2023. @article{Aggarwal2023, The power spectral density (PSD) of the brain signals is characterized by two distinct features: oscillations, which are represented as distinct “bumps,” and broadband aperiodic activity, that reduces in power with increasing frequency and is characterized by the slope of the power falloff. Recent studies have shown a change in the slope of the aperiodic activity with healthy aging and mental disorders. However, these studies analyzed slopes over a limited frequency range (<100 Hz). To test whether the PSD slope is affected over a wider frequency range with aging and mental disorder, we analyzed the slope till 800 Hz in electroencephalogram data recorded from elderly subjects (>49 years) who were healthy (n = 217) or had mild cognitive impairment (MCI; n = 11) or Alzheimer's Disease (AD; n = 5). Although the slope reduced up to ~ 150 Hz with healthy aging (as shown previously), surprisingly, at higher frequencies (>200 Hz), it increased with age. These results were observed in all electrodes, for both eyes open and eyes closed conditions, and for different reference schemes. However, slopes were not significantly different in MCI/AD subjects compared with healthy controls. Overall, our results constrain the biophysical mechanisms that are reflected in the PSD slopes in healthy and pathological aging. |
Joshua Ahn; Benjamin Tari; Anisa Morava; Harry Prapavessis; Matthew Heath A single bout of passive exercise mitigates a mental fatigue-induced inhibitory control deficit Journal Article In: Experimental Brain Research, vol. 241, no. 7, pp. 1835–1845, 2023. @article{Ahn2023, Sustained cognitive effort associated with the psychomotor vigilance task (PVT) increases objective and subjective measures of mental fatigue and elicits a post-PVT inhibitory control deficit. In contrast, passive exercise wherein an individual's limbs are moved via an external force (i.e., mechanically driven cycle ergometer flywheel) provides a postexercise inhibitory control benefit linked to an exercise-based increase in cerebral blood flow. Here, we examined whether passive exercise performed concurrently with the PVT ‘blunts' an inhibitory control deficit. On separate days, participants (N = 27) completed a 20 min PVT protocol (control condition) and same duration PVT protocol paired with passive cycle ergometry (passive exercise condition). Prior to (i.e., baseline), immediately after and 30 min after each condition inhibitory control was assessed via the antisaccade task. Antisaccades require a goal-directed eye movement (i.e., saccade) mirror-symmetrical to a target and provide an ideal tool for evaluating task-based changes in inhibitory control. PVT results showed that vigilance (as assessed via reaction time: RT) during control and passive exercise conditions decreased from the first to last 5 min of the protocol and increased subjective ratings of mental fatigue. As well, in the control condition, immediate (but not 30-min) post-intervention antisaccade RTs were longer than their baseline counterparts–a result evincing a transient mental fatigue-based inhibitory control deficit. For the passive exercise condition, immediate and 30-min post-intervention antisaccade RTs were shorter than their baseline counterparts and this result was linked to decreased subjective ratings of mental fatigue. Thus, passive exercise ameliorated the selective inhibitory control deficit associated with PVT-induced mental fatigue and thus provides a potential framework to reduce executive dysfunction in vigilance-demanding occupations. |
Kazuaki Akamatsu; Tomohiro Nishino; Yoichi Miyawaki Spatiotemporal bias of the human gaze toward hierarchical visual features during natural scene viewing Journal Article In: Scientific Reports, vol. 13, no. 1, pp. 1–12, 2023. @article{Akamatsu2023, The human gaze is directed at various locations from moment to moment in acquiring information necessary to recognize the external environment at the fine resolution of foveal vision. Previous studies showed that the human gaze is attracted to particular locations in the visual field at a particular time, but it remains unclear what visual features produce such spatiotemporal bias. In this study, we used a deep convolutional neural network model to extract hierarchical visual features from natural scene images and evaluated how much the human gaze is attracted to the visual features in space and time. Eye movement measurement and visual feature analysis using the deep convolutional neural network model showed that the gaze was more strongly attracted to spatial locations containing higher-order visual features than to locations containing lower-order visual features or to locations predicted by conventional saliency. Analysis of the time course of gaze attraction revealed that the bias to higher-order visual features was prominent within a short period after the beginning of observation of the natural scene images. These results demonstrate that higher-order visual features are a strong gaze attractor in both space and time, suggesting that the human visual system uses foveal vision resources to extract information from higher-order visual features with higher spatiotemporal priority. |
Müge Akkoyun; Koray Koçoğlu; Hatice Eraslan Boz; Pembe Keskinoğlu; Gülden Akdal Saccadic eye movements in patients with mild cognitive impairment: A longitudinal study Journal Article In: Journal of Motor Behavior, vol. 55, no. 4, pp. 354–372, 2023. @article{Akkoyun2023, Saccadic eye movements are one of the sensitive and noninvasive methods to help monitor the cognitive course of mild cognitive impairment (MCI). The study aimed to evaluate both pro and anti-saccade longitudinally and the relationship between cognitive functions and eye movements in MCI subgroups and healthy controls (HCs) at a two-year follow-up. This study revealed that the anti-saccade anticipatory responses decreased in amnestic MCI (aMCI). Correct vertical pro-saccades increased in non-amnestic MCI (naMCI), while the express saccades decreased. Our study demonstrated that longer than two years of follow-up is necessary to monitor the course of MCI. Findings of the relationships between longitudinal changes of saccades and cognitive measurements demonstrated the usability of eye movements in evaluating the process of MCI. |
Francesca Ales; Luciano Giromini; Jessica Bosi; Alessandro Zennaro White space responses in the Rorschach: Using eye-tracking to further understand the distinction between space reversal and space integration Journal Article In: Current Psychology, vol. 42, pp. 14122–14131, 2023. @article{Ales2023, This study investigated eye movements associated with the production of different Rorschach responses involving the use of the inkless (or “white space”) areas of the inkblots. More specifically, we examined whether Space Integration (SI) and Space Reversal (SR) responses associated with different test-taker's approaches to visually inspecting the Rorschach inkblots while completing the test. We retrieved archival data from 71 non-clinical volunteers who took the Rorschach test while their eye movements were being registered. The results of our analyses indicated that: (a) SI, but not SR, positively associated with the overall number of eye fixations recorded while scanning the Rorschach inkblots; (b) SR, but not SI, associated with a proportionally greater visual focus (i.e., greater number of fixations and longer duration of fixations) on white than non-white areas of inkblots. Taken together, these findings support Rorschach Performance Assessment System (R-PAS) determination to interpret SI and SR responses differently. |
Johannes Algermissen; Hanneke E. M. Ouden Goal-directed recruitment of pavlovian biases through selective visual attention Journal Article In: Journal of Experimental Psychology: General, vol. 152, no. 10, pp. 2941–2956, 2023. @article{Algermissen2023, Prospective outcomes bias behavior in a “Pavlovian” manner: Reward prospect invigorates action, while punishment prospect suppresses it. Theories have posited Pavlovian biases as global action “priors” in unfamiliar or uncontrollable environments. However, this account fails to explain the strength of these biases—causing frequent action slips—even in well-known environments. We propose that Pavlovian control is additionally useful if flexibly recruited by instrumental control. Specifically, instrumental action plans might shape selective attention to reward/punishment information and thus the input to Pavlovian control. In two eye-tracking samples (N = 35/64), we observed that Go/NoGo action plans influenced when and for how long participants attended to reward/punishment information, which in turn biased their responses in a Pavlovian manner. Participants with stronger attentional effects showed higher performance. Thus, humans appear to align Pavlovian control with their instrumental action plans, extending its role beyond action defaults to a powerful tool ensuring robust action execution. |
Ayeh Alhasan; Nathan Caruana Evidence for the adaptive parsing of non-communicative eye movements during joint attention interactions Journal Article In: PeerJ, vol. 11, pp. 1–25, 2023. @article{Alhasan2023, During social interactions, the ability to detect and respond to gaze-based joint attention bids often involves the evaluation of non-communicative eye movements. However, very little is known about how much humans are able to track and parse spatial information from these non-communicative eye movements over time, and the extent to which this influences joint attention outcomes. This was investigated in the current study using an interactive computer-based joint attention game. Using a fully within-subjects design, we specifically examined whether participants were quicker to respond to communicative joint attention bids that followed predictive, as opposed to random or no, non-communicative gaze behaviour. Our results suggest that in complex, dynamic tasks, people adaptively use and dismiss non-communicative gaze information depending on whether it informs the locus of an upcoming joint attention bid. We also went further to examine the extent to which this ability to track dynamic spatial information was specific to processing gaze information. This was achieved by comparing performance to a closely matched non-social task where eye gaze cues were replaced with dynamic arrow stimuli. Whilst we found that people are also able to track and use dynamic non-social information from arrows, there was clear evidence for a relative advantage for tracking gaze cues during social interactions. The implications of these findings for social neuroscience and autism research are discussed. |
Abdulaziz Altamimi; Kathy Conklin Effects of pre-reading study and reading exposure on the learning and processing of collocations Journal Article In: TESOL Quarterly, pp. 1–23, 2023. @article{Altamimi2023, Little is known about the effect of pre-reading exposure on collocational learning. This study used eye-tracking and offline measures (form recall and recognition) to explore the effectiveness of pre-reading study and reading exposure on the processing and learning of novel collocations. Three learning conditions were evaluated: reading-only (target items were simply embedded in sentences), study-only (explicit learning of target items), and pre-reading study plus reading (explicit learning of target items followed by reading). Pre-reading study plus reading was the most effective learning condition, while reading-only was more effective than study-only. More specifically, studying collocations before reading led to increased attention when encountering the same collocation in subsequent reading. Furthermore, greater attention, in the pre-reading study phase, as indicated by fixations, was associated with larger collocational gains. |
Esther Álvarez-García; José Manuel Igoa González Lexico-Semantic Influence on Syntactic Processing: An Eye-Tracking Study with Spanish Relative Clauses Journal Article In: Brain Sciences, vol. 13, no. 3, pp. 1–39, 2023. @article{AlvarezGarcia2023, This paper investigates the interaction between lexicosemantic and syntactic information in sentence processing by examining the online comprehension of Spanish relative clauses (RCs) of both restrictive and non-restrictive types. A corpus study shows that, in Spanish, a RC may be introduced by different function words (called relativizers), which differ in lexical frequency, as well as semantic features. Based on these facts, an eye-tracking experiment was conducted with the aim of analyzing whether lexicosemantic information could influence sentence processing at the early stages. The results report an early influence of lexicosemantic information not only when activating a relativizer but also when integrating it within the syntactic structure. Additionally, the semantic role played by each RC type seems to constrain sentence processing at different regions. Our results favor an interactive view of language processing, according to which language comprehension is guided from the early stages by different kinds of linguistic information rather than syntactic information alone. |
Simona Amenta; Jana Hasenäcker; Davide Crepaldi; Marco Marelli Prediction at the intersection of sentence context and word form: Evidence from eye-movements in reading Journal Article In: Psychonomic Bulletin & Review, vol. 30, no. 3, pp. 1081–1092, 2023. @article{Amenta2023, A key issue in language processing is how we recognize and understand words in sentences. Research on sentence reading indicates that the time we need to read a word depends on how (un)expected it is. Research on single word recognition shows that each word also has its own recognition dynamics based on the relation between its orthographic form and its meaning. It is not clear, however, how these sentence-level and word-level dynamics interact. In the present study, we examine the joint impact of these sources of information during sentence reading. We analyze existing eye-tracking and self-paced reading data (Frank et al., 2013, Behavior Research Methods, 45[4], 1182–1190) to investigate the interplay of sentence-level prediction (operationalized as Surprisal) and word Orthography-Semantics Consistency in activating word meaning in sentence processing. Results indicate that both Surprisal and Orthography-Semantics Consistency exert an influence on several reading measures. The shape of the observed interaction differs, but the results give compelling indication for a general trade-off between expectations based on sentence context and cues to meaning from word orthography. |
Rhona M. Amos; Robert J. Hartsuiker; Kilian G. Seeber; Martin J. Pickering Purposeful listening in challenging conditions: A study of prediction during consecutive interpreting in noise Journal Article In: PLoS ONE, vol. 18, pp. 1–27, 2023. @article{Amos2023, Prediction is often used during language comprehension. However, studies of prediction have tended to focus on L1 listeners in quiet conditions. Thus, it is unclear how listeners predict outside the laboratory and in specific communicative settings. Here, we report two eyetracking studies which used a visual-world paradigm to investigate whether prediction during a consecutive interpreting task differs from prediction during a listening task in L2 listeners, and whether L2 listeners are able to predict in the noisy conditions that might be associated with this communicative setting. In a first study, thirty-six Dutch-English bilinguals either just listened to, or else listened to and then consecutively interpreted, predictable sentences presented on speech-shaped sound. In a second study, another thirty-six Dutch-English bilinguals carried out the same tasks in clear speech. Our results suggest that L2 listeners predict the meaning of upcoming words in noisy conditions. However, we did not find that predictive eye movements depended on task, nor that L2 listeners predicted upcoming word form. We also did not find a difference in predictive patterns when we compared our two studies. Thus, L2 listeners predict in noisy circumstances, supporting theories which posit that prediction regularly takes place in comprehension, but we did not find evidence that a subsequent production task or noise affects semantic prediction. |
Rhona M. Amos; Kilian G. Seeber; Martin J. Pickering Student interpreters predict meaning while simultaneously interpreting - even before training Journal Article In: Interpreting, vol. 25, no. 2, pp. 211–238, 2023. @article{Amos2023a, Prediction has long been considered advantageous in simultaneous interpreting, as it may allow interpreters to comprehend more rapidly and focus on their own production. However, evidence of prediction in simultaneous interpreting to date is relatively limited. In addition, it is unclear whether training in simultaneous interpreting influences predictive processing during a simultaneous interpreting task. We report on a longitudinal eye-tracking study which measured the timing and extent of prediction in students before and after two semesters of training in simultaneous interpreting. The students simultaneously interpreted sentences containing a highly predictable word as they viewed a screen containing four pictures, one of which depicted a highly predictable object. They made predictive eye movements to the highly predictable object both before and after their training in simultaneous interpreting. However, we did not find evidence that training influenced the timing or the magnitude of their prediction. |
Ariana R. Andrei; Alan E. Akil; Natasha Kharas; Robert Rosenbaum; Krešimir Josić; Valentin Dragoi Rapid compensatory plasticity revealed by dynamic correlated activity in monkeys in vivo Journal Article In: Nature Neuroscience, vol. 26, no. 11, pp. 1960–1969, 2023. @article{Andrei2023, To produce adaptive behavior, neural networks must balance between plasticity and stability. Computational work has demonstrated that network stability requires plasticity mechanisms to be counterbalanced by rapid compensatory processes. However, such processes have yet to be experimentally observed. Here we demonstrate that repeated optogenetic activation of excitatory neurons in monkey visual cortex (area V1) induces a population-wide dynamic reduction in the strength of neuronal interactions over the timescale of minutes during the awake state, but not during rest. This new form of rapid plasticity was observed only in the correlation structure, with firing rates remaining stable across trials. A computational network model operating in the balanced regime confirmed experimental findings and revealed that inhibitory plasticity is responsible for the decrease in correlated activity in response to repeated light stimulation. These results provide the first experimental evidence for rapid homeostatic plasticity that primarily operates during wakefulness, which stabilizes neuronal interactions during strong network co-activation. |
Bernhard Angele; Ismael Gutiérrez-Cordero; Manuel Perea; Ana Marcet Reading(,) with and without commas Journal Article In: Quarterly Journal of Experimental Psychology, pp. 1–11, 2023. @article{Angele2023, All major writing systems mandate the use of commas to separate clauses and list items. However, casual writers often omit mandatory commas. Little empirical or theoretical research has been done on the effect that omitting mandatory commas has on eye movement control during reading. We present an eye-tracking experiment in Spanish, a language with a clear standard as to mandatory comma use. Sentences were presented with or without mandatory commas while readers' eye movements were recorded. There was a local increase in the go-past time for the pre-comma region when commas were presented, which was balanced out by shorter first-pass and second-pass times on the subsequent regions. In global sentence reading time, there was no evidence for an advantage of presenting commas. These findings suggest that, even when commas are mandatory, their effect is primarily to shift when processing takes place rather than to facilitate processing overall. |
Kristine Anthony; Hoo Keat Wong; Alfred Lim; Farrah Sow; Steve M. J. Janssen Examining the roles of visual imagery and working memory in the retrieval of autobiographical memories using a dual-task paradigm Journal Article In: Quarterly Journal of Experimental Psychology, pp. 1–14, 2023. @article{Anthony2023, The retrieval of autobiographical memories involves the construction of mental representations of past personal events. Many researchers examining the processes underlying memory retrieval argue that visual imagery plays a fundamental role. Other researchers, however, have argued that working memory is an integral component involved in memory retrieval. The goal of this study was to resolve these conflicting arguments by comparing the relative contributions of visual imagery and working memory during the retrieval of autobiographical memories in a dual-task paradigm. While following a moving dot, viewing a dynamic visual noise (DVN), or viewing a blank screen, 95 participants recalled their memories and subsequently rated them on different memory characteristics. The results suggest that inhibiting visual imagery by having participants view DVN merely delayed memory retrieval but did not affect the phenomenological quality of the memories retrieved. Taxations to the working memory by having participants follow a moving dot, on the contrary, resulted in only longer retrieval latencies and no reductions in the specificity, vividness, or the emotional intensity of the memories retrieved. Whereas the role of visual imagery during retrieval is clear, future studies could further examine the role of working memory during retrieval by administering a task that is less difficult or by recruiting a larger sample than this study. The results of this study seem to suggest that both visual imagery and working memory play a role during the retrieval of autobiographical memory, but more research needs to be conducted to determine their exact roles. |
Gizelle Anzures; Melissa Mildort; Cassandra Bell; Elizabeth Soethe Visual examination of own- and other-race face identities and implicit racial bias Journal Article In: Current Psychology, vol. 42, no. 28, pp. 24986–24997, 2023. @article{Anzures2023, The current paper used eye tracking to examine the influence of implicit racial bias on the visual examination and recognition of own- and other-race face identities. Implicit bias favoring the own-race group was not associated with differences in the amount of time spent looking at the internal features (i.e., right eye, left eye, nose, mouth) of other-race faces during an old/new identity recognition task. However, larger implicit biases favoring the own-race group was associated with longer total dwell times towards the internal features of own-race faces during the test phase of the identity recognition task. Regardless of implicit bias, adults generally showed an own-race advantage in their face recognition. |
Kofi Appiah; Zhiyong Jin; Lei Shi; Sze Chai Kwok Naturalistic Scene Modelling: Deep Learning with Insights from Biology Journal Article In: Journal of Signal Processing Systems, vol. 95, no. 10, pp. 1153–1165, 2023. @article{Appiah2023, Advances in machine learning coupled with the abundances of training data has facilitated the deep learning era, which has demonstrated its ability and effectiveness in solving complex detection and recognition problems. In general application areas with elements of machine learning have seen exponential growth with promising new and sophisticated solutions to complex learning problems. In computer vision, the challenge related to the detection of known objects in a scene is a thing of the past. With the tremendous increase in detection accuracies, some close to that of human detection, there are several areas still lagging in computer vision and machine learning where improvements may call for more architectural designs. In this paper, we propose a physiologically inspired model for scene understanding that encodes three key components: object location, size and category. Our aim is to develop an energy efficient artificial intelligent model for naturalistic scene understanding capable of deploying on a low power neuromorphic hardware. We have reviewed recent advances in deep learning architecture that have taken inspiration from human or primate learning systems and provided direct to future advancement on deep learning with inspiration from physiological experiments. Upon a review of areas that have benefitted from deep learning, we provide recommendations for enhancing those areas that might have stalled or grinded to a halt with little or no significant improvement. |
Talia Ariss; Catharine E. Fairbairn; Michael A. Sayette; Brynne A. Velia; Howard Berenbaum; Sarah Brown-Schmidt Where to look? Alcohol, affect, and gaze behavior during a virtual social interaction Journal Article In: Clinical Psychological Science, vol. 11, no. 2, pp. 1–14, 2023. @article{Ariss2023, COVID-19 forced social interactions to move online. Yet researchers have little understanding of the mental-health consequences of this shift. Given pandemic-related surges in emotional disorders and problematic drinking, it becomes imperative to understand the cognitive and affective processes involved in virtual interactions and the impact of alcohol in virtual social spaces. Participants (N = 246) engaged in an online video call while their gaze behavior was tracked. Before the interaction, participants were randomly assigned to receive an alcoholic or control beverage. Participants' affect was repeatedly assessed. Results indicated that a proportionally larger amount of time spent gazing at oneself (vs. one's interaction partner) predicted significantly higher negative affect after the exchange. Furthermore, alcohol independently increased self-directed attention, failing to demonstrate its typically potent social-affective enhancement in this virtual context. Results carry potential implications for understanding factors that increase risk for hazardous drinking and negative affect in an increasingly virtual world. |
Rose Nasrawi; Sage E. P. Boettcher; Freek Ede Prospection of potential actions during visual working memory starts early, is flexible, and predicts behavior Journal Article In: Journal of Neuroscience, vol. 43, no. 49, pp. 8515–8524, 2023. @article{Nasrawi2023, For visual working memory to serve upcoming behavior, it is crucial that we prepare for the potential use of working-memory contents ahead of time. Recent studies have demonstrated how the prospection and planning for an upcoming manual action starts early after visual encoding, and occurs alongside visual retention. Here, we address whether such ‘output planning' in visual working memory flexibly adapts to different visual-motor mappings, and occurs even when an upcoming action will only potentially become relevant for behavior. Human participants (female and male) performed a visual-motor working memory task in which they remembered one or two colored oriented bars for later (potential) use. We linked, and counterbalanced, the tilt of the visual items to specific manual responses. This allowed us to track planning of upcoming behavior through contralateral attenuation of beta-band activity – a canonical motor-cortical EEG signature of manual-action planning. The results revealed how action encoding and subsequent planning alongside visual working memory (1) reflect anticipated task demands rather than specific visual-motor mappings, (2) occur even for actions that will only potentially become relevant for behavior, and (3) are associated with faster performance for the encoded item, at the expense of performance to other working-memory content. This reveals how the potential prospective use of visual working memory content is flexibly planned early on, with consequences for the speed of memory-guided behavior. |
Ulrike Nederstigt; Béryl Hilberink-Schulpen Attention to multilingual job ads: An eye-tracking study on the use of English in German job ads Journal Article In: Folia Linguistica, vol. 57, no. 2, pp. 313–343, 2023. @article{Nederstigt2023, In many non-English-speaking countries, English loanwords in job ads seem to be very common. The question is whether this linguistic choice is advantageous, especially when the job advertised does not involve working in an international environment. Previous research of English loanwords in job ads has revealed that their effect in terms of the evaluation of the company, the job and the ad is limited if effects can be shown at all. Suggestions that English loanwords draw readers' attention because this language choice deviates from what readers expect and, in addition, take more processing time (because they are foreign) lack empirical evidence. The eye-tracking and behavioural data of our experiment did not provide any empirical evidence for the attention-drawing function of English loanwords nor an influence on their effectiveness in job ads geared to graduate students in Germany. We suggest that loanwords need a certain amount of processing to be identified as foreign. This means they are different from other salient cues that were shown to draw readers' attention because they are not subject to automatic processes. In addition, our participants were sufficiently proficient in English so that differences in processing time were not reflected in their eye-movement data. |
Qing Nian; Wenping Lu; Ying Xu Effects of object working memory load on visual search in basketball players: An eye movement study Journal Article In: BMC Psychology, vol. 11, no. 1, pp. 1–11, 2023. @article{Nian2023, Background: Working memory may affect the athletes' visual search ability. Objective: This study aimed to examine the differences in the performance of visual search tasks among basketball players of varying sport levels, considering the influence of different object working memory loads. Method: This study recruited forty-two participants who were divided into three groups based on the classification of elite athletes: competitive elite, semi-elite, and novice. Results: Objective working memory load significantly impacts the accuracy of visual search, reaction time, and gaze fixation in basketball players. In the visual search task of the basketball sports scene, the inclusion of object working memory load led to a significant decrease in the accuracy of visual search, a significant increase in reaction time, a significant increase in the number of fixation points, and a more complex gaze trajectory. In a visual search task with object working memory load, the difference in reaction time between basketball players of different sport levels was observed during the search initiation time and scanning time, with higher sport levels associated with shorter reaction times. The effect of object working memory load on the eye movement phase of visual search varied among basketball players of different sport levels. For the novice group, the effect was on the reaction time during the verification phase, while for the semi-elite and competitive elite groups, the effect was on the reaction time during the scanning phase. Conclusion: The effect of object working memory load on visual search varied among basketball players of different sport levels. |
Nick Sidorenko; Hui- Kuan Chung; Marcus Grueschow; Boris B. Quednow; Helen Hayward-Könnecke; Alexander Jetter; Philippe N. Tobler Acetylcholine and noradrenaline enhance foraging optimality in humans Journal Article In: Proceedings of the National Academy of Sciences, vol. 120, no. 36, pp. 1–12, 2023. @article{NickSidorenko2023, Foraging theory prescribes when optimal foragers should leave the current option for more rewarding alternatives. Actual foragers often exploit options longer than prescribed by the theory, but it is unclear how this foraging suboptimality arises. We investigated whether the upregulation of cholinergic, noradrenergic, and dopaminergic systems increases foraging optimality. In a double- blind, between-subject design, participants (N = 160) received placebo, the nicotinic acetylcholine receptor agonist nicotine, a noradrenaline reuptake inhibitor reboxetine, or a preferential dopamine reuptake inhibitor methylphenidate, and played the role of a farmer who collected milk from patches with different yield. Across all groups, participants on average overharvested. While methylphenidate had no effects on this bias, nicotine, and to some extent also reboxetine, significantly reduced deviation from foraging optimality, which resulted in better performance compared to placebo. Concurring with amplified goal- directedness and excluding heuristic explanations, nicotine independently also improved trial initiation and time perception. Our findings elucidate the neurochemical basis of behavioral flexibility and decision optimality and open unique perspectives on psychiatric disorders affecting these functions. exploration |
Sunny Nigam; Russell Milton; Sorin Pojoga; Valentin Dragoi Adaptive coding across visual features during free-viewing and fixation conditions Journal Article In: Nature Communications, vol. 14, no. 87, pp. 1–12, 2023. @article{Nigam2023, Theoretical studies have long proposed that adaptation allows the brain to effectively use the limited response range of sensory neurons to encode widely varying natural inputs. However, despite this influential view, experimental studies have exclusively focused on how the neural code adapts to a range of stimuli lying along a single feature axis, such as orientation or contrast. Here, we performed electrical recordings in macaque visual cortex (area V4) to reveal significant adaptive changes in the neural code of single cells and populations across multiple feature axes. Both during free viewing and passive fixation, populations of cells improved their ability to encode image features after rapid exposure to stimuli lying on orthogonal feature axes even in the absence of initial tuning to these stimuli. These results reveal a remarkable adaptive capacity of visual cortical populations to improve network computations relevant for natural viewing despite the modularity of the functional cortical architecture. |
Andrey R. Nikolaev; Benedikt V. Ehinger; Radha Nila Meghanathan; Cees Leeuwen Planning to revisit: Neural activity in refixation precursors Journal Article In: Journal of Vision, vol. 23, no. 7, pp. 1–19, 2023. @article{Nikolaev2023, Eye tracking studies suggest that refixations—fixations to locations previously visited—serve to recover information lost or missed during earlier exploration of a visual scene. These studies have largely ignored the role of precursor fixations—previous fixations on locations the eyes return to later.We consider the possibility that preparations to return later are already made during precursor fixations. This process would mark precursor fixations as a special category of fixations, that is, distinct in neural activity from other fixation categories such as refixations and fixations to locations visited only once. To capture the neural signals associated with fixation categories, we analyzed electroencephalograms (EEGs) and eye movements recorded simultaneously in a free-viewing contour search task. We developed a methodological pipeline involving regression-based deconvolution modeling, allowing our analyses to account for overlapping EEG responses owing to the saccade sequence and other oculomotor covariates. We found that precursor fixations were preceded by the largest saccades among the fixation categories. Independent of the effect of saccade length, EEG amplitude was enhanced in precursor fixations compared with the other fixation categories 200 to 400 ms after fixation onsets, most noticeably over the occipital areas.We concluded that precursor fixations play a pivotal role in visual perception, marking the continuous occurrence of transitions between exploratory and exploitative modes of eye movement in natural viewing behavior. |
Bo Ning; Shuyan Luo; Aijun Wang; Ming Zhang Effects of banner ad type, web content type and theme consistency on banner blindness: An eye movement study Journal Article In: Cognitive Processing, vol. 24, no. 3, pp. 313–326, 2023. @article{Ning2023, During the epidemic, online advertising became more important, and several studies have suggested that internet users tend to avoid viewing online ads, such as banner ads. Previous studies have shown that product items that use animation lead to increased visual attention to all items on a webpage at the expense of attention to nonanimated items on the same webpage. However, few studies have compared the impact of the picture and text forms taken by static banners on the effectiveness of banner ads. At the same time, whether semantic factors (theme consistency) moderate the influence of structural factors (picture and text forms) on banner advertising remains unknown. The aim of this paper is to examine the influence of structural factors and semantic factors of ads on participants' visual attention to and memory of banner ads. The participants (twenty-seven males and forty females aged 18–26 years) were divided into two groups, one for consistent ad-web content themes and the other for inconsistent ad-web content themes. Then, the participants were asked to browse 16 complete pages (4 pages each of text-type web content and text-type banner ads, picture-type web content and picture-type banner ads, text-type web content and picture-type banner ads, and picture-type web content and text-type banner ads), and their eye movements were recorded to measure the participants' level of attention to the banner ads. A recognition task was used to measure the participants' memories of the banner ads. The results showed that the text-type banner ad had a lower blindness rate and exerted better attention and memory effects than the picture-type banner ad, and the text-type banner ad had a lower blindness rate and better attention and memory effects when positioned in the background of picture-type web content than when positioned in the background of text-type web content. A significant interaction effect among banner ad type, web content type and theme consistency showed that ad-web content theme consistency moderated the effect of web content type and banner ad type on ad effectiveness. Taken together, the results of these tasks demonstrate that theme consistency moderates the effect of web content type and banner ad type on ad effectiveness in a top-down manner. To reduce the negative effect of banner blindness, placing text-type banner ads in picture-type web content and setting a consistent theme between the banner ad and the web content is the more effective choice. The findings from this study can be used to assist advertising agencies in designing more effective and efficient banner ads from the perspective of basic psychology. |
Tarikere T. Niranjan; Narendra K. Ghosalya; Raveen R. Menon; Kristian Rotaru; Srinagesh Gavirneni Unpacking the cognitive processes of the boundedly rational newsvendor Journal Article In: Production and Operations Management, vol. 32, no. 10, pp. 3138–3157, 2023. @article{Niranjan2023, We report on the findings of five controlled experiments that test the effectiveness of proposed interventions aiming to improve both the process and outcomes of decision making when performing the newsvendor task. We use eye-tracking technology aided by interviews to gain new insights into people's cognitive processes. Our results confirm that human newsvendors exhibit the tendency of mean-reverting demand prediction using past demand even when the demand is independent and identically distributed (i.i.d.). This points toward the presence of the cognitive bias known as the law of small numbers in the decision-making process. The interventions involving ordering multiple products instead of the same product repeatedly, feedback frequency reduction, training and provision of optimal solution, all reduce reliance on the past demand, thereby reducing the extent of the mean-reverting tendency. Yet, none of these interventions eliminated this tendency completely; overall, judgmental forecasting persisted, albeit at a lower extent or in a different form. This tendency provides a plausible explanation for the fact that the interventions (and the resultant reduction in reliance on past demand) fail to lead to performance improvements. While the qualitative analysis of the interviews shows the subjects' intention to not rely on past demand in some instances, their gaze behavior shows that the past demand continued to impact their orders to varied degrees. Mere reduction (or even removal) of irrelevant information does not automatically make the subjects shift their focus to the relevant information and use them as intended. |
M. P. Noonan; A. H. Von Lautz; Y. Bauer; C. Summerfield; M. S. Stokes Differential modulation of visual responses by distractor or target expectations Journal Article In: Attention, Perception, & Psychophysics, vol. 85, no. 3, pp. 845–862, 2023. @article{Noonan2023, Discriminating relevant from irrelevant information in a busy visual scene is supported by statistical regularities in the environment. However, it is unclear to what extent immediate stimulus repetitions and higher order expectations (whether a repetition is statistically probable or not) are supported by the same neural mechanisms. Moreover, it is also unclear whether target and distractor-related processing are mediated by the same or different underlying neural mechanisms. Using a speeded target discrimination task, the present study implicitly cued subjects to the location of the target or the distractor via manipulations in the underlying stimulus predictability. In separate studies, we collected EEG and MEG alongside behavioural data. Results showed that reaction times were reduced with increased expectations for both types of stimuli and that these effects were driven by expected repetitions in both cases. Despite the similar behavioural pattern across target and distractors, neurophysiological measures distinguished the two stimuli. Specifically, the amplitude of the P1 was modulated by stimulus relevance, being reduced for repeated distractors and increased for repeated targets. The P1 was not, however, modulated by higher order stimulus expectations. These expectations were instead reflected in modulations in ERP amplitude and theta power in frontocentral electrodes. Finally, we observed that a single repetition of a distractor was sufficient to reduce decodability of stimulus spatial location and was also accompanied by diminished representation of stimulus features. Our results highlight the unique mechanisms involved in distractor expectation and suppression and underline the importance of studying these processes distinctly from target-related attentional control. |
Mathias Norqvist; Bert Jonsson; Johan Lithner Shifts in student attention on algorithmic and creative practice tasks Journal Article In: Educational Studies in Mathematics, pp. 1–20, 2023. @article{Norqvist2023, In mathematics classrooms, it is common practice to work through a series of comparable tasks provided in a textbook. A central question in mathematics education is if tasks should be accompanied with solution methods, or if students should construct the solutions themselves. To explore the impact of these two task designs on student behavior during repetitive practice, an eye-tracking study was conducted with 50 upper secondary and university students. Their eye movements were analyzed to study how the two groups shifted their gaze both within and across 10 task sets. The results show that when a solution method was present, the students reread this every time they solved the task, while only giving minute attention to the illustration that carried information supporting mathematical understanding. Students who practiced with tasks without a solution method seemed to construct a solution method by observing the illustration, which later could be retrieved from memory, making this method more efficient in the long run. We discuss the implications for teaching and how tasks without solution methods can increase student focus on important mathematical properties. |
Alina Nostadt; Michael A. Nitsche; Martin Tegenthoff; Silke Lissek In: Scientific Reports, vol. 13, no. 1, pp. 1–16, 2023. @article{Nostadt2023, Contextual information is essential for learning and memory processes and plays a crucial role during the recall of extinction memory, and in the renewal effect, which is the context-dependent recovery of an extinguished response. The dopaminergic system is known to be involved in regulating attentional processes by shifting attention to novel and salient contextual cues. Higher dopamine levels are associated with a better recall of previously learned stimulus-outcome associations and enhanced encoding, as well as retrieval of contextual information which promotes renewal. In this fMRI study, we aimed to investigate the impact of processing contextual information and the influence of dopaminergic D2-like receptor activation on attention to contextual information during a predictive learning task as well as upon extinction learning, memory performance, and activity of extinction-related brain areas. A single oral dose of 1.25 mg bromocriptine or an identical-looking placebo was administered to the participants. We modified a predictive learning task that in previous studies reliably evoked a renewal effect, by increasing the complexity of contextual information. We analysed fixations and dwell on contextual cues by use of eye-tracking and correlated these with behavioural performance and BOLD activation of extinction-related brain areas. Our results indicate that the group with dopaminergic D2-like receptor stimulation had higher attention to task-relevant contextual information and greater/lower BOLD activation of brain regions associated with cognitive control during extinction learning and recall. Moreover, renewal responses were almost completely absent. Since this behavioural effect was observed for both treatment groups, we assume that this was due to the complexity of the altered task design. |
Leonie Nowack; Hermann J. Müller; Markus Conci Changes in attentional breadth scale with the demands of Kanizsa-figure object completion–evidence from pupillometry Journal Article In: Attention, Perception, and Psychophysics, pp. 1–18, 2023. @article{Nowack2023, The present study investigated whether the integration of separate parts into a whole-object representation varies with the amount of available attentional resources. To this end, two experiments were performed, which required observers to maintain central fixation while searching in peripheral vision for a target among various distractor configurations. The target could either be a “grouped” whole-object Kanizsa figure, or an “ungrouped” configuration of identical figural parts, but which do not support object completion processes to the same extent. In the experiments, accuracies and changes in pupil size were assessed, with the latter reflecting a marker of the covert allocation of attention in the periphery. Experiment 1 revealed a performance benefit for grouped (relative to ungrouped) targets, which increased with decreasing distance from fixation. By contrast, search for ungrouped targets was comparably poor in accuracy without revealing any eccentricity-dependent variation. Moreover, measures of pupillary dilation mirrored this eccentricity-dependent advantage in localizing grouped targets. Next, in Experiment 2, an additional attention-demanding foveal task was introduced in order to further reduce the availability of attentional resources for the peripheral detection task. This additional task hampered performance overall, alongside with corresponding pupil size changes. However, there was still a substantial benefit for grouped over ungrouped targets in both the behavioral and the pupillometric data. This shows that perceptual grouping scales with the allocation of attention even when only residual attentional resources are available to trigger the representation of a complete (target) object, thus illustrating that object completion operates in the “near absence” of attention. |
Anna Nowakowska; Alasdair D. F. Clarke; Josephine Reuther; Amelia R. Hunt Variable search for orientation, uniformly optimal search for identity Journal Article In: Journal of Experimental Psychology: General, pp. 1–16, 2023. @article{Nowakowska2023, We compare eye movement strategies across a range of different stimulus sets to test the prediction that eye movements are guided by expected information gain. When searching for a simple target that has been defined based on orientation, interindividual variability is high, and a large proportion of eye movements are directed to locations where peripheral vision would have been sufficient to determine whether the target was present there or not. In contrast, when searching for a target defined based on identity, eye movements are similar across individuals and highly efficient, being directed almost exclusively to the locations where central vision is most needed. The results suggest that for most people, the way they search for a simple fea- ture (orientation) is not directly representative of theway they search for objects based on their identity. More generally, the results highlight that because humans are adaptable, contradictory theories can be accurate descriptions of search in particular contexts and individuals. For a complete and accurate account of human search behavior to be achieved, the conditions that shift us from one mode of behavior to another need to be part of our models. |
Stijn A. Nuiten; Jan Willem Gee; Jasper B. Zantvoord; Johannes J. Fahrenfort; Simon Gaal Catecholaminergic neuromodulation and selective attention jointly shape perceptual decision-making Journal Article In: eLife, vol. 12, pp. 1–26, 2023. @article{Nuiten2023, Perceptual decisions about sensory input are influenced by fluctuations in ongoing neural activity, most prominently driven by attention and neuromodulator systems. It is currently unknown if neuromodulator activity and attention differentially modulate perceptual decision-making and/or whether neuromodulatory systems in fact control attentional processes. To investigate the effects of two distinct neuromodulatory systems and spatial attention on perceptual decisions, we pharmacologically elevated cholinergic (through donepezil) and catecholaminergic (through atomoxetine) levels in humans performing a visuo-spatial attention task, while we measured electroencephalography (EEG). Both attention and catecholaminergic enhancement improved decision-making at the behavioral and algorithmic level, as reflected in increased perceptual sensitivity and the modulation of the drift rate parameter derived from drift diffusion modeling. Univariate analyses of EEG data time-locked to the attentional cue, the target stimulus, and the motor response further revealed that attention and catecholaminergic enhancement both modulated pre-stimulus cortical excitability, cue- and stimulus-evoked sensory activity, as well as parietal evidence accumulation signals. Interestingly, we observed both similar, unique, and interactive effects of attention and catecholaminergic neuromodulation on these behavioral, algorithmic, and neural markers of the decision-making process. Thereby, this study reveals an intricate relationship between attentional and catecholaminergic systems and advances our understanding about how these systems jointly shape various stages of perceptual decision-making. |
Lauri Nummenmaa; Riitta Hari Bodily feelings and aesthetic experience of art Journal Article In: Cognition and Emotion, vol. 37, no. 3, pp. 515–528, 2023. @article{Nummenmaa2023, Humans all around the world are drawn to creating and consuming art due to its capability to evoke emotions, but the mechanisms underlying art-evoked feelings remain poorly characterised. Here we show how embodiement contributes to emotions evoked by a large database of visual art pieces (n = 336). In four experiments, we mapped the subjective feeling space of art-evoked emotions (n = 244), quantified “bodily fingerprints” of these emotions (n = 615), and recorded the subjects' interest annotations (n = 306) and eye movements (n = 21) while viewing the art. We show that art evokes a wide spectrum of feelings, and that the bodily fingerprints triggered by art are central to these feelings, especially in artworks where human figures are salient. Altogether these results support the model that bodily sensations are central to the aesthetic experience. |
Antje Nuthmann; Christopher N. L. Clark Pseudoneglect during object search in naturalistic scenes Journal Article In: Experimental Brain Research, vol. 241, no. 9, pp. 2345–2360, 2023. @article{Nuthmann2023, Pseudoneglect, that is the tendency to pay more attention to the left side of space, is typically assessed with paper-and-pencil tasks, particularly line bisection. In the present study, we used an everyday task with more complex stimuli. Subjects' task was to look for pre-specified objects in images of real-world scenes. In half of the scenes, the search object was located on the left side of the image (L-target); in the other half of the scenes, the target was on the right side (R-target). To control for left–right differences in the composition of the scenes, half of the scenes were mirrored horizontally. Eye-movement recordings were used to track the course of pseudoneglect on a millisecond timescale. Subjects' initial eye movements were biased to the left of the scene, but less so for R-targets than for L-targets, indicating that pseudoneglect was modulated by task demands and scene guidance. We further analyzed how horizontal gaze positions changed over time. When the data for L- and R-targets were pooled, the leftward bias lasted, on average, until the first second of the search process came to an end. Even for right-side targets, the gaze data showed an early left-bias, which was compensated by adjustments in the direction and amplitude of later saccades. Importantly, we found that pseudoneglect affected search efficiency by leading to less efficient scan paths and consequently longer search times for R-targets compared with L-targets. It may therefore be prudent to take spatial asymmetries into account when studying visual search in scenes. |
Sean R. O'Bryan; Shinyoung Jung; Anto J. Mohan; Miranda Scolari Category learning selectively enhances representations of boundary-adjacent exemplars in early visual cortex Journal Article In: The Journal of Neuroscience, vol. 44, no. 3, pp. 1–13, 2023. @article{OBryan2023, Category learning and visual perception are fundamentally interactive processes, such that successful categorization often depends on the ability to make fine visual discriminations between stimuli that vary on continuously valued dimensions. Research suggests that category learning can improve perceptual discrimination along the stimulus dimensions that predict category membership, and that these perceptual enhancements are a byproduct of functional plasticity in the visual system. However, the precise mechanisms underlying learning-dependent sensory modulation in categorization are not well understood. We hypothesized that category learning leads to a representational sharpening of underlying sensory populations tuned to values at or near the category boundary. Furthermore, such sharpening should occur largely during active learning of new categories. These hypotheses were tested using fMRI and a theoretically constrained model of vision to quantify changes in the shape of orientation representations while human adult subjects learned to categorize physically identical stimuli based on either an orientation rule (N = 12) or an orthogonal spatial frequency rule (N = 13). Consistent with our predictions, modeling results revealed relatively enhanced reconstructed representations of stimulus orientation in visual cortex (V1–V3) only for orientation rule learners. Moreover, these reconstructed representations varied as a function of distance from the category boundary, such that representations for challenging stimuli near the boundary were significantly sharper than those for stimuli at the category centers. These results support an efficient model of plasticity wherein only the sensory populations tuned to the most behaviorally relevant regions of feature space are enhanced during category learning. Significance Statement Poisonous or edible? Friend or foe? Quickly grouping objects into appropriate categories is critical to our survival. Many category decisions are supported by the presence of one or more defining features – for example, the shape and color of a banana can easily distinguish it from other fruits at the store. Other decisions require highly precise perceptual representations – which exact shade of yellow determines whether a banana is ripe? We tested the hypothesis that ongoing learning of new visual categories should lead to more precise sensory representations, especially where precision is likely to improve categorization performance. Our results bore this out: active category learning can lead to rapid and specific improvements in the way early visual cortex represents relevant features. |
Ryan M. O'Leary; Nicole M. Amichetti; Zoe Brown; Alexander J. Kinney; Arthur Wingfield Congruent prosody reduces cognitive effort in memory for spoken sentences: A pupillometric study with young and older adults Journal Article In: Experimental Aging Research, pp. 1–24, 2023. @article{OLeary2023, Background: In spite of declines in working memory and other processes, older adults generally maintain good ability to understand and remember spoken sentences. In part this is due to preserved knowledge of linguistic rules and their implementation. Largely overlooked, however, is the support older adults may gain from the presence of sentence prosody (pitch contour, lexical stress, intra-and inter-word timing) as an aid to detecting the structure of a heard sentence. Methods: Twenty-four young and 24 older adults recalled recorded sentences in which the sentence prosody corresponded to the clausal structure of the sentence, when the prosody was in conflict with this structure, or when there was reduced prosody uninformative with regard to the clausal structure. Pupil size was concurrently recorded as a measure of processing effort. Results: Both young and older adults' recall accuracy was superior for sentences heard with supportive prosody than for sentences with uninformative prosody or for sentences in which the prosodic marking and causal structure were in conflict. The measurement of pupil dilation suggested that the task was generally more effortful for the older adults, but with both groups showing a similar pattern of effort-reducing effects of supportive prosody. Conclusions: Results demonstrate the influence of prosody on young and older adults' ability to recall accurately multi-clause sentences, and the significant role effective prosody may play in preserving processing effort. |
Sreenivasan Meyyappan; Abhijit Rajan; George R. Mangun; Mingzhou Ding Top-down control of the left visual field bias in cued visual spatial attention Journal Article In: Cerebral Cortex, vol. 33, no. 9, pp. 5097–5107, 2023. @article{Meyyappan2023, A left visual field (LVF) bias in perceptual judgments, response speed, and discrimination accuracy has been reported in humans. Cognitive factors, such as visual spatial attention, are known to modulate or even eliminate this bias. We investigated this problem by recording pupillometry together with functional magnetic resonance imaging (fMRI) in a cued visual spatial attention task. We observed that (i) the pupil was significantly more dilated following attend-right than attend-left cues, (ii) the task performance (e.g. reaction time [RT]) did not differ between attend-left and attend-right trials, and (iii) the difference in cue-related pupil dilation between attend-left and attend-right trials was inversely related to the corresponding difference in RT. Neuroscientically, correlating the difference in cue-related pupil dilation with the corresponding cue-related fMRI difference yielded activations primarily in the right hemisphere, including the right intraparietal sulcus and the right ventrolateral prefrontal cortex. These results suggest that (i) there is an asymmetry in visual spatial attention control, with the rightward attention control being more effortful than the leftward attention control, (ii) this asymmetry underlies the reduction or the elimination of the LVF bias, and (iii) the components of the attentional control networks in the right hemisphere are likely part of the neural substrate of the observed asymmetry in attentional control. |
Łukasz Michalczyk Fixation offset decreases pupillary inhibition of return Journal Article In: Brain and Cognition, vol. 170, pp. 1–9, 2023. @article{Michalczyk2023, Inhibition of return (IOR) is reflected as a slower manual or saccadic response to a cued rather than an uncued target (manual IOR and saccadic IOR, respectively), and as a pupillary dilation when a bright, relative to a dark side of a display is cued (pupillary IOR). The aim of this study was to investigate the relation between an IOR and oculomotor system. According to the predominant view, only the saccadic IOR is strictly related to the visuomotor process, and the manual and pupillary IORs depend on non-motor factors (e.g., short-term visual depression). Alternatively, the after-effect of the covert-orienting hypothesis postulates that IOR is strictly related to the oculomotor system. As fixation offset affects oculomotor processes, this study investigated whether fixation offset also affects pupillary and manual IORs. The results show that fixation offset decreased IOR in pupillary but not manual responses, and provides support for the hypothesis that at least the pupillary IOR is tightly linked to eye movement preparation. |
Serena Micheletti; Giacomo Vivanti; Stefano Renzetti; Matteo Paolo Lanaro; Paola Martelli; Stefano Calza; Patrizia Accorsi; Stefania Agostini; Anna Alessandrini; Nicole D'Adda; Laura Ferrari; Valentina Foresti; Jessica Galli; Lucio Giordano; Melissa Marras; Alessandro Rizzi; Elisa Fazzi Social attention and social-emotional modulation of attention in Angelman syndrome: An eye-tracking study Journal Article In: Scientific Reports, vol. 13, no. 1, pp. 1–10, 2023. @article{Micheletti2023, Individuals with Angelman syndrome (AS) present with severe intellectual disability alongside a social phenotype characterised by social communication difficulties and an increased drive for social engagement. As the social phenotype in this condition is poorly understood, we examined patterns of social attention and social modulation of attention in AS. Twenty-four individuals with AS and twenty-one young children with similar mental age were shown videos featuring unfamiliar actors who performed simple actions across two conditions: a playful condition, in which the actor showed positive facial emotions, and a neutral condition, in which the actor showed a neutral facial expression. During the passive observation of the videos, participants' proportion of time spent watching the two areas of interest (faces and actions) was examined using eye-tracking technology. We found that the playful condition elicited increased proportion of fixations duration to the actor's face compared to the neutral condition similarly across groups. Additionally, the proportion of fixations duration to the action area was similar across groups in the two conditions. However, children with AS looked towards the actor's face for a shorter duration compared to the comparison group across conditions. This pattern of similarities and differences provides novel insight on the complex social phenotype of children with AS. |
Andra Mihali; Marianne Broeker; Florian D. M. Ragalmuto; Guillermo Horga Introspective inference counteracts perceptual distortion Journal Article In: Nature Communications, vol. 14, no. 1, pp. 1–24, 2023. @article{Mihali2023, Introspective agents can recognize the extent to which their internal perceptual experiences deviate from the actual states of the external world. This ability, also known as insight, is critically required for reality testing and is impaired in psychosis, yet little is known about its cognitive underpinnings. We develop a Bayesian modeling framework and a psychophysics paradigm to quantitatively characterize this type of insight while people experience a motion after-effect illusion. People can incorporate knowledge about the illusion into their decisions when judging the actual direction of a motion stimulus, compensating for the illusion (and often overcompensating). Furthermore, confidence, reaction-time, and pupil-dilation data all show signatures consistent with inferential adjustments in the Bayesian insight model. Our results suggest that people can question the veracity of what they see by making insightful inferences that incorporate introspective knowledge about internal distortions. |
Greta N. Minor; Deborah E. Hannula; Andrew Gordon; J. Daniel Ragland; Ana Maria Iosif; Marjorie Solomon Relational memory weakness in autism despite the use of a controlled encoding task Journal Article In: Frontiers in Psychology, vol. 14, pp. 1–21, 2023. @article{Minor2023, Introduction: Recent work challenged past findings that documented relational memory impairments in autism. Previous studies often relied solely on explicit behavioral responses to assess relational memory integrity, but successful performance on behavioral tasks may rely on other cognitive abilities (e.g., executive functioning) that are impacted in some autistic individuals. Eye-tracking tasks do not require explicit behavioral responses, and, further, eye movements provide an indirect measure of memory. The current study examined whether memory-specific viewing patterns toward scenes differ between autistic and non-autistic individuals. Methods: Using a long-term memory paradigm that equated for complexity between item and relational memory tasks, participants studied a series of scenes. Following the initial study phase, scenes were re-presented, accompanied by an orienting question that directed participants to attend to either features of an item (i.e., in the item condition) or spatial relationships between items (i.e., in the relational condition) that might be subsequently modified during test. At test, participants viewed scenes that were unchanged (i.e., repeated from study), scenes that underwent an “item” modification (an exemplar switch) or a “relational” modification (a location switch), and scenes that had not been presented before. Eye movements were recorded throughout. Results: During study, there were no significant group differences in viewing directed to regions of scenes that might be manipulated at test, suggesting comparable processing of scene details during encoding. However, there was a group difference in explicit recognition accuracy for scenes that underwent a relational change. Marginal group differences in the expression of memory-based viewing effects during test for relational scenes were consistent with this behavioral outcome, particularly when analyses were limited to scenes recognized correctly with high confidence. Group differences were also evident in correlational analyses that examined the association between study phase viewing and recognition accuracy and between performance on the Picture Sequence Memory Test and recognition accuracy. Discussion: Together, our findings suggest differences in the integrity of relational memory representations and/or in the relationships between subcomponents of memory in autism. |
Blake A. Mitchell; Brock M. Carlson; Jacob A. Westerberg; Michele A. Cox; Alexander Maier A role for ocular dominance in binocular integration Journal Article In: Current Biology, vol. 33, no. 18, pp. 3884–3895, 2023. @article{Mitchell2023, Neurons in the primate primary visual cortex (V1) combine left- and right-eye information to form a binocular output. Controversy surrounds whether ocular dominance, the preference of these neurons for one eye over the other, is functionally relevant. Here, we demonstrate that ocular dominance impacts gain control during binocular combination. We recorded V1 spiking activity while monkeys passively viewed grating stimuli. Gratings were either presented to one eye (monocular), both eyes with the same contrasts (binocular balanced), or both eyes with different contrasts (binocular imbalanced). We found that contrast placed in a neuron's dominant eye was weighted more strongly than contrast placed in a neuron's non-dominant eye. This asymmetry covaried with neurons' ocular dominance. We then tested whether accounting for ocular dominance within divisive normalization improves the fit to neural data. We found that ocular dominance significantly improved model performance, with interocular normalization providing the best fits. These findings suggest that V1 ocular dominance is relevant for response normalization during binocular stimulation. |
Viola Mocz; Su Keun Jeong; Marvin Chun; Yaoda Xu Multiple visual objects are represented differently in the human brain and convolutional neural networks Journal Article In: Scientific Reports, vol. 13, no. 1, pp. 1–16, 2023. @article{Mocz2023, Objects in the real world usually appear with other objects. To form object representations independent of whether or not other objects are encoded concurrently, in the primate brain, responses to an object pair are well approximated by the average responses to each constituent object shown alone. This is found at the single unit level in the slope of response amplitudes of macaque IT neurons to paired and single objects, and at the population level in fMRI voxel response patterns in human ventral object processing regions (e.g., LO). Here, we compare how the human brain and convolutional neural networks (CNNs) represent paired objects. In human LO, we show that averaging exists in both single fMRI voxels and voxel population responses. However, in the higher layers of five CNNs pretrained for object classification varying in architecture, depth and recurrent processing, slope distribution across units and, consequently, averaging at the population level both deviated significantly from the brain data. Object representations thus interact with each other in CNNs when objects are shown together and differ from when objects are shown individually. Such distortions could significantly limit CNNs' ability to generalize object representations formed in different contexts. |
Lea Moersdorf; Alexandra M. Freund; Moritz M. Daum What do you focus on? An investigation of goal focus from childhood to old age Journal Article In: Psychological Research, vol. 87, no. 7, pp. 2120–2137, 2023. @article{Moersdorf2023, Goals constitute an important construct in developmental psychology. They represent a central way in which individuals shape their development. Here, we present two studies on age-related differences in one important goal dimension, goal focus, that is, the relative salience of the means and ends of goal pursuit. Extant studies on age-related differences in adults suggest a shift from focusing on the ends to focusing on the means across adulthood. The current studies aimed to expand this research to encompass the entire lifespan including childhood. The first cross-sectional study included participants spanning from early childhood into old age (N = 312, age range: 3–83 years) and used a multimethodological approach comprising eye tracking, behavioral, and verbal measures of goal focus. The second study investigated the verbal measures of the first study in more detail in an adult sample (N = 1550, age range: 17–88 years). Overall, the results do not show a clear pattern, making them difficult to interpret. There was little convergence of the measures, pointing to the difficulties in assessing a construct such as goal focus across a large range of age groups differing in social-cognitive and verbal skills. |
Anisa Morava; Benjamin Tari; Joshua Ahn; Mustafa Shirzad; Matthew Heath; Harry Prapavessis Acute stress imparts a transient benefit to task-switching that is not modulated following a single bout of exercise Journal Article In: Frontiers in Psychology, vol. 14, pp. 1–11, 2023. @article{Morava2023, Introduction: Cognitive flexibility represents a core component of executive function that promotes the ability to efficiently alternate—or “switch”—between different tasks. Literature suggests that acute stress negatively impacts cognitive flexibility, whereas a single bout of aerobic exercise supports a postexercise improvement in cognitive flexibility. Here, we examined whether a single bout of aerobic exercise attenuates a stress-induced decrement in task-switching. Materials and Methods: Forty participants (age range = 19–30) completed the Trier Social Stress Test (TSST) and were randomized into separate Exercise or Rest groups entailing 20-min sessions of heavy intensity exercise (80% of heart rate maximum via cycle ergometer) or rest, respectively. Stress induction was confirmed via state anxiety and heart rate. Task-switching was assessed prior to the TSST (i.e., pre-TSST), following the TSST (i.e., post-TSST), and following Exercise and Rest interventions (i.e., post-intervention) via pro- (i.e., saccade to veridical target location) and antisaccades (i.e., saccade mirror-symmetrical to target location) arranged in an AABB task-switching paradigm. The underlying principle of the AABB paradigm suggests that when prosaccades are preceded by antisaccades (i.e., task-switch trials), the reaction times are longer compared to their task-repeat counterparts (i.e., unidirectional prosaccade switch-cost). Results: As expected, the pre-TSST assessment yielded a prosaccade switch cost. Notably, post-TSST physiological measures indicated a reliable stress response and at this assessment a null prosaccade switch-cost was observed. In turn, post-intervention assessments revealed a switch-cost independent of Exercise and Rest groups. Conclusion: Accordingly, the immediate effects of acute stress supported improved task-switching in young adults; however, these benefits were not modulated by a single bout of aerobic exercise. |
M. Barker; G. Rehrig; F. Ferreira Speakers prioritise affordance-based object semantics in scene descriptions Journal Article In: Language, Cognition and Neuroscience, vol. 38, no. 8, pp. 1045–1067, 2023. @article{Barker2023, This work investigates the linearisation strategies used by speakers when describing real-world scenes to better understand production plans for multi-utterance sequences. In this study, 30 participants described real-world scenes aloud. To investigate which semantic features of scenes predict order of mention, we quantified three features (meaning, graspability, and interactability) using two techniques (whole-object ratings and feature map values). We found that object-level semantic features, namely those affordance-based, predicted order of mention in a scene description task. Our findings provide the first evidence for an object-related semantic feature that guides linguistic ordering decisions and offers theoretical support for the role of object semantics in scene viewing and description. |
Alisa Baron; Vanessa Harwood; Daniel Kleinman; Luca Campanelli; Joseph Molski; Nicole Landi; Julia Irwin Where on the face do we look during phonemic restoration: An eye-tracking study Journal Article In: Frontiers in Psychology, vol. 14, pp. 1–12, 2023. @article{Baron2023, Face to face communication typically involves audio and visual components to the speech signal. To examine the effect of task demands on gaze patterns in response to a speaking face, adults participated in two eye-tracking experiments with an audiovisual (articulatory information from the mouth was visible) and a pixelated condition (articulatory information was not visible). Further, task demands were manipulated by having listeners respond in a passive (no response) or an active (button press response) context. The active experiment required participants to discriminate between speech stimuli and was designed to mimic environmental situations which require one to use visual information to disambiguate the speaker's message, simulating different listening conditions in real-world settings. Stimuli included a clear exemplar of the syllable /ba/ and a second exemplar in which the formant initial consonant was reduced creating an /a/−like consonant. Consistent with our hypothesis, results revealed that the greatest fixations to the mouth were present in the audiovisual active experiment and visual articulatory information led to a phonemic restoration effect for the /a/ speech token. In the pixelated condition, participants fixated on the eyes, and discrimination of the deviant token within the active experiment was significantly greater than the audiovisual condition. These results suggest that when required to disambiguate changes in speech, adults may look to the mouth for additional cues to support processing when it is available. |
Miguel Barretto-García; Gilles Hollander; Marcus Grueschow; Rafael Polanía; Michael Woodford; Christian C. Ruff Individual risk attitudes arise from noise in neurocognitive magnitude representations Journal Article In: Nature Human Behaviour, vol. 7, no. 9, pp. 1551–1567, 2023. @article{BarrettoGarcia2023, Humans are generally risk averse, preferring smaller certain over larger uncertain outcomes. Economic theories usually explain this by assuming concave utility functions. Here, we provide evidence that risk aversion can also arise from relative underestimation of larger monetary payoffs, a perceptual bias rooted in the noisy logarithmic coding of numerical magnitudes. We confirmed this with psychophysics and functional magnetic resonance imaging, by measuring behavioural and neural acuity of magnitude representations during a magnitude perception task and relating these measures to risk attitudes during separate risky financial decisions. Computational modelling indicated that participants use similar mental magnitude representations in both tasks, with correlated precision across perceptual and risky choices. Participants with more precise magnitude representations in parietal cortex showed less variable behaviour and less risk aversion. Our results highlight that at least some individual characteristics of economic behaviour can reflect capacity limitations in perceptual processing rather than processes that assign subjective values to monetary outcomes. |
Julian Basanovic; Owen Myles; Colin MacLeod In: Quarterly Journal of Experimental Psychology, vol. 76, no. 2, pp. 221–230, 2023. @article{Basanovic2023, Individual differences in the ability to control visual attention, often termed “attentional control,” have been of particular interest to cognitive researchers. This has led to the development of numerous tasks intended to measure attentional control, including the antisaccade task. While attentional performance on the antisaccade task is typically indexed through the recording of eye movements, increasingly researchers are reporting the use of probe-based methods of indexing attentional performance on the task. Critically, no research has yet determined the convergence of measures yielded by each of these assessment methods, nor compared the reliability of these measures. The purpose of the present study was to examine whether antisaccade cost measures yielded by a probe-based adaptation of the task converge with antisaccade cost measures yielded by an eye movement task in the sample of individuals, and whether these alternative approaches have comparable levels of psychometric reliability. Ninety-three individuals completed an eye movement task and a probe-based task at two assessment times, and an index of antisaccade cost was computed from each task at each assessment time. Analyses revealed that the antisaccade cost index yielded by each task demonstrated high internal reliability (eye-movement |
Dana Basel; Amit Lazarov A sight for sore eyes? Attention allocation to obsession-provoking stimuli and stimuli reflecting compulsion completion Journal Article In: Motivation and Emotion, pp. 1–15, 2023. @article{Basel2023, Research on attention allocation in OCD has exclusively used obsession-provoking threat stimuli, showing sustained attention over neutral ones. Recently, however, a study contrasting neutral stimuli with stimuli depicting the completion of compulsive acts (end-states stimuli), which is associated with a reduced anxiety (negative reinforcement), showed similar results. Yet, as relative to neutral stimuli end-state stimuli were also OCD-related, these results may still reflect obsession-related distress rather than relief brought on by stimuli signaling compulsion completion. Also, end-states stimuli were not systematically validated. In Study 1, participants rated the subjective discomfort experienced when viewing traditional obsession-provoking threat pictures and novel end-states pictures. We first compared participants with high (HOC) and low (LOC) levels of obsessive-compulsive symptoms, and then clinically diagnosed OCD participants and matched healthy controls. In study 2, we compared gaze patterns of HOC and LOC participants while freely viewing 2-by-2 matrices directly contrasting two threat and two end-state stimuli. Study 1 showed a larger difference in experienced discomfort when viewing the end-state stimuli, compared to threat stimuli, for both OC groups compared with their respected control groups. Study 2 showed that while LOC participants demonstrated no difference in dwell time on threat vs. end-state pictures, the HOC group allocated more attention toward the latter. Both groups were more prone to fixate first the threat pictures. Task reliability was high. Attention allocation in OCD may also be affected by cues signaling the completion of compulsive acts. |
Dana Basel; Moriah Magen; Amit Lazarov Increased attention allocation to stimuli reflecting end-states of compulsive behaviors among obsessive compulsive individuals Journal Article In: Scientific Reports, vol. 13, no. 1, pp. 14–18, 2023. @article{Basel2023a, Attentional research in OCD has focused solely on threat stimuli, assumed to provoke related obsessions and ensuing compulsions. OCD-related stimuli depicting the completion of compulsive acts (“end-states”) have yet to be examined. Past research also neglected to explore the reliability of tasks used. Here, attention allocation to both stimuli types was examined. Participants with high (HOC) and low (LOC) levels of obsessive–compulsive symptoms freely viewed three blocks of 30 two-by-two picture matrices, each including two OCD-related (cleaning$backslash$checking$backslash$ordering) and two neutral pictures, presented for eight seconds, while their gaze was recorded. Participants completed two task versions – one with traditional threat stimuli and one with novel stimuli signaling compulsions end-states. Only the end-state version yielded significant results, showing that HOC participants, compared to LOC participants, spent significantly more time fixating on OCD-related stimuli. Results remained significant after controlling for anxiety, stress, and depression. Task reliability was high. OCD-related stimuli signaling end-states of compulsive behavior should be incorporated in attentional research in OCD. |
Stefanie I. Becker; Anna Grubert; Gernot Horstmann; Ulrich Ansorge Which processes dominate visual search: Bottom-up feature contrast, top-down tuning or trial history? Journal Article In: Cognition, vol. 236, pp. 1–17, 2023. @article{Becker2023a, Previous research has identified three mechanisms that guide visual attention: bottom-up feature contrasts, top-down tuning, and the trial history (e.g., priming effects). However, only few studies have simultaneously examined all three mechanisms. Hence, it is currently unclear how they interact or which mechanisms dominate over others. With respect to local feature contrasts, it has been claimed that a pop-out target can only be selected immediately in dense displays when the target has a high local feature contrast, but not when the displays are sparse, which leads to an inverse set-size effect. The present study critically evaluated this view by systematically varying local feature contrasts (i.e., set size), top-down knowledge, and the trial history in pop-out search. We used eye tracking to distinguish between early selection and later identification-related processes. The results revealed that early visual selection was mainly dominated by top-down knowledge and the trial history: When attention was biased to the target feature, either by valid pre-cueing (top-down) or automatic priming, the target could be localised immediately, regardless of display density. Bottom-up feature contrasts only modulated selection when the target was unknown and attention was biased to the non-targets. We also replicated the often-reported finding of reliable feature contrast effects in the mean RTs, but showed that these were due to later, target identification processes (e.g., in the target dwell times). Thus, contrary to the prevalent view, bottom-up feature contrasts in dense displays do not seem to directly guide attention, but only facilitate nontarget rejection, probably by facilitating nontarget grouping. |
Stefanie I. Becker; Zachary Hamblin-Frohman; Hongfeng Xia; Zeguo Qiu Tuning to non-veridical features in attention and perceptual decision-making: An EEG study Journal Article In: Neuropsychologia, vol. 188, pp. 1–10, 2023. @article{Becker2023b, When searching for a lost item, we tune attention to the known properties of the object. Previously, it was believed that attention is tuned to the veridical attributes of the search target (e.g., orange), or an attribute that is slightly shifted away from irrelevant features towards a value that can more optimally distinguish the target from the distractors (e.g., red-orange; optimal tuning). However, recent studies showed that attention is often tuned to the relative feature of the search target (e.g., redder), so that all items that match the relative features of the target equally attract attention (e.g., all redder items; relational account). Optimal tuning was shown to occur only at a later stage of identifying the target. However, the evidence for this division mainly relied on eye tracking studies that assessed the first eye movements. The present study tested whether this division can also be observed when the task is completed with covert attention and without moving the eyes. We used the N2pc in the EEG of participants to assess covert attention, and found comparable results: Attention was initially tuned to the relative colour of the target, as shown by a significantly larger N2pc to relatively matching distractors than a target-coloured distractor. However, in the response accuracies, a slightly shifted, “optimal” distractor interfered most strongly with target identification. These results confirm that early (covert) attention is tuned to the relative properties of an item, in line with the relational account, while later decision-making processes may be biased to optimal features. |
Stefanie I. Becker; James D. Retell; Jeremy M. Wolfe Mirror blindness: Our failure to recognize the target in search for mirror-reversed shapes Journal Article In: Attention, Perception, & Psychophysics, vol. 85, no. 2, pp. 418–437, 2023. @article{Becker2023, It is well known that visual search for a mirror target (i.e., a horizontally flipped item) is more difficult than search for other-oriented items (e.g., vertically flipped items). Previous studies have typically attributed costs of mirror search to early, attention-guiding processes but could not rule out contributions from later processes. In the present study we used eye tracking to distinguish between early, attention-guiding processes and later target identification processes. The results of four experiments revealed a marked human weakness in identifying mirror targets: Observers appear to frequently fail to classify a mirror target as a target on first fixation and to continue with search even after having directly looked at the target. Awareness measures corroborated that the location of a mirror target could not be reported above chance level after it had been fixated once. This mirror blindness effect explained a large proportion (45–87%) of the overall costs of mirror search, suggesting that part of the difficulties with mirror search are rooted in later, object identification processes (not attentional guidance). Mirror blindness was significantly reduced but not completely eliminated when both the target and non-targets were held constant, which shows that perfect top-down knowledge can reduce mirror blindness, without completely eliminating it. The finding that non-target certainty reduced mirror blindness suggests that object identification is not solely achieved by comparing a selected item to a target template. These results demonstrate that templates that guide search toward targets are not identical to the templates used to conclusively identify those targets. |
Aaron G. Beckner; Mary Katz; David N. Tompkins; Annika T. Voss; Deaven Winebrake; Vanessa LoBue; Lisa M. Oakes; Marianella Casasola A novel approach to assessing infant and child mental rotation Journal Article In: Journal of Intelligence, vol. 11, no. 8, pp. 1–21, 2023. @article{Beckner2023, Mental rotation is a critically important, early developing spatial skill that is related to other spatial cognitive abilities. Understanding the early development of this skill, however, requires a developmentally appropriate assessment that can be used with infants, toddlers, and young children. We present here a new eye-tracking task that uses a staircase procedure to assess mental rotation in 12-, 24-, and 36-month-old children (N = 41). To ensure that all children understood the task, the session began with training and practice, in which the children learned to fixate which of two houses a giraffe, facing either left or right, would approach. The adaptive two-up, one-down staircase procedure assessed the children's ability to fixate the correct house when the giraffe was rotated in 30° (up) or 15° (down) increments. The procedure was successful, with most children showing evidence of mental rotation. In addition, the children were less likely to succeed as the angle of rotation increased, and the older children succeeded at higher angles of rotation than the younger children, replicating previous findings with other procedures. The present study contributes a new paradigm that can assess the development of mental rotation in young children and holds promise for yielding insights into individual differences in mental rotation. |
Bertrand Beffara; Fadila Hadj-Bouziane; Suliann Ben Hamed; C. Nico Boehler; Leonardo Chelazzi; Elisa Santandrea; Emiliano Macaluso Separate and overlapping mechanisms of statistical regularities and salience processing in the occipital cortex and dorsal attention network Journal Article In: Human Brain Mapping, vol. 44, no. 18, pp. 6439–6458, 2023. @article{Beffara2023, Attention selects behaviorally relevant inputs for in-depth processing. Beside the role of traditional signals related to goal-directed and stimulus-driven control, a debate exists regarding the mechanisms governing the effect of statistical regularities on attentional selection, and how these are integrated with other control signals. Using a visuo-spatial search task under fMRI, we tested the joint effects of statistical regularities and stimulus-driven salience. We found that both types of signals modulated occipital activity in a spatially specific manner. Salience acted primarily by reducing the attention bias towards the target location when associated with irrelevant distractors, while statistical regularities reduced this attention bias when the target was presented at a low probability location, particularly at the lower levels of the visual hierarchy. In addition, we found that both statistical regularities and salience activated the dorsal frontoparietal network. Additional exploratory analyses of functional connectivity revealed that only statistical regularities modulated the inter-regional coupling between the posterior parietal cortex and the occipital cortex. These results show that statistical regularities and salience signals are both spatially represented at the occipital level, but that their integration into attentional processing priorities relies on dissociable brain mechanisms. |
Anthony Beh; Paul V. McGraw; Denis Schluppeck The effects of simulated hemianopia on eye movements during text reading Journal Article In: Vision Research, vol. 204, pp. 1–14, 2023. @article{Beh2023, Vision loss is a common, devastating complication of cerebral strokes. In some cases the complete contra-lesional visual field is affected, leading to problems with routine tasks and, notably, the ability to read. Although visual information crucial for reading is imaged on the foveal region, readers often extract useful parafoveal information from the next word or two in the text. In hemianopic field loss, parafoveal processing is compromised, shrinking the visual span and resulting in slower reading speeds. Recent approaches to rehabilitation using perceptual training have been able to demonstrate some recovery of useful visual capacity. As gains in visual sensitivity were most pronounced at the border of the scotoma, it may be possible to use training to restore some of the lost visual span for reading. As restitutive approaches often involve prolonged training sessions, it would be beneficial to know how much recovery is required to restore reading ability. To address this issue, we employed a gaze-contingent paradigm using a low-pass filter to blur one side of the text, functionally simulating a visual field defect. The degree of blurring acts as a proxy for visual function recovery that could arise from restitutive strategies, and allows us to evaluate and quantify the degree of visual recovery required to support normal reading fluency in patients. Because reading ability changes with age, we recruited a group of younger participants, and another with older participants who are closer in age to risk groups for ischaemic strokes. Our results show that changes in patterns of eye movement observed in hemianopic loss can be captured using this simulated reading environment. This opens up the possibility of using participants with normal visual function to help identify the most promising strategies for ameliorating hemianopic loss, before translation to patient groups. |
Manuel Beiran; Nicolas Meirhaeghe; Hansem Sohn; Mehrdad Jazayeri; Manuel Beiran; Nicolas Meirhaeghe; Hansem Sohn; Mehrdad Jazayeri; Srdjan Ostojic Parametric control of flexible timing through low- dimensional neural manifolds Journal Article In: Neuron, vol. 111, pp. 1–15, 2023. @article{Beiran2023, Biological brains possess an unparalleled ability to adapt behavioral responses to changing stimuli and environments. How neural processes enable this capacity is a fundamental open question. Previous works have identified two candidate mechanisms: a low-dimensional organization of neural activity and a modulation by contextual inputs. We hypothesized that combining the two might facilitate generalization and adaptation in complex tasks. We tested this hypothesis in flexible timing tasks where dynamics play a key role. Examining trained recurrent neural networks, we found that confining the dynamics to a low-dimensional subspace allowed tonic inputs to parametrically control the overall input-output transform, enabling generalization to novel inputs and adaptation to changing conditions. Reverse-engineering and theoretical analyses demonstrated that this parametric control relies on a mechanism where tonic inputs modulate the dynamics along non-linear manifolds while preserving their geometry. Comparisons with data from behaving monkeys confirmed the behavioral and neural signatures of this mechanism. |
Manuel Beiran; Nicolas Meirhaeghe; Hansem Sohn; Mehrdad Jazayeri; Srdjan Ostojic Parametric control of flexible timing through low-dimensional neural manifolds Journal Article In: Neuron, vol. 111, no. 5, pp. 739–753, 2023. @article{Beiran2023a, Biological brains possess an unparalleled ability to adapt behavioral responses to changing stimuli and environments. How neural processes enable this capacity is a fundamental open question. Previous works have identified two candidate mechanisms: a low-dimensional organization of neural activity and a modulation by contextual inputs. We hypothesized that combining the two might facilitate generalization and adaptation in complex tasks. We tested this hypothesis in flexible timing tasks where dynamics play a key role. Examining trained recurrent neural networks, we found that confining the dynamics to a low-dimensional subspace allowed tonic inputs to parametrically control the overall input-output transform, enabling generalization to novel inputs and adaptation to changing conditions. Reverse-engineering and theoretical analyses demonstrated that this parametric control relies on a mechanism where tonic inputs modulate the dynamics along non-linear manifolds while preserving their geometry. Comparisons with data from behaving monkeys confirmed the behavioral and neural signatures of this mechanism. |
Judith Bek; Emma Gowen; Stefan Vogt; Trevor J. Crawford; Ellen Poliakoff Observation and imitation of object-directed hand movements in Parkinson's disease Journal Article In: Scientific Reports, vol. 13, no. 1, pp. 1–9, 2023. @article{Bek2023, Action observation and imitation may facilitate movement in Parkinson's disease (PD). People with PD have been found to imitate intransitive actions similarly to neurologically healthy older adults, but their imitation of object-directed hand movements has not previously been investigated using kinematic measures. The present study examined observation and imitation of object-directed hand movements in 18 participants with PD and 21 neurologically healthy age-matched control participants. Participants observed and immediately imitated sequences showing a human hand reaching for and transferring an object between horizontal positions. Both groups significantly modulated their finger movements, showing higher vertical amplitude when imitating elevated compared to direct trajectories. In addition, movements were lower in vertical amplitude and higher in velocity when imitating the reaching segment than the transfer segment. Eye-tracking revealed that controls made smaller saccades when observing predictable than unpredictable elevated movements, but no effects of predictability on eye movements were found for the PD group. This study provides quantitative evidence that people with mild to moderate PD can imitate object-directed hand movement kinematics, although their prediction of such movements may be reduced. These findings suggest that interventions targeting object-directed actions may capitalize on the ability of people with PD to imitate kinematic parameters of a demonstrated movement. |
B. Bellana; N. Ladyka-Wojcik; S. Lahan; M. Moscovitch; C. L. Grady Recollection and prior knowledge recruit the left angular gyrus during recognition Journal Article In: Brain Structure and Function, vol. 228, pp. 197–217, 2023. @article{Bellana2023, The human angular gyrus (AG) is implicated in recollection, or the ability to retrieve detailed memory content from a specific episode. A separate line of research examining the neural bases of more general mnemonic representations, extracted over multiple episodes, also highlights the AG as a core region of interest. To reconcile these separate views of AG function, the present fMRI experiment used a Remember-Know paradigm with famous (prior knowledge) and non-famous (no prior knowledge) faces to test whether AG activity could be modulated by both task-specific recollection and general prior knowledge within the same individuals. Increased BOLD activity in the left AG was observed during both recollection in the absence of prior knowledge (recollected > non-recollected or correctly rejected non-famous faces) and when prior knowledge was accessed in the absence of experiment-specific recollection (famous > non-famous correct rejections). This pattern was most prominent for the left AG as compared to the broader inferior parietal lobe. Recollection-related responses in the left AG increased with encoding duration and prior knowledge, despite prior knowledge being incidental to the recognition decision. Overall, the left AG appears sensitive to both task-specific recollection and the incidental access of general prior knowledge, thus broadening our notions of the kinds of mnemonic representations that drive activity in this region. |
Alessio Bellato; Iti Arora; Puja Kochhar; Danielle Ropar; Chris Hollis; Madeleine J. Groom Relationship between autonomic arousal and attention orienting in children and adolescents with ADHD, autism and co-occurring ADHD and autism Journal Article In: Cortex, vol. 166, pp. 306–321, 2023. @article{Bellato2023, Introduction: Attention-Deficit/Hyperactivity Disorder (ADHD) and Autism Spectrum Disorder (ASD) may be characterized by different profiles of visual attention orienting. However, there are also many inconsistent findings emerging from the literature, probably due to the fact that the potential effect of autonomic arousal (which has been proposed to be dysregulated in these conditions) on oculomotor performance has not been investigated before. Moreover, it is not known how visual attention orienting is affected by the co-occurrence of ADHD and autism in people with a double diagnosis. Methods: 99 children/adolescents with or without ADHD and/or autism (age 10.79 ± 2.05 years, 65% boys) completed an adapted version of the gap-overlap task (with baseline and overlap trials only). The social salience and modality of stimuli were manipulated between trials. Eye movements and pupil size were recorded. We compared saccadic reaction times (SRTs) between diagnostic groups and investigated if a trial-by-trial association existed between pre-saccadic pupil size and SRTs. Results: Faster orienting (shorter SRT) was found for baseline compared to overlap trials, faces compared to non-face stimuli and–more evidently in children without ADHD and/or autism–for multi-modal compared to uni-modal stimuli. We also found a linear negative association between pre-saccadic pupil size and SRTs, in autistic participants (without ADHD), and a quadratic association in children with ADHD (without autism), for which SRTs were slower when intra-individual pre-saccadic pupil size was smallest or largest. Conclusion: Our findings are in line with previous literature and indicate a possible effect of dysregulated autonomic arousal on oculomotor mechanisms in autism and ADHD, which should be further investigated in future research studies with larger samples, to reliably investigate possible differences between children with single and dual diagnoses. |
Daniel Bennett; Angela Radulescu; Sam Zorowitz; Valkyrie Felso; Yael Niv Affect-congruent attention modulates generalized reward expectations Journal Article In: PLoS Computational Biology, vol. 19, no. 12, pp. 1–33, 2023. @article{Bennett2023, Positive and negative affective states are respectively associated with optimistic and pessimistic expectations regarding future reward. One mechanism that might underlie these affect-related expectation biases is attention to positive- versus negative-valence features (e.g., attending to the positive reviews of a restaurant versus its expensive price). Here we tested the effects of experimentally induced positive and negative affect on feature-based attention in 120 participants completing a compound-generalization task with eye-tracking. We found that participants' reward expectations for novel compound stimuli were modulated in an affect-congruent way: positive affect induction increased reward expectations for compounds, whereas negative affect induction decreased reward expectations. Computational modelling and eye-tracking analyses each revealed that these effects were driven by affect-congruent changes in participants' allocation of attention to high- versus low-value features of compounds. These results provide mechanistic insight into a process by which affect produces biases in generalized reward expectations. |
Katharine Aveni; Juweiriya Ahmed; Arielle Borovsky; Ken McRae; Mary E. Jenkins; Katherine Sprengel; J. Alexander Fraser; Joseph B. Orange; Thea Knowles; Angela C. Roberts Predictive language comprehension in Parkinson's disease Journal Article In: PLoS ONE, vol. 18, pp. 1–32, 2023. @article{Aveni2023, Verb and action knowledge deficits are reported in persons with Parkinson's disease (PD), even in the absence of dementia or mild cognitive impairment. However, the impact of these deficits on combinatorial semantic processing is less well understood. Following on previous verb and action knowledge findings, we tested the hypothesis that PD impairs the ability to integrate event-based thematic fit information during online sentence processing. Specifically, we anticipated persons with PD with age-typical cognitive abilities would perform more poorly than healthy controls during a visual world paradigm task requiring participants to predict a target object constrained by the thematic fit of the agent-verb combination. Twenty-four PD and 24 healthy age-matched participants completed comprehensive neuropsychological assessments. We recorded participants' eye movements as they heard predictive sentences (The fisherman rocks the boat) alongside target, agent-related, verb-related, and unrelated images. We tested effects of group (PD/control) on gaze using growth curve models. There were no significant differences between PD and control participants, suggesting that PD participants successfully and rapidly use combinatory thematic fit information to predict upcoming language. Baseline sentences with no predictive information (e.g., Look at the drum) confirmed that groups showed equivalent sentence processing and eye movement patterns. Additionally, we conducted an exploratory analysis contrasting PD and controls' performance on low-motion-content versus high-motion-content verbs. This analysis revealed fewer predictive fixations in high-motion sentences only for healthy older adults. PD participants may adapt to their disease by relying on spared, non-action-simulation-based language processing mechanisms, although this conclusion is speculative, as the analyses of high- vs. low-motion items was highly limited by the study design. These findings provide novel evidence that individuals with PD match healthy adults in their ability to use verb meaning to predict upcoming nouns despite previous findings of verb semantic impairment in PD across a variety of tasks. |
Thomas R. Barber; Kinan Muhammed; Daniel Drew; Kevin M. Bradley; Daniel R. McGowan; Johannes C. Klein; Sanjay G. Manohar; Michele T. M. Hu; Masud Husain Reward insensitivity is associated with dopaminergic deficit in rapid eye movement sleep behaviour disorder Journal Article In: Brain, vol. 146, no. 6, pp. 2502–2511, 2023. @article{Barber2023, Idiopathic rapid eye movement sleep behaviour disorder (iRBD) has now been established as an important marker of the prodromal stage of Parkinson's disease and related synucleinopathies. However, although dopamine transporter single photon emission computed tomography (SPECT) has been used to demonstrate the presence of nigro-striatal deficit in iRBD, quantifiable correlates of this are currently lacking. Sensitivity to rewarding stimuli is reduced in some people with Parkinson's disease, potentially contributing to aspects of the neuropsychiatric phenotype in these individuals. Furthermore, a role for dopaminergic degeneration is suggested by the fact that reward insensitivity can be improved by dopaminergic medications. Patients with iRBD present a unique opportunity to study the relationship between reward sensitivity and early dopaminergic deficit in the unmedicated state. Here, we investigate whether a non-invasive, objective measure of reward sensitivity might be a marker of dopaminergic status in prodromal Parkinson's disease by comparing with SPECT/CT measurement of dopaminergic loss in the basal ganglia. Striatal dopaminergic deficits in iRBD are associated with progression to Parkinsonian disorders. Therefore, identification of a clinically measurable correlate of this degenerative process might provide a basis for the development of novel risk stratification tools. Using a recently developed incentivized eye-tracking task, we quantified reward sensitivity in a cohort of 41 patients with iRBD and compared this with data from 40 patients with Parkinson's disease and 41 healthy controls. Patients with iRBD also underwent neuroimaging with dopamine transporter SPECT/CT. Overall, reward sensitivity, indexed by pupillary response to monetary incentives, was reduced in iRBD cases compared with controls and was not significantly different to that in patients with Parkinson's disease. However, in iRBD patients with normal dopamine transporter SPECT/CT imaging, reward sensitivity was not significantly different from healthy controls. Across all iRBD cases, a positive association was observed between reward sensitivity and dopaminergic SPECT/CT signal in the putamen. These findings demonstrate a direct relationship between dopaminergic deficit and reward sensitivity in patients with iRBD and suggest that measurement of pupillary responses could be of value in models of risk stratification and disease progression in these individuals. |
Mehdi Bejani; Elisa Luque-Buzo; Arsen Burlaka-Petrash; Jorge A. Gomez-Garcia; Julian D. Arias-Londono; F. Grandas-Perez; Jesus Grajal; Juan Ignacio Godino-Llorente Baseline wander removal applied to smooth pursuit eye movements from parkinsonian patients Journal Article In: IEEE Access, vol. 11, pp. 32119–32133, 2023. @article{Bejani2023, Prior studies aiming to parametrize the sequences obtained from the Smooth Pursuit Eye Movements (SPEM) of patients with Parkinson's disease are based on the manual extraction of cues of interest. This is because methods to automatically extract the relevant information are complex to implement and are constrained, in part, by the appearance of a baseline wander (BW). Thus, new methods are required for preprocessing the SPEM sequences to make the potential parameterisation procedures much more robust, removing the aforementioned BW. In this respect, the present study compares different BW removal methods applied to SPEM sequences based on several objective evaluation metrics. At the same time, it proposes a set of guidelines to estimate the ground truth that is required for comparison purposes. Data were collected using a high-speed video-based eye-tracking device. 52 patients and 60 controls and 12 young participants were enrolled in the study. The ground truth required to compare the different BW removal techniques was manually delineated according to a predefined protocol. Seven methods were developed to remove the BW, and four objective metrics were used to evaluate the results. According to the results, a method based on the Empirical Wavelet Transform provided the best performance removing the BW. Furthermore, the objective and subjective results show that potential asymmetries between left and right eye movements are solved by removing the BW. Regardless of the techniques used, BW removal is revealed to be a crucial step for any autonomous SPEM processing tool. |
Florence Blondiaux; Louisien Lebrun; Bernard J. Hanseeuw; Frédéric Crevecoeur Impairments of saccadic and reaching adaptation in essential tremor are linked to movement execution Journal Article In: Journal of Neurophysiology, vol. 130, no. 5, pp. 1092–1102, 2023. @article{Blondiaux2023, Essential tremor (ET) is a neurological disorder characterized by involuntary oscillations of the limbs. Previous studies have hypothesized that ET is a cerebellar disorder and reported impairments in motor adaptation. However, recent advances have highlighted that motor adaptation involves several components linked to anticipation and control, all dependent on cerebellum. We studied the contribution of both components in adaptation to better understand the adaptation impairments observed in ET from a behavioral perspective. To address this question, we investigated behavioral markers of adaptation in ET patients (n = 20) and age-matched neurologically intact volunteers (n = 20) in saccadic and upper limb adaptation tasks, probing compensation for target jumps and for velocity-dependent force fields, respectively. We found that both groups adapted their movements to the novel contexts; however, ET patients adapted to a lesser extent compared with neurologically intact volunteers. Importantly, components of the movement linked to anticipation were preserved in the ET group, whereas components linked to movement execution appeared responsible for the adaptation deficit in this group. Altogether, our results suggest that execution deficits may be a specific functional consequence of the alteration of neural pathways associated with ET.NEW & NOTEWORTHY We tested essential tremor patients' adaptation abilities in classical tasks including saccadic adaptation to target jumps and reaching adaptation to force field disturbances. Patients' adaptation was present but impaired in both tasks. Interestingly, the deficits were mainly present during movement execution, whereas the anticipatory components of movements were similar to neurologically intact volunteers. These findings reinforce the hypothesis of a cerebellar origin for essential tremor and detail the motor adaptation impairments previously found in this disorder. |
Laura B. Bragdon; Jacob A. Nota; Goi Khia Eng; Nicolette Recchia; Pearl Kravets; Katherine A. Collins; Emily R. Stern Failures of urge suppression in obsessive-compulsive disorder: Behavioral modeling using a blink suppression task Journal Article In: Journal of Obsessive-Compulsive and Related Disorders, vol. 38, pp. 1–10, 2023. @article{Bragdon2023, Many individuals with obsessive-compulsive disorder (OCD) report sensory-based urges (e.g. ‘not-just-right experiences') in addition to, or instead of, concrete fear-based obsessions. These sensations may be comparable to normative “urges-for-action” (UFA), such as the urge to blink. While research has identified altered functioning of brain regions related to UFA in OCD, little is known about behavioral patterns of urge suppression in the disorder. Using an urge-to-blink task as a model for sensory-based urges, this study compared failures of urge suppression between OCD patients and controls by measuring eyeblinks during 60-s blocks of instructed blink suppression. Cox shared frailty models estimated the hazard of first blinks during each 60-s block and recurrent blinks following each initial erroneous blink. OCD patients demonstrated a higher hazard of first and recurrent blinks compared to controls, suggesting greater difficulty resisting repetitive sensory-based urges. Within OCD, relationships between task outcomes and symptom severity were inconsistent. Findings provide support for a deficit in delaying initial urge-induced actions and terminating subsequent actions in OCD, which is not clearly related to clinical heterogeneity. Elucidating the nature of behavioral resistance to urges is relevant for informing conceptualizations of obsessive-compulsive psychopathology and optimizing treatment outcomes. |
Olivia G. Calancie; Ashley C. Parr; Don C. Brien; Jeff Huang; Isabell C. Pitigoi; Brian C. Coe; Linda Booij; Sarosh Khalid-Khan; Douglas P. Munoz In: Frontiers in Neuroscience, vol. 17, pp. 1–18, 2023. @article{Calancie2023, Shifting motor actions from reflexively reacting to an environmental stimulus to predicting it allows for smooth synchronization of behavior with the outside world. This shift relies on the identification of patterns within the stimulus – knowing when a stimulus is predictable and when it is not – and launching motor actions accordingly. Failure to identify predictable stimuli results in movement delays whereas failure to recognize unpredictable stimuli results in early movements with incomplete information that can result in errors. Here we used a metronome task, combined with video-based eye-tracking, to quantify temporal predictive learning and performance to regularly paced visual targets at 5 different interstimulus intervals (ISIs). We compared these results to the random task where the timing of the target was randomized at each target step. We completed these tasks in female pediatric psychiatry patients (age range: 11–18 years) with borderline personality disorder (BPD) symptoms, with (n = 22) and without (n = 23) a comorbid attention-deficit hyperactivity disorder (ADHD) diagnosis, against controls (n = 35). Compared to controls, BPD and ADHD/BPD cohorts showed no differences in their predictive saccade performance to metronome targets, however, when targets were random ADHD/BPD participants made significantly more anticipatory saccades (i.e., guesses of target arrival). The ADHD/BPD group also significantly increased their blink rate and pupil size when initiating movements to predictable versus unpredictable targets, likely a reflection of increased neural effort for motor synchronization. BPD and ADHD/BPD groups showed increased sympathetic tone evidenced by larger pupil sizes than controls. Together, these results support normal temporal motor prediction in BPD with and without ADHD, reduced response inhibition in BPD with comorbid ADHD, and increased pupil sizes in BPD patients. Further these results emphasize the importance of controlling for comorbid ADHD when querying BPD pathology. |
Devonte Campbell; Bernadette Ann Murphy; James Burkitt; Nicholas La Delfa; Praveen Sanmugananthan; Ushani Ambalavanar; Paul Yielder Cervico-ocular and vestibulo-ocular reflexes in subclinical neck pain and healthy individuals: A cross-sectional study Journal Article In: Brain Sciences, vol. 13, no. 11, pp. 1–15, 2023. @article{Campbell2023, Alterations in neck sensory input from recurrent neck pain (known as subclinical neck pain (SCNP)) result in disordered sensorimotor integration (SMI). The cervico-ocular (COR) and vestibulo-ocular (VOR) reflexes involve various neural substrates but are coordinated by the cerebellum and reliant upon proprioceptive feedback. Given that proprioception and cerebellar processing are impaired in SCNP, we sought to determine if COR or VOR gain is also altered. COR and VOR were assessed using an eye-tracking device in 20 SCNP (9 M and 11 F; 21.8 (SD = 2.35) years) and 17 control (7 M and 10 F; 22.40 (SD = 3.66) years) participants. COR gain (10 trials): A motorized chair rotated the trunk at a frequency of 0.04 Hz and an amplitude of 5° while participants gazed at a circular target that disappeared after three seconds. VOR gain (30 trials): Rapid bilateral head movements away from a disappearing circular target while eyes fixated on the last observed target. Independent t-tests on COR and VOR gain were performed. SCNP had a significantly larger COR gain (p = 0.006) and smaller VOR gain (p = 0.487) compared to healthy controls. The COR group differences suggest an association between proprioceptive feedback and SMI, indicating COR may be a sensitive marker of altered cerebellar processing. |
Clara Grazia Chisari; Giorgia Sciacca; Ester Reggio; Claudio Terravecchia; Francesco Patti; Mario Zappia Subclinical involvement of eye movements detected by video-based eye tracking in myasthenia gravis Journal Article In: Neurological Sciences, vol. 44, no. 7, pp. 2555–2559, 2023. @article{Chisari2023, Background: Ocular abnormalities in myasthenia gravis (MG) are characterized by severely limited movements and rapid saccades. Data about eye motility of MG patients whose ocular movements are apparently normal are lacking. Our study assessed the eye movement parameters in MG patients without clinical eye motility dysfunctions and investigated the effects of neostigmine administration on the eye motility in these patients. Materials: In this longitudinal study, we screened all patients diagnosed with MG referring to the Neurologic Clinic of the University of Catania between October 1, 2019, and June 30, 2021. Ten age- and sex-matched healthy controls were enrolled. Patients underwent eye movement recording using the EyeLink1000 Plus® eye tracker at baseline and after 90 min from the intramuscular administration of neostigmine (0.5 mg). Results: A total of 14 MG patients with no clinical signs of ocular motor dysfunction (64.3% men, with a mean age of 50.4 ± 14.4 years) were enrolled. At baseline, saccades in MG patients showed slower velocities and longer latencies compared to controls. Moreover, the fatigue test induced a reduction in saccadic velocity and an increase in latencies. After neostigmine administration, the ocular motility analysis showed shorter saccadic latencies and a significant improvement of velocities. Conclusions: Eye motility is impaired even in MG patients with no clinical evidence of ocular movement disturbance. Video-based eye tracking may detect subclinical involvement of eye movements in patients with MG. |