EyeLink 认知出版物
所有EyeLink认知和感知研究出版物,直至2023年(部分早于2024年)均按年份列出。您可以使用视觉搜索、场景感知、面部处理等关键词搜索出版物。您还可以搜索单个作者姓名。如果我们错过了任何EyeLink认知或感知文章,请给我们发电子邮件!
2023 |
Hao Wu; Yuding Zhang; Qiong Luo; Zhengzhou Zhu The magnitude representations of fractions of Chinese students: Evidence from behavioral experiment and eye-tracking Journal Article In: Current Psychology, pp. 1–16, 2023. @article{Wu2023b, Early knowledge of fractions can largely predict later mathematical performance, and a comprehensive and in-depth understanding of fractions is fundamental to learning more advanced mathematics. The study aimed to explore the influencing factors and age characteristics of magnitude representations of fractions by a fraction comparison task, using subjects' eye-movement measures as direct evidence and the results of linear regression analyses as indirect evidence. The results found that the number of digits of fractions' components and types of fraction pairs jointly influence the magnitude representations of fractions. For one-digit fraction pairs with and without common components, componential representation is favored; for two-digit fraction pairs with common components, componential representation is preferred, while for two-digit fraction pairs without common components, holistic representation is selected. The representation styles are consistent across university students, junior high school students and primary school students, and there are significant age differences in representation levels, with university students being more flexible in their use of representation strategies of fractions than the other two ages, and junior high school students showing the same level with the primary school students. These results suggest that not only Chinese university students, but also Chinese primary and junior high school students can select and adapt representation strategies of fractions according to the characteristics and complexity of fraction processing tasks. The eye-movement technique can largely compensate for the shortcomings of the regression analysis paradigm and better reveal the critical cognitive processes involved in the processing of fractions. |
Fei Wu; Zhibing Gao; Changlin Luo; Tuo Zhang; Xiangling Zhuang; Guojie Ma The effect of unit number and inter-unit distance on perceived food portion size Journal Article In: Food Quality and Preference, vol. 107, no. 199, pp. 1–12, 2023. @article{Wu2023a, Previous studies have demonstrated that perceived portion size of food influences consumption, so modifying perceived portion size may affect food intake. The present study evaluated the effects of unit number and inter-unit distance on perceived food portion size through eye-tracking and behavioral experiments. After observing one reference portion size picture, 34 participants in Experiment 1 and 29 participants in Experiment 2 evaluated 60 chocolate pictures with 10 different total portion sizes, with a unit number of 9 or 16 and an inter-unit distance of 100%, 120%, or 130%. The results demonstrated that unit number and inter-unit distance independently influenced the perception of overall portion size, while only the unit number could influence the perception of unit portion size. Making estimations about unit portion size requires more cognitive resources than that of overall portion size. These findings imply that we can adjust people's perceived portion sizes by varying the inter-unit distance or unit number of foods, thus nudging individuals to make more rational portion size decisions. |
Chenjing Wu; Hongyan Zhu; Yameng Zhang; Wei Zhang; Xianyou He Sensitivity to moral goodness under different aesthetic contexts Journal Article In: Ethics and Behavior, pp. 1–15, 2023. @article{Wu2023, Does context influence our appreciation of beauty? To answer this question, two experiments were conducted to determine the effect of contextual aesthetics on the recognition of moral behavior. Experiment 1 demonstrated that individuals in a high-aesthetic context had a quicker recognition time for moral behavior than those in a low-aesthetic context. In a low-aesthetic context, individuals recognize immoral behavior more quickly than in a high aesthetic context. Individuals showed greater recognition rates for moral behavior in a high aesthetic context and higher recognition for immoral behaviors in a low aesthetic context for behavior with unclear information. Experiment 2 revealed that individual fixation counts were smaller under the conditions of high aesthetic context and moral behavior than under the conditions of low aesthetic context and moral behavior, indicating a correlation between low aesthetic context and immoral behavior. This study shows that high aesthetic context facilitates the recognition of moral behavior, which has implications for moral education. |
Clare Wright; Jun Wang The role of visual processing in learning Mandarin characters Journal Article In: Journal of the European Second Language Association, vol. 7, no. 1, pp. 31–45, 2023. @article{Wright2023, This study explored whether beginner-level learners use radicals to learn written Chinese characters in making form-meaning paired-associate mappings, one of the key components in written character acquisition and word learning (Chan et al., 2020; Kintsch, 1988). Eyegaze patterns during new word-learning was measured to indicate visual focus, along with visual working memory (VWM) capacity, hitherto unexamined at beginner-level for Chinese (Chen et al., 2018; Godfroid, 2019). The experiment compared ease of recall across three groups of characters with different semantic radicals (nominal and verbal) and different visual salience. Greater visual salience rather than semantic class was predicted to foster ease of recall (Bax, 2013; Godfroid, 2019). Thirty-five adult Anglophone ab-initio learners of Chinese took part, recruited after five weeks at a language institute in China. Participants completed a computer- based self-paced character learning test and a VWM shape recall test. They then took a randomized character recall test; eyegaze patterns measured fixations on target radical areas during learning and testing phases. During testing, nominal recall was significantly the fastest and most accurate of the three types (p < .001). There were no significant correlations for accuracy of recall with VWM or eyegaze patterns. These findings, although tentative, suggest that some linguistic element of noun-learning comes “for free” (e.g., Gentner, 1982) even at beginner-level level. The study has timely implications for theoretical and pedagogical understanding of Chinese word learning processes, given the rapidly expanding area of Mandarin Chinese language learning in both taught and self-study app-based contexts. |
Christian Wolf; Markus Lappe Motivation by reward jointly improves speed and accuracy, whereas task-relevance and meaningful images do not Journal Article In: Attention, Perception, & Psychophysics, vol. 85, no. 3, pp. 930–948, 2023. @article{Wolf2023, Visual selection is characterized by a trade-off between speed and accuracy. Speed or accuracy of the selection process can be affected by higher level factors—for example, expecting a reward, obtaining task-relevant information, or seeing an intrinsically relevant target. Recently, motivation by reward has been shown to simultaneously increase speed and accuracy, thus going beyond the speed–accuracy-trade-off. Here, we compared the motivating abilities of monetary reward, task-relevance, and image content to simultaneously increase speed and accuracy. We used a saccadic distraction task that required suppressing a distractor and selecting a target. Across different blocks successful target selection was followed either by (i) a monetary reward, (ii) obtaining task-relevant information, or (iii) seeing the face of a famous person. Each block additionally contained the same number of irrelevant trials lacking these consequences, and participants were informed about the upcoming trial type. We found that postsaccadic vision of a face affected neither speed nor accuracy, suggesting that image content does not affect visual selection via motivational mechanisms. Task relevance increased speed but decreased selection accuracy, an observation compatible with a classical speed–accuracy trade-off. Motivation by reward, however, simultaneously increased response speed and accuracy. Saccades in all conditions deviated away from the distractor, suggesting that the distractor was suppressed, and this deviation was strongest in the reward block. Drift-diffusion modelling revealed that task-relevance affected behavior by affecting decision thresholds, whereas motivation by reward additionally increased the rate of information uptake. The present findings thus show that the three consequences differ in their motivational abilities. |
Joost De Winter; Toine Koelmans; Maarten Kokshoorn; Kars Van Der Valk A role of peripheral vision in chess? Evidence from a gaze-contingent method Journal Article In: Journal of Expertise, vol. 6, no. 1, pp. 23–38, 2023. @article{Winter2023, Chunking theory and previous eye-tracking studies suggest that expert chess players use peripheral vision to judge chess positions and determine the best moves to play. However, the role of peripheral vision in chess has largely been inferred rather than tested through controlled experimentation. In this study, we used a gaze-contingent paradigm in a reconstruction task, similar to the one initially used by De Groot (1946). It was hypothesized that the smaller the gaze-contingent window while memorizing a chess position, the smaller the differences in reconstruction accuracy between novice and expert players. Participants viewed 30 chess positions for 20 seconds, after which they reconstructed this position. This was done for four different window sizes as well as for full visibility of the board. The results, as measured by Cohen's d effect sizes between experts and novices of the proportion of correctly placed pieces, supported the above hypothesis, with experts performing much better but losing much of their performance advantage for the smallest window size. A complementary find-the-best-move task and additional eye-movement analyses showed that experts had a longer median fixation duration and more spatially concentrated scan patterns than novice players. These findings suggest a key contribution of peripheral vision and are consistent with the prevailing chunking theory. |
Hanna E. Willis; I. Betina Ip; Archie Watt; Jon Campbell; Saad Jbabdi; William T. Clarke; Matthew R. Cavanaugh; Krystel R. Huxlin; Kate E. Watkins; Marco Tamietto; Holly Bridge GABA and glutamate in hMT+ link to individual differences in residual visual function after occipital stroke Journal Article In: Stroke, vol. 54, no. 9, pp. 2286–2295, 2023. @article{Willis2023, BACKGROUND: Damage to the primary visual cortex following an occipital stroke causes loss of conscious vision in the contralateral hemifield. Yet, some patients retain the ability to detect moving visual stimuli within their blind field. The present study asked whether such individual differences in blind field perception following loss of primary visual cortex could be explained by the concentration of neurotransmitters γ-aminobutyric acid (GABA) and glutamate or activity of the visual motion processing, human middle temporal complex (hMT+). METHODS: We used magnetic resonance imaging in 19 patients with chronic occipital stroke to measure the concentration of neurotransmitters GABA and glutamate (proton magnetic resonance spectroscopy) and functional activity in hMT+ (functional magnetic resonance imaging). We also tested each participant on a 2-interval forced choice detection task using high-contrast, moving Gabor patches. We then measured and assessed the strength of relationships between participants' residual vision in their blind field and in vivo neurotransmitter concentrations, as well as visually evoked functional magnetic resonance imaging activity in their hMT+. Levels of GABA and glutamate were also measured in a sensorimotor region, which served as a control. RESULTS: Magnetic resonance spectroscopy-derived GABA and glutamate concentrations in hMT+ (but not sensorimotor cortex) strongly predicted blind-field visual detection abilities. Performance was inversely related to levels of both inhibitory and excitatory neurotransmitters in hMT+ but, surprisingly, did not correlate with visually evoked blood oxygenation level-dependent signal change in this motion-sensitive region. CONCLUSIONS: Levels of GABA and glutamate in hMT+ appear to provide superior information about motion detection capabilities inside perimetrically defined blind fields compared to blood oxygenation level-dependent signal changes - in essence, serving as biomarkers for the quality of residual visual processing in the blind-field. Whether they also reflect a potential for successful rehabilitation of visual function remains to be determined. |
Craig A. Williamson; Jari J. Morganti; Hannah E. Smithson Bright-light distractions and visual performance Journal Article In: Frontiers in Psychology, vol. 14, pp. 1–11, 2023. @article{Williamson2023, Visual distractions pose a significant risk to transportation safety, with laser attacks against aircraft pilots being a common example. This study used a research-grade High Dynamic Range (HDR) display to produce bright-light distractions for 12 volunteer participants performing a combined visual task across central and peripheral visual fields. The visual scene had an average luminance of 10 cd∙m−2 with targets of approximately 0.5° angular size, while the distractions had a maximum luminance of 9,000 cd∙m−2 and were 3.6° in size. The dependent variables were the mean fixation duration during task execution (representative of information processing time), and the critical stimulus duration required to support a target level of performance (representative of task efficiency). The experiment found a statistically significant increase in mean fixation duration, rising from 192 ms without distractions to 205 ms with bright-light distractions (p = 0.023). This indicates a decrease in visibility of the low contrast targets or an increase in cognitive workload that required greater processing time for each fixation in the presence of the bright-light distractions. Mean critical stimulus duration was not significantly affected by the distraction conditions used in this study. Future experiments are suggested to replicate driving and/or piloting tasks and employ bright-light distractions based on real-world data, and we advocate the use of eye-tracking metrics as sensitive measures of changes in performance. |
Louis Williams; Kelsey J. Mulder; Andrew Charlton-Perez; Matthew Lickiss; Alison Black; Rachel McCloy; Eugene McSorley; Joe Young Understanding representations of uncertainty, an eye-tracking study-part 2: The effect of expertise Journal Article In: Geoscience Communication, vol. 6, no. 3, pp. 111–123, 2023. @article{Williams2023, As the ability to make predictions regarding uncertainty information representing natural hazards increases, an important question for those designing and communicating hazard forecasts is how visualizations of uncertainty influence understanding amongst the intended, potentially varied, target audiences. End-users have a wide range of differing expertise and backgrounds, possibly influencing the decision-making process they undertake for a given forecast presentation. Our previous, Part 1 study (Mulder et al., 2023) examined how the presentation of uncertainty information influenced end-user decision making. Here, we shift the focus to examine the decisions and reactions of participants with differing areas of expertise (meteorology, psychology, and graphic-communication students) when presented with varied hypothetical forecast representations (boxplot, fan plot, or spaghetti plot with and without median lines) using the same eye-tracking methods and experiments. Participants made decisions about a fictional scenario involving the choices between ships of different sizes in the face of varying ice thickness forecasts. Eye movements to the graph area and key and how they changed over time (early, intermediate, and later viewing periods) were examined. More fixations (maintained gaze on one location) and more fixation time were spent on the graph and key during early and intermediate periods of viewing, particularly for boxplots and fan plots. The inclusion of median lines led to less fixations being made on all graph types during early and intermediate viewing periods. No difference in eye movement behaviour was found due to expertise; however, those with greater expertise were more accurate in their decisions, particularly during more difficult scenarios. Where scientific producers seek to draw users to the central estimate, an anchoring line can significantly reduce cognitive load, leading both experts and non-experts to make more rational decisions. When asking users to consider extreme scenarios or uncertainty, different prior expertise can lead to significantly different cognitive loads for processing information, with an impact on one's ability to make appropriate decisions. |
Sobanawartiny Wijeakumar; Samuel H. Forbes; Vincent A. Magnotta; Sean Deoni; Kiara Jackson; Vinay P. Singh; Madhuri Tiwari; Aarti Kumar; John P. Spencer Stunting in infancy is associated with atypical activation of working memory and attention networks Journal Article In: Nature Human Behaviour, vol. 7, no. 12, pp. 2199–2211, 2023. @article{Wijeakumar2023, Stunting is associated with poor long-term cognitive, academic and economic outcomes, yet the mechanisms through which stunting impacts cognition in early development remain unknown. In a first-ever neuroimaging study conducted on infants from rural India, we demonstrate that stunting impacts a critical, early-developing cognitive system—visual working memory. Stunted infants showed poor visual working memory performance and were easily distractible. Poor performance was associated with reduced engagement of the left anterior intraparietal sulcus, a region involved in visual working memory maintenance and greater suppression in the right temporoparietal junction, a region involved in attentional shifting. When assessed one year later, stunted infants had lower problem-solving scores, while infants of normal height with greater left anterior intraparietal sulcus activation showed higher problem-solving scores. Finally, short-for-age infants with poor physical growth indices but good visual working memory performance showed more positive outcomes suggesting that intervention efforts should focus on improving working memory and reducing distractibility in infancy. |
Christian Wienke; Marcus Grueschow; Aiden Haghikia; Tino Zaehle In: Journal of Neuroscience, vol. 43, no. 36, pp. 6306–6319, 2023. @article{Wienke2023, Transcutaneous auricular vagus nerve stimulation (taVNS) has been proposed to activate the locus ceruleus-noradrenaline (LC-NA) system. However, previous studies failed to find consistent modulatory effects of taVNS on LC-NA biomarkers. Previous studies suggest that phasic taVNS may be capable of modulating LC-NA biomarkers such as pupil dilation and alpha oscillations. However, it is unclear whether these effects extend beyond pure sensory vagal nerve responses. Critically, the potential of the pupillary light reflex as an additional taVNS biomarker has not been explored so far. Here, we applied phasic active and sham taVNS in 29 subjects (16 female, 13 male) while they performed an emotional Stroop task (EST) and a passive pupil light reflex task (PLRT). We recorded pupil size and brain activity dynamics using a combined Magnetoencephalography (MEG) and pupillometry design. Our results show that phasic taVNS significantly increased pupil dilation and performance during the EST. During the PLRT, active taVNS reduced and delayed pupil constriction. In the MEG, taVNS increased frontal-midline theta and alpha power during the EST, whereas occipital alpha power was reduced during both the EST and PLRT. Our findings provide evidence that phasic taVNS systematically modulates behavioral, pupillary, and electrophysiological parameters of LC-NA activity during cognitive processing. Moreover, we demonstrate for the first time that the pupillary light reflex can be used as a simple and effective proxy of taVNS efficacy. These findings have important implications for the development of noninvasive neuromodulation interventions for various cognitive and clinical applications. |
Bogusława Whyatt; Olga Witczak; Ewa Tomczak-Łukaszewska; Olha Lehka-Paul The proof of the translation process is in the reading of the target text: An eyetracking reception study Journal Article In: Ampersand, vol. 11, pp. 1–10, 2023. @article{Whyatt2023, This article is an attempt to bridge the divide between translation process research (TPR) which has investigated how translators as specialised bilingual professionals use their expertise to translate texts and translation reception which explores how the texts are read and received by the target language readers. Over the last thirty years, TPR has provided empirically grounded findings to demonstrate the complexity of the cognitive processes in the translator's mind but much less empirical interest has been paid to how translated texts are read and processed by the readers. To redress this imbalance, we hypothesise that the cognitive effort invested in reading a translated text can be taken as proof of how successful the translation process has been. We report on an exploratory study in which two groups of participants read a high-quality and a low-quality translation of the same text while their eye movements were recorded by an eyetracker. We compare the readers' cognitive effort indexed by character-adjusted dwell time, number of runs and re-reading in the second and third run with the translators' character-adjusted cognitive effort invested in producing the target texts. The results show that the relationship between the translation process and the reading experience is not straightforward and depends on the quality of the target text. |
Robert L. Whitwell; Mehul A. Garach; Melvyn A. Goodale; Irene Sperandio In: Philosophical Transactions of the Royal Society B: Biological Sciences, vol. 378, no. 1869, pp. 1–11, 2023. @article{Whitwell2023, Perceiving and grasping an object present an animal with different sets of computational problems. The solution in primates entails the specialization of separate neural networks for visual processing with different object representations. This explains why the Ebbinghaus illusion minimally affects the grasping hand's in-flight aperture, which normally scales with target size, even though the size of the target disc remains misperceived. An attractive alternative account, however, posits that grasps are refractory to the illusion because participants fixate on the target and fail to attend to the surrounding context. To test this account, we tracked both limb and gaze while participants made forced-choice judgments of relative disc size in the Ebbinghaus illusion or did so in combination with grasping or manually estimating the size of one of the discs. We replicated the classic dissociation: grasp aperture was refractory to the measured illusory effect on perceived size, while judgments and manual estimates of disc size were not. Importantly, the number of display-wide saccades per second and the percentage of total fixation time or fixations directed at the selected disc failed to explain the dissociation. Our findings support the contention that object perception and goal-directed action rely on distinct visual representations. This article is part of a discussion meeting issue 'New approaches to 3D vision'. |
Jonathon Whitlock; Ryan Hubbard; Huiyu Ding; Lili Sahakyan Trial-level fluctuations in pupil dilation at encoding reflect strength of relational binding. Journal Article In: Journal of Experimental Psychology: Learning, Memory, and Cognition, pp. 1–18, 2023. @article{Whitlock2023, Eye-tracking methodologies have revealed that eye movements and pupil dilations are influenced by our previous experiences. Dynamic fluctuations in pupil size during learning reflect in part the formation of memories for learned information, while viewing behavior during memory testing is influenced by memory retrieval and drawn to previously learned associations. However, no study to date has linked fluctuations in pupil dilation at encoding to the magnitude of viewing behavior at test. The current investigation involved monitoring eye movements both in single item recognition and relational recognition tasks. In the item task, all faces were presented with the same background scene and memory for faces was subsequently tested, whereas in the relational task each face was presented with its own unique background scene and memory for the face-scene association was subsequently tested. Pupil size changes during encoding predicted the magnitude of preferential viewing during test, as well as future recognition accuracy. These effects emerged only in the relational task, but not in the item task, and were replicated in an additional experiment in which stimulus luminance was more tightly controlled. A follow-up experiment and additional analyses ruled out differences in orienting instructions or number of fixations to the encoding display as explanations of the observed effects. The results shed light on the links between pupil dilation, memory encoding, and eye movement patterns during recognition and suggest that trial-level fluctuations in pupil dilation during encoding reflect relational binding of items to their context rather than general memory formation or strength. |
Mirjam C. M. Wever; Lisanne A. E. M. Houtum; Loes H. C. Janssen; Wilma G. M. Wentholt; Iris M. Spruit; Marieke S. Tollenaar; Geert Jan Will; Bernet M. Elzinga In: Cognitive, Affective, & Behavioral Neuroscience, vol. 23, no. 6, pp. 1598–1609, 2023. @article{Wever2023, One of the most prevalent nonverbal, social phenomena known to automatically elicit self- and other-referential processes is eye contact. By its negative effects on the perception of social safety and views about the self and others, childhood emotional maltreatment (CEM) may fundamentally affect these processes. To investigate whether the socioaffective consequences of CEM may become visible in response to (prolonged) eye gaze, 79 adult participants (mean [M]age = 49.87, standard deviation [SD]age = 4.62) viewed videos with direct and averted gaze of an unfamiliar other and themselves while we recorded self-reported mood, eye movements using eye-tracking, and markers of neural activity using fMRI. Participants who reported higher levels of CEM exhibited increased activity in ventromedial prefrontal cortex to one's own, but not to others', direct gaze. Furthermore, in contrast to those who reported fewer of such experiences, they did not report a better mood in response to a direct gaze of self and others, despite equivalent amounts of time spent looking into their own and other peoples' eyes. The fact that CEM is associated with enhanced neural activation in a brain area that is crucially involved in self-referential processing (i.e., vmPFC) in response to one's own direct gaze is in line with the chronic negative impact of CEM on a person's self-views. Interventions that directly focus on targeting maladaptive self-views elicited during eye gaze to self may be clinically useful. |
Jacob A. Westerberg; Jeffrey D. Schall; Geoffrey F. Woodman; Alexander Maier Feedforward attentional selection in sensory cortex Journal Article In: Nature Communications, vol. 14, no. 1, pp. 1–17, 2023. @article{Westerberg2023, Salient objects grab attention because they stand out from their surroundings. Whether this phenomenon is accomplished by bottom-up sensory processing or requires top-down guidance is debated. We tested these alternative hypotheses by measuring how early and in which cortical layer(s) neural spiking distinguished a target from a distractor. We measured synaptic and spiking activity across cortical columns in mid-level area V4 of male macaque monkeys performing visual search for a color singleton. A neural signature of attentional capture was observed in the earliest response in the input layer 4. The magnitude of this response predicted response time and accuracy. Errant behavior followed errant selection. Because this response preceded top-down influences and arose in the cortical layer not targeted by top-down connections, these findings demonstrate that feedforward activation of sensory cortex can underlie attentional priority. |
Shirui Wen; Huangyemin Zhang; Kailing Huang; Xiaojie Wei; Ke Yang; Quan Wang; Li Feng Impaired orienting function detected through eye movements in patients with temporal lobe epilepsy Journal Article In: Frontiers in Neuroscience, vol. 17, pp. 1–10, 2023. @article{Wen2023, Objective: Patients with temporal lobe epilepsy (TLE) often exhibit attention function impairment. The orienting network is the subsystem of the attention network that has not been fully studied. In this study, we used eye-tracking technology with an attention network test (ANT)-based task to assess the orienting function of TLE patients, aiming to characterize their eye movement patterns. Methods: A total of 37 TLE patients and 29 healthy controls (HCs) completed the ANT task based on eye-tracking technology. Orienting function damage was mainly assessed by the ANT orienting effect. Eye movement metrics, such as mean first goal-directed saccade latency (MGSL), total saccades, and saccade amplitudes, were compared between groups Results: The TLE patients had a significantly lower ANT orienting effect (HC, 54.05 ± 34.05; TLE, 32.29 ± 39.54) and lower eye-tracking orienting effect (HC, 116.98 ± 56.59; TLE, 86.72 ± 59.10) than those of the HCs. The larger orienting effects indicate that orienting responses are faster when receiving a spatial cue compared with a center cue. In the spatial cue condition, compared with HCs, the TLE group showed a longer first goal-directed saccade latency (HC, 76.77 ± 58.87ms; TLE, 115.14 ± 59.15ms), more total saccades (HC, 28.46 ± 12.30; TLE, 36.69 ± 15.13), and larger saccade amplitudes (HC, 0.75◦ ± 0.60◦; TLE, 1.36◦ ± 0.89◦). Furthermore, there was a positive correlation of the orienting-effect score between the ANT task and eye-tracking metrics (r = 0.58, p < 0.05). Conclusion: We innovatively developed a new detection method using eye-tracking technology in combination with an ANT-based task to detect the orienting function in TLE patients. The current research demonstrated that TLE patients had a significant orienting dysfunction with a specific saccade pattern characterized by a longer first goal-directed saccade latency, more total saccades, and larger saccade amplitudes. These oculomotor metrics are likely to be a better indicator of orienting function and may potentially be used for behavioral-based interventions and long-term cognition monitoring in TLE patients. |
Zi-Han Wei; Yan Liang; Ci-Juan Liang; Hong-Zhi Liu Information search processing affects social decisions Journal Article In: Journal of Behavioral Decision Making, vol. 36, no. 5, pp. 1–11, 2023. @article{Wei2023a, Social decisions often require individuals to balance conflicts between their own selfish interests and the need for equality. The way information about available options is presented can have an impact on how people process information and make social decisions. In this study, we examined the effect of information presentation on social decisions in a mini-dictator game, where participants must make binary choices about how to allocate money between themselves and another participant. We conducted two tasks with different presentation styles: the attribute-based task, where attributes such as own payoffs or others' payoffs were displayed sequentially, and the alternative-based task, where alternatives were displayed sequentially. We found that participants in the attribute-based task made more selfish choices and were less sensitive to equality than those in the alternative-based task. The direction of information search and the complexity level of information processing played a mediating role in the effect of task on social decisions. Our findings highlight the relationship between information search and social decisions, shedding light on the mechanisms and processes that underlie social decision-making. |
Jelena M. Wehrli; Yanfang Xia; Benjamin Offenhammer; Birgit Kleim; Daniel Müller; Dominik R. Bach Effect of the matrix metalloproteinase inhibitor doxycycline on human trace fear memory Journal Article In: eNeuro, vol. 10, no. 2, pp. 1–13, 2023. @article{Wehrli2023, Learning to predict threat is of adaptive importance, but aversive memory can also become disadvantageous and burdensome in clinical conditions such as posttraumatic stress disorder (PTSD). Pavlovian fear conditioning is a laboratory model of aversive memory and thought to rely on structural synaptic reconfiguration involving matrix metalloproteinase (MMP)9 signaling. It has recently been suggested that the MMP9-inhibiting antibiotic doxycycline, applied before acquisition training in humans, reduces fear memory retention after one week. This previous study used cued delay fear conditioning, in which predictors and outcomes overlap in time. However, temporal separation of predictors and outcomes is common in clinical conditions. Learning the association of temporally separated events requires a partly different neural circuitry, for which the role of MMP9 signaling is not yet known. Here, we investigate the impact of doxycycline on long-interval (15 s) trace fear conditioning in a randomized controlled trial with 101 (50 females) human participants. We find no impact of the drug in our preregistered analyses. Exploratory post hoc analyses of memory retention suggested a serum level-dependent effect of doxycycline on trace fear memory retention. However, effect size to distinguish CS+/CS in the placebo group turned out to be smaller than in previously used delay fear conditioning protocols, which limits the power of statistical tests. Our results suggest that doxycycline effect on trace fear conditioning in healthy individuals is smaller and less robust than anticipated, potentially limiting its clinical application potential. |
Taylor D. Webb; Matthew G. Wilson; Henrik Odéen; Jan Kubanek Sustained modulation of primate deep brain circuits with focused ultrasonic waves Journal Article In: Brain Stimulation, vol. 16, no. 3, pp. 798–805, 2023. @article{Webb2023, Background: Transcranial focused ultrasound has the potential to noninvasively modulate deep brain circuits and impart sustained, neuroplastic effects. Objective: Bring the approach closer to translations by demonstrating sustained modulation of deep brain circuits and choice behavior in task-performing non-human primates. Methods: Low-intensity transcranial ultrasound of 30 s in duration was delivered in a controlled manner into deep brain targets (left or right lateral geniculate nucleus; LGN) of non-human primates while the subjects decided whether a left or a right visual target appeared first. While the animals performed the task, we recorded intracranial EEG from occipital screws. The ultrasound was delivered into the deep brain targets daily for a period of more than 6 months. Results: The brief stimulation induced effects on choice behavior that persisted up to 15 minutes and were specific to the sonicated target. Stimulation of the left/right LGN increased the proportion of rightward/leftward choices. These effects were accompanied by an increase in gamma activity over visual cortex. The contralateral effect on choice behavior and the increase in gamma, compared to sham stimulation, suggest that the stimulation excited the target neural circuits. There were no detrimental effects on the animals' discrimination performance over the months-long course of the stimulation. Conclusion: This study demonstrates that brief, 30-s ultrasonic stimulation induces neuroplastic effects specifically in the target deep brain circuits, and that the stimulation can be applied daily without detrimental effects. These findings encourage repeated applications of transcranial ultrasound to malfunctioning deep brain circuits in humans with the goal of providing a durable therapeutic reset. |
Noriya Watanabe; Kosuke Miyoshi; Koji Jimura; Daisuke Shimane; Ruedeerat Keerativittayayut; Kiyoshi Nakahara; Masaki Takeda Multimodal deep neural decoding reveals highly resolved spatiotemporal profile of visual object representation in humans Journal Article In: NeuroImage, vol. 275, pp. 1–19, 2023. @article{Watanabe2023, Perception and categorization of objects in a visual scene are essential to grasp the surrounding situation. Recently, neural decoding schemes, such as machine learning in functional magnetic resonance imaging (fMRI), has been employed to elucidate the underlying neural mechanisms. However, it remains unclear as to how spatially distributed brain regions temporally represent visual object categories and sub-categories. One promising strategy to address this issue is neural decoding with concurrently obtained neural response data of high spatial and temporal resolution. In this study, we explored the spatial and temporal organization of visual object representations using concurrent fMRI and electroencephalography (EEG), combined with neural decoding using deep neural networks (DNNs). We hypothesized that neural decoding by multimodal neural data with DNN would show high classification performance in visual object categorization (faces or non-face objects) and sub-categorization within faces and objects. Visualization of the fMRI DNN was more sensitive than that in the univariate approach and revealed that visual categorization occurred in brain-wide regions. Interestingly, the EEG DNN valued the earlier phase of neural responses for categorization and the later phase of neural responses for sub-categorization. Combination of the two DNNs improved the classification performance for both categorization and sub-categorization compared with fMRI DNN or EEG DNN alone. These deep learning-based results demonstrate a categorization principle in which visual objects are represented in a spatially organized and coarse-to-fine manner, and provide strong evidence of the ability of multimodal deep learning to uncover spatiotemporal neural machinery in sensory processing. |
Zi-yang Wang; Li Liu; Yu Liu A multi-source behavioral and physiological recording system for cognitive assessment Journal Article In: Scientific Reports, vol. 13, no. 1, pp. 1–12, 2023. @article{Wang2023n, Cognitive assessment has a broad application prospect, including estimate of childhood neuro development and maturation, diagnosis of neurodegenerative diseases, and selection for special profession. With the development of computer technique and behavioral recording sensors, the method of cognitive assessment has been replaced from paper scale test to human–computer interaction. We can not only obtain the results of tasks, but also make it possible to acquire multiple behavioral and physiological data during the task. However, there is still a strong challenge of recording multi-source data synchronously during multi-dimensional cognitive assessments. Therefore, we built a multi-source cognitive assessment system can record multi-pattern behavioral and physiological data and feedback at different spatiotemporal levels. Under this system, we developed a multi-source diagnostic toolset for cognitive assessment, including eye tracking, hand movement, EEG and human–computer interaction data during the cognitive task. 238 participants with different mental disorders were assessed using this system. The results showed that our diagnostic toolset can be used to study the behavioral abnormalities of patients with mental disorders through the characteristics of multi-source data. Furthermore, this system can provide some objective diagnostic criteria such as behavioral characters and EEG features for diagnosis of mental disorders. |
Xinrui Wang; Hui Jing Lu; Hanran Li; Lei Chang Childhood environmental unpredictability and experimentally primed uncertainty in relation to intuitive versus deliberate visual search Journal Article In: Current Psychology, pp. 1–14, 2023. @article{Wang2023k, Visual search is an integral part of animal life. Two search strategies, intuitive vs. deliberate search, are adopted by almost all animals including humans to adapt to different extent of environmental uncertainty. In two eye-tracking experiments involving simple visual search (Study 1) and complex information search (Study 2), we used the evolutionary life history (LH) approach to investigate the interaction between childhood environmental unpredictability and primed concurrent uncertainty in enabling these two search strategies. The results indicate that when individuals with greater childhood unpredictability were exposed to uncertainty cues, they exhibited intuitive rather than deliberate visual search (i.e., fewer fixations, reduced dwell time, a larger saccade size, and fewer repetitive inspections relative to individuals with lower childhood unpredictability). We conclude that childhood environment is crucial in calibrating LH including visual and cognitive strategies to adaptively respond to current environmental conditions. |
Kangning Wang; Shuang Qiu; Wei Wei; Yukun Zhang; Shengpei Wang; Huiguang He; Minpeng Xu; Tzyy Ping Jung; Dong Ming A multimodal approach to estimating vigilance in SSVEP-based BCI Journal Article In: Expert Systems with Applications, vol. 225, pp. 1–16, 2023. @article{Wang2023h, Brain-computer interface (BCI) is a communication system that allows a direct connection between the human brain and external devices, which is able to provide assistance and improve the quality of life for people with disabilities. Vigilance is an important cognitive state and plays an important role in human–computer interaction. In BCI tasks, the low-vigilance state of the BCI user would lead to the performance degradation. Therefore, it is desirable to develop an efficient method to estimate the vigilance state of BCI users. In this study, we built a 4-target BCI system based on steady-state visual evoked potential (SSVEP) for cursor control. Electroencephalogram (EEG) and electrooculogram (EOG) were recorded simultaneously from 18 subjects during a 90-min continuous cursor-control BCI task. We proposed a multimodal vigilance estimating network, named MVENet, to estimate the vigilance state of BCI users through the multimodal signals. In this architecture, a spatial-temporal convolution module with an attention mechanism was adopted to explore the temporal-spatial information of the EEG features, and a long short-term memory module was utilized to learn the temporal dependencies of EOG features. Moreover, a fusion mechanism was built to fuse the EEG representations and EOG representations effectively. Experimental results showed that the proposed network achieved a better performance than the compared methods. These results demonstrate the feasibility and effectiveness of our methods for estimating the vigilance state of BCI users. |
Kangning Wang; Shuang Qiu; Wei Wei; Weibo Yi; Huiguang He; Minpeng Xu; Tzyy Ping Jung; Dong Ming Investigating EEG-based cross-session and cross-task vigilance estimation in BCI systems Journal Article In: Journal of Neural Engineering, vol. 20, no. 5, pp. 1–18, 2023. @article{Wang2023g, Objective. The state of vigilance is crucial for effective performance in brain-computer interface (BCI) tasks, and therefore, it is essential to investigate vigilance levels in BCI tasks. Despite this, most studies have focused on vigilance levels in driving tasks rather than on BCI tasks, and the electroencephalogram (EEG) patterns of vigilance states in different BCI tasks remain unclear. This study aimed to identify similarities and differences in EEG patterns and performances of vigilance estimation in different BCI tasks and sessions. Approach. To achieve this, we built a steady-state visual evoked potential-based BCI system and a rapid serial visual presentation-based BCI system and recruited 18 participants to carry out four BCI experimental sessions over four days. Main results. Our findings demonstrate that specific neural patterns for high and low vigilance levels are relatively stable across sessions. Differential entropy features significantly differ between different vigilance levels in all frequency bands and between BCI tasks in the delta and theta frequency bands, with the theta frequency band features playing a critical role in vigilance estimation. Additionally, prefrontal, temporal, and occipital regions are more relevant to the vigilance state in BCI tasks. Our results suggest that cross-session vigilance estimation is more accurate than cross-task estimation. Significance. Our study clarifies the underlying mechanisms of vigilance state in two BCI tasks and provides a foundation for further research in vigilance estimation in BCI applications. |
Jiahui Wang Mind wandering in videos that integrate instructor's visuals: An eye tracking study Journal Article In: Innovations in Education and Teaching International, pp. 1–16, 2023. @article{Wang2023e, With an increasing number of videos integrating instructor's visuals on screen, we know little about the impacts of this design on mind wandering. The study aims to investigate a) how instructor visibility impacts mind wandering; b) the relationship between mind wandering and retention performance; c) how visual behaviour during video-watching influences mind wandering. Each participant watched a video with or without instructor visibility, while their visual behaviour was recorded by an eye tracker. Retention performance was measured at the completion of the video. Mind wandering was inferred via global self-report measure and objective eye tracking measure. Both measures of mind wandering indicated the instructor visible video resulted in less mind wandering. Findings suggested mind wandering impaired retention performance. Additionally, visual attention to the instructor was associated with less mind wandering. |
Haozhe Zac Wang; Yan Tat Wong A novel simulation paradigm utilising MRI-derived phosphene maps for cortical prosthetic vision Journal Article In: Journal of Neural Engineering, vol. 20, no. 4, pp. 1–18, 2023. @article{Wang2023d, Objective. We developed a realistic simulation paradigm for cortical prosthetic vision and investigated whether we can improve visual performance using a novel clustering algorithm. Approach. Cortical visual prostheses have been developed to restore sight by stimulating the visual cortex. To investigate the visual experience, previous studies have used uniform phosphene maps, which may not accurately capture generated phosphene map distributions of implant recipients. The current simulation paradigm was based on the Human Connectome Project retinotopy dataset and the placement of implants on the cortices from magnetic resonance imaging scans. Five unique retinotopic maps were derived using this method. To improve performance on these retinotopic maps, we enabled head scanning and a density-based clustering algorithm was then used to relocate centroids of visual stimuli. The impact of these improvements on visual detection performance was tested. Using spatially evenly distributed maps as a control, we recruited ten subjects and evaluated their performance across five sessions on the Berkeley Rudimentary Visual Acuity test and the object recognition task. Main results. Performance on control maps is significantly better than on retinotopic maps in both tasks. Both head scanning and the clustering algorithm showed the potential of improving visual ability across multiple sessions in the object recognition task. Significance. The current paradigm is the first that simulates the experience of cortical prosthetic vision based on brain scans and implant placement, which captures the spatial distribution of phosphenes more realistically. Utilisation of evenly distributed maps may overestimate the performance that visual prosthetics can restore. This simulation paradigm could be used in clinical practice when making plans for where best to implant cortical visual prostheses. |
Chin-An Wang; Neil G. Muggleton; Yi-Hsuan Chang; Cesar Barquero; Ying-Chun Kuo Time-on-task effects on human pupillary and saccadic metrics after theta burst transcranial magnetic stimulation over the frontal eye field Journal Article In: IBRO Neuroscience Reports, vol. 15, pp. 364–375, 2023. @article{Wang2023c, Pupil size undergoes constant changes primarily influenced by ambient luminance. These changes are referred to as the pupillary light reflex (PLR), where the pupil transiently constricts in response to light. PLR kinematics provides valuable insights into autonomic nervous system function and have significant clinical applications. Recent research indicates that attention plays a role in modulating the PLR, and the circuit involving the frontal eye field (FEF) and superior colliculus is causally involved in controlling this pupillary modulation. However, there is limited research exploring the role of the human FEF in these pupillary responses, and its impact on PLR metrics remains unexplored. Additionally, although the protocol of continuous theta-burst stimulation (cTBS) is well-established, the period of disruption after cTBS is yet to be examined in pupillary responses. Our study aimed to investigate the effects of FEF cTBS on pupillary and saccadic metrics in relation to time spent performing a task (referred to as time-on-task). We presented a bright stimulus to induce the PLR in visual- and memory-delay saccade tasks following cTBS over the right FEF or vertex. FEF cTBS, compared to vertex cTBS, resulted in decreased baseline pupil size, peak constriction velocities, and amplitude. Furthermore, the time-on-task effects on baseline pupil size, peak amplitude, and peak time differed between the two stimulation conditions. In contrast, the time-on-task effects on saccadic metrics were less pronounced between the two conditions. In summary, our study provides the first evidence that FEF cTBS affects human PLR metrics and that these effects are modulated by time-on-task. |
Chao Wang; Mitchell Reid Pond LaPointe; Shree Venkateshan; Guang Zhao; Weidong Tao; Hong-Jin Sun; Bruce Milliken Item-specific control of attention capture: An eye movement study Journal Article In: Quarterly Journal of Experimental Psychology, vol. 76, no. 1, pp. 117–132, 2023. @article{Wang2023o, Measures of attentional capture are sensitive to attentional control settings. Recent research suggests that such control settings can be linked associatively to specific items. Rapid item-specific retrieval of these control settings can then modulate measures of attentional capture. However, the processes that produce this item-specific control of attentional capture are unclear. The current study addressed this issue by examining eye-movement patterns associated with the item-specific proportion congruency effect (ISPC). Participants searched for a shape singleton target in search displays that also contained a colour singleton—the colour singleton was either the same item as the shape singleton (congruent trials) or a different item (incongruent trials). The relative proportions of congruent and incongruent trials were manipulated separately for two distinct item types that were randomly intermixed. Response times (RTs) were faster on congruent than incongruent trials, and this congruency effect was larger for high-proportion congruent (HPC) than low-proportion congruent (LPC) items. Eye movement data revealed a higher proportion of saccades towards the distractor and longer dwell times on the distractor in the HPC condition. These results suggest that item-specific associative learning can influence the strength of representation of the task goal (e.g., find the odd shape), a form of selection history effect in visual search. |
Ailian Wang; Jing Pan; Caihong Jiang; Jia Jin Create the best first glance: The cross-cultural effect of image background on purchase intention Journal Article In: Decision Support Systems, vol. 170, pp. 1–12, 2023. @article{Wang2023a, As globalization drives more firms toward cross-border e-commerce (CBEC), a well-designed decision support system becomes crucial to gain a competitive edge in the international market. Product images, a vital aspect of the system interface, play a significant role in shaping users' first impressions, facilitating seller-buyer information interaction, and ultimately enhancing users' decisions making in the system. Across a series of studies, this research investigates the effect of cultural differences (thinking style: holistic vs. analytic) on image background and reveals the underlying mechanism. Results show that online consumers from cultures characterized by holistic thinking style (Chinese sample) are more prone to purchase products presented with contextual backgrounds than those with white backgrounds, while this effect is absent for online consumers from cultures that tend to think in an analytic way (American sample). This effect is also observed when the thinking style is primed within the culture in separate samples from the United States and China. Study 3 employs eye-tracking technology and shows that holistic thinking, compared to analytic thinking, results in an asymmetry in cognitive effort to purchase the same products framed with contextual and white background images. Specifically, contextual (vs. white) background information greatly assists holistic thinking consumers in understanding the product, enabling them to spend less cognitive effort on product information processing. Instead, the cognitive effort that analytic thinking consumers spare in the product information is not affected by the background. Finally, we discuss theoretical contributions and practical insights for CBEC retailers and system designers that the findings indicate. |
Yingjia Wan; Yipu Wei; Baorui Xu; Liqi Zhu; Michael K. Tanenhaus Musical coordination affects children's perspective-taking, but musical synchrony does not Journal Article In: Developmental Science, pp. 1–13, 2023. @article{Wan2023, Perspective-taking, which is important for communication and social activities, can be cultivated through joint actions, including musical activities in children. We examined how rhythmic activities requiring coordination affect perspective-taking in a referential communication task with 100 Chinese 4- to 6-year-old children. In Study 1, 5- to 6-year-old children played an instrument with a virtual partner in one of three coordination conditions: synchrony, asynchrony, and antiphase synchrony. Eye movements were then monitored with the partner giving instructions to identify a shape referent which included a pre-nominal scalar adjective (e.g., big cubic block). When the target contrast (a small cubic block) was in the shared ground and a competitor contrast was occluded for the partner, participants who used perspective differences could, in principle, identify the intended referent before the shape was named. We hypothesized that asynchronous and antiphase synchronous musical activities, which require self- other distinction, might have stronger effects on perspective-taking than synchronous activity. Children in the asynchrony and antiphase synchrony conditions, but not the synchrony condition, showed anticipatory looks at the target, demonstrating real-time use of the partner's perspective. Study 2 was conducted to determine if asynchrony and antiphase asynchrony resulted in perspective-taking that otherwise would not have been observed, or if synchronous coordination inhibited perspective-taking that wouldotherwise have occurred. We found no evidence for online perspective-taking in 4-to 6-year-old children without music manipulation. Therefore, playing instruments asynchronously or in alternation, but not synchronously, increases perspective-taking in children of this age, likely by training self-other distinction and control. |
Yingjia Wan; Yipu Wei; Baorui Xu; Liqi Zhu; Michael K. Tanenhaus Musical coordination affects children's perspective-taking, but musical synchrony does not Journal Article In: Developmental Science, vol. 26, no. 5, pp. 1–13, 2023. @article{Wan2023a, Perspective-taking, which is important for communication and social activities, can be cultivated through joint actions, including musical activities in children. We examined how rhythmic activities requiring coordination affect perspective-taking in a referential communication task with 100 Chinese 4- to 6-year-old children. In Study 1, 5- to 6-year-old children played an instrument with a virtual partner in one of three coordination conditions: synchrony, asynchrony, and antiphase synchrony. Eye movements were then monitored with the partner giving instructions to identify a shape referent which included a pre-nominal scalar adjective (e.g., big cubic block). When the target contrast (a small cubic block) was in the shared ground and a competitor contrast was occluded for the partner, participants who used perspective differences could, in principle, identify the intended referent before the shape was named. We hypothesized that asynchronous and antiphase synchronous musical activities, which require self-other distinction, might have stronger effects on perspective-taking than synchronous activity. Children in the asynchrony and antiphase synchrony conditions, but not the synchrony condition, showed anticipatory looks at the target, demonstrating real-time use of the partner's perspective. Study 2 was conducted to determine if asynchrony and antiphase asynchrony resulted in perspective-taking that otherwise would not have been observed, or if synchronous coordination inhibited perspective-taking that would otherwise have occurred. We found no evidence for online perspective-taking in 4- to 6-year-old children without music manipulation. Therefore, playing instruments asynchronously or in alternation, but not synchronously, increases perspective-taking in children of this age, likely by training self-other distinction and control. A video abstract of this article can be viewed at https://youtu.be/TM9h_GpFlsA. Research Highlights: This study is the first to show that rhythmic coordination, a form of non-linguistic interaction, can affect children's performance in a subsequent linguistic task. Eye-movement data revealed that children's perspective-taking in language processing was facilitated by prior asynchronous and antiphase synchronous musical interactions, but not by synchronous coordination. The results challenge the common “similar is better” view, suggesting that maintaining self-other distinction may benefit social interactions that involve representing individual differences. |
Carla A. Wall; Frederick Shic; Sreeja Varanasi; Jane E. Roberts Distinct social attention profiles in preschoolers with autism contrasted to fragile X syndrome Journal Article In: Autism Research, vol. 16, no. 2, pp. 340–354, 2023. @article{Wall2023, Social attention is a critical skill for learning and development. Social attention difficulties are present in both non-syndromic autism spectrum disorder (nsASD) and fragile X syndrome (FXS), and our understanding of these difficulties is complicated by heterogeneity in both disorders, including co-occurring diagnoses like intellectual disability and social anxiety. Existing research largely utilizes a single index of social attention and rarely includes children with intellectual impairment or uses a cross-syndrome approach. This study investigated whether multi-trait social attention profiles including naturalistic initial eye contact, facial attention, and social scene attention differ in preschool children with nsASD and FXS matched on developmental ability (DQ) and contrasted to neurotypical (NT) controls. The relationship between DQ, ASD severity, and social anxiety and social attention profiles was also examined. Initial eye contact related to social scene attention, implicating that naturalistic social attention is consistent with responses during experimental conditions. Reduced eye contact and lower social scene attention characterized nsASD and FXS. Children with nsASD displayed less facial attention than FXS and NT children, who did not differ. Lower DQ and elevated ASD severity associated with decreased eye contact in nsASD and FXS, and lower DQ was associated with lower social scene attention in FXS. Sex, social anxiety, and age were not associated with social attention. These findings suggest social attention profiles of children with nsASD are highly similar to, yet distinct from, children with FXS. Children with nsASD may present with a global social attention deficit whereas FXS profiles may reflect context-dependent social avoidance. |
Josefine Waldthaler; Lena Stock; Charlotte Krüger-Zechlin; Zain Deeb; Lars Timmermann Cluster analysis reveals distinct patterns of saccade impairment and their relation to cognitive profiles in Parkinson's disease Journal Article In: Journal of Neuropsychology, vol. 17, no. 2, pp. 251–263, 2023. @article{Waldthaler2023b, Saccade performance has been reported to be altered in Parkinson's disease (PD), however, with a large variability between studies as both motor and cognitive impairment interfere with oculomotor control. The aim of this study was to identify different patterns in saccade alterations in PD using a data-driven approach and to explore their relationship with cognitive phenotypes. Sixty-one participants with PD and 25 controls performed eye-tracking (horizontal and vertical prosaccades, antisaccades) and neuropsychological testing. Hierarchical cluster analysis was applied to the eye-tracking data to subsequently compare the clusters based on demographical, clinical and cognitive characteristics. The three identified clusters of saccade alterations differed in cognitive profiles from healthy controls, but not in PD-related motor symptoms or demographics. The rate of directive errors in the antisaccade task was increased in clusters 1 and 2. Further, cluster 1 was defined by a general disinhibition of reflexive saccades and executive dysfunction in the neuropsychological evaluation. In cluster 2, prolonged saccade latencies and hypometria were accompanied by multidomain cognitive impairment. The cluster 3 showed increased antisaccade latency and vertical hypometria despite lack of evidence for cognitive impairment. Our results suggest that there may be at least two opposing patterns of saccade alterations associated with cognitive impairment in PD, which may explain some of the contradictory results of previous studies. |
Josefine Waldthaler; Alexander Sperlich; Charlotte Stüssel; Kenan Steidel; Lars Timmermann; David J. Pedrosa Stimulation of non-motor subthalamic nucleus impairs selective response inhibition via prefrontal connectivity Journal Article In: Brain Communications, vol. 5, no. 2, pp. 1–13, 2023. @article{Waldthaler2023a, Given the inconsistent results in the past, there is an ongoing debate whether and how deep brain stimulation in the subthalamic nucleus modifies cognitive control processes like response inhibition in persons with Parkinson's disease. In this study, we examined how the location of the stimulation volume within the subthalamic nucleus affects the performance in an antisaccade task but also how its structural connectivity is related to response inhibition. Antisaccade error rates and latencies were collected in 14 participants on and off deep brain stimulation in a randomized order. Stimulation volumes were computed based on patient-specific lead localizations using preoperative MRI and postoperative CT scans. Structural connectivity of the stimulation volumes with pre-defined cortical oculomotor control regions as well as whole-brain connectivity was estimated using a normative connectome. We showed that the detrimental effect of deep brain stimulation on response inhibition, measured as antisaccade error rate, depended upon the magnitude of the intersection of volumes of activated tissue with the non-motor subregion of the subthalamic nucleus and on its structural connectivity with regions of the prefrontal oculomotor network including bilateral frontal eye fields and right anterior cingulate cortex. Our results corroborate previous recommendations for avoidance of stimulation in the ventromedial non-motor subregion of the subthalamic nucleus which connects to the prefrontal cortex to prevent stimulation-induced impulsivity. Furthermore, antisaccades were initiated faster with deep brain stimulation when the stimulation volume was connected to fibres passing the subthalamic nucleus laterally and projecting onto the prefrontal cortex, indicating that improvement of voluntary saccade generation with deep brain stimulation may be an off-target effect driven by stimulation of corticotectal fibres directly projecting from the frontal and supplementary eye fields onto brainstem gaze control areas. Taken together, these findings could help implement individualized circuit-based deep brain stimulation strategies that avoid impulsive side effects while improving voluntary oculomotor control. |
Josefine Waldthaler; Alexander Sperlich; Aylin König; Charlotte Stüssel; Frank Bremmer; Lars Timmermann; David Pedrosa In: NeuroImage: Clinical, vol. 37, pp. 1–11, 2023. @article{Waldthaler2023, While deep brain stimulation (DBS) in the subthalamic nucleus (STN) improves motor functions in Parkinson's disease (PD), it may also increase impulsivity by interfering with the inhibition of reflexive responses. The aim of this study was to investigate if varying the pulse frequency of STN-DBS has a modulating effect on response inhibition and its neural correlates. For this purpose, 14 persons with PD repeated an antisaccade task in three stimulation settings (DBS off, high-frequency DBS (130 Hz), mid-frequency DBS (60 Hz)) in a randomized order, while eye movements and brain activity via high-density EEG were recorded. On a behavioral level, 130 Hz DBS stimulation had no effect on response inhibition measured as antisaccade error rate, while 60 Hz DBS induced a slight but significant reduction of directional errors compared with the DBS-off state and 130 Hz DBS. Further, stimulation with both frequencies decreased the onset latency of correct antisaccades, while increasing the latency of directional errors. Time-frequency domain analysis of the EEG data revealed that 60 Hz DBS was associated with an increase in preparatory theta power over a midfrontal region of interest compared with the off-DBS state which is generally regarded as a marker of increased cognitive control. While no significant differences in brain activity over mid- and lateral prefrontal regions of interest emerged between the 60 Hz and 130 Hz conditions, both stimulation frequencies were associated with a stronger midfrontal beta desynchronization during the mental preparation for correct antisaccades compared with DBS off-state which is discussed in the context of potentially enhanced proactive recruitment of the oculomotor network. Our preliminary findings suggest that mid-frequency STN-DBS may provide beneficial effects on response inhibition, while both 130 Hz- and 60 Hz STN-DBS may promote voluntary actions at the expense of slower reflexive responses. |
Nicholas Wagner; Emily Perkins; Yuheiry Rodriguez; Cora Ordway; Michaela Flum; Lucia Hernandez-Pena; Polina Perelstein; Kathy Sem; Yael Paz; Rista Plate; Ayomide Popoola; Sarah Lynch; Kristina Astone; Ethan Goldstein; Wanjikũ F. M. Njoroge; Adriane Raine; Donna Pincus; Koraly Pérez-Edgar; Rebecca Waller In: BMJ Open, vol. 13, no. 10, pp. 1–13, 2023. @article{Wagner2023b, Introduction: Children with callous-unemotional (CU) traits are at high lifetime risk of antisocial behaviour. Low affiliation (ie, social bonding difficulties) and fearlessness (ie, low threat sensitivity) are proposed risk factors for CU traits. Parenting practices (eg, harshness and low warmth) also predict risk for CU traits. However, few studies in early childhood have identified attentional or physiological markers of low affiliation and fearlessness. Moreover, no studies have tested whether parenting practices are underpinned by low affiliation or fearlessness shared by parents, which could further shape parent-child interactions and exacerbate risk for CU traits. Addressing these questions will inform knowledge of how CU traits develop and isolate novel parent and child targets for future specialised treatments for CU traits. Methods and analysis: The Promoting Empathy and Affiliation in Relationships (PEAR) study aims to establish risk factors for CU traits in children aged 3-6 years. The PEAR study will recruit 500 parent-child dyads from two metropolitan areas of the USA. Parents and children will complete questionnaires, computer tasks and observational assessments, alongside collection of eye-tracking and physiological data, when children are aged 3-4 (time 1) and 5-6 (time 2) years. The moderating roles of child sex, race and ethnicity, family and neighbourhood disadvantage, and parental psychopathology will also be assessed. Study aims will be addressed using structural equation modelling, which will allow for flexible characterisation of low affiliation, fearlessness and parenting practices as risk factors for CU traits across multiple domains. Ethics and dissemination: Ethical approval was granted by Boston University (#6158E) and the University of Pennsylvania (#850638). Results will be disseminated through conferences and open-access publications. All study and task materials will be made freely available on lab websites and through the Open Science Framework (OSF). |
Isabella C. Wagner; Luise P. Graichen; Boryana Todorova; Andre Lüttig; David B. Omer; Matthias Stangl; Claus Lamm Entorhinal grid-like codes and time-locked network dynamics track others navigating through space Journal Article In: Nature Communications, vol. 14, no. 1, pp. 1–18, 2023. @article{Wagner2023a, Navigating through crowded, dynamically changing environments requires the ability to keep track of other individuals. Grid cells in the entorhinal cortex are a central component of self-related navigation but whether they also track others' movement is unclear. Here, we propose that entorhinal grid-like codes make an essential contribution to socio-spatial navigation. Sixty human participants underwent functional magnetic resonance imaging (fMRI) while observing and re-tracing different paths of a demonstrator that navigated a virtual reality environment. Results revealed that grid-like codes in the entorhinal cortex tracked the other individual navigating through space. The activity of grid-like codes was time-locked to increases in co-activation and entorhinal-cortical connectivity that included the striatum, the hippocampus, parahippocampal and right posterior parietal cortices. Surprisingly, the grid-related effects during observation were stronger the worse participants performed when subsequently re-tracing the demonstrator's paths. Our findings suggests that network dynamics time-locked to entorhinal grid-cell-related activity might serve to distribute information about the location of others throughout the brain. |
A. C. L. Vrijling; M. J. Boer; R. J. Renken; J. B. C. Marsman; A. Grillini; C. E. Petrillo; J. Heutink; N. M. Jansonius; F. W. Cornelissen Stimulus contrast, pursuit mode, and age strongly influence tracking performance on a continuous visual tracking task Journal Article In: Vision Research, vol. 205, pp. 1–11, 2023. @article{Vrijling2023, Human observers tend to naturally track moving stimuli. This tendency may be exploited towards an intuitive means of screening visual function as an impairment induced reduction in stimulus visibility will decrease tracking performance. Yet, to be able to detect subtle impairments, stimulus contrast is critical. If too high, the decrease in performance may remain undetected. Therefore, for this approach to become reliable and sensitive, we need a detailed understanding of how age, stimulus contrast, and the type of stimulus movement affect continuous tracking performance. To do so, we evaluated how well twenty younger and twenty older participants tracked a semi-randomly moving stimulus (Goldmann size III, 0.43 degrees of visual angle), presented at five contrast levels (5%-10%-20%-40%-80%). The stimulus could move smoothly only (smooth pursuit mode) or in alternation with displacements (saccadic pursuit mode). Additionally, we assessed static foveal and peripheral contrast thresholds. For all participants, tracking performance improved with increasing contrast in both pursuit modes. To reach threshold performance levels, older participants required about twice as much contrast (20% vs. 10% and 40% vs. 20% in smooth and saccadic modes respectively). Saccadic pursuit detection thresholds correlated significantly with static peripheral contrast thresholds (rho = 0.64). Smooth pursuit detection thresholds were uncorrelated with static foveal contrast thresholds (rho = 0.29). We conclude that continuous visual stimulus tracking is strongly affected by stimulus contrast, pursuit mode, and age. This provides essential insights that can be applied towards new and intuitive approaches of screening visual function. |
Jelena Vranjes; Bart Defrancq To repair or not to repair? Repairs and risk taking in video remote interpreting Journal Article In: Perspectives: Studies in Translation Theory and Practice, pp. 1–22, 2023. @article{Vranjes2023, The importance of video remote interpreting (VRI) for providing interpreting services has drastically increased over the last decade. Empirical research has shown, however, that interpreting through video link may have a significant impact on the interaction and the interpreting performance in dialogue interpreting contexts. The present study contributes to this growing field of research by focusing on interpreters' repair initiations in the context of VRI. Although repairs are an important mechanism for addressing problems in communication, very little research has been devoted to the study of interpreter-initiated repair in dialogue settings. Based on a corpus of video-recorded interpreted interactions (Dutch-Russian), where the interpreter is either present onsite or connected through video link, we analyse interpreters' repair initiations and related risk taking behaviour. More specifically, we examine how interpreters manage a specific type of repair initiations in video remote interpreting, namely postponed repairs. The analysis reveals differences in repair patterns between video remote and onsite interpreting and we propose that these differences result from differential risk management in the two settings. |
Dimitris Voudouris; Immo Schuetz; Tabea Schinke; Katja Fiehler Pupil dilation scales with movement distance of real but not of imagined reaching movements Journal Article In: Journal of Neurophysiology, vol. 130, no. 1, pp. 104–116, 2023. @article{Voudouris2023, Pupillary responses have been reliably identified for cognitive and motor tasks, but less is known about their relation to mentally simulated movements (known as motor imagery). Previous work found pupil dilations during the execution of simple finger movements, where peak pupillary dilation scaled with the complexity of the finger movement and force required. Recently, pupillary dilations were reported during imagery of grasping and piano playing. Here, we examined whether pupillary responses are sensitive to the dynamics of the underlying motor task for both executed and imagined reach movements. Participants reached or imagined reaching to one of three targets placed at different distances from a start position. Both executed and imagined movement times scaled with target distance, and they were highly correlated, confirming previous work and suggesting that participants did imagine the respective movement. Increased pupillary dilation was evident during motor execution compared with rest, with stronger dilations for larger movements. Pupil dilations also occurred during motor imagery, however, they were generally weaker than those during motor execution and they were not influenced by imagined movement distance. Instead, dilations during motor imagery resembled pupil responses obtained during a nonmotor imagery task (imagining a previously viewed painting). Our results demonstrate that pupillary responses can reliably capture the dynamics of an executed goal-directed reaching movement, but suggest that pupillary responses during imagined reaching movements reflect general cognitive processes, rather than motor-specific components related to the simulated dynamics of the sensorimotor system.NEW & NOTEWORTHY Pupil size is influenced by the performance of cognitive and motor tasks. Here, we demonstrate that pupil size increases not only during execution but also during mental simulation of goal-directed reaching movements. However, pupil dilations scale with movement amplitude of executed but not of imagined movement, whereas they are similar during motor imagery and a nonmotor imagery task. |
Ria Vormbrock; Maximilian Bruchmann; Lucas Menne; Thomas Straube; Sebastian Schindler Testing stimulus exposure time as the critical factor of increased EPN and LPP amplitudes for fearful faces during perceptual distraction tasks Journal Article In: Cortex, vol. 160, pp. 9–23, 2023. @article{Vormbrock2023, Fearful facial expressions are prioritized across different information processing stages, as evident in early, intermediate, and late components of event-related brain potentials (ERPs). Recent studies showed that, in contrast to early N170 modulations, mid-latency (Early Posterior Negativity, EPN) and late (Late Positive Potential, LPP) emotional modula- tions depend on the attended perceptual feature. Nevertheless, several studies reported significant differences between emotional and neutral faces for the EPN or LPP components during distraction tasks. One cause for these conflicting findings might be that when faces are presented sufficiently long, participants attend to task-irrelevant features of the faces. In this registered report, we tested whether the presentation duration of faces is the critical factor for differences between reported emotional modulations during perceptual distraction tasks. To this end, 48 participants were required to discriminate the orientation of lines overlaid onto fearful or neutral faces, while face presentation varied (100 msec, 300 msec, 1,000 msec, 2,000 msec). While participants did not need to pay attention to the faces, we observed main effects of emotion for the EPN and LPP, but no interaction between emotion and presentation duration. Of note, unregistered exploratory tests per presentation duration showed no significant EPN and LPP emotion differences during short durations (100 and 300 msec) but significant differences with longer durations. While the presentation duration seems not to be a critical factor for EPN and LPP emotion effects, future studies are needed to investigate the role of threshold effects and the applied analytic designs to explain conflicting findings in the literature. |
Lara Koch; Norbert Kathmann; Benedikt Reuter Lack of speeded disengagement from facial expressions of disgust in remitted major depressive disorder: Evidence from an eye-movement study Journal Article In: Behaviour Research and Therapy, vol. 160, pp. 1–11, 2023. @article{Koch2023a, Acute major depression is characterized by specific abnormalities in the way emotional material is attended to. In late stages of stimulus processing, clinically depressed and dysphoric individuals show difficulties to disengage attention from emotionally negative material. It is unclear, however, whether aberrant disengagement is a transitory attentional phenomenon tied to depressive symptoms, or whether it constitutes a more stable disposition that outlast the symptomatic episode. To address this issue, the current study examined 39 currently euthymic individuals previously affected by major depression (RMD) and 40 healthy control participants reporting no lifetime psychopathology (ND). We used a gaze-contingent eye tracking paradigm designed to separately assess the attentional components of engagement and disengagement when viewing facial expressions of sadness, disgust and happiness. Never-depressed healthy participants, but not remitted euthymic individuals, showed speeded disengagement from facial expressions of disgust. We propose that the lack of this distinct acceleration in previously depressed but fully remitted individuals might reflect an attentional disposition that carries over to euthymic phases of the disease. On the other hand, a tendency to disengage quickly from areas in the visual field that convey social disdain could potentially act as a protective, possibly mood-stabilizing bias in resilient individuals. |
Christoph J. Völter; Ana Tomašić; Laura Nipperdey; Ludwig Huber Dogs' expectations about occlusion events: From expectancy violation to exploration Journal Article In: Proceedings of the Royal Society B: Biological Sciences, vol. 290, no. 2003, pp. 1–12, 2023. @article{Voelter2023, Previous research on human infants has shown that violations of basic physical regularities can stimulate exploration, which may represent a type of hypothesis testing aimed at acquiring knowledge about new causal relationships. In this study, we examined whether a similar connection between expectancy violation and exploration exists in nonhuman animals. Specifically, we investigated how dogs react to expectancy violations in the context of occlusion events. Throughout three experiments, dogs exhibited longer looking times at expectancy-inconsistent events than at consistent ones. This finding was further supported by pupil size analyses in the first two eye-tracking experiments. Our results suggest that dogs expect objects to reappear when they are not obstructed by a screen and consider the size of the occluding screen in relation to the occluded object. In Experiment 3, expectancy violations increased the dogs' exploration of the target object, similar to the findings with human infants. We conclude that expectancy violations can provide learning opportunities for nonhuman animals as well. |
Vera A. Voigtlaender; Florian Sandhaeger; David J. Hawellek; Steffen R. Hage; Markus Siegel Neural representations of the content and production of human vocalization Journal Article In: Proceedings of the National Academy of Sciences, vol. 120, no. 23, pp. 1–9, 2023. @article{Voigtlaender2023, Speech, as the spoken form of language, is fundamental for human communication. The phenomenon of covert inner speech implies functional independence of speech content and motor production. However, it remains unclear how a flexible mapping between speech content and production is achieved on the neural level. To address this, we recorded magnetoencephalography in humans performing a rule-based vocalization task. On each trial, vocalization content (one of two vowels) and production form (overt or covert) were instructed independently. Using multivariate pattern analysis, we found robust neural information about vocalization content and produc- tion, mostly originating from speech areas of the left hemisphere. Production signals dynamically transformed upon presentation of the content cue, whereas content signals remained largely stable throughout the trial. In sum, our results show dissociable neural representations of vocalization content and production in the human brain and provide insights into the neural dynamics underlying human vocalization. |
Sarah Villard; Tyler K. Perrachione; Sung-Joo Lim; Ayesha Alam; Gerald Kidd In: The Journal of the Acoustical Society of America, vol. 154, no. 2, pp. 1152–1167, 2023. @article{Villard2023, The task of processing speech masked by concurrent speech/noise can pose a substantial challenge to listeners. However, performance on such tasks may not directly reflect the amount of listening effort they elicit. Changes in pupil size and neural oscillatory power in the alpha range (8–12 Hz) are prominent neurophysiological signals known to reflect listening effort; however, measurements obtained through these two approaches are rarely correlated, suggesting that they may respond differently depending on the specific cognitive demands (and, by extension, the specific type of effort) elicited by specific tasks. This study aimed to compare changes in pupil size and alpha power elicited by different types of auditory maskers (highly confusable intelligible speech maskers, speech-envelope-modulated speech-shaped noise, and unmodulated speech-shaped noise maskers) in young, normal-hearing listeners. Within each condition, the target-to-masker ratio was set at the participant's individually estimated 75% correct point on the psychometric function. The speech masking condition elicited a significantly greater increase in pupil size than either of the noise masking conditions, whereas the unmodulated noise masking condition elicited a significantly greater increase in alpha oscillatory power than the speech masking condition, suggesting that the effort needed to solve these respective tasks may have different neural origins. |
Audrey Vialatte; Eric Chabanat; Agnès Witko; Laure Pisella In: Cognitive Neuropsychology, pp. 1–28, 2023. @article{Vialatte2023, Some dyslexics cannot process multiple letters simultaneously. It has been argued that this reduced visuo-attentional (VA) letter span could result from poor reading ability and experience. Here, moving away from reading context, we showed that dyslexic group exhibited slower visual search than normal readers group for “symbols”, defined as graphic stimuli made up of separable visual features, but not for filled objects. Slowness in symbol visual search was explained by reduced VA field and atypical ocular behaviour when processing those letter-like stimuli and was associated with reduced VA letter span and impaired elementary visuo-spatial perception. Such a basic visual search deficit can hardly be attributed to poor reading ability and experience. Moreover, because it is specific to letter-like stimuli (i.e., “symbols”), it can specifically hinder reading acquisition. Symbol visual search can easily be tested in the pre-reading phase, opening up prospects for early risk detection and prevention of VA dyslexia. |
Martin R. Vasilev; Michael Lowman; Katherine Bills; Fabrice B. R. Parmentier; Julie A. Kirkby Unexpected sounds inhibit the movement of the eyes during reading and letter scanning Journal Article In: Psychophysiology, vol. 60, no. 12, pp. 1–19, 2023. @article{Vasilev2023, Novel sounds that unexpectedly deviate from a repetitive sound sequence are well known to cause distraction. Such unexpected sounds have also been shown to cause global motor inhibition, suggesting that they trigger a neurophysiological response aimed at stopping ongoing actions. Recently, evidence from eye movements has suggested that unexpected sounds also temporarily pause the movements of the eyes during reading, though it is unclear if this effect is due to inhibition of oculomotor planning or inhibition of language processes. Here, we sought to distinguish between these two possibilities by comparing a natural reading task to a letter scanning task that involves similar oculomotor demands to reading, but no higher level lexical processing. Participants either read sentences for comprehension or scanned letter strings of these sentences for the letter ‘o' in three auditory conditions: silence, standard, and novel sounds. The results showed that novel sounds were equally distracting in both tasks, suggesting that they generally inhibit ongoing oculomotor processes independent of lexical processing. These results suggest that novel sounds may have a global suppressive effect on eye-movement control. |
Nele Vanbilsen; Valentina Pergher; Marc M. Van Hulle Effects of task-specific strategy on attentional control game training: Preliminary data from healthy adults Journal Article In: Current Psychology, pp. 1–15, 2023. @article{Vanbilsen2023, Although recent studies showed the beneficial effect of video game training, it is still unclear whether the used strategy plays an important role in enhancing performance in the trained cognitive ability and in promoting transfers to other cognitive domains. We investigated behaviourally the effect of strategy on the outcomes of visual attentional control game training and both behaviourally and in terms of EEG-based event-related potentials (ERPs), the effect on other cognitive domains. We recruited 21 healthy adults, divided into three groups: a strategy-training group (STG) instructed to use a specific strategy, a non-strategy training group (NSTG) that self-developed their strategy, and a passive control group (PCG) that underwent only pre- and post-tests. Our results showed that the use of a specific strategy made the STG participants respond faster to the trained contrast level task, but not on the contour exercises task. Furthermore, both STG and NSTG showed pre- and post-transfers, however no significant differences were found when comparing the groups, for both behaviour and ERP responses. In conclusion, we believe these preliminary results provide evidence for the importance of strategy choice in cognitive training protocols. |
Bas Opheusden; Ionatan Kuperwajs; Gianni Galbiati; Zahy Bnaya; Yunqi Li; Wei Ji Ma Expertise increases planning depth in human gameplay Journal Article In: Nature, vol. 618, no. 7967, pp. 1000–1005, 2023. @article{Opheusden2023, A hallmark of human intelligence is the ability to plan multiple steps into the future1,2. Despite decades of research3–5, it is still debated whether skilled decision-makers plan more steps ahead than novices6–8. Traditionally, the study of expertise in planning has used board games such as chess, but the complexity of these games poses a barrier to quantitative estimates of planning depth. Conversely, common planning tasks in cognitive science often have a lower complexity9,10 and impose a ceiling for the depth to which any player can plan. Here we investigate expertise in a complex board game that offers ample opportunity for skilled players to plan deeply. We use model fitting methods to show that human behaviour can be captured using a computational cognitive model based on heuristic search. To validate this model, we predict human choices, response times and eye movements. We also perform a Turing test and a reconstruction experiment. Using the model, we find robust evidence for increased planning depth with expertise in both laboratory and large-scale mobile data. Experts memorize and reconstruct board features more accurately. Using complex tasks combined with precise behavioural modelling might expand our understanding of human planning and help to bridge the gap with progress in artificial intelligence. |
Dirk Moorselaar; Changrun Huang; Jan Theeuwes Electrophysiological indices of distractor processing in visual search are shaped by target expectations Journal Article In: Journal of Cognitive Neuroscience, vol. 35, no. 6, pp. 1032–1044, 2023. @article{Moorselaar2023, Although in many cases salient stimuli capture attention involuntarily, it has been proposed recently that under certain conditions, the bottom–up signal generated by such stimuli can be proactively suppressed. In support of this signal suppression hypothesis, ERP studies have demonstrated that salient stimuli that do not capture attention elicit a distractor positivity (PD), a putative neural index of suppression. At the same time, it is becoming increasingly clear that regularities across preceding search episodes have a large influence on attentional selection. Yet to date, studies in support of the signal suppression hypothesis have largely ignored the role of selection history on the processing of distractors. The current study addressed this issue by examining how electrophysiological markers of attentional selection (N2pc) and suppression (PD) elicited by targets and dis-tractors, respectively, were modulated when the search target randomly varied instead of being fixed across trials. Results showed that although target selection was unaffected by this manipulation, both in terms of manual response times, as well as in terms of the N2pc component, the PD component was reliably attenuated when the target features varied randomly across trials. This result demonstrates that the distractor PD, which is typically considered the marker of selective distractor processing, cannot unequivocally be attributed to suppression only, as it also, at least in part, reflects the upweighting of target features. |
Florence Van Meenen; Nicolas Masson; Leen Catrysse; Liesje Coertjens Taking a closer look at how higher education students process and use (discrepant) peer feedback Journal Article In: Learning and Instruction, vol. 84, pp. 1–11, 2023. @article{VanMeenen2023, Little is known on how students process peer feedback (PF) and use it to improve their work. We asked 59 participants to read the feedback of two peers on a fictional essay and to revise it, while we recorded their gaze behaviour. Regarding the PF processing subphase, discrepant PF led to more transitions, but only for participants who reported the discrepancy afterwards. Counterintuitively, participants who did not report the discrepancy, showed longer first-pass reading times. Concerning the PF use subphase, dwell time on essay correlated positively with the quality of the revised essays assessed by professors. Participants with a high-quality revision spent more time addressing higher order comments, corrected one or two lower order aspects at a time and proofread in the end, in which they went beyond the suggestions provided in the PF. These insights can be used when designing training to foster students' uptake of (discrepant) PF. |
Janneke E. P. Leeuwen; Amy McDougall; Dimitris Mylonas; Aida Suárez-González; Sebastian J. Crutch; Jason D. Warren Pupil responses to colorfulness are selectively reduced in healthy older adults Journal Article In: Scientific Reports, vol. 13, no. 1, pp. 1–16, 2023. @article{Leeuwen2023a, The alignment between visual pathway signaling and pupil dynamics offers a promising non-invasive method to further illuminate the mechanisms of human color perception. However, only limited research has been done in this area and the effects of healthy aging on pupil responses to the different color components have not been studied yet. Here we aim to address this by modelling the effects of color lightness and chroma (colorfulness) on pupil responses in young and older adults, in a closely controlled passive viewing experiment with 26 broad-spectrum digital color fields. We show that pupil responses to color lightness and chroma are independent from each other in both young and older adults. Pupil responses to color lightness levels are unaffected by healthy aging, when correcting for smaller baseline pupil sizes in older adults. Older adults exhibit weaker pupil responses to chroma increases, predominantly along the Green–Magenta axis, while relatively sparing the Blue–Yellow axis. Our findings complement behavioral studies in providing physiological evidence that colors fade with age, with implications for color-based applications and interventions both in healthy aging and later-life neurodegenerative disorders. |
Janneke E. P. Leeuwen; Sebastian J. Crutch; Jason D. Warren Thinking eyes: Visual thinking strategies and the social brain Journal Article In: Frontiers in Psychology, vol. 14, pp. 1–16, 2023. @article{Leeuwen2023, The foundation of art processes in the social brain can guide the scientific study of how human beings perceive and interact with their environment. Here, we applied the theoretical frameworks of the social and artistic brain connectomes to an eye-tracking paradigm with the aim to elucidate how different viewing conditions and social cues influence gaze patterns and personal resonance with artworks and complex imagery in healthy adults. We compared two viewing conditions that encourage personal or social perspective taking—modeled on the well-known Visual Thinking Strategies (VTS) method—to a viewing condition during which only contextual information about the image was provided. Our findings showed that the viewing conditions that used VTS techniques directed the gaze more toward highly salient social cues (Animate elements) in artworks and complex imagery, compared to when only contextual information was provided. We furthermore found that audio cues also directed visual attention, whereby listening to a personal reflection by another person (VTS) had a stronger effect than contextual information. However, we found no effect of viewing condition on the personal resonance with the artworks and complex images when taking the random effects of the image selection into account. Our study provides a neurobiological grounding of the VTS method in the social brain, revealing that this pedagogical method of engaging viewers with artworks measurably shapes people's visual exploration patterns. This is not only of relevance to (art) education but also has implications for art-based diagnostic and therapeutic applications. |
Elle Heusden; Christian N. L. Olivers; Mieke Donk The eyes prefer targets nearby fixation: Quantifying eccentricity-dependent attentional biases in oculomotor selection Journal Article In: Vision Research, vol. 205, pp. 1–11, 2023. @article{Heusden2023, An important function of peripheral vision is to provide the target of the next eye movement. Here we investigate the extent to which the eyes are biased to select a target closer to fixation over one further away. Participants were presented with displays containing two identical singleton targets and were asked to move their eyes to either one of them. The targets could be presented at three different eccentricities relative to central fixation. In one condition both singletons were presented at the same eccentricity, providing an estimate of the speed of selection at each of the eccentricities. The saccadic latency distributions from this same-eccentricity condition were then used to predict the selection bias when both targets were presented at different eccentricities. The results show that when targets are presented at different eccentricities, participants are biased to select the item closest to fixation. This eccentricity-based bias was considerably stronger than predicted on the basis of saccadic latency distributions in the same-eccentricity condition. This rules out speed of processing per se as a sole explanation for such a bias. Instead, the results are consistent with attentional competition being weighted in favour of items close to fixation. |
Elle Heusden; Christian N. L. Olivers; Mieke Donk The effects of eccentricity on attentional capture Journal Article In: Attention, Perception, & Psychophysics, pp. 1–17, 2023. @article{Heusden2023a, Visual attention may be captured by an irrelevant yet salient distractor, thereby slowing search for a relevant target. This phenomenon has been widely studied using the additional singleton paradigm in which search items are typically all presented at one and the same eccentricity. Yet, differences in eccentricity may well bias the competition between target and distractor. Here we investigate how attentional capture is affected by the relative eccentricities of a target and a distractor. Participants searched for a shape-defined target in a grid of homogeneous nontargets of the same color. On 75% of trials, one of the nontarget items was replaced by a salient color-defined distractor. Crucially, target and distractor eccentricities were independently manipulated across three levels of eccentricity (i.e., near, middle, and far). Replicating previous work, we show that the presence of a distractor slows down search. Interestingly, capture as measured by manual reaction times was not affected by target and distractor eccentricity, whereas capture as measured by the eyes was: items close to fixation were more likely to be selected than items presented further away. Furthermore, the effects of target and distractor eccentricity were largely additive, suggesting that the competition between saliency- and relevance-driven selection was modulated by an independent eccentricity-based spatial component. Implications of the dissociation between manual and oculomotor responses are also discussed. |
Joeri F. L. Helden; Marnix Naber In: Neuroscience, vol. 509, pp. 201–209, 2023. @article{Helden2023, The inversion of a picture of a face hampers the accuracy and speed at which observers can perceptually process it. Event-related potentials and pupillary responses, successfully used as biomarkers of face inversion in the past, suggest that the perception of visual features, that are organized in an unfamiliar manner, recruits demanding additional processes. However, it remains unclear whether such inversion effects generalize beyond face stimuli and whether indeed more mental effort is needed to process inverted images. Here we aimed to study the effects of natural scene inversion on visual evoked potentials and pupil dilations. We simultaneously measured responses of 47 human participants to presentations of images showing upright or inverted natural scenes. For inverted scenes, we observed relatively stronger occipito-temporo-parietal N1 peak amplitudes and larger pupil dilations (on top of an initial orienting response) than for upright scenes. This study revealed neural and physiological markers of natural scene inversion that are in line with inversion effects of other stimulus types and demonstrates the robustness and generalizability of the phenomenon that unfamiliar configurations of visual content require increased processing effort. |
Olof J. Werf; Teresa Schuhmann; Tom Graaf; Sanne Ten Oever; Alexander T. Sack Investigating the role of task relevance during rhythmic sampling of spatial locations Journal Article In: Scientific Reports, vol. 13, no. 1, pp. 1–11, 2023. @article{Werf2023, Recently it has been discovered that visuospatial attention operates rhythmically, rather than being stably employed over time. A low-frequency 7–8 Hz rhythmic mechanism coordinates periodic windows to sample relevant locations and to shift towards other, less relevant locations in a visual scene. Rhythmic sampling theories would predict that when two locations are relevant 8 Hz sampling mechanisms split into two, effectively resulting in a 4 Hz sampling frequency at each location. Therefore, it is expected that rhythmic sampling is influenced by the relative importance of locations for the task at hand. To test this, we employed an orienting task with an arrow cue, where participants were asked to respond to a target presented in one visual field. The cue-to-target interval was systematically varied, allowing us to assess whether performance follows a rhythmic pattern across cue-to-target delays. We manipulated a location's task relevance by altering the validity of the cue, thereby predicting the correct location in 60%, 80% or 100% of trials. Results revealed significant 4 Hz performance fluctuations at cued right visual field targets with low cue validity (60%), suggesting regular sampling of both locations. With high cue validity (80%), we observed a peak at 8 Hz towards non-cued targets, although not significant. These results were in line with our hypothesis suggesting a goal-directed balancing of attentional sampling (cued location) and shifting (non-cued location) depending on the relevance of locations in a visual scene. However, considering the hemifield specificity of the effect together with the absence of expected effects for cued trials in the high valid conditions we further discuss the interpretation of the data. |
Susanne M. Veen; Robert A. Perera; Laura Manning-Franke; Amma A. Agyemang; Karen Skop; Scott R. Sponheim; Elisabeth A. Wilde; Alexander Stamenkovic; James S. Thomas; William C. Walker Executive function and relation to static balance metrics in chronic mild TBI: A LIMBIC-CENC secondary analysis Journal Article In: Frontiers in Neurology, vol. 13, pp. 1–16, 2023. @article{Veen2023, Introduction: Among patients with traumatic brain injury (TBI), postural instability often persists chronically with negative consequences such as higher fall risk. One explanation may be reduced executive function (EF) required to effectively process, interpret and combine, sensory information. In other populations, a decline in higher cognitive functions are associated with a decline in walking and balance skills. Considering the link between EF decline and reduction in functional capacity, we investigated whether specific tests of executive function could predict balance function in a cohort of individuals with a history of chronic mild TBI (mTBI) and compared to individuals with a negative history of mTBI. Methods: Secondary analysis was performed on the local LIMBIC-CENC cohort (N = 338, 259 mTBI, mean 45 ± STD 10 age). Static balance was assessed with the sensory organization test (SOT). Hierarchical regression was used for each EF test outcome using the following blocks: (1) the number of TBIs sustained, age, and sex; (2) the separate Trail making test (TMT); (3) anti-saccade eye tracking items (error, latency, and accuracy); (4) Oddball distractor stimulus P300 and N200 at PZ and FZ response; and (5) Oddball target stimulus P300 and N200 at PZ and FZ response. Results: The full model with all predictors accounted for between 15.2% and 21.5% of the variability in the balance measures. The number of TBI's) showed a negative association with the SOT2 score (p = 0.002). Additionally, longer times to complete TMT part B were shown to be related to a worse SOT1 score (p = 0.038). EEG distractors had the most influence on the SOT3 score (p = 0.019). Lastly, the SOT-composite and SOT5 scores were shown to be associated with longer inhibition latencies and errors (anti-saccade latency and error |
Ine Van der Cruyssen; Gershon Ben-Shakhar; Yoni Pertzov; Bruno Verschuere Detecting concealed familiarity using eye movements: The effect of leakage of mock crime details to innocents Journal Article In: Journal of Applied Research in Memory and Cognition, pp. 1–10, 2023. @article{VanderCruyssen2023a, The present study examined the eye-tracking Concealed Information Test (CIT) in a mock crime scenario. Participants were instructed to either commit a mock crime on campus (guilty participants; n = 42), read an article about this mock crime (informed innocents; n = 45), or read an unrelated article (naïve innocent participants; n = 46). Afterward, all participants were presented with an eye-tracking CIT task. Based on preregistered analyses of participants' gaze behavior, we were able to distinguish the guilty participants from the naïve innocents (area under the curve [AUC] = .71, 95% CI [.60, .82]). Interestingly, we were also able to distinguish the guilty participants from the informed innocent ones (AUC = .65, 95% CI [.53, .77]). Although these results are promising, the observed detection efficiency was lower than both previous eye-tracking CIT studies that used highly familiar stimuli as well as mock crime CIT studies relying on physiological measures. |
Ruud L. Brink; Keno Hagena; Niklas Wilming; Peter R. Murphy; Christian Büchel; Tobias H. Donner Flexible sensory-motor mapping rules manifest in correlated variability of stimulus and action codes across the brain Journal Article In: Neuron, vol. 111, no. 4, pp. 571–584, 2023. @article{Brink2023, Humans and non-human primates can flexibly switch between different arbitrary mappings from sensation to action to solve a cognitive task. It has remained unknown how the brain implements such flexible sensory-motor mapping rules. Here, we uncovered a dynamic reconfiguration of task-specific correlated variability between sensory and motor brain regions. Human participants switched between two rules for reporting visual orientation judgments during fMRI recordings. Rule switches were either signaled explicitly or inferred by the participants from ambiguous cues. We used behavioral modeling to reconstruct the time course of their belief about the active rule. In both contexts, the patterns of correlations between ongoing fluctuations in stimulus- and action-selective activity across visual- and action-related brain regions tracked participants' belief about the active rule. The rule-specific correlation patterns broke down around the time of behavioral errors. We conclude that internal beliefs about task state are instantiated in brain-wide, selective patterns of correlated variability. |
Willem S. Boxtel; Briana N. Cox; Austin Keen; Jiyeon Lee Planning sentence production in aphasia: Evidence from structural priming and eye-tracking Journal Article In: Frontiers in Language Sciences, vol. 2, pp. 1–16, 2023. @article{Boxtel2023, Background: Grammatical encoding is impaired in many persons with aphasia (PWA), resulting in deficits in sentence production accuracies and underlying planning processes. However, relatively little is known on how these grammatical encoding deficits can be mediated in PWA. This study aimed to facilitate off-line (accuracy) and real-time (eye fixations) encoding of passive sentences through implicit structural priming, a tendency to better process a current sentence because of its grammatical similarity to a previously experienced (prime) sentence. Method: Sixteen PWA and Sixteen age-matched controls completed an eyetracking-while-speaking task, where they described a target transitive picture preceded by a comprehension prime involving either an active or passive form. We measured immediate and cumulative priming effects on proportions of passives produced for the target pictures and proportions of eye fixations made to the theme actor in the target scene before speech onset of the sentence production. Results and conclusion: Both PWA and controls produced cumulatively more passives as the experiment progressed despite an absence of immediate priming effects in PWA. Both groups also showed cumulative changes in the pre-speech eye fixations associated with passive productions, with this cumulative priming effect greater for the PWA group. These findings suggest that structural priming results in gradual adaptation of the grammatical encoding processes of PWA and that structural priming may be used as a treatment component for improving grammatical deficits in aphasia. |
Roman Vakhrushev; Felicia Pei-Hsin Cheng; Anne Schacht; Arezoo Pooresmaeili Differential effects of intra-modal and crossmodal reward value on perception: ERP evidence Journal Article In: PLoS ONE, vol. 18, pp. 1–25, 2023. @article{Vakhrushev2023, In natural environments objects comprise multiple features from the same or different sensory modalities but it is not known how perception of an object is affected by the value associations of its constituent parts. The present study compares intra- and cross-modal valuedriven effects on behavioral and electrophysiological correlates of perception. Human participants first learned the reward associations of visual and auditory cues. Subsequently, they performed a visual discrimination task in the presence of previously rewarded, task irrelevant visual or auditory cues (intra- and cross-modal cues, respectively). During the conditioning phase, when reward associations were learned and reward cues were the target of the task, high value stimuli of both modalities enhanced the electrophysiological correlates of sensory processing in posterior electrodes. During the post-conditioning phase, when reward delivery was halted and previously rewarded stimuli were task-irrelevant, cross-modal value significantly enhanced the behavioral measures of visual sensitivity, whereas intra-modal value produced only an insignificant decrement. Analysis of the simultaneously recorded event-related potentials (ERPs) of posterior electrodes revealed similar findings. We found an early (90-120 ms) suppression of ERPs evoked by high-value, intramodal stimuli. Cross-modal stimuli led to a later value-driven modulation, with an enhancement of response positivity for high- compared to low-value stimuli starting at the N1 window (180-250 ms) and extending to the P3 (300-600 ms) responses. These results indicate that sensory processing of a compound stimulus comprising a visual target and task-irrelevant visual or auditory cues is modulated by the reward value of both sensory modalities, but such modulations rely on distinct underlying mechanisms. |
Aditya Upadhyayula; John M. Henderson Spatiotemporal jump detection during continuous film viewing Journal Article In: Journal of Vision, vol. 23, no. 2, pp. 1–17, 2023. @article{Upadhyayula2023, Prior research on film viewing has demonstrated that participants frequently fail to notice spatiotemporal disruptions, such as scene edits in the movies.Whether such insensitivity to spatiotemporal disruptions extends beyond scene edits in film viewing is not well understood. Across three experiments, we created spatiotemporal disruptions by presenting participants with minute long movie clips, and occasionally jumping the movie clips ahead or backward in time. Participants were instructed to press a button when they noticed any disruptions while watching the clips. The results from experiments 1 and 2 indicate that participants failed to notice the disruptions in continuity about 10% to 30% of the time depending on the magnitude of the jump. In addition, detection rates were lower by approximately 10% when the videos jumped ahead in time compared to the backward jumps across all jump magnitudes, suggesting a role of knowledge about the future affects jump detection. An additional analysis used optic flow similarity during these disruptions. Our findings suggest that insensitivity to spatiotemporal disruptions during film viewing is influenced by knowledge about future states. |
Yoshiyuki Ueda; Tsung-Ren Huang; Zixin Shen; Chifumi Sakata; Su-Ling Yeh; Satoru Saito Sequential processing facilitates Hebb repetition learning in visuospatial domains Journal Article In: Journal of Experimental Psychology: General, vol. 152, no. 9, pp. 2559–2577, 2023. @article{Ueda2023, Exposure to the same information improves auditory/verbal short-term memory performance, but such improvement is not always observed in visual short-term memory. In this study, we demonstrate that sequential processing makes visuospatial repetition learning efficient in a paradigm that employs a similar design previously used for an auditory/verbal domain. When we presented sets of color patches simultaneously in Experiments 1–4, recall accuracy did not increase with repetition; however, once color patches were presented sequentially in Experiment 5, accuracy did increase rapidly with repetition, even when participants engaged in articulatory suppression. Moreover, these learning dynamics matched those in Experiment 6, which used verbal materials. These findings suggest that (a) sequential focus on each item facilitates a repetition learning effect, indicating a temporal bottleneck is involved early in this process and (b) repetition learning is mechanistically similar across sensory modalities even though these modalities differently specialize in processing spatial or temporal information. |
Tawny Tsang; Adam J. Naples; Erin C. Barney; Minhang Xie; Raphael Bernier; Geraldine Dawson; James Dziura; Susan Faja; Shafali Spurling Jeste; James C. McPartland; Charles A. Nelson; Michael Murias; Helen Seow; Catherine Sugar; Sara J. Webb; Frederick Shic; Scott P. Johnson Attention allocation during exploration of visual arrays in ASD: Results from the ABC-CT feasibility study Journal Article In: Journal of Autism and Developmental Disorders, vol. 53, no. 8, pp. 3220–3229, 2023. @article{Tsang2023, Visual exploration paradigms involving object arrays have been used to examine salience of social stimuli such as faces in ASD. Recent work suggests performance on these paradigms may associate with clinical features of ASD. We evaluate metrics from a visual exploration paradigm in 4-to-11-year-old children with ASD (n = 23; 18 males) and typical development (TD; n = 23; 13 males). Presented with arrays containing faces and nonsocial stimuli, children with ASD looked less at (p = 0.002) and showed fewer fixations to (p = 0.022) faces than TD children, and spent less time looking at each object on average (p = 0.004). Attention to the screen and faces correlated positively with social and cognitive skills in the ASD group (ps <.05). This work furthers our understanding of objective measures of visual exploration in ASD and its potential for quantifying features of ASD. |
Caterina Trentin; Heleen A. Slagter; Christian N. L. Olivers Visual working memory representations bias attention more when they are the target of an action plan Journal Article In: Cognition, vol. 230, pp. 1–10, 2023. @article{Trentin2023, Attention has frequently been regarded as an emergent property of linking sensory representations to action plans. It has recently been proposed that similar mechanisms may operate within visual working memory (VWM), such that linking an object in VWM to an action plan strengthens its sensory memory representation, which then expresses as an attentional bias. Here we directly tested this hypothesis by comparing attentional biases induced by VWM representations which were the target of a future action, to those induced by VWM representations that were equally task-relevant, but not the direct target of action. We predicted that the first condition would result in a more prioritized memory state and hence stronger attentional biases. Specifically, participants memorized a geometric shape for a subsequent memory test. At test, in case of a match, participants either had to perform a grip movement on the matching object (action condition), or perform the same movement, but on an unrelated object (control condition). To assess any attentional biases, during the delay period between memorandum and test, participants performed a visual selection task in which either the target was surrounded by the memorized shape (congruent trials) or a distractor (incongruent trials). Eye movements were measured as a proxy for attentional priority. We found a significant interaction for saccade latencies between action condition and shape congruency, reflecting more pronounced VWM-based attentional biases in the action condition. Our results are consistent with the idea that action plans prioritize sensory representations in VWM. |
Sébastien Tremblay; Camille Testard; Ron W. Ditullio; Jeanne Inchauspé; Michael Petrides Neural cognitive signals during spontaneous movements in the macaque Journal Article In: Nature Neuroscience, vol. 26, no. 2, pp. 295–305, 2023. @article{Tremblay2023, The single-neuron basis of cognitive processing in primates has mostly been studied in laboratory settings where movements are severely restricted. It is unclear, therefore, how natural movements might affect neural signatures of cognition in the brain. Moreover, studies in mice indicate that body movements, when measured, account for most of the neural dynamics in the cortex. To examine these issues, we recorded from single-neuron ensembles in the prefrontal cortex in moving monkeys performing a cognitive task and characterized eye, head and body movements using video tracking. Despite considerable trial-to-trial movement variability, single-neuron tuning could be precisely measured and decision signals accurately decoded on a single-trial basis. Creating or abolishing spontaneous movements through head restraint and task manipulations had no measurable impact on neural responses. However, encoding models showed that uninstructed movements explained as much neural variance as task variables, with most movements aligned to task events. These results demonstrate that cognitive signals in the cortex are robust to natural movements, but also that unmeasured movements are potential confounds in cognitive neurophysiology experiments. |
Tobiasz Trawiński; Natalie Mestry; Nick Donnelly The effect of prior viewing position and spatial scale on the viewing of paintings Journal Article In: Vision, vol. 7, no. 3, pp. 36–39, 2023. @article{Trawinski2023, The visual inspection of scenes is disrupted when participants are forced to begin inspection away from the centre of an image. The present study explored the effect of the starting point on the visual inspection of paintings. Eye movements were recorded while participants viewed paintings for later identification in a yes/no discrimination task. The viewing of each painting was preceded by the presentation of a pseudo-randomly positioned Navon figure. Participants were instructed using a cue to attend to either the local or global level of the Navon figure. Each painting was split into regions of interest (ROIs) defined by face, theme, and context to allow the analysis of eye movements. These data were directly compared with a subset of those initially reported in our previous study in which the same experiment was run but without the inclusion of the Navon figure. The inclusion of the Navon task lowered the discrimination accuracy in the yes/no discrimination task. More importantly, eye movements to the paintings were disrupted across the entire period over which they were viewed and not just in the period following the offset of the Navon figure. The results show the sensitivity of eye movements to the conditions present at the beginning of viewing. The results have implications for the viewing of paintings (and other images) in the real world, where the starting conditions for inspection cannot be controlled. |
David Torrents-Rodas; Stephan Koenig; Metin Uengoer; Harald Lachnit The effect of prediction error on overt attention and learning in humans Journal Article In: Behavioural Processes, vol. 206, pp. 1–10, 2023. @article{TorrentsRodas2023, It has been suggested that attention modulates the speed at which cues come to predict contingent outcomes, and that attention changes with the prediction errors generated by cues. Evidence for this interaction in humans is inconsistent, with divergent findings depending on whether attention was measured with eye fixations or learning speed. We included both measures in our experiment. Initially, predictive cues (A and B) were consistently followed by one outcome (o1), while nonpredictive cues (X and Y) were followed by two randomly alternating outcomes (o1 and o2). Consistent with an effect of prediction error, participants' fixated for longer on the nonpredictive cues than on the predictive ones. Then, the cues were combined in three pairs: AX, followed by o1, and AY and BX, followed by o2. Discrimination of AX and AY depended on the previously nonpredictive cues and, given that these received more attention during initial training, it should proceed faster than discrimination of AX and BX, which depended on the previously predictive cues. However, participants learned to predict the outcomes of AY and BX at a similar rate. The fixation times were similar for the previously predictive and previously nonpredictive cues. We discuss reasons that could explain these findings. |
Christof Elias Topfstedt; Luca Wollenberg; Thomas Schenk The role of habitual learning in premotor attention allocation Journal Article In: Journal of Vision, vol. 23, no. 5, pp. 1–18, 2023. @article{Topfstedt2023, Dual-task studies have demonstrated that goal-directed actions are typically preceded by a premotor shift of visual attention toward the movement goal location. This finding is often taken as evidence for an obligatory coupling between attention and motor preparation. Here, we examined whether this coupling entails a habitual component relating to an expectation of spatial congruence between visual and motor targets. In two experiments, participants had to identify a visual discrimination target (DT) while preparing variably delayed pointing movements to a motor target (MT). To induce distinct expectations regarding the DT position, different groups of participants performed a training phase in which the DT either always appeared at MT, opposite to MT, or at an unpredictable position. In a subsequent test phase, the DT position was randomized to assess the impact of learned expectancy on premotor attention allocation. Although we applied individually determined DT presentation times in the test phase of Experiment 1, a fixed DT presentation time was used in Experiment 2. Both experiments yielded evidence for attentional enhancement at the expected DT position. Although interpretability of this effect was limited in Experiment 1 because of between-group differences in DT presentation time, results of Experiment 2 were much clearer. Specifically, a marked discrimination benefit was observed at the position opposite to MT in participants anticipating the DT at this position, whereas no statistically significant benefit was found at MT. Crucially, this was observed at short movement delays, demonstrating that expectation of spatial incongruence between visual and motor targets allows for decoupling of attentional resources from ongoing motor preparation. Based on our findings, we suggest that premotor attention shifts entail a considerable habitual component rather than being the sole result of motor programming. |
Shin-ichi Tokushige; Hideyuki Matsumoto; Shun-ichi Matsuda; Satomi Inomata-Terada; Naoki Kotsuki; Masashi Hamada; Shoji Tsuji; Yoshikazu Ugawa; Yasuo Terao Early detection of cognitive decline in Alzheimer's disease using eye tracking Journal Article In: Frontiers in Aging Neuroscience, vol. 15, pp. 1–15, 2023. @article{Tokushige2023, Background: Patients with Alzheimer's disease (AD) are known to exhibit visuospatial processing impairment, as reflected in eye movements from the early stages of the disease. We investigated whether the pattern of gaze exploration during visual tasks could be useful for detecting cognitive decline at the earliest stage. Methods: Sixteen AD patients (age: 79.1 ± 7.9 years, Mini Mental State Examination [MMSE] score: 17.7 ± 5.3, mean ± standard deviation) and 16 control subjects (age: 79.4 ± 4.6, MMSE score: 26.9 ± 2.4) participated. In the visual memory task, subjects memorized presented line drawings for later recall. In the visual search tasks, they searched for a target Landolt ring of specific orientation (serial search task) or color (pop-out task) embedded among arrays of distractors. Using video-oculography, saccade parameters, patterns of gaze exploration, and pupil size change during task performance were recorded and compared between AD and control subjects. Results: In the visual memory task, the number of informative regions of interest (ROIs) fixated was significantly reduced in AD patients compared to control subjects. In the visual search task, AD patients took a significantly longer time and more saccades to detect the target in the serial but not in pop-out search. In both tasks, there was no significant difference in the saccade frequency and amplitude between groups. On-task pupil modulation during the serial search task was decreased in AD. The number of ROIs fixated in the visual memory task and search time and saccade numbers in the serial search task differentiated both grwoups of subjects with high sensitivity, whereas saccade parameters of pupil size modulation were effective in confirming normal cognition from cognitive decline with high specificity. Discussion: Reduced fixation on informative ROIs reflected impaired attentional allocation. Increased search time and saccade numbers in the visual search task indicated inefficient visual processing. Decreased on-task pupil size during visual search suggested decreased pupil modulation with cognitive load in AD patients, reflecting impaired function of the locus coeruleus. When patients perform the combination of these tasks to visualize multiple aspects of visuospatial processing, cognitive decline can be detected at an early stage with high sensitivity and specificity and its progression be evaluated. |
Yixin Tian; Jiapeng Yin; Chengyao Wang; Zhenliang He; Jingyi Xie; Xiaoshan Feng; Yang Zhou; Tianyu Ma; Yang Xie; Xue Li; Tianming Yang; Chi Ren; Chengyu Li; Zhengtuo Zhao An ultraflexible electrode array for large-scale chronic recording in the nonhuman primate brain Journal Article In: Advanced Science, vol. 10, no. 33, pp. 1–15, 2023. @article{Tian2023, Single-unit (SU) recording in nonhuman primates (NHPs) is indispensible in the quest of how the brain works, yet electrodes currently used for the NHP brain are limited in signal longevity, stability, and spatial coverage. Using new structural materials, microfabrication, and penetration techniques, we develop a mechanically robust ultraflexible, 1 µm thin electrode array (MERF) that enables pial penetration and high-density, large-scale, and chronic recording of neurons along both vertical and horizontal cortical axes in the nonhuman primate brain. Recording from three monkeys yields 2,913 SUs from 1,065 functional recording channels (up to 240 days), with some SUs tracked for up to 2 months. Recording from the primary visual cortex (V1) reveals that neurons with similar orientation preferences for visual stimuli exhibited higher spike correlation. Furthermore, simultaneously recorded neurons in different cortical layers of the primary motor cortex (M1) show preferential firing for hand movements of different directions. Finally, it is shown that a linear decoder trained with neuronal spiking activity across M1 layers during monkey's hand movements can be used to achieve on-line control of cursor movement. Thus, the MERF electrode array offers a new tool for basic neuroscience studies and brain–machine interface (BMI) applications in the primate brain. |
Malathi Thothathiri; Jeremy Kirkwood; Abhijeet Patra; Anna Krason; Erica L. Middleton Multimodal measures of sentence comprehension in agrammatism Journal Article In: Cortex, vol. 169, pp. 309–325, 2023. @article{Thothathiri2023, Agrammatic or asyntactic comprehension is a common language impairment in aphasia. We considered three possible hypotheses about the underlying cause of this deficit, namely problems in syntactic processing, over-reliance on semantics, and a deficit in cognitive control. We tested four individuals showing asyntactic comprehension on their comprehension of syntax-semantics conflict sentences (e.g., The robber handcuffed the cop), where semantic cues pushed towards a different interpretation from syntax. Two of the four participants performed above chance on such sentences indicating that not all agrammatic individuals are impaired in structure-based interpretation. We collected additional eyetracking measures from the other two participants, who performed at chance on the conflict sentences. These measures suggested distinct underlying processing profiles in the two individuals. Cognitive assessments further suggested that one participant might have performed poorly due to a linguistic cognitive control impairment while the other had difficulty due to over-reliance on semantics. Together, the results highlight the importance of multimodal measures for teasing apart aphasic individuals' underlying deficits. They corroborate findings from neurotypical adults by showing that semantics can strongly influence comprehension and that cognitive control could be relevant for choosing between competing sentence interpretations. They extend previous findings by demonstrating variability between individuals with aphasia—cognitive control might be especially relevant for patients who are not overly reliant on semantics. Clinically, the identification of distinct underlying problems in different individuals suggests that different treatment paths might be warranted for cases who might look similar on behavioral assessments. |
Lowell W. Thompson; Byounghoon Kim; Bas Rokers; Ari Rosenberg Hierarchical computation of 3D motion across macaque areas MT and FST Journal Article In: Cell Reports, vol. 42, no. 12, pp. 1–18, 2023. @article{Thompson2023, Computing behaviorally relevant representations of three-dimensional (3D) motion from two-dimensional (2D) retinal signals is critical for survival. To ascertain where and how the primate visual system performs this computation, we recorded from the macaque middle temporal (MT) area and its downstream target, the fundus of the superior temporal sulcus (area FST). Area MT is a key site of 2D motion processing, but its role in 3D motion processing is controversial. The functions of FST remain highly underexplored. To distinguish representations of 3D motion from those of 2D retinal motion, we contrast responses to multiple motion cues during a motion discrimination task. The results reveal a hierarchical transformation whereby many FST but not MT neurons are selective for 3D motion. Modeling results further show how generalized, cue-invariant representations of 3D motion in FST may be created by selectively integrating the output of 2D motion selective MT neurons. |
Nikita Thomas; Jennifer H. Acton; Jonathan T. Erichsen; Tony Redmond; Matt J. Dunn Reliability of gaze-contingent perimetry Journal Article In: Behavior Research Methods, pp. 1–10, 2023. @article{Thomas2023, Standard automated perimetry, a psychophysical task performed routinely in eyecare clinics, requires observers to maintain fixation for several minutes at a time in order to measure visual field sensitivity. Detection of visual field damage is confounded by eye movements, making the technique unreliable in poorly attentive individuals and those with pathologically unstable fixation, such as nystagmus. Microperimetry, which utilizes ‘partial gaze-contingency' (PGC), aims to counteract eye movements but only corrects for gaze position errors prior to each stimulus onset. Here, we present a novel method of visual field examination in which stimulus position is updated during presentation, which we refer to as ‘continuous gaze-contingency' (CGC). In the first part of this study, we present three case examples that demonstrate the ability of CGC to measure the edges of the physiological blind spot in infantile nystagmus with greater accuracy than PGC and standard ‘no gaze-contingency' (NoGC), as initial proof-of-concept for the utility of the paradigm in measurements of absolute scotomas in these individuals. The second part of this study focused on healthy observers, in which we demonstrate that CGC has the lowest stimulus positional error (gaze-contingent precision: CGC = ± 0.29° |
Chaitanya Thammineni; Hemanth Manjunatha; Ehsan T. Esfahani Selective eye-gaze augmentation to enhance imitation learning in Atari games Journal Article In: Neural Computing and Applications, vol. 35, no. 32, pp. 23401–23410, 2023. @article{Thammineni2023, This paper presents the selective use of eye-gaze information in learning human actions in Atari games. Extensive evidence suggests that our eye movements convey a wealth of information about the direction of our attention and mental states and encode the information necessary to complete a task. Based on this evidence, we hypothesize that selective use of eye-gaze, as a clue for attention direction, will enhance the learning from demonstration. For this purpose, we propose a selective eye-gaze augmentation (SEA) network that learns when to use the eye-gaze information. The proposed network architecture consists of three sub-networks: gaze prediction, gating, and action prediction network. Using the prior 4 game frames, a gaze map is predicted by the gaze prediction network, which is used for augmenting the input frame. The gating network will determine whether the predicted gaze map should be used in learning and is fed to the final network to predict the action at the current frame. To validate this approach, we use publicly available Atari Human Eye-Tracking And Demonstration (Atari-HEAD) dataset consists of 20 Atari games with 28 million human demonstrations and 328 million eye-gazes (over game frames) collected from four subjects. We demonstrate the efficacy of selective eye-gaze augmentation compared to the state-of-the-art Attention Guided Imitation Learning (AGIL) and Behavior Cloning (BC). The results indicate that the selective augmentation approach (the SEA network) performs significantly better than the AGIL and BC. Moreover, to demonstrate the significance of selective use of gaze through the gating network, we compare our approach with the random selection of the gaze. Even in this case, the SEA network performs significantly better, validating the advantage of selectively using the gaze in demonstration learning. |
Qawi K. Telesford; Eduardo Gonzalez-Moreira; Ting Xu; Yiwen Tian; Stanley J. Colcombe; Jessica Cloud; Brian E. Russ; Arnaud Falchier; Maximilian Nentwich; Jens Madsen; Lucas C. Parra; Charles E. Schroeder; Michael P. Milham; Alexandre R. Franco An open-access dataset of naturalistic viewing using simultaneous EEG-fMRI Journal Article In: Scientific Data, vol. 10, no. 1, pp. 1–13, 2023. @article{Telesford2023, In this work, we present a dataset that combines functional magnetic imaging (fMRI) and electroencephalography (EEG) to use as a resource for understanding human brain function in these two imaging modalities. The dataset can also be used for optimizing preprocessing methods for simultaneously collected imaging data. The dataset includes simultaneously collected recordings from 22 individuals (ages: 23–51) across various visual and naturalistic stimuli. In addition, physiological, eye tracking, electrocardiography, and cognitive and behavioral data were collected along with this neuroimaging data. Visual tasks include a flickering checkerboard collected outside and inside the MRI scanner (EEG-only) and simultaneous EEG-fMRI recordings. Simultaneous recordings include rest, the visual paradigm Inscapes, and several short video movies representing naturalistic stimuli. Raw and preprocessed data are openly available to download. We present this dataset as part of an effort to provide open-access data to increase the opportunity for discoveries and understanding of the human brain and evaluate the correlation between electrical brain activity and blood oxygen level-dependent (BOLD) signals. |
Robert Taylor; Ivan Tomić; David Aagten-Murphy; Paul M. Bays Working memory is updated by reallocation of resources from obsolete to new items Journal Article In: Attention, Perception, & Psychophysics, vol. 85, no. 5, pp. 1437–1451, 2023. @article{Taylor2023a, Visual working memory (VWM) resources are limited, placing constraints on how much visual information can be simultaneously retained. During visually guided activity, stored information can quickly become outdated, so updating mechanisms are needed to ensure the contents of memory remain relevant to current task goals. In particular, successful deallocation of resources from items that become obsolete is likely to be critical for maintaining the precision of those representations still in memory. The experiments in this study involved presenting two memory arrays of coloured disks in sequence. The appearance of the second array was a cue to replace, rehearse, or add a new colour to the colours in memory. We predicted that successful resource reallocation should result in comparable recall precision when an item was replaced or rehearsed, owing to the removal of pre-replacement features. In contrast, a failure to update WM should lead to comparable precision with a condition in which a new colour was added to memory. We identified a very small proportion (∼5%) of trials in which participants incorrectly reported a feature from the first array in place of its replacement in the second, which we interpreted as a failure to incorporate the information from the second display into memory. Once these trials were discounted, precision estimates were consistent with complete redistribution of resources in the case of updating a single item. We conclude that working memory can be efficiently updated when previous information becomes obsolete, but that this is a demanding active process that occasionally fails. |
John M. Tauber; Scott L. Brincat; Emily P. Stephen; Jacob A. Donoghue; Leo Kozachkov; Emery N. Brown; Earl K. Miller Propofol-mediated unconsciousness disrupts progression of sensory signals through the cortical hierarchy Journal Article In: Journal of Cognitive Neuroscience, vol. 36, no. 2, pp. 394–413, 2023. @article{Tauber2023, A critical component of anesthesia is the loss of sensory perception. Propofol is the most widely used drug for general anesthesia, but the neural mechanisms of how and when it disrupts sensory processing are not fully understood. We analyzed local field potential and spiking recorded from Utah arrays in auditory cortex, associative cortex, and cognitive cortex of nonhuman primates before and during propofol-mediated unconsciousness. Sensory stimuli elicited robust and decodable stimulus responses and triggered periods of stimulus-related synchronization between brain areas in the local field potential of Awake animals. By contrast, propofol-mediated unconsciousness eliminated stimulus-related synchrony and drastically weakened stimulus responses and information in all brain areas except for auditory cortex, where responses and information persisted. However, we found stimuli occurring during spiking Up states triggered weaker spiking responses than in Awake animals in auditory cortex, and little or no spiking responses in higher order areas. These results suggest that propofol's effect on sensory processing is not just because of asynchronous Down states. Rather, both Down states and Up states reflect disrupted dynamics. |
A. Caglar Tas; Jessica L. Parker The role of color in transsaccadic object correspondence Journal Article In: Journal of Vision, vol. 23, no. 8, pp. 1–21, 2023. @article{Tas2023, With each saccade, visual information is disrupted, and the visual system is tasked with establishing object correspondence between the presaccadic and postsaccadic representations of the saccade target. There is substantial evidence that the visual system consults spatiotemporal continuity when determining object correspondence across saccades. The evidence for surface feature continuity, however, is mixed. Surface features that are integral to the saccade target object's identity (e.g., shape and contrast polarity) are informative of object continuity, but features that may only imply the state of the object (e.g., orientation) are ignored. The present study tested whether color information is consulted to determine transsaccadic object continuity.We used two variations of the intrasaccadic target displacement task. In Experiments 1 and 2, participants reported the direction of the target displacement. In Experiments 3 and 4, they instead reported whether they detected any target movement. In all experiments, we manipulated the saccade target's continuity by removing it briefly (i.e., blanking) and by changing its color.We found that large color changes can disrupt stability and increase sensitivity to displacements for both direction and movement reports, although not as strongly as long blank durations (250 ms). Interestingly, even smaller color changes, but not blanking, reduced response biases. These results indicate that disrupting surface feature continuity may impact the process of transsaccadic object correspondence more strongly than spatiotemporal disruptions by both increasing the sensitivity and decreasing the response bias. |
Benjamin Tari; Joshua Ahn; Connor Dalton; Sun Young Choo; Matthew Heath Cerebral blood flow and immediate and sustained executive function benefits following single bouts of passive and active exercise Journal Article In: Brain and Cognition, vol. 166, pp. 1–9, 2023. @article{Tari2023, Passive exercise occurs when an individual's limbs are moved via an external force and is a modality that increases cerebral blood flow (CBF) and provides an immediate postexercise executive function (EF) benefit. To our knowledge, no work has examined for how long passive exercise benefits EF. Here, healthy young adults (N = 22; 7 female) used a cycle ergometer to complete three 20-min conditions: passive exercise (via mechanically driven flywheel), a traditional light intensity (37 W) “active” exercise condition (i.e., via volitional pedalling) and a non-exercise control condition. An estimate of CBF was obtained via transcranial Doppler ultrasound measurement of middle cerebral artery blood velocity (MCAv) and antisaccades (i.e., saccade mirror-symmetrical to a target) were completed prior to and immediately, 30- and 60-min following each condition to assess EF. Passive and active exercise increased MCAv; however, the increase was larger in the latter condition. In terms of antisaccades, passive and active exercise provided an immediate postexercise reaction time benefit. At the 30-min assessment, the benefit was observed for active but not passive exercise and neither produced a benefit at the 60-min assessment. Thus, passive exercise provided an evanescent EF “boost” and is a finding that may reflect a smaller cortical hemodynamic response. |
Yuma Taniyama; Yuta Suzuki; Taisei Kondo; Tetsuto Minami; Shigeki Nakauchi Pupil dilation is driven by perceptions of naturalness of color composition in paintings Journal Article In: Psychology of Aesthetics, Creativity, and the Arts, pp. 1–12, 2023. @article{Taniyama2023, Findings regarding the direction of pupil modulation (dilation/constriction) related to aesthetic preference are often contradictory, partly because preference is determined by multiple factors depending on the target. Research has demonstrated that art paintings with image features similar to those of natural scenes are preferred, suggesting that the perception of naturalness is one factor affecting preference. This study aimed to test the hypothesis that the pupil dilation in response to visual examination of a preferred painting may be caused by the perceived naturalness of the color composition of the painting. We investigated the relationship between pupil response and preference/perception of naturalness by manipulating the color composition of art paintings. First, we found that when compared to hue-rotated paintings, the paintings presented with their original color composition were preferred and perceived as more natural. Second, the extent of the pupil dilation had a significant positive correlation with the perceptions of naturalness for the painting, whereas there was no significant correlation between pupil dilation and preference. This result indicates that the pupil dilation during the viewing of the paintings is not caused by preference but by the perceived naturalness regarding the color composition of paintings. This was observed not only in representational paintings but also in abstract paintings, suggesting that the color composition of a painting itself, rather than memory colors—the standard, known hues of objects—or other influences, is an important factor of perceived naturalness that produces pupil dilation. |
Gene Tangtartharakul; Catherine A. Morgan; Simon K. Rushton; D. Samuel Schwarzkopf Retinotopic connectivity maps of human visual cortex with unconstrained eye movements Journal Article In: Human Brain Mapping, vol. 44, no. 16, pp. 5221–5237, 2023. @article{Tangtartharakul2023, Human visual cortex contains topographic visual field maps whose organization can be revealed with retinotopic mapping. Unfortunately, constraints posed by standard mapping hinder its use in patients, atypical subject groups, and individuals at either end of the lifespan. This severely limits the conclusions we can draw about visual processing in such individuals. Here, we present a novel data-driven method to estimate connective fields, resulting in fine-grained maps of the functional connectivity between brain areas. We find that inhibitory connectivity fields accompany, and often surround facilitatory fields. The visual field extent of these inhibitory subfields falls off with cortical magnification. We further show that our method is robust to large eye movements and myopic defocus. Importantly, freed from the controlled stimulus conditions in standard mapping experiments, using entertaining stimuli and unconstrained eye movements our approach can generate retinotopic maps, including the periphery visual field hitherto only possible to map with special stimulus displays. Generally, our results show that the connective field method can gain knowledge about retinotopic architecture of visual cortex in patients and participants where this is at best difficult and confounded, if not impossible, with current methods. |
Cheng-Hui Tan; Qi-Qi Xing; Yuan Zhao; Bo-Hai Song; Chuan-Lin Zhu; Jun-Jie Qiu; Mu-Ye He; Dian-Zhi Liu Goal-directed action anticipation and prediction error processing in children with autism spectrum disorders: An eye-movement study Journal Article In: Research in Autism Spectrum Disorders, vol. 106, pp. 1–13, 2023. @article{Tan2023, Background: Differences in predictive ability have been proposed as a possible explanation for the core symptoms of autism spectrum disorder (ASD). This study aimed to investigate potential differences in prior knowledge acquisition and application for goal-directed anticipation in children with ASD. Method: The study included 22 children with ASD and 19 typically developing (TD) children between the ages of 5–10 years. Two eye-tracking phases were used to examine the formation of goal-directed action anticipations and the processing of action prediction errors. In the action anticipation formation phase, participants were asked to observe goal-directed actions repeatedly to examine prior knowledge acquisition about agent-goal association. In the action anticipation violation phase, the goals of actions were changed to examine the application of previously acquired knowledge. Results: Children with ASD required more trials to form goal-directed anticipations than TD children. Furthermore, prior knowledge acquisition was characterized by variability and instability in children with ASD. During the action anticipation violation phase, children with ASD exhibited lower preference for the action goal determined by prior knowledge in uncertain situations. This atypical processing of prior knowledge was significantly correlated with the severity of ASD symptoms. Conclusions: Our findings support the Bayesian perception theory and predictive coding theory, suggesting that children with ASD may experience difficulties in both the acquisition and application of prior knowledge in anticipation. These findings have implications for developing interventions to improve goal-directed anticipation and reduce social and communication difficulties in individuals with ASD. |
Noam Tal-Perry; Shlomit Yuval-Greenberg Sequential effect and temporal orienting in prestimulus oculomotor inhibition Journal Article In: Journal of Vision, vol. 23, no. 14, pp. 1–13, 2023. @article{TalPerry2023, When faced with unfamiliar circumstances, we often turn to our past experiences with similar situations to shape our expectations. This results in the well-established sequential effect, in which previous trials influence the expectations of the current trial. Studies have revealed that, in addition to the classical behavioral metrics, the inhibition of eye movement could be used as a biomarker to study temporal expectations. This prestimulus oculomotor inhibition is found a few hundred milliseconds prior to predictable events, with a stronger inhibition for predictable than unpredictable events. The phenomenon has been found to occur in various temporal structures, such as rhythms, cue-association, and conditional probability, yet it is still unknown whether it reflects local sequential information of the previous trial. To explore this, we examined the relationship between the sequential effect and the prestimulus oculomotor inhibition. Our results (N = 40) revealed that inhibition was weaker when the previous trial was longer than the current trial, in line with findings of behavioral metrics. These findings indicate that the prestimulus oculomotor inhibition covaries with expectation based on local sequential information, demonstrating the tight connection between this phenomenon and expectation and providing a novel measurement for studying sequential effects in temporal expectation. |
Bharath Chandra Talluri; Incheol Kang; Adam Lazere; Katrina R. Quinn; Nicholas Kaliss; Jacob L. Yates; Daniel A. Butts; Hendrikje Nienborg Activity in primate visual cortex is minimally driven by spontaneous movements Journal Article In: Nature Neuroscience, vol. 26, no. 11, pp. 1953–1959, 2023. @article{Talluri2023, Organisms process sensory information in the context of their own moving bodies, an idea referred to as embodiment. This idea is important for developmental neuroscience, robotics and systems neuroscience. The mechanisms supporting embodiment are unknown, but a manifestation could be the observation in mice of brain-wide neuromodulation, including in the primary visual cortex, driven by task-irrelevant spontaneous body movements. We tested this hypothesis in macaque monkeys (Macaca mulatta), a primate model for human vision, by simultaneously recording visual cortex activity and facial and body movements. We also sought a direct comparison using an analogous approach to those used in mouse studies. Here we found that activity in the primate visual cortex (V1, V2 and V3/V3A) was associated with the animals' own movements, but this modulation was largely explained by the impact of the movements on the retinal image, that is, by changes in visual input. These results indicate that visual cortex in primates is minimally driven by spontaneous movements and may reflect species-specific sensorimotor strategies. |
Travis N. Talcott; John E. Kiat; Steven J. Luck; Nicholas Gaspelin Is covert attention necessary for programming accurate saccades? Evidence from saccade-locked event-related potentials Journal Article In: Attention, Perception, and Psychophysics, pp. 1–19, 2023. @article{Talcott2023, For decades, researchers have assumed that shifts of covert attention mandatorily occur prior to eye movements to improve perceptual processing of objects before they are fixated. However, recent research suggests that the N2pc component—a neural measure of covert attentional allocation—does not always precede eye movements. The current study investigated whether the N2pc component mandatorily precedes eye movements and assessed its role in the accuracy of gaze control. In three experiments, participants searched for a letter of a specific color (e.g., red) and directed gaze to it as a response. Electroencephalograms and eye movements were coregistered to determine whether neural markers of covert attention preceded the initial shift of gaze. The results showed that the presaccadic N2pc only occurred under limited conditions: when there were many potential target locations and distractors. Crucially, there was no evidence that the presence or magnitude of the presaccadic N2pc was associated with improved eye movement accuracy in any of the experiments. Interestingly, ERP decoding analyses were able to classify the target location well before the eyes started to move, which likely reflects a presaccadic cognitive process that is distinct from the attentional process measured by the N2pc. Ultimately, we conclude that the covert attentional mechanism indexed by the N2pc is not necessary for precise gaze control. |
Norihiro Takakuwa; Kaoru Isa; Reona Yamaguchi; Hirotaka Onoe; Jun Takahashi; Masatoshi Yoshida; Tadashi Isa Protocol for making an animal model of “blindsight” in macaque monkeys Journal Article In: STAR Protocols, vol. 4, no. 1, pp. 1–22, 2023. @article{Takakuwa2023, Patients with damage to the primary visual cortex (V1) can respond correctly to visual stimuli in their lesion-affected visual field above the chance level, an ability named blindsight. Here, we present a protocol for making an animal model of blindsight in macaque monkeys. We describe the steps to perform pre-lesion training of monkeys on a visual task, followed by lesion surgery, post-lesion training, and evaluation of blindsight. This animal model can be used to investigate the source of visual awareness. For complete details on the use and execution of this protocol, please refer to Yoshida et al. (2008)1 and Takakuwa et al. (2021).2 |
Maciej J. Szul; Sotirios Papadopoulos; Sanaz Alavizadeh; Sébastien Daligaut; Denis Schwartz; Jérémie Mattout; James J. Bonaiuto Diverse beta burst waveform motifs characterize movement-related cortical dynamics Journal Article In: Progress in Neurobiology, vol. 228, pp. 1–17, 2023. @article{Szul2023, Classical analyses of induced, frequency-specific neural activity typically average band-limited power over trials. More recently, it has become widely appreciated that in individual trials, beta band activity occurs as transient bursts rather than amplitude-modulated oscillations. Most studies of beta bursts treat them as unitary, and having a stereotyped waveform. However, we show there is a wide diversity of burst shapes. Using a biophysical model of burst generation, we demonstrate that waveform variability is predicted by variability in the synaptic drives that generate beta bursts. We then use a novel, adaptive burst detection algorithm to identify bursts from human MEG sensor data recorded during a joystick-based reaching task, and apply principal component analysis to burst waveforms to define a set of dimensions, or motifs, that best explain waveform variance. Finally, we show that bursts with a particular range of waveform motifs, ones not fully accounted for by the biophysical model, differentially contribute to movement-related beta dynamics. Sensorimotor beta bursts are therefore not homogeneous events and likely reflect distinct computational processes. |
Elise M. Szeremeta; Dane Sutton; Welber Marinovic; Patrick J. F. Clarke The effects of left prefrontal stimulation on selective attention and emotional reactivity for positive and negative information Journal Article In: Biological Psychology, vol. 182, pp. 1–10, 2023. @article{Szeremeta2023, Transcranial direct current stimulation targeting lateral prefrontal areas may attenuate attentional vigilance for negative content and reduce emotional reactivity. However, little research to date has examined how such stimulation may affect attention towards and emotional reactivity to positive emotional content. The aim of this study was to examine whether anodal tDCS targeting the left dorsolateral prefrontal cortex would affect attentional bias towards either or both negative and positive content, and similarly, how it would impact emotional reactivity to negative and positive emotional content among healthy individuals. Unselected participants (N = 101) were recruited (Mage = 22.57 |
Georgia F. Symons; William T. O'Brien; Larry Abel; Zhibin Chen; Daniel M. Costello; Terence J. O'Brien; Scott Kolbe; Joanne Fielding; Sandy R. Shultz; Meaghan Clough; William T. O'Brien; Larry Abel; Zhibin Chen; Daniel M. Costello; Terence J. O'brien; Scott Kolbe; Joanne Fielding; Sandy R. Shultz; Meaghan Clough Monitoring the acute and subacute recovery of cognitive ocular motor changes after a sports-related concussion Journal Article In: Cerebral Cortex, vol. 33, no. 9, pp. 5276–5288, 2023. @article{Symons2023, Identifying when recovery from a sports-related concussion (SRC) has occurred remains a challenge in clinical practice. This study investigated the utility of ocular motor (OM) assessment to monitor recovery post-SRC between sexes and compared to common clinical measures. From 139 preseason baseline assessments (i.e. before they sustained an SRC), 18 (12 males, 6 females) consequent SRCs were sustained and the longitudinal follow-ups were collected at 2, 6, and 13 days post-SRC. Participants completed visually guided, antisaccade (AS), and memory-guided saccade tasks requiring a saccade toward, away from, and to a remembered target, respectively. Changes in latency (processing speed), visual-spatial accuracy, and errors were measured. Clinical measures included The Sports Concussion Assessment Tool, King-Devick test, Stroop task, and Digit span. AS latency was significantly longer at 2 days and returned to baseline by 13-days post-SRC in females only (P < 0.001). Symptom numbers recovered from 2 to 6 days and 13 days (P < 0.05). Persistently poorer AS visual-spatial accuracy was identified at 2, 6 and 13 days post-SRC (P < 0.05) in both males and females but with differing trajectories. Clinical measures demonstrated consistent improvement reminiscent of practice effects. OM saccade assessment may have improved utility in tracking recovery compared to conventional measures and between sexes. |
Sai Sun; Hongbo Yu; Shuo Wang; Rongjun Yu Cognitive and neural bases of visual-context-guided decision-making Journal Article In: NeuroImage, vol. 275, pp. 1–15, 2023. @article{Sun2023d, Humans adjust their behavioral strategies based on feedback, a process that may depend on intrinsic preferences and contextual factors such as visual salience. In this study, we hypothesized that decision-making based on visual salience is influenced by habitual and goal-directed processes, which can be evidenced by changes in attention and subjective valuation systems. To test this hypothesis, we conducted a series of studies to investigate the behavioral and neural mechanisms underlying visual salience-driven decision-making. We first established the baseline behavioral strategy without salience in Experiment 1 (n = 21). We then highlighted the utility or performance dimension of the chosen outcome using colors in Experiment 2 (n = 30). We demonstrated that the difference in staying frequency increased along the salient dimension, confirming a salience effect. Furthermore, the salience effect was abolished when directional information was removed in Experiment 3 (n = 28), suggesting that the salience effect is feedback-specific. To generalize our findings, we replicated the feedback-specific salience effects using eye-tracking and text emphasis. The fixation differences between the chosen and unchosen values were enhanced along the feedback-specific salient dimension in Experiment 4 (n = 48) but unchanged after removing feedback-specific information in Experiment 5 (n = 32). Moreover, the staying frequency was correlated with fixation properties, confirming that salience guides attention deployment. Lastly, our neuroimaging study (Experiment 6 |
Sai Sun; Runnan Cao; Ueli Rutishauser; Rongjun Yu; Shuo Wang A uniform human multimodal dataset for emotion perception and judgment Journal Article In: Scientific Data, vol. 10, no. 1, pp. 1–14, 2023. @article{Sun2023c, Face perception is a fundamental aspect of human social interaction, yet most research on this topic has focused on single modalities and specific aspects of face perception. Here, we present a comprehensive multimodal dataset for examining facial emotion perception and judgment. This dataset includes EEG data from 97 unique neurotypical participants across 8 experiments, fMRI data from 19 neurotypical participants, single-neuron data from 16 neurosurgical patients (22 sessions), eye tracking data from 24 neurotypical participants, behavioral and eye tracking data from 18 participants with ASD and 15 matched controls, and behavioral data from 3 rare patients with focal bilateral amygdala lesions. Notably, participants from all modalities performed the same task. Overall, this multimodal dataset provides a comprehensive exploration of facial emotion perception, emphasizing the importance of integrating multiple modalities to gain a holistic understanding of this complex cognitive process. This dataset serves as a key missing link between human neuroimaging and neurophysiology literature, and facilitates the study of neuropsychiatric populations. |
Rui Sun; Julia Fietz; Mira Erhart; Dorothee Poehlchen; Lara Henco; Tanja M. Brückl; BeCOME Team; Michael Czisch; Philipp G. Saemann; Victor I. Spoormaker Free-viewing gaze patterns reveal a mood-congruency bias in MDD during an affective fMRI/eye-tracking task Journal Article In: European Archives of Psychiatry and Clinical Neuroscience, pp. 1–13, 2023. @article{Sun2023b, Major depressive disorder (MDD) has been related to abnormal amygdala activity during emotional face processing. However, a recent large-scale study (n = 28,638) found no such correlation, which is probably due to the low precision of fMRI measurements. To address this issue, we used simultaneous fMRI and eye-tracking measurements during a commonly employed emotional face recognition task. Eye-tracking provide high-precision data, which can be used to enrich and potentially stabilize fMRI readouts. With the behavioral response, we additionally divided the active task period into a task-related and a free-viewing phase to explore the gaze patterns of MDD patients and healthy controls (HC) and compare their respective neural correlates. Our analysis showed that a mood-congruency attentional bias could be detected in MDD compared to healthy controls during the free-viewing phase but without parallel amygdala disruption. Moreover, the neural correlates of gaze patterns reflected more prefrontal fMRI activity in the free-viewing than the task-related phase. Taken together, spontaneous emotional processing in free viewing might lead to a more pronounced mood-congruency bias in MDD, which indicates that combined fMRI with eye-tracking measurement could be beneficial for our understanding of the underlying psychopathology of MDD in different emotional processing phases. |
Juncai Sun; Tiantian Dong; Ping Liu Holistic processing and visual characteristics of regulated and spontaneous expressions Journal Article In: Journal of Vision, vol. 23, no. 3, pp. 1–12, 2023. @article{Sun2023a, The rapid and efficient recognition of facial expressions is crucial for adaptive behaviors, and holistic processing is one of the critical processing methods to achieve this adaptation. Therefore, this study integrated the effects and attentional characteristics of the authenticity of facial expressions on holistic processing. The results show that both regulated and spontaneous expressions were processed holistically. However, the spontaneous expression details did not indicate typical holistic processing, with the congruency effect observed equally for aligned and misaligned conditions. No significant difference between the two expressions was observed in terms of reaction times and eye movement characteristics (i.e., total fixation duration, fixation counts, and first fixation duration). These findings suggest that holistic processing strategies differ between the two expressions. Nevertheless, the difference was not reflected in attentional engagement. |
Benjamin Suarez-Jimenez; Amit Lazarov; Xi Zhu; Daniel S. Pine; Yair Bar-Haim; Yuval Neria Attention allocation to negatively-valenced stimuli in PTSD is associated with reward-related neural pathways Journal Article In: Psychological Medicine, vol. 53, no. 10, pp. 4666–4674, 2023. @article{SuarezJimenez2023, Background. In a recent eye-tracking study we found a differential dwell time pattern for negatively-valenced and neutral faces among patients with posttraumatic stress disorder (PTSD), trauma-exposed healthy control (TEHCs), and healthy control (HC) participants. Here, we explored whether these group differences relate to resting-state functional connectivity (rsFC) patterns of brain areas previously linked to both attention processes and PTSD. These encompass the amygdala, dorsal anterior cingulate cortex (dACC), dorsolateral prefrontal cortex (dlPFC), ventrolateral prefrontal cortex (vlPFC), and nucleus accumbens (NAcc).Methods.Ten minutes magnetic resonance imaging rsFC scans were recorded in 17 PTSD patients, 21 TEHCs, and 16 HCs. Participants then completed a free-viewing eye-tracking task assessing attention allocation outside the scanner. Dwell time on negatively-valenced stimuli (DT%) were assessed relative to functional connectivity in the aforementioned seed regions of interest (amygdala, dACC, dlPFC, vlPFC, and NAcc) to whole-brain voxel-wise rsFC.Results. As previously reported, group differences occurred in attention allocation to negative-valence stimuli, with longer dwell time on negatively valence stimuli in the PTSD and TEHC groups than the HC group. Higher DT% correlated with weaker NAcc-orbitofrontal cortex (OFC) connectivity in patients with PTSD. Conversely, a positive association emerged in the HC group between DT% and NAcc-OFC connectivity.Conclusions. While exploratory in nature, present findings may suggest that reward-related brain areas are involved in disengaging attention from negative-valenced stimuli, and possibly in regulating ensuing negative emotions. |
Patrick Sturt; Nayoung Kwon Agreement attraction in comprehension: Do active dependencies and distractor position play a role? Journal Article In: Language, Cognition and Neuroscience, pp. 1–23, 2023. @article{Sturt2023, Across four eye-tracking studies and one self-paced reading study, we test whether attraction in subject-verb agreement is affected by (a) the relative linear positions of target and distractor, and (b) the active dependency status of the distractor. We find an effect of relative position, with greater attraction in retro-active interference configurations, where the distractor is linearly closer to the critical verb (Subject…Distractor…V) than in pro-active interference where it is more distant (Distractor…Subject…V). However, within pro-active interference configurations, attraction was not affected by the active dependency status of the distractor: attraction effects were similarly small whether or not the distractor was waiting to complete an upcoming dependency at the critical verb, with Bayes Factor analyses showing evidence in favour of a null effect of active dependency status. We discuss these findings in terms of the decay of activation, and whether such decay is affected by maintenance of features in memory. |
Stefanie Sturm; Jordi Costa-Faidella; Iria SanMiguel Neural signatures of memory gain through active exploration in an oculomotor-auditory learning task Journal Article In: Psychophysiology, vol. 60, no. 10, pp. 1–20, 2023. @article{Sturm2023, Active engagement improves learning and memory, and self- versus externally generated stimuli are processed differently: perceptual intensity and neural responses are attenuated. Whether the attenuation is linked to memory formation remains unclear. This study investigates whether active oculomotor control over auditory stimuli—controlling for movement and stimulus predictability—benefits associative learning, and studies the underlying neural mechanisms. Using EEG and eye tracking we explored the impact of control during learning on the processing and memory recall of arbitrary oculomotor-auditory associations. Participants (N = 23) learned associations through active exploration or passive observation, using a gaze-controlled interface to generate sounds. Our results show faster learning progress in the active condition. ERPs time-locked to the onset of sound stimuli showed that learning progress was linked to an attenuation of the P3a component. The detection of matching movement-sound pairs triggered a target-matching P3b. There was no general modulation of ERPs through active learning. However, we found continuous variation in the strength of the memory benefit across participants: some benefited more strongly from active control during learning than others. This was paralleled in the strength of the N1 attenuation effect for self-generated stimuli, which was correlated with memory gain in active learning. Our results show that control helps learning and memory and modulates sensory responses. Individual differences during sensory processing predict the strength of the memory benefit. Taken together, these results help to disentangle the effects of agency, unspecific motor-based neuromodulation, and predictability on ERP components and establish a link between self-generation effects and active learning memory gain. |
Dawid Strzelczyk; Simon P. Kelly; Nicolas Langer Neurophysiological markers of successful learning in healthy aging Journal Article In: GeroScience, vol. 45, no. 5, pp. 2873–2896, 2023. @article{Strzelczyk2023, The capacity to learn and memorize is a key determinant for the quality of life but is known to decline to varying degrees with age. However, neural correlates of memory formation and the critical features that determine the extent to which aging affects learning are still not well understood. By employing a visual sequence learning task, we were able to track the behavioral and neurophysiological markers of gradual learning over several repetitions, which is not possible in traditional approaches that utilize a remember vs. forgotten comparison. On a neurophysiological level, we focused on two learning-related centro-parietal event-related potential (ERP) components: the expectancy-driven P300 and memory-related broader positivity (BP). Our results revealed that although both age groups showed significant learning progress, young individuals learned faster and remembered more stimuli than older participants. Successful learning was directly linked to a decrease of P300 and BP amplitudes. However, young participants showed larger P300 amplitudes with a sharper decrease during the learning, even after correcting for an observed age-related longer P300 latency and increased P300 peak variability. Additionally, the P300 amplitude predicted learning success in both age groups and showed good test–retest reliability. On the other hand, the memory formation processes, reflected by the BP amplitude, revealed a similar level of engagement in both age groups. However, this engagement did not translate into the same learning progress in the older participants. We suggest that the slower and more variable timing of the stimulus identification process reflected in the P300 means that despite the older participants engaging the memory formation process, there is less time for it to translate the categorical stimulus location information into a solidified memory trace. The results highlight the important role of the P300 and BP as a neurophysiological marker of learning and may enable the development of preventive measures for cognitive decline. |