All EyeLink Publications
All 11,000+ peer-reviewed EyeLink research publications up until 2022 (with some early 2023s) are listed below by year. You can search the publications library using keywords such as Visual Search, Smooth Pursuit, Parkinson’s, etc. You can also search for individual author names. Eye-tracking studies grouped by research area can be found on the solutions pages. If we missed any EyeLink eye-tracking papers, please email us!
2022 |
Antonius Wiehler; Francesca Branzoli; Isaac Adanyeguh; Fanny Mochel; Mathias Pessiglione A neuro-metabolic account of why daylong cognitive work alters the control of economic decisions Journal Article In: Current Biology, vol. 32, no. 16, pp. 3564–3575, 2022. @article{Wiehler2022,Behavioral activities that require control over automatic routines typically feel effortful and result in cognitive fatigue. Beyond subjective report, cognitive fatigue has been conceived as an inflated cost of cognitive control, objectified by more impulsive decisions. However, the origins of such control cost inflation with cognitive work are heavily debated. Here, we suggest a neuro-metabolic account: the cost would relate to the necessity of recycling potentially toxic substances accumulated during cognitive control exertion. We validated this account using magnetic resonance spectroscopy (MRS) to monitor brain metabolites throughout an approximate workday, during which two groups of participants performed either high-demand or low-demand cognitive control tasks, interleaved with economic decisions. Choice-related fatigue markers were only present in the high-demand group, with a reduction of pupil dilation during decision-making and a preference shift toward short-delay and little-effort options (a low-cost bias captured using computational modeling). At the end of the day, high-demand cognitive work resulted in higher glutamate concentration and glutamate/glutamine diffusion in a cognitive control brain region (lateral prefrontal cortex [lPFC]), relative to low-demand cognitive work and to a reference brain region (primary visual cortex [V1]). Taken together with previous fMRI data, these results support a neuro-metabolic model in which glutamate accumulation triggers a regulation mechanism that makes lPFC activation more costly, explaining why cognitive control is harder to mobilize after a strenuous workday. |
Stephen Whitmarsh; Christophe Gitton; Veikko Jousmäki; Jérôme Sackur; Catherine Tallon-Baudry Neuronal correlates of the subjective experience of attention Journal Article In: European Journal of Neuroscience, vol. 55, no. 11-12, pp. 3465–3482, 2022. @article{Whitmarsh2022,The effect of top–down attention on stimulus-evoked responses and alpha oscillations and the association between arousal and pupil diameter are well established. However, the relationship between these indices, and their contribution to the subjective experience of attention, remains largely unknown. Participants performed a sustained (10–30 s) attention task in which rare (10%) targets were detected within continuous tactile stimulation (16 Hz). Trials were followed by attention ratings on an 8-point visual scale. Attention ratings correlated negatively with contralateral somatosensory alpha power and positively with pupil diameter. The effect of pupil diameter on attention ratings extended into the following trial, reflecting a sustained aspect of attention related to vigilance. The effect of alpha power did not carry over to the next trial and furthermore mediated the association between pupil diameter and attention ratings. Variations in steady-state amplitude reflected stimulus processing under the influence of alpha oscillations but were only weakly related to subjective ratings of attention. Together, our results show that both alpha power and pupil diameter are reflected in the subjective experience of attention, albeit on different time spans, while continuous stimulus processing might not contribute to the experience of attention. |
Mirjam C. M. Wever; Lisanne A. E. M. Houtum; Loes H. C. Janssen; Wilma G. M. Wentholt; Iris M. Spruit; Marieke S. Tollenaar; Geert Jan Will; Bernet M. Elzinga Neural and affective responses to prolonged eye contact with one's own adolescent child and unfamiliar others Journal Article In: NeuroImage, vol. 260, pp. 1–12, 2022. @article{Wever2022,Eye contact is crucial for the formation and maintenance of social relationships, and plays a key role in facilitating a strong parent-child bond. However, the precise neural and affective mechanisms through which eye contact impacts on parent-child relationships remain elusive. We introduce a task to assess parents' neural and affective responses to prolonged direct and averted gaze coming from their own child, and an unfamiliar child and adult. While in the scanner, 79 parents (n = 44 mothers and n = 35 fathers) were presented with prolonged (16-38 s) videos of their own child, an unfamiliar child, an unfamiliar adult, and themselves (i.e., targets), facing the camera with a direct or an averted gaze. We measured BOLD-responses, tracked parents' eye movements during the videos, and asked them to report on their mood and feelings of connectedness with the targets after each video. Parents reported improved mood and increased feelings of connectedness after prolonged exposure to direct versus averted gaze and these effects were amplified for unfamiliar targets compared to their own child, due to high affect and connectedness ratings after videos of their own child. Neuroimaging results showed that the sight of one's own child was associated with increased activity in middle occipital gyrus, fusiform gyrus and inferior frontal gyrus relative to seeing an unfamiliar child or adult. While we found no robust evidence of specific neural correlates of eye contact (i.e., contrast direct > averted gaze), an exploratory parametric analysis showed that dorsomedial prefrontal cortex (dmPFC) activity increased linearly with duration of eye contact (collapsed across all “other” targets). Eye contact-related dmPFC activity correlated positively with increases in feelings of connectedness, suggesting that this region may drive feelings of connectedness during prolonged eye contact with others. These results underline the importance of prolonged eye contact for affiliative processes and provide first insights into its neural correlates. This may pave the way for new research in individuals or pairs in whom affiliative processes are disrupted. |
Jacob A. Westerberg; Michelle S. Schall; Alexander Maier; Geoffrey F. Woodman; Jeffrey D. Schall Laminar microcircuitry of visual cortex producing attention-associated electric fields Journal Article In: eLife, vol. 11, pp. 1–23, 2022. @article{Westerberg2022,Cognitive operations are widely studied by measuring electric fields through EEG and ECoG. However, despite their widespread use, the neural circuitry giving rise to these signals remains unknown because the functional architecture of cortical columns producing attention-associated electric fields has not been explored. Here we detail the laminar cortical circuitry underlying an attention-associated electric field measured over posterior regions of the brain in humans and monkeys. First, we identified visual cortical area V4 as one plausible contributor to this attention-associated electric field through inverse modeling of cranial EEG in macaque monkeys performing a visual attention task. Next, we performed laminar neurophysiological recordings on the prelunate gyrus and identified the electric-field-producing dipoles as synaptic activity in distinct cortical layers of area V4. Specifically, activation in the extragranular layers of cortex resulted in the generation of the attention-associated dipole. Feature selectivity of a given cortical column determined the overall contribution to this electric field. Columns selective for the attended feature contributed more to the electric field than columns selective for a different feature. Lastly, the laminar profile of synaptic activity generated by V4 was sufficient to produce an attention-associated signal measurable outside of the column. These findings suggest that the top-down recipient cortical layers produce an attention-associated electric field that can be measured extracortically with the relative contribution of each column depending upon the underlying functional architecture. |
Stephanie Wermelinger; Lea Moersdorf; Moritz M. Daum How experience shapes infants' communicative behaviour: Comparing gaze following in infants with and without pandemic experience Journal Article In: Infancy, vol. 27, no. 5, pp. 937–962, 2022. @article{Wermelinger2022a,The COVID-19 pandemic has been influencing people's social life substantially. Everybody, including infants and children needed to adapt to changes in social interactions (e.g., social distancing) and to seeing other people wearing facial masks. In this study, we investigated whether these pandemic-related changes influenced 12- to 15-months-old infants' reactions to observed gaze shifts (i.e., their gaze following). In two eye-tracking tasks, we measured infants' gaze-following behavior during the pandemic (with-COVID-19-experience sample) and compared it to data of infants tested before the pandemic (no-COVID-19-experience sample). Overall, the results indicated no significant differences between the two samples. However, in one sub-task infants in the with-COVID-19-experience sample looked longer at the eyes of a model compared to the no-COVID-19-experience sample. Within the with-COVID-19-experience sample, the amount of mask exposure and the number of contacts without mask were not related to infants' gaze-following behavior. We speculate that even though infants encounter fewer different people during the pandemic and are increasingly exposed to people wearing facial masks, they still also see non-covered faces. These contacts might be sufficient to provide infants with the social input they need to develop social and emotional competencies such as gaze following. |
Stephanie Wermelinger; Lea Moersdorf; Simona Ammann; Moritz M. Daum Exploring the role of COVID-19 pandemic-related changes in social interactions on preschoolers' emotion labeling Journal Article In: Frontiers in Psychology, vol. 13, pp. 1–13, 2022. @article{Wermelinger2022,During the COVID-19 pandemic people were increasingly obliged to wear facial masks and to reduce the number of people they met in person. In this study, we asked how these changes in social interactions are associated with young children's emotional development, specifically their emotion recognition via the labeling of emotions. Preschoolers labeled emotional facial expressions of adults (Adult Faces Task) and children (Child Faces Task) in fully visible faces. In addition, we assessed children's COVID-19-related experiences (i.e., time spent with people wearing masks, number of contacts without masks) and recorded children's gaze behavior during emotion labeling. We compared different samples of preschoolers (4.00–5.75 years): The data for the no-COVID-19-experience sample were taken from studies conducted before the pandemic (Adult Faces Task: N = 40; Child Faces Task: N = 30). The data for the with-COVID-19-experience sample (N = 99) were collected during the COVID-19 pandemic in Switzerland between June and November 2021. The results did not indicate differences in children's labeling behavior between the two samples except for fearful adult faces. Children with COVID-19-experience more often labeled fearful faces correctly compared to children with no COVID-19 experience. Furthermore, we found no relations between children's labeling behavior, their individual COVID-19-related experiences, and their gaze behavior. These results suggest that, even though the children had experienced differences in the amount and variability of facial input due to the pandemic, they still received enough input from visible faces to be able to recognize and label different emotions. |
Wen Wen; Zhibang Huang; Yin Hou; Sheng Li Tracking neural markers of template formation and implementation in attentional inhibition under different distractor consistency Journal Article In: Journal of Neuroscience, vol. 42, no. 24, pp. 4927–4936, 2022. @article{Wen2022,Performing visual search tasks requires optimal attention deployment to promote targets and inhibit distractors. Rejection templates based on the distractor's feature can be built to constrain the search process. We measured electroencephalography (EEG) of human participants of both sexes when they performed a visual search task in conditions where the distractor cues were constant within a block (fixed-cueing) or changed on a trial-by-trial basis (varied-cueing). In the fixed-cueing condition, sustained decoding of the cued colors could be achieved during the retention interval and the participants with higher decoding accuracy showed larger suppression benefits of the distractor cueing in the search period. In the varied-cueing condition, the cued color could only be transiently decoded after its onset and the higher decoding accuracy was observed from the participants who demonstrated lower suppression benefit. The differential neural representations of the to-be-ignored color in the two cueing conditions as well as their reverse associations with behavioral performance implied that rejection templates were formed in the fixed-cueing condition but not in the varied-cueing condition. Additionally, we observed stronger posterior alpha lateralization and mid-frontal theta/beta power during the retention interval of the varied-cueing condition, indicating the cognitive costs in template formation caused by the trialwise change of distractor colors. Taken together, our findings revealed the neural markers associated with the critical roles of distractor consistency in linking template formation to successful inhibition. |
Lisa Weller; Aleks Pieczykolan; Lynn Huestegge Response modalities and the cognitive architecture underlying action control: Intra-modal trumps cross-modal action coordination Journal Article In: Cognition, vol. 225, pp. 1–8, 2022. @article{Weller2022,Performing two actions at the same time usually hampers performance. Previous studies have demonstrated a strong impact of the particular effector systems on performance in multiple action control situations. However, an open question is whether performance is generally better or worse in situations in which two actions within the same effector system are coordinated (intra-modal actions: e.g., two pedal or two manual actions) compared to situations requiring two different effector systems (cross-modal actions: e.g., a manual combined with a vocal action). Performance differences can be predicated, among others, in the light of encapsulation accounts. Encapsulation of modules on the output side of processing would suggest that actions in two different modules can be triggered simultaneously without significant interference between the actions. Thus, cross-modal actions should lead to better performance compared to intra-modal actions. We investigated this issue in two basic experiments, in which participants responded to a single stimulus (thereby maximizing control over input and central processing stages) with one or two either intra-modal or cross-modal responses (manual-manual vs. manual-oculomotor/manual-vocal in Experiment 1/2, respectively). The results represent clear evidence for a performance advantage of intra-modal over cross-modal action control across both effector system combinations and independent of the particular spatial compatibility relation between responses. The results suggest performance benefits by taking advantage of integrated, holistic representations of intra-modal action compounds. |
Dominik Welke; Edward A. Vessel Naturalistic viewing conditions can increase task engagement and aesthetic preference but have only minimal impact on EEG quality Journal Article In: NeuroImage, vol. 256, pp. 1–19, 2022. @article{Welke2022,Free gaze and moving images are typically avoided in EEG experiments due to the expected generation of artifacts and noise. Yet for a growing number of research questions, loosening these rigorous restrictions would be beneficial. Among these is research on visual aesthetic experiences, which often involve open-ended exploration of highly variable stimuli. Here we systematically compare the effect of conservative vs. more liberal experimental settings on various measures of behavior, brain activity and physiology in an aesthetic rating task. Our primary aim was to assess EEG signal quality. 43 participants either maintained fixation or were allowed to gaze freely, and viewed either static images or dynamic (video) stimuli consisting of dance performances or nature scenes. A passive auditory background task (auditory steady-state response; ASSR) was added as a proxy measure for overall EEG recording quality. We recorded EEG, ECG and eye tracking data, and participants rated their aesthetic preference and state of boredom on each trial. Whereas both behavioral ratings and gaze behavior were affected by task and stimulus manipulations, EEG SNR was barely affected and generally robust across all conditions, despite only minimal preprocessing and no trial rejection. In particular, we show that using video stimuli does not necessarily result in lower EEG quality and can, on the contrary, significantly reduce eye movements while increasing both the participants' aesthetic response and general task engagement. We see these as encouraging results indicating that — at least in the lab — more liberal experimental conditions can be adopted without significant loss of signal quality. |
Hannah B. Weinberg-Wolf; Nick Fagan; Olga Dal Monte; Steve W. C. Chang Increasing central serotonin with 5-hydroxytryptophan disrupts the inhibition of social gaze in nonhuman primates Journal Article In: Journal of Neuroscience, vol. 42, no. 4, pp. 670–681, 2022. @article{WeinbergWolf2022,To competently navigate the world, individuals must flexibly balance distinct aspects of social gaze, orienting toward others and inhibiting orienting responses, depending on the context. These behaviors are often disrupted amongst patient populations treated with serotonergic drugs. However, those in the field lack a clear understanding of how the serotonergic system mediates social orienting and inhibiting behaviors. Here, we tested how increasing central concentrations of serotonin with the direct precursor 5-hydroxytryptophan (5-HTP) would modulate the ability of rhesus macaques (both sexes) to use eye movements to flexibly orient to, or inhibit orienting to, faces. Systemic administrations of 5-HTP effectively increased central serotonin levels and impaired flexible orientation and inhibition. Critically, 5-HTP selectively impaired the ability of monkeys to inhibit orienting to face images, whereas it similarly impaired orienting to face and control images. 5-HTP also caused monkeys to perseverate on their gaze responses, making them worse at flexibly switching between orienting and inhibiting behaviors. Furthermore, the effects of 5-HTP on performance correlated with a constriction of the pupil, an increased time to initiate trials, and an increased reaction time, suggesting that the disruptive effects of 5-HTP on social gaze behaviors are likely driven by a downregulation of arousal and motivational states. Together, these findings provide causal evidence for a modulatory relationship between 5-HTP and social gaze behaviors in nonhuman primates and offer translational insights for the role of the serotonergic system in social gaze. |
Emily R. Weichart; Matthew Galdo; Vladimir M. Sloutsky; Brandon M. Turner As within, so without, as above, so below: Support between and within-trial category learning dynamics Journal Article In: Psychological Review, vol. 129, no. 5, pp. 1104–1143, 2022. @article{Weichart2022,Two fundamental difficulties when learning novel categories are deciding (a) what information is relevant and (b) when to use that information. Although previous theories have specified how observers learn to attend to relevant dimensions over time, those theories have largely remained silent about how attention should be allocated on a within-trial basis, which dimensions of information should be sampled, and how the temporal order of information sampling influences learning. Here, we use the adaptive attention representation model (AARM) to demonstrate that a common set of mechanisms can be used to specify: (a) How the distribution of attention is updated between trials over the course of learning and (b) how attention dynamically shifts among dimensions within a trial. We validate our proposed set of mechanisms by comparing AARM's predictions to observed behavior in four case studies, which collectively encompass different theoretical aspects of selective attention. We use both eye-tracking and choice response data to provide a stringent test of how attention and decision processes dynamically interact during category learning. Specifically, how does attention to selected stimulus dimensions gives rise to decision dynamics, and in turn, how do decision dynamics influence which dimensions are attended to via gaze fixations? |
Zi-Han Wei; Qiu-Yue Li; Ci-Juan Liang; Hong-Zhi Liu Cognitive process underlying ultimatum game: An eye-tracking study from a dual-system perspective Journal Article In: Frontiers in Psychology, vol. 13, pp. 1–10, 2022. @article{Wei2022,According to the dual-system theories, the decisions in an ultimatum game (UG) are governed by the automatic System 1 and the controlled System 2. The former drives the preference for fairness, whereas the latter drives the self-interest motive. However, the association between the contributions of the two systems in UG and the cognitive process needs more direct evidence. In the present study, we used the process dissociation procedure to estimate the contributions of the two systems and recorded participants eye movements to examine the cognitive processes underlying UG decisions. Results showed that the estimated contributions of the two systems are uncorrelated and that they demonstrate a dissociated pattern of associations with third variables, such as reaction time (RT) and mean fixation duration (MFD). Furthermore, the relative time advantage (RTA) and the transitions between the two payoffs can predict the final UG decisions. Our findings provide evidence for the independent contributions of preference for fairness (System 1) and self-interest maximizing (System 2) inclinations to UG and shed light on the underlying processes. |
Jelena M. Wehrli; Yanfang Xia; Samuel Gerster; Dominik R. Bach Measuring human trace fear conditioning Journal Article In: Psychophysiology, vol. 59, no. 12, pp. 1–13, 2022. @article{Wehrli2022,Trace fear conditioning is an important research paradigm to model aversive learning in biological or clinical scenarios, where predictors (conditioned stimuli, CS) and aversive outcomes (unconditioned stimuli, US) are separated in time. The optimal measurement of human trace fear conditioning, and in particular of memory retention after consolidation, is currently unclear. We conducted two identical experiments (N1 = 28 |
Taylor D. Webb; Matthew G. Wilson; Henrik Odéen; Jan Kubanek Remus: System for remote deep brain interventions Journal Article In: iScience, vol. 25, no. 11, pp. 1–13, 2022. @article{Webb2022a,Transcranial-focused ultrasound brings personalized medicine to the human brain. Ultrasound can modulate neural activity or release drugs in specific neural circuits but this personalized approach requires a system that delivers ultrasound into specified targets flexibly and on command. We developed a remote ultrasound system (Remus) that programmatically targets deep brain regions with high spatiotemporal precision and in a multi-focal manner. We validated these functions by modulating two deep brain nuclei—the left and right lateral geniculate nucleus—in a task-performing nonhuman primate. This flexible system will enable researchers and clinicians to diagnose and treat specific deep brain circuits in a noninvasive yet targeted manner, thus embodying the promise of personalized treatments of brain disorders. |
Abigail L. M. Webb; Jordi M. Asher; Paul B. Hibbard Saccadic eye movements are deployed faster for salient facial stimuli, but are relatively indifferent to their emotional content Journal Article In: Vision Research, vol. 198, pp. 1–11, 2022. @article{Webb2022,The present study explores the threat bias for fearful facial expressions using saccadic latency, with a particular focus on the role of low-level facial information, including spatial frequency and contrast. In a simple localisation task, participants were presented with spatially-filtered versions of neutral, fearful, angry and happy faces. Together, our findings show that saccadic responses are not biased toward fearful expressions compared to neutral, angry or happy counterparts, regardless of their spatial frequency content. Saccadic response times are, however, significantly influenced by the spatial frequency and contrast of facial stimuli. We discuss the implications of these findings for the threat bias literature, and the extent to which image processing can be expected to influence behavioural responses to socially-relevant facial stimuli. |
I. K. Wardhani; B. H. Janssen; C. N. Boehler Investigating the relationship between background luminance and self-reported valence of auditory stimuli Journal Article In: Acta Psychologica, vol. 224, pp. 1–10, 2022. @article{Wardhani2022a,The present study investigated the effect of background luminance on the self-reported valence ratings of auditory stimuli, as suggested by some earlier work. A secondary aim was to better characterise the effect of auditory valence on pupillary responses, on which the literature is inconsistent. Participants were randomly presented with sounds of different valence categories (negative, neutral, and positive) obtained from the IADS-E database. At the same time, the background luminance of the computer screen (in blue hue) was manipulated across three levels (i.e., low, medium, and high), with pupillometry confirming the expected strong effect of luminance on pupil size. Participants were asked to rate the valence of the presented sound under these different luminance levels. On a behavioural level, we found evidence for an effect of background luminance on the self-reported valence rating, with generally more positive ratings as background luminance increased. Turning to valence effects on pupil size, irrespective of background luminance, interestingly, we observed that pupils were smallest in the positive valence and the largest in negative valence condition, with neutral valence in between. In sum, the present findings provide evidence concerning a relationship between luminance perception (and hence pupil size) and self-reported valence of auditory stimuli, indicating a possible cross-modal interaction of auditory valence processing with completely task-irrelevant visual background luminance. We furthermore discuss the potential for future applications of the current findings in the clinical field. |
I. K. Wardhani; C. N. Boehler; S. Mathôt The influence of pupil responses on subjective brightness perception Journal Article In: Perception, vol. 51, no. 6, pp. 370–387, 2022. @article{Wardhani2022,When the pupil dilates, the amount of light that falls onto the retina increases. However, in daily life, this does not make the world look brighter. Here we asked whether pupil size (resulting from active pupil movement) influences subjective brightness in the absence of indirect cues that, in daily life, support brightness constancy. We measured the subjective brightness of a tester stimulus relative to a referent as a function of pupil size during tester presentation. In Experiment 1, we manipulated pupil size through a secondary working-memory task (larger pupils with higher load and after errors). We found some evidence that the tester was perceived as darker, rather than brighter, when pupils were larger. In Experiment 2, we presented a red or blue display (larger pupils following red displays). We again found that the tester was perceived as darker when pupils were larger. We speculate that the visual system takes pupil size into account when making brightness judgments. Finally, we highlight the challenges associated with manipulating pupil size. In summary, the current study (as well as a recent pharmacological study on the same topic by another team) is intriguing first steps towards understanding the role of pupil size in brightness perception. |
Shamini Warda; Jaana Simola; Devin B. Terhune Pupillometry tracks errors in interval timing Journal Article In: Behavioral Neuroscience, vol. 13, no. 2, pp. 495–502, 2022. @article{Warda2022,Recent primate studies suggest a potential link between pupil size and subjectively elapsed duration. Here, we sought to investigate the relationship between pupil size and perceived duration in human participants performing two temporal bisection tasks in the subsecond and suprasecond interval ranges. In the subsecond task, pupil diameter was greater during stimulus processing when shorter intervals were overestimated but also during and after stimulus offset when longer intervals were underestimated. By contrast, in the suprasecond task, larger pupil diameter was observed only in the late stimulus offset phase prior to response prompts when longer intervals were underestimated. This pattern of results suggests that pupil diameter relates to an error monitoring mechanism in interval timing. These results are at odds with a direct relationship between pupil size and the perception of duration but suggest that pupillometric variation might play a key role in signifying errors related to temporal judgments. |
Colleen B. Ward; Jennifer E. Mack The effect of an aphasia ID card on the processing of language produced by a speaker with nonfluent aphasia Journal Article In: Journal of Communication Disorders, vol. 100, pp. 1–14, 2022. @article{Ward2022,Introduction: We tested whether aphasia self-disclosure via an aphasia ID card impacts (1) how non-aphasic listeners initially process language produced by a speaker with aphasia and (2) learning of the speaker's error patterns over time. Methods: In this eye-tracking experiment, 27 young adults followed instructions recorded by a speaker with nonfluent aphasia while viewing a target picture and a distractor. The Card group (n = 14) was shown a simulated aphasia ID card for the speaker and the No Card group (n = 13) was not. The task was divided into Pre-Observation and Post-Observation blocks. Between blocks, participants observed the speaker making semantic paraphasias. Eye-tracking analyses compared the time course of target advantage (reflecting competition from the distractor picture) and workspace advantage (reflecting attention to task) between groups and blocks. Results: Pre-Observation, the Card group had a higher target advantage than the No Card group in the post-response window (i.e., after participants had responded), indicating sustained attention to the speaker's language. Across blocks, there was evidence that the Card group (but not the No Card group) learned that the speaker makes semantic paraphasias. Conclusions: Aphasia ID cards impacted listeners' processing of language produced by a speaker with nonfluent aphasia. Increased patience and attentiveness may underlie both the Card group's sustained attention to the speaker as well as learning of the speaker's error patterns. Further research should address whether these changes impact communication success between PWA and new conversation partners. |
Ying Wang; Hai-Long Lyu; Xiao-Han Tian; Bing Lang; Xiao-Yi Wang; David St Clair; Renrong Wu; Jingping Zhao The similar eye movement dysfunction between major depressive disorder, bipolar depression and bipolar mania Journal Article In: The World Journal of Biological Psychiatry, vol. 23, no. 9, pp. 689–702, 2022. @article{Wang2022j,Objective: To find eye movement characteristics in patients with affective disorders. Method: The demographic and clinical evaluation data of patients with major depressive disorder (MDD), bipolar disorder (BPD), and healthy control (HC) were collected. EyeLink 1000 eye tracker was used to collect eye movement data. Chi-squared test and independent sample t-test were used for demographics and clinical characteristics. The Mann–Whitney U-test was used to compare the eye movement variables among four groups, and the FDR method was used for multiple comparison correction. Pearson correlation analysis was used to analyse the relationship between clinical symptoms and eye movement variables. Results: Patients with affective disorders showed smaller saccade amplitude under free-viewing task, more fixations and saccades, shorter fixation duration, longer saccade duration under fixation stability and smooth pursuit tasks (all, p < 0.05) when compared to HC, but there was no significant difference in all eye movement variables among patients in the three groups. Also, all eye movement variables under the three paradigms had no significant correlation with clinical scale scores. Conclusion: Patients with major depression, bipolar depression and bipolar mania share similar eye movement dysfunction under free-viewing, fixation stability and smooth pursuit tasks. |
Shuai Wang; Jialing Li; Siyu Wang; Wei Wang; Can Mi; Wenjing Xiong; Zhengjia Xu; Longxing Tang; Yanzhang Li In: Frontiers in Psychology, vol. 13, pp. 1–9, 2022. @article{Wang2022i,Individuals with high risk of internet gaming disorder (HIGD) showed abnormal psychological performances in response inhibition, impulse control, and emotion regulation, and are considered the high-risk stage of internet gaming disorder (IGD). The identification of this population mainly relies on clinical scales, which are less accurate. This study aimed to explore whether these performances have highly accurate for discriminating HIGD from low-risk ones. Eye tracking based anti-saccade task, Barratt impulsiveness scale (BIS), and Wong and Law emotional intelligence scale (WLEIS) were used to evaluate psychological performances in 57 individuals with HIGD and 52 matched low risk of internet gaming disorder (LIGD). HIGD group showed significantly increased BIS total (t = −2.875 |
Shuai Wang; Jialing Li; Siyu Wang; Can Mi; Wei Wang; Zhengjia Xu; Wenjing Xiong; Longxing Tang; Yanzhang Li Escapism-based motivation affected the psychological performances of high-risk internet gaming disorder individuals Journal Article In: Frontiers in Psychiatry, vol. 13, pp. 1–10, 2022. @article{Wang2022h,Background: Escapism-based motivation (EBM) is considered as one of the diagnostic criteria for internet gaming disorder (IGD). However, how EBM affects the high risk of IGD (HIGD) population remains unclear. Methods: An initial number of 789 college students participated in the general, internet gaming behavior, and motivation surveys. After multiple evaluations, 57 individuals were identified as HIGD (25 with EBM, H-EBM; 32 with non-EBM, H-nEBM). In addition, 51 no-gaming individuals were included as the control group (CONTR). The cohorts completed the psychological assessments and eye-tracking tests, and analyses of group differences, correlations, and influencing factors of the indicators were performed. Results: The Barratt impulsiveness score of H-nEBM and H-EBM was significantly higher than that of CONTR (MD = 3.605 |
Maya Zhe Wang; Benjamin Y. Hayden; Sarah R. Heilbronner A structural and functional subdivision in central orbitofrontal cortex Journal Article In: Nature Communications, vol. 13, no. 1, pp. 1–12, 2022. @article{Wang2022g,Economic choice requires many cognitive subprocesses, including stimulus detection, valuation, motor output, and outcome monitoring; many of these subprocesses are associated with the central orbitofrontal cortex (cOFC). Prior work has largely assumed that the cOFC is a single region with a single function. Here, we challenge that unified view with convergent anatomical and physiological results from rhesus macaques. Anatomically, we show that the cOFC can be subdivided according to its much stronger (medial) or weaker (lateral) bidirectional anatomical connectivity with the posterior cingulate cortex (PCC). We call these subregions cOFCm and cOFCl, respectively. These two subregions have notable functional differences. Specifically, cOFCm shows enhanced functional connectivity with PCC, as indicated by both spike-field coherence and mutual information. The cOFCm-PCC circuit, but not the cOFCl-PCC circuit, shows signatures of relaying choice signals from a non-spatial comparison framework to a spatially framed organization and shows a putative bidirectional mutually excitatory pattern. |
Jie Wang; Jiaming Shi; Xin Wen; Liang Xu; Ke Zhao; Fuyang Tao; Wenbiao Zhao; Xiuying Qian The effect of signal icon and persuasion strategy on warning design in online fraud Journal Article In: Computers and Security, vol. 121, pp. 1–14, 2022. @article{Wang2022f,The rapid increase in the use of mobile technology and online communication has facilitated more opportunities for social interactions as well as for online fraud. Warnings are one of the last lines of defense in transaction security. Many warnings used in anti-fraud processes are often ineffective due to habituation and the trial-and-error method used in their design. Following psychological theories of persuasion and warning design principles, in this paper, we design fourteen warnings and examine their effectiveness in an eye-tracker experiment (Study 1) and in an online A/B test on the Alipay platform (Study 2). Based on the communication-human information processing (C-HIP) model, Study 1 found that pictorial signal icons and persuasion strategies significantly improved the effectiveness of warnings. Specifically, pictorial signal icons attracted users' attention better than the conventional signal icons, and warnings with authority, social influence, diversion, questioning, and multiple strategies performed better than those without a persuasion strategy. Study 2 showed that our warnings performed better than the original Alipay warnings. The overall case rate was reduced by 33.2%, avoiding at least 30 million yuan in economic losses. Our work contributes to the field of security warning design with both theoretical and practical value and provides an important reference for future research. |
Jiahui Wang; Abigail Stebbins; Richard E. Ferdig Examining the effects of students' self-efficacy and prior knowledge on learning and visual behavior in a physics game Journal Article In: Computers and Education, vol. 178, pp. 1–13, 2022. @article{Wang2022,Research has provided evidence of the significant promise of using educational games for learning. However, there is limited understanding of how individual differences (e.g., self-efficacy and prior knowledge) affect visual processing of game elements and learning from an educational game. This study aimed to address these gaps by: a) examining the effects of students' self-efficacy and prior knowledge on learning from a physics game; and b) exploring how learners with distinct levels of self-efficacy and prior knowledge differ in their visual behavior with respect to the game elements. The visual behavior of 69 undergraduate students was recorded as they played an educational game focusing on Newtonian mechanics. Individual differences in self-efficacy in learning physics and prior knowledge were assessed prior to the game, while a comprehension test was administered immediately after gameplay. Wilcoxon signed-rank tests showed that all participants significantly improved in their understanding of Newtonian mechanics. Mann-Whitney U tests indicated learning gains were not significantly different between the groups with varying levels of prior knowledge or self-efficacy. Additionally, a series of Mann-Whitney U tests of the eye tracking data suggested the learners with high self-efficacy tended to pay more attention to the motion map - a critical navigation component of the game. Further, the high prior knowledge individuals excelled in attentional control abilities and exhibited effective visual processing strategies. The study concludes with important implications for the future design of educational games and developing individualized instructional support in game-based learning. |
Jiahui Wang Does working memory capacity influence learning from videos and attentional processing of the instructor's visuals? Journal Article In: Behaviour and Information Technology, pp. 1–15, 2022. @article{Wang2022e,Existing evidence suggested learners with differences in attention and cognition might respond to the same media in differential ways. The current study focused on one format of video design – instructor visibility and explored the moderating effects of working memory capacity on learning from such video design and if learners with high and low working memory capacity attended to the instructor's visuals differently. Participants watched a video either with or without the instructor's visuals on the screen, while their visual attention was recorded simultaneously. After the video, participants responded to a learning test that measured retention and transfer. Although the results did not show working memory capacity moderated the instructor visibility effects on learning or influenced learners' visual attention to the instructor's visuals, the findings did indicate working memory capacity was a positive predictor of retention performance regardless of the video design. Discussions and implications of the findings were provided. |
Chin-an Wang; Brian White; Douglas P. Munoz Pupil-linked arousal signals in the midbrain superior colliculus Journal Article In: Journal of Cognitive Neuroscience, vol. 34, no. 8, pp. 1340–1354, 2022. @article{Wang2022c,The orienting response evoked by the appearance of a salient stimulus is modulated by arousal; however, neural under- pinnings for the interplay between orienting and arousal are not well understood. The superior colliculus (SC), causally involved in multiple components of the orienting response including gaze and attention shifts, receives not only multisensory and cognitive inputs but also arousal-regulated inputs from various cortical and subcortical structures. To investigate the impact of moment-by-moment fluctuations in arousal on orienting saccade responses, we used microstimulation of the monkey SC to trigger saccade responses, and we used pupil size and velocity to index the level ofarousal at stimulation onset because these measures correlate with changes in brain states and locus coeruleus activity. Saccades induced by SC microstimulation correlated with prestimulation pupil velocity, with higher pupil velocities on trials without evoked saccades than with evoked saccades. In contrast, prestimulation absolute pupil size did not correlate with saccade behavior. Moreover, pupil velocity correlated with evoked saccade latency and metrics. Together, our results demonstrated that small fluctuations in arousal, indexed by pupil velocity, can modulate the saccade response evoked by SC microstimulation in awake behaving monkeys. |
Chao Wang; Mitchell Reid Pond LaPointe; Shree Venkateshan; Guang Zhao; Weidong Tao; Hong-Jin Sun; Bruce Milliken Item-specific control of attention capture: An eye movement study Journal Article In: Quarterly Journal of Experimental Psychology, vol. 76, no. 1, pp. 117–132, 2022. @article{Wang2022b,Measures of attentional capture are sensitive to attentional control settings. Recent research suggests that such control settings can be linked associatively to specific items. Rapid item-specific retrieval of these control settings can then modulate measures of attentional capture. However, the processes that produce this item-specific control of attentional capture are unclear. The current study addressed this issue by examining eye-movement patterns associated with the item-specific proportion congruency effect (ISPC). Participants searched for a shape singleton target in search displays that also contained a colour singleton—the colour singleton was either the same item as the shape singleton (congruent trials) or a different item (incongruent trials). The relative proportions of congruent and incongruent trials were manipulated separately for two distinct item types that were randomly intermixed. Response times (RTs) were faster on congruent than incongruent trials, and this congruency effect was larger for high-proportion congruent (HPC) than low-proportion congruent (LPC) items. Eye movement data revealed a higher proportion of saccades towards the distractor and longer dwell times on the distractor in the HPC condition. These results suggest that item-specific associative learning can influence the strength of representation of the task goal (e.g., find the odd shape), a form of selection history effect in visual search. |
Andi Wang; Ana Pellicer-Sánchez Incidental vocabulary learning from bilingual subtitled viewing: An eye-tracking study Journal Article In: Language Learning, vol. 72, no. 3, pp. 765–805, 2022. @article{Wang2022a,This study examined the effectiveness of bilingual subtitles relative to captions, subtitles, and no subtitles for incidental vocabulary learning. Learners' processing of novel words in the subtitles and its relationship to learning gains were also explored. While their eye movements were recorded, 112 intermediate to advanced Chinese learners of English watched a documentary in one of 4 conditions: bilingual subtitles, captions, L1 subtitles, and no subtitles. Vocabulary pretests and posttests assessed the participants' knowledge of the target vocabulary for form recognition, meaning recall, and meaning recognition. Results suggested an advantage for bilingual subtitles over captions for meaning recognition and over L1 subtitles for meaning recall. Bilingual subtitles were less effective than captions for form recognition. Participants in the bilingual subtitles group spent more time reading the Chinese translations of the target items than the English target words. The amount of attention to the English target words (but not to the translations) predicted learning gains. |
A. J. Walters; A. Lithopoulos; E. M. Tennant; S. Weissman; A. E. Latimer-Cheung Exploring attention to the Canadian 24-Hour Movement Guidelines for Children and Youth using eye-tracking: A randomized control trial Journal Article In: Public Health Nursing, vol. 39, pp. 982–992, 2022. @article{Walters2022,Background: The Canadian 24-Hour Movement Guidelines for Children and Youth (“Guidelines”) not only pioneered the notion of an integrated movement continuum from sleep to vigorous-intensity physical activity but also introduced a new branded Guideline visual identity. Objectives: This study evaluated youths' (N = 46) attention to and thoughts about the Guidelines and the brand. Design: A cross-sectional between-participants randomized intervention design was used. Sample: Canadian youth between 10 and 17 years of age comprised the study sample. Interventions: Participants were randomly assigned to view either branded Guidelines (n = 26) or unbranded Guidelines (n = 20). Youths' eye-movements (e.g., dwell time, fixation count) were recorded during Guideline viewing. Participants completed a follow-up survey assessing brand perceptions and Guideline cognitions. Results: The branded Guidelines neither drew greater overall attention nor led to more positive brand perceptions or Guideline cognitions compared to the unbranded Guidelines. Conclusions: Exploratory analyses provide valuable, yet preliminary insight into how branding and Guideline content may shape how Guidelines are perceived and acted upon. These findings inform an agenda for future health education resources. |
Kerri Walter; Peter Bex Low-level factors increase gaze-guidance under cognitive load: A comparison of image-salience and semantic-salience models Journal Article In: PloS ONE, vol. 17, no. 11, pp. 1–16, 2022. @article{Walter2022,Growing evidence links eye movements and cognitive functioning, however there is debate concerning what image content is fixated in natural scenes. Competing approaches have argued that low-level/feedforward and high-level/feedback factors contribute to gaze-guidance. We used one low-level model (Graph Based Visual Salience, GBVS) and a novel language-based high-level model (Global Vectors for Word Representation, GloVe) to predict gaze locations in a natural image search task, and we examined how fixated locations during this task vary under increasing levels of cognitive load. Participants (N = 30) freely viewed a series of 100 natural scenes for 10 seconds each. Between scenes, subjects identified a target object from the scene a specified number of trials (N) back among three distracter objects of the same type but from alternate scenes. The N-back was adaptive: N-back increased following two correct trials and decreased following one incorrect trial. Receiver operating characteristic (ROC) analysis of gaze locations showed that as cognitive load increased, there was a significant increase in prediction power for GBVS, but not for GloVe. Similarly, there was no significant difference in the area under the ROC between the minimum and maximum N-back achieved across subjects for GloVe (t(29) = -1.062 |
R. Calen Walshe; Wilson S. Geisler Efficient allocation of attentional sensitivity gain in visual cortex reduces foveal sensitivity in visual search Journal Article In: Current Biology, vol. 32, no. 1, pp. 26–36, 2022. @article{Walshe2022,The human visual system has a high-resolution fovea and a low-resolution periphery. When actively searching for a target, humans perform a covert search during each fixation, and then shift fixation (the fovea) to probable target locations. Previous studies of covert search under carefully controlled conditions provide strong evidence that for simple and small search displays, humans process all potential target locations with the same efficiency that they process those locations when individually cued on each trial. Here, we extend these studies to the case of large displays, in which the target can appear anywhere within the display. These more natural conditions reveal an attentional effect in which sensitivity in the fovea and parafovea is greatly diminished. We show that this “foveal neglect” is the expected consequence of efficiently allocating a fixed total attentional sensitivity gain across the retinotopic map in the visual cortex. We present a formal theory that explains our findings and the previous findings. |
Carla A. Wall; Frederick Shic; Sreeja Varanasi; Jane E. Roberts Distinct social attention profiles in preschoolers with autism contrasted to fragile X syndrome Journal Article In: Autism Research, pp. 1–15, 2022. @article{Wall2022,Social attention is a critical skill for learning and development. Social attention difficulties are present in both non-syndromic autism spectrum disorder (nsASD) and fragile X syndrome (FXS), and our understanding of these difficulties is complicated by heterogeneity in both disorders, including co-occurring diagnoses like intellectual disability and social anxiety. Existing research largely utilizes a single index of social attention and rarely includes children with intellectual impairment or uses a cross-syndrome approach. This study investigated whether multi-trait social attention profiles including naturalistic initial eye contact, facial attention, and social scene attention differ in preschool children with nsASD and FXS matched on developmental ability (DQ) and contrasted to neurotypical (NT) controls. The relationship between DQ, ASD severity, and social anxiety and social attention profiles was also examined. Initial eye contact related to social scene attention, implicating that naturalistic social attention is consistent with responses during experimental conditions. Reduced eye contact and lower social scene attention characterized nsASD and FXS. Children with nsASD displayed less facial attention than FXS and NT children, who did not differ. Lower DQ and elevated ASD severity associated with decreased eye contact in nsASD and FXS, and lower DQ was associated with lower social scene attention in FXS. Sex, social anxiety, and age were not associated with social attention. These findings suggest social attention profiles of children with nsASD are highly similar to, yet distinct from, children with FXS. Children with nsASD may present with a global social attention deficit whereas FXS profiles may reflect context-dependent social avoidance. |
Josefine Waldthaler; Mikkel C. Vinding; Allison Eriksson; Per Svenningsson; Daniel Lundqvist Neural correlates of impaired response inhibition in the antisaccade task in Parkinson's disease Journal Article In: Behavioural Brain Research, vol. 422, pp. 1–12, 2022. @article{Waldthaler2022a,Deficits in response inhibition are a central feature of the highly prevalent dysexecutive syndrome found in Parkinson's disease (PD). Such deficits are related to a range of common clinically relevant symptoms including cognitive impairment as well as impulsive and compulsive behaviors. In this study, we explored the cortical dynamics underlying response inhibition during the mental preparation for the antisaccade task by recording magnetoencephalography (MEG) and eye-movements in 21 non-demented patients with early to mid-stage Parkinson's disease and 21 age-matched healthy control participants (HC). During the pre-stimulus preparatory period for antisaccades we observed: • a preparation-related increase in beta band activity in the right dorsolateral prefrontal cortex (DLPFC) of HC (n = 15) for antisaccades compared with prosaccades that was not detectable in the PD group (n = 17); • a significant attenuation of the preparation-related increase in alpha band power in bilateral FEF and reduced alpha band connectivity between the right DLPFC and right FEF in the PD group compared with HC, suggesting reduced top-down control to inhibit pre-potent activation of FEF in PD; and • a positive correlation between the magnitude of pre-stimulus beta desynchronization in FEF and subsequent antisaccade latency in PD and HC, indicating a relationship between preparatory beta band modulation and effectiveness of subsequent antisaccade execution. Taken together, the results indicate that alterations in pre-stimulus prefrontal alpha and beta activity hinder proactive response inhibition and in turn result in higher error rates and prolonged response latencies in PD. |
Josefine Waldthaler; Lena Stock; Charlotte Krüger-Zechlin; Zain Deeb; Lars Timmermann Cluster analysis reveals distinct patterns of saccade impairment and their relation to cognitive profiles in Parkinson's disease Journal Article In: Journal of Neuropsychology, pp. 1–13, 2022. @article{Waldthaler2022,Saccade performance has been reported to be altered in Parkinson's disease (PD), however, with a large variability between studies as both motor and cognitive impairment interfere with oculomotor control. The aim of this study was to identify different patterns in saccade alterations in PD using a data-driven approach and to explore their relationship with cognitive phenotypes. Sixty-one participants with PD and 25 controls performed eye-tracking (horizontal and vertical prosaccades, antisaccades) and neuropsychological testing. Hierarchical cluster analysis was applied to the eye-tracking data to subsequently compare the clusters based on demographical, clinical and cognitive characteristics. The three identified clusters of saccade alterations differed in cognitive profiles from healthy controls, but not in PD-related motor symptoms or demographics. The rate of directive errors in the antisaccade task was increased in clusters 1 and 2. Further, cluster 1 was defined by a general disinhibition of reflexive saccades and executive dysfunction in the neuropsychological evaluation. In cluster 2, prolonged saccade latencies and hypometria were accompanied by multidomain cognitive impairment. The cluster 3 showed increased antisaccade latency and vertical hypometria despite lack of evidence for cognitive impairment. Our results suggest that there may be at least two opposing patterns of saccade alterations associated with cognitive impairment in PD, which may explain some of the contradictory results of previous studies. |
Elena N. Waidmann; Kenji W. Koyano; Julie J. Hong; Brian E. Russ; David A. Leopold Local features drive identity responses in macaque anterior face patches Journal Article In: Nature Communications, vol. 13, no. 1, pp. 1–13, 2022. @article{Waidmann2022,Humans and other primates recognize one another in part based on unique structural details of the face, including both local features and their spatial configuration within the head and body. Visual analysis of the face is supported by specialized regions of the primate cerebral cortex, which in macaques are commonly known as face patches. Here we ask whether the responses of neurons in anterior face patches, thought to encode face identity, are more strongly driven by local or holistic facial structure. We created stimuli consisting of recombinant photorealistic images of macaques, where we interchanged the eyes, mouth, head, and body between individuals. Unexpectedly, neurons in the anterior medial (AM) and anterior fundus (AF) face patches were predominantly tuned to local facial features, with minimal neural selectivity for feature combinations. These findings indicate that the high-level structural encoding of face identity rests upon populations of neurons specialized for local features. |
Christopher N. Wahlheim; Michelle L. Eisenberg; David Stawarczyk; Jeffrey M. Zacks Understanding everyday events: Predictive-looking errors drive memory updating Journal Article In: Psychological Science, vol. 33, no. 5, pp. 765–781, 2022. @article{Wahlheim2022,Memory-guided predictions can improve event comprehension by guiding attention and the eyes to the location where an actor is about to perform an action. But when events change, viewers may experience predictive-looking errors and need to update their memories. In two experiments (Ns = 38 and 98), we examined the consequences of mnemonic predictive-looking errors for comprehending and remembering event changes. University students watched movies of everyday activities with actions that were repeated exactly and actions that were repeated with changed features—for example, an actor reached for a paper towel on one occasion and a dish towel on the next. Memory guidance led to predictive-looking errors that were associated with better memory for subsequently changed event features. These results indicate that retrieving recent event features can guide predictions during unfolding events and that error signals derived from mismatches between mnemonic predictions and actual events contribute to new learning. |
Ilja Wagner; Dion Henare; Jan Tünnermann; Anna Schubö; Alexander C. Schütz Humans trade off search costs and accuracy in a combined visual search and perceptual task Journal Article In: Attention, Perception, & Psychophysics, vol. 85, pp. 23–40, 2022. @article{Wagner2022,To interact with one's environment, relevant objects have to be selected as targets for saccadic eye movements. Previous studies have demonstrated that factors such as visual saliency and reward influence saccade target selection, and that humans can dynamically trade off these factors to maximize expected value during visual search. However, expected value in everyday situations not only depends on saliency and reward, but also on the required time to find objects, and the likelihood of a successful object-interaction after search. Here we studied whether search costs and the accuracy to discriminate an object feature can be traded off to maximize expected value. We designed a combined visual search and perceptual discrimination task, where participants chose whether to search for an easy- or difficult-to-discriminate target in search displays populated by distractors that shared features with either the easy or the difficult target. Participants received a monetary reward for correct discriminations and were given limited time to complete as many trials as they could. We found that participants considered their discrimination performance and the search costs when choosing targets and, by this, maximized expected value. However, the accumulated reward was constrained by noise in both the choice of which target to search for, and which elements to fixate during search. We conclude that humans take into account the prospective search time and the likelihood of successful a object-interaction, when deciding what to search for. However, search performance is constrained by noise in decisions about what to search for and how to search for it. |
Cécile Vullings; Zachary Lively; Preeti Verghese Saccades during visual search in macular degeneration Journal Article In: Vision Research, vol. 201, pp. 1–14, 2022. @article{Vullings2022,Macular degeneration (MD) compromises both high-acuity vision and eye movements when the foveal regions of both eyes are affected. Individuals with MD adapt to central field loss by adopting a preferred retinal locus (PRL) for fixation. Here, we investigate how individuals with bilateral MD use eye movements to search for targets in a visual scene under realistic binocular viewing conditions. Five individuals with binocular scotomata, 3 individuals with monocular scotomata and 6 age-matched controls participated in our study. We first extensively mapped the binocular scotoma with an eyetracker, while fixation was carefully monitored (Vullings & Verghese, 2020). Participants then completed a visual search task where 0, 1, or 2 Gaussian blobs were distributed randomly across a natural scene. Participants were given 10 s to actively search the display and report the number of blobs. An analysis of saccade characteristics showed that individuals with binocular scotomata made more saccades in the direction of their scotoma than controls for the same directions. Saccades in the direction of the scotoma were typically of small amplitude, and did not fully uncover the region previously hidden by the scotoma. Rather than make more saccades to explore this hidden region, participants frequently made saccades back toward newly uncovered regions. Backward saccades likely serve a similar purpose to regressive saccades exhibited during reading in MD, by inspecting previously covered regions near the direction of gaze. Our analysis suggests that the higher prevalence of backward saccades in individuals with binocular scotomata might be related to the PRL being adjacent to the scotoma. |
Stella D. Voulgaropoulou; Fasya Fauzani; Janine Pfirrmann; Claudia Vingerhoets; Thérèse Amelsvoort; Dennis Hernaus Asymmetric effects of acute stress on cost and benefit learning Journal Article In: Psychoneuroendocrinology, vol. 138, pp. 1–10, 2022. @article{Voulgaropoulou2022,Background: Humans are continuously exposed to stressful challenges in everyday life. Such stressful events trigger a complex physiological reaction – the fight-or-flight response – that can hamper flexible decision-making and learning. Inspired by key neural and peripheral characteristics of the fight-or-flight response, here, we ask whether acute stress changes how humans learn about costs and benefits. Methods: Healthy adults were randomly exposed to an acute stress (age mean=23.48, 21/40 female) or no-stress control (age mean=23.80, 22/40 female) condition, after which they completed a reinforcement learning task in which they minimize cost (physical effort) and maximize benefits (monetary rewards). During the task pupillometry data were collected. A computational model of cost-benefit reinforcement learning was employed to investigate the effect of acute stress on cost and benefit learning and decision-making. Results: Acute stress improved learning to maximize rewards relative to minimizing physical effort (Condition-by-Trial Type interaction: F(1,78)= 6.53 |
Katie Von Holzen; Sandrien Ommen; Katherine S. White; Thierry Nazzi The impact of phonological biases on mispronunciation sensitivity and novel accent adaptation Journal Article In: Language Learning and Development, pp. 1–20, 2022. @article{VonHolzen2022,Successful word recognition requires that listeners attend to differences that are phonemic in the language while also remaining flexible to the variation introduced by different voices and accents. Previous work has demonstrated that American-English-learning 19-month-olds are able to balance these demands: although one-off one-feature mispronunciations typically disrupt English-learning toddlers' lexical access, they no longer do after toddlers are exposed to a novel accent in which these changes occur systematically. The flexibility to deal with different types of variation may not be the same for toddlers learning different first languages, however, as language structure shapes early phonological biases. We examined French-learning 19-month-olds' sensitivity and adaptation to a novel accent that shifted either the standard pronunciation of /a/ from [a] to [ɛ] (Experiment 1) or the standard pronunciation of /p/ from [p] to [t] (Experiment 2). In Experiment 1, French-learning toddlers recognized words with /a/ produced as [ɛ], regardless of whether they were previously exposed to an accent that contained this vowel shift or not. In Experiment 2, toddlers did not recognize words with /p/ pronounced as [t] at test unless they were first familiarized with an accent that contained this consonant shift. These findings are consistent with evidence that French-learning toddlers privilege consonants over vowels in lexical processing. Together with previous work, these results demonstrate both differences and similarities in how French- and English-learning children treat variation, in line with their language-specific phonological biases. |
Christoph J. Völter; Ludwig Huber Pupil size changes reveal dogs' sensitivity to motion cues Journal Article In: iScience, vol. 25, no. 9, pp. 1–16, 2022. @article{Voelter2022,Certain motion cues like self-propulsion and speed changes allow human and nonhuman animals to quickly detect animate beings. In the current eye-tracking study, we examined whether dogs' (Canis familiaris) pupil size was influenced by such motion cues. In Experiment 1, dogs watched different videos with normal or reversed playback direction showing a human agent releasing an object. The reversed playback gave the impression that the objects were self-propelled. In Experiment 2, dogs watched videos of a rolling ball that either moved at constant or variable speed. We found that the dogs' pupil size only changed significantly over the course of the videos in the conditions with self-propelled (upward) movements (Experiment 1) or variable speed (Experiment 2). Our findings suggest that dogs orient toward self-propelled stimuli that move at variable speed, which might contribute to their detection of animate beings. |
Chiara Visentin; Chiara Valzolgher; Matteo Pellegatti; Paola Potente; Francesco Pavani; Nicola Prodi A comparison of simultaneously-obtained measures of listening effort: Pupil dilation, verbal response time and self-rating Journal Article In: International Journal of Audiology, vol. 61, no. 7, pp. 561–573, 2022. @article{Visentin2022,Objective: The aim of this study was to assess to what extent simultaneously-obtained measures of listening effort (task-evoked pupil dilation, verbal response time [RT], and self-rating) could be sensitive to auditory and cognitive manipulations in a speech perception task. The study also aimed to explore the possible relationship between RT and pupil dilation. Design: A within-group design was adopted. All participants were administered the Matrix Sentence Test in 12 conditions (signal-to-noise ratios [SNR] of −3, −6, −9 dB; attentional resources focussed vs divided; spatial priors present vs absent). Study sample: Twenty-four normal-hearing adults, 20–41 years old (M = 23.5), were recruited in the study. Results: A significant effect of the SNR was found for all measures. However, pupil dilation discriminated only partially between the SNRs. Neither of the cognitive manipulations were effective in modulating the measures. No relationship emerged between pupil dilation, RT and self-ratings. Conclusions: RT, pupil dilation, and self-ratings can be obtained simultaneously when administering speech perception tasks, even though some limitations remain related to the absence of a retention period after the listening phase. The sensitivity of the three measures to changes in the auditory environment differs. RTs and self-ratings proved most sensitive to changes in SNR. |
Saúl Villameriel; Brendan Costello; Marcel Giezen; Manuel Carreiras Cross-modal and cross-language activation in bilinguals reveals lexical competition even when words or signs are unheard or unseen Journal Article In: PNAS, vol. 119, no. 36, pp. 1–9, 2022. @article{Villameriel2022,We exploit the phenomenon of cross-modal, cross-language activation to examine the dynamics of language processing. Previous within-language work showed that seeing a sign coactivates phonologically related signs, just as hearing a spoken word coactivates phonologically related words. In this study, we conducted a series of eye-tracking experiments using the visual world paradigm to investigate the time course of cross-language coactivation in hearing bimodal bilinguals (Spanish–Spanish Sign Language) and unimodal bilinguals (Spanish/Basque). The aim was to gauge whether (and how) seeing a sign could coactivate words and, conversely, how hearing a word could coactivate signs and how such cross-language coactivation patterns differ from within-language coactivation. The results revealed cross-language, cross-modal activation in both directions. Furthermore, comparison with previous findings of within-language lexical coactivation for spoken and signed language showed how the impact of temporal structure changes in different modalities. Spoken word activation follows the temporal structure of that word only when the word itself is heard; for signs, the temporal structure of the sign does not govern the time course of lexical access (location coactivation precedes handshape coactivation)—even when the sign is seen. We provide evidence that, instead, this pattern of activation is motivated by how common in the lexicon the sublexical units of the signs are. These results reveal the interaction between the perceptual properties of the explicit signal and structural linguistic properties. Examining languages across modalities illustrates how this interaction impacts language processing. |
Laura Vilkaitė-Lozdienė Do different morphological forms of collocations show comparable processing facilitation? Journal Article In: Journal of Experimental Psychology: Learning, Memory, and Cognition, vol. 48, no. 9, pp. 1328–1347, 2022. @article{VilkaiteLozdiene2022,There are numerous studies showing processing advantages for collocations, but none of them so far takes into account the fact that the morphological form of a collocation varies to fit the context. Questions whether collocations retain their processing advantage when their morphological form changes and how or if different morphological forms of the same collocation are related in the mental lexicon have remained unanswered. The present study starts addressing these questions. The article reports an eye-tracking experiment during which 37 native speakers of Lithuanian (a morphologically complex language) read 10 short stories with embedded verb + object collocations in three different morphological forms (infinitive + accusative, past tense third person + accusative, and passive attributive participle + nominative) as well as control phrases (60 target items per participant). Mixed-effects analysis showed that collocations in all three morphological forms were processed with comparable facilitation. The study also analyzed whether the phrasal form frequency of the specific morphological form or the base frequency of that collocation works better at predicting reading behavior. The results show no clear advantage of one or the other. Potential reasons for this finding are discussed. |
Manuel Vidal; Françoise Vitu In: PLoS ONE, vol. 17, no. 4, pp. 1–30, 2022. @article{Vidal2022,Throughout the day, humans react to multisensory events conveying both visual and auditory signals by rapidly reorienting their gaze. Several studies showed that sounds can impact the latency of visually guided saccades depending on when and where they are delivered. We found that unlocalized beeps delivered near the onset time of a visual target reduce latencies, more for early beeps and less for late beeps, however, this modulation is far weaker than for perceptual temporal judgments. Here we tested our previous assumption that beeps shift the perceived timing of target onset and result in two competing effects on saccade latencies: a multisensory modulation in line with the expected perceptual effect and an illusory gap/overlap effect, resulting from target appearance being perceived later/closer in time than fixation offset and shortening/lengthening saccade latencies. Gap/overlap effects involve an oculomotor component associated with neuronal activity in the superior colliculus (SC), a multisensory subcortical structure devoted to sensory-motor transformation. We therefore predicted that the interfering illusory gap/overlap effect would be weaker for manual responses, which involve distinct multisensory areas. In three experiments we manipulated the delay between target onset and an irrelevant auditory beep (stimulus onset asynchrony; SOA) and between target onset and fixation offset (real gap/overlap). Targets appeared left/right of fixation and participants were instructed to make quick saccades or button presses towards the targets. Adding a real overlap/gap (50% of SOA) compensated for the illusory gap/overlap by increasing the beep-related modulation of saccade latencies across the entire SOA range, whereas it barely affected manual responses. However, although auditory and gap/overlap effects modulated saccade latencies in similar ways, these were additive and could saturate, suggesting that they reflect independent mechanisms. Therefore, multisensory temporal binding affects perception and oculomotor control differently, likely due to the implication of the SC in saccade programming and multisensory integration. |
Jason E. Vice; Mandy K. Biles; Marcello Maniglia; Kristina M. Visscher Oculomotor changes following learned use of an eccentric retinal locus Journal Article In: Vision Research, vol. 201, pp. 1–9, 2022. @article{Vice2022,People with bilateral central vision loss sometimes develop a new point of oculomotor reference called a preferred retinal locus (PRL) that is used for fixating and planning saccadic eye movements. How individuals develop and learn to effectively use a PRL is still debated; in particular, the time course of learning to plan saccades using a PRL and learning to stabilize peripheral fixation at the desired location. Here we address knowledge limitations through research describing how eye movements change as a person learns to adopt an eccentric retinal locus. Using a gaze-contingent, eye tracking-guided paradigm to simulate central vision loss, 40 participants developed a PRL by engaging in an oculomotor and visual recognition task. After 12 training sessions, significant improvements were observed in six eye movement metrics addressing different aspects involved in learning to use a PRL: first saccade landing dispersion, saccadic re-referencing, saccadic precision, saccadic latency, percentage of useful trials, and fixation stability. Importantly, our analyses allowed separate examination of the stability of target fixation separately from the dispersion and precision of the landing location of saccades. These measures explained 50% of the across-subject variance in accuracy. Fixation stability and saccadic precision showed a strong, positive correlation. Although there was no statistically significant difference in rate of learning, individuals did tend to learn saccadic precision faster than fixation stability. Saccadic precision was also more associated with accuracy than fixation stability for the behavioral task. This suggests effective intervention strategies in low vision should address both fixation stability and saccadic precision. |
Simone Vespa; Lars Stumpp; Giulia Liberati; Jean Delbeke; Antoine Nonclercq; André Mouraux; Riëm El Tahry Characterization of vagus nerve stimulation-induced pupillary responses in epileptic patients Journal Article In: Brain Stimulation, vol. 15, pp. 1498–1507, 2022. @article{Vespa2022,Background: Modulation of the locus coeruleus (LC)-noradrenergic system is a key mechanism of vagus nerve stimulation (VNS). Activation of the LC produces pupil dilation, and the VNS-induced change in pupil diameter was demonstrated in animals as a possible dose-dependent biomarker for treatment titration. Objective: This study aimed to characterize VNS-induced pupillary responses in epileptic patients. Methods: Pupil diameter was recorded in ten epileptic patients upon four stimulation conditions: three graded levels of VNS intensity and a somatosensory control stimulation (cutaneous electrical stimulation over the left clavicle). For each block, the patients rated the intensity of stimulation on a numerical scale. We extracted the latency of the peak pupil dilation and the magnitude of the early (0e2.5 s) and late components (2.5e5 s) of the pupil dilation response (PDR). Results: VNS elicited a peak dilation with longer latency compared to the control condition (p ¼ 0.043). The magnitude of the early PDR was significantly correlated with the intensity of perception (p ¼ 0.046), whereas the late PDR was not (p ¼ 0.19). There was a significant main effect of the VNS level of intensity on the magnitude of the late PDR (p ¼ 0.01) but not on the early PDR (p ¼ 0.2). The relationship between late PDR magnitude and VNS intensity was best fit by a Gaussian model (inverted-U). Conclusions: The late component of the PDR might reflect specific dose-dependent effects of VNS, as compared to control somatosensory stimulation. The inverted-U relationship of late PDR with VNS in- tensity might indicate the engagement of antagonist central mechanisms at high stimulation intensities. |
Preeti Verghese; Saeideh Ghahghaei; Zachary Lively Mapping residual stereopsis in macular degeneration Journal Article In: Journal of Vision, vol. 22, no. 13, pp. 1–13, 2022. @article{Verghese2022,Individuals with macular degeneration typically lose vision in the central region of one or both eyes. A binocular scotoma occurs when vision loss occurs in overlapping locations in both eyes, but stereopsis is impacted even in the non-overlapping region wherever the visual field in either eye is affected. We used a novel stereoperimetry protocol to measure local stereopsis across the visual field (up to 25° eccentricity) to determine how locations with functional stereopsis relate to the scotomata in the two eyes. Participants included those with monocular or binocular scotomata and age-matched controls with healthy vision. Targets (with or without depth information) were presented on a random dot background. Depth targets had true binocular disparity of 20' (crossed), whereas non-depth targets were defined by monocular cues such as contrast and dot density. Participants reported target location and whether it was in depth or flat. Local depth sensitivity (d') estimates were then combined to generate a stereopsis map. This stereopsis map was compared to the union of the monocular microperimetry estimates that mapped out the functional extent of the scotoma in each eye. The "union" prediction aligned with residual stereopsis, showing impaired stereopsis within this region and residual stereopsis outside this region. Importantly, the stereoblind region was typically more extensive than the binocular scotoma defined by the intersection (overlap) of the scotomata. This explains why individuals may have intact binocular visual fields but be severely compromised in tasks of daily living that benefit from stereopsis, such as eye-hand coordination and navigation. |
Valentina Vencato; Mark Harwood; Laurent Madelain Saccadic initiation biased by fixational activity Journal Article In: Vision Research, vol. 201, pp. 1–15, 2022. @article{Vencato2022,Both the gap and overlap paradigm may reveal the interaction between fixating and moving the eyes, but the effects of the overlap paradigm have not been fully characterized yet. Here we present a series of experiments probing how an overlap paradigm, combined with the manipulation of stimuli durations, saliency and transient changes might modulate saccadic reaction time distributions. We recorded saccadic reaction time in four participants in six experiments in which a saccade-target appeared at a pseudo-random amplitude after a fixation period. First, we parametrically manipulated the duration of the overlap using a range of intervals (from 0 to 200 ms). In a second experiment we probed the interaction of various foreperiod intervals (i.e. the duration of the fixation period prior to saccade-target onset) and overlap using two overlap intervals (20 or 140 ms). In two additional experiments we manipulated either the stimuli sizes or their contrast ratio in overlap paradigms (20 or 140 ms). Lastly, we introduced a visual transient during the overlap interval via two manipulations (both with a range of SOA): either a distractor ring appeared around the fixation-target, or a dynamic random noise patch replaced the fixation-target. Results show reliable modifications in the latency distributions depending on the overlap interval as well as idiosyncratic differences. Additional experimental manipulations also affected the latency distributions revealing strong interacting inhibitory processes. We conclude that the effects of overlap intervals may combine with the influence of other stimuli properties affecting decision process. |
Aaron Veldre; Roslyn Wong; Sally Andrews Predictability effects and parafoveal processing in older readers Journal Article In: Psychology and Aging, vol. 37, no. 2, pp. 222–238, 2022. @article{Veldre2022a,Normative aging is accompanied by visual and cognitive changes that impact the systems that are critical for fluent reading. The patterns of eye movements during reading displayed by older adults have been characterized as demonstrating a trade-off between longer forward saccades and more word skipping versus higher rates of regressions back to previously read text. This pattern is assumed to reflect older readers' reliance on top-down contextual information to compensate for reduced uptake of parafoveal information from yet-to-be fixated words. However, the empirical evidence for these assumptions is equivocal. This study investigated the depth of older readers' parafoveal processing as indexed by sensitivity to the contextual plausibility of parafoveal words in both neutral and highly constraining sentence contexts. The eye movements of 65 cognitively intact older adults (61–87 years) were compared with data previously collected from young adults in two sentence reading experiments in which critical target words were replaced by valid, plausible, related, or implausible previews until the reader fixated on the target word location. Older and younger adults showed equivalent plausibility preview benefits on first-pass reading measures of both predictable and unpredictable words. However, older readers did not show the benefit of preview orthographic relatedness that was observed in young adults and showed significantly attenuated preview validity effects. Taken together, the data suggest that older readers are specifically impaired in the integration of parafoveal and foveal information but do not show deficits in the depth of parafoveal processing. The implications for understanding the effects of aging on reading are discussed. |
Aaron Veldre; Erik D. Reichle; Lili Yu; Sally Andrews Understanding the visual constraints on lexical processing: New empirical and simulation results Journal Article In: Journal of Experimental Psychology: General, pp. 1–30, 2022. @article{Veldre2022,Word identification is slower and less accurate outside central vision, but the precise relationship between retinal eccentricity and lexical processing is not well specified by models of either word identification or reading. In a seminal eye-movement study, Rayner and Morrison (1981) found that participants made remarkably accurate naming and lexical-decision responses to words displayed more than 3 degrees from the center of vision—even under conditions requiring fixed gaze. However, the validity of these findings is challenged by a range of methodological limitations. We report a series of gaze-contingent lexical-decision and naming experiments that replicate and extend Rayner and Morrison's study to provide a more accurate estimate of how visual constraints delimit lexical processing. Simulations were conducted using the E-Z Reader model (Reichle et al., 2012) to assess the implications for understanding eye-movement control during reading. Augmenting the model's assumptions about the impact of both eccentricity and visual crowding on the rate of lexical processing provided good fits to the observed data without impairing the model's ability to simulate benchmark eye-movement effects. The findings are discussed with a view toward the development of a complete model of reading. |
Juan Vela-Candelas; Natàlia Català; Josep Demestre Effects of world knowledge on the prediction of upcoming verbs: An eye-tracking study Journal Article In: Journal of Psycholinguistic Research, vol. 51, no. 6, pp. 1335–1345, 2022. @article{VelaCandelas2022,Some theories of sentence processing make a distinction between two kinds of meaning: a linguistic meaning encoded at the lexicon (i.e., selectional restrictions), and an extralinguistic knowledge derived from our everyday experiences (i.e., world knowledge). According to such theories, the former meaning is privileged over the latter in terms of the time-course of its access and influence during on-line language comprehension. The present study aims to examine whether world knowledge anomalies (that do not violate selectional restrictions) are rapidly detected during online sentence processing. In an eye-tracking experiment, we used materials in which the likelihood of a specific verb (entrevistar or secuestrar, the Spanish translations for to interview and to kidnap) depended on the agent of the event (periodista or terrorista, the Spanish translations for journalist and terrorist). The results showed an effect of typicality in regression path duration and total reading times at both the verb region and the spillover region, thus providing evidence that world knowledge is rapidly accessed and used during on-line sentence comprehension. |
Monica Vanoncini; Natalie Boll-Avetisyan; Birgit Elsner; Stefanie Hoehl; Ezgi Kayhan The role of mother-infant emotional synchrony in speech processing in 9-month-old infants Journal Article In: Infant Behavior and Development, vol. 69, pp. 1–13, 2022. @article{Vanoncini2022,Rhythmicity characterizes both interpersonal synchrony and spoken language. Emotions and language are forms of interpersonal communication, which interact with each other throughout development. We investigated whether and how emotional synchrony between mothers and their 9-month-old infants relates to infants' word segmentation as an early marker of language development. Twenty-six 9-month-old infants and their German-speaking mothers took part in the study. To measure emotional synchrony, we coded positive, neutral and negative emotional expressions of the mothers and their infants during a free play session. We then calculated the degree to which the mothers' and their infants' matching emotional expressions followed a predictable pattern. To measure word segmentation, we familiarized infants with auditory text passages and tested how long they looked at the screen while listening to familiar versus novel words. We found that higher levels of predictability (i.e. low entropy) during mother-infant interaction is associated with infants' word segmentation performance. These findings suggest that individual differences in word segmentation relate to the complexity and predictability of emotional expressions during mother-infant interactions. |
Sietske Viersen; Athanassios Protopapas; George K. Georgiou; Rauno Parrila; Laoura Ziaka; Peter F. Jong Lexicality effects on orthographic learning in beginning and advanced readers of Dutch: An eye-tracking study Journal Article In: Quarterly Journal of Experimental Psychology, vol. 75, no. 6, pp. 1135–1154, 2022. @article{Viersen2022,Orthographic learning is the topic of many recent studies about reading, but much is still unknown about conditions that affect orthographic learning and their influence on reading fluency development over time. This study investigated lexicality effects on orthographic learning in beginning and relatively advanced readers of Dutch. Eye movements of 131 children in Grades 2 and 5 were monitored during an orthographic learning task. Children read sentences containing pseudowords or low-frequency real words that varied in number of exposures. We examined both offline learning outcomes (i.e., orthographic choice and spelling dictation) of target items and online gaze durations on target words. The results showed general effects of exposure, lexicality, and reading-skill level. Also, a two-way interaction was found between the number of exposures and lexicality when detailed orthographic representations were required, consistent with a larger overall effect of exposure on learning the spellings of pseudowords. Moreover, lexicality and reading-skill level were found to affect the learning rate across exposures based on a decrease in gaze durations, indicating a larger learning effect for pseudowords in Grade 5 children. Yet, further interactions between exposure and reading-skill level were not present, indicating largely similar learning curves for beginning and advanced readers. We concluded that the reading system of more advanced readers may cope somewhat better with words varying in lexicality, but is not more efficient than that of beginning readers in building up orthographic knowledge of specific words across repeated exposures. |
Elle Heusden; Wieske Zoest; Mieke Donk; Christian N. L. Olivers An attentional limbo: Saccades become momentarily non-selective in between saliency-driven and relevance-driven selection Journal Article In: Psychonomic Bulletin & Review, vol. 29, pp. 1327–1337, 2022. @article{Heusden2022,Human vision involves selectively directing the eyes to potential objects of interest. According to most prominent theories, selection is the quantal outcome of an ongoing competition between saliency-driven signals on the one hand, and relevance-driven signals on the other, with both types of signals continuously and concurrently projecting onto a common priority map. Here, we challenge this view. We asked participants to make a speeded eye movement towards a target orientation, which was presented together with a non-target of opposing tilt. In addition to the difference in relevance, the target and non-target also differed in saliency, with the target being either more or less salient than the non-target. We demonstrate that saliency- and relevance-driven eye movements have highly idiosyncratic temporal profiles, with saliency-driven eye movements occurring rapidly after display onset while relevance-driven eye movements occur only later. Remarkably, these types of eye movements can be fully separated in time: We find that around 250 ms after display onset, eye movements are no longer driven by saliency differences between potential targets, but also not yet driven by relevance information, resulting in a period of non-selectivity, which we refer to as the attentional limbo. Binomial modeling further confirmed that visual selection is not necessarily the outcome of a direct battle between saliency- and relevance-driven signals. Instead, selection reflects the dynamic changes in the underlying saliency- and relevance-driven processes themselves, and the time at which an action is initiated then determines which of the two will emerge as the driving force of behavior. |
Mats W. J. Es; Tom R. Marshall; Eelke Spaak; Ole Jensen; Jan-Mathijs Schoffelen Phasic modulation of visual representations during sustained attention Journal Article In: European Journal of Neuroscience, vol. 55, no. 11-12, pp. 3191–3208, 2022. @article{Es2022,Sustained attention has long been thought to benefit perception in a continuous fashion, but recent evidence suggests that it affects perception in a discrete, rhythmic way. Periodic fluctuations in behavioral performance over time, and modulations of behavioral performance by the phase of spontaneous oscillatory brain activity point to an attentional sampling rate in the theta or alpha frequency range. We investigated whether such discrete sampling by attention is reflected in periodic fluctuations in the decodability of visual stimulus orientation from magnetoencephalographic (MEG) brain signals. In this exploratory study, human subjects attended one of the two grating stimuli, while MEG was being recorded. We assessed the strength of the visual representation of the attended stimulus using a support vector machine (SVM) to decode the orientation of the grating (clockwise vs. counterclockwise) from the MEG signal. We tested whether decoder performance depended on the theta/alpha phase of local brain activity. While the phase of ongoing activity in the visual cortex did not modulate decoding performance, theta/alpha phase of activity in the frontal eye fields and parietal cortex, contralateral to the attended stimulus did modulate decoding performance. These findings suggest that phasic modulations of visual stimulus representations in the brain are caused by frequency-specific top-down activity in the frontoparietal attention network, though the behavioral relevance of these effects could not be established. |
Olof J. Werf; Sanne Ten Oever; Teresa Schuhmann; Alexander T. Sack No evidence of rhythmic visuospatial attention at cued locations in a spatial cuing paradigm, regardless of their behavioural relevance Journal Article In: European Journal of Neuroscience, vol. 55, no. 11-12, pp. 3100–3116, 2022. @article{Werf2022,Recent evidence suggests that visuospatial attentional performance is not stable over time but fluctuates in a rhythmic fashion. These attentional rhythms allow for sampling of different visuospatial locations in each cycle of this rhythm. However, it is still unclear in which paradigmatic circumstances rhythmic attention becomes evident. First, it is unclear at what spatial locations rhythmic attention occurs. Second, it is unclear how the behavioural relevance of each spatial location determines the rhythmic sampling patterns. Here, we aim to elucidate these two issues. Firstly, we aim to find evidence of rhythmic attention at the predicted (i.e. cued) location under moderately informative predictor value, replicating earlier studies. Secondly, we hypothesise that rhythmic attentional sampling behaviour will be affected by the behavioural relevance of the sampled location, ranging from non-informative to fully informative. To these aims, we used a modified Egly-Driver task with three conditions: a fully informative cue, a moderately informative cue (replication condition), and a non-informative cue. We did not find evidence of rhythmic sampling at cued locations, failing to replicate earlier studies. Nor did we find differences in rhythmic sampling under different predictive values of the cue. The current data does not allow for robust conclusions regarding the non-cued locations due to the absence of a priori hypotheses. Post-hoc explorative data analyses, however, clearly indicate that attention samples non-cued locations in a theta-rhythmic manner, specifically when the cued location bears higher behavioural relevance than the non-cued locations. |
Susanne M. Veen; Alexander Stamenkovic; James S. Thomas; Peter E. Pidcoe Skill-related adaptive modifications of gaze stabilization in elite and non-elite athletes Journal Article In: Frontiers in Sports and Active Living, vol. 4, pp. 1–7, 2022. @article{Veen2022,The vestibular ocular reflex (VOR) provides gaze stability during head movements by driving eye movements in a direction opposing head motion. Although vestibular-based rehabilitation strategies are available, it is still unclear whether VOR can be modulated by training. By examining adaptations in gaze stabilization mechanisms in a population with distinct visuomotor requirements for task success (i.e., gymnasts), this study was designed to determine whether experience level (as a proxy of training potential) was associated with gaze stabilization modifications during fixed target (VOR promoting) and fixed-to-head-movement target (VOR suppressing) tasks. Thirteen gymnasts of different skill levels participated in VOR and VOR suppression tasks. The gain between head and eye movements was calculated and compared between skill levels using an analysis of covariance. Across experience levels, there was a similar degradation in VOR gain away from −1 at higher movement speeds. However, during the suppression tasks, more experienced participants were able to maintain VOR gain closer to 0 across movement speeds, whereas novice participants showed greater variability in task execution regardless of movement speed. Changes in adaptive modifications to gaze stability associated with experience level suggest that the mechanisms impacting gaze stabilization can be manipulated through training. |
Ruud L. Brink; Keno Hagena; Niklas Wilming; Peter R. Murphy; Christian Büchel; Tobias H. Donner Flexible sensory-motor mapping rules manifest in correlated variability of stimulus and action codes across the brain Journal Article In: Neuron, vol. 111, pp. 1–14, 2022. @article{Brink2022,Humans and non-human primates can flexibly switch between different arbitrary mappings from sensation to action to solve a cognitive task. It has remained unknown how the brain implements such flexible sensory-motor mapping rules. Here, we uncovered a dynamic reconfiguration of task-specific correlated variability between sensory and motor brain regions. Human participants switched between two rules for reporting visual orientation judgments during fMRI recordings. Rule switches were either signaled explicitly or inferred by the participants from ambiguous cues. We used behavioral modeling to reconstruct the time course of their belief about the active rule. In both contexts, the patterns of correlations between ongoing fluctuations in stimulus- and action-selective activity across visual- and action-related brain regions tracked participants' belief about the active rule. The rule-specific correlation patterns broke down around the time of behavioral errors. We conclude that internal beliefs about task state are instantiated in brain-wide, selective patterns of correlated variability. |
Nils S. Berg; Nikki A. Lammers; Anouk R. Smits; Selma Lugtmeijer; Yair Pinto; Edward H. F. De Haan Mid-range visual functions in relation to higher-order visual functions after stroke Journal Article In: Journal of Clinical and Experimental Neuropsychology, vol. 44, no. 8, pp. 580–591, 2022. @article{Berg2022a,Introduction: We aimed to investigate whether associations between deficits in “mid-range” visual functions and deficits in higher-order visual cognitive functions in stroke patients are more in line with a hierarchical, two-pathway model of the visual brain, or with a patchwork model, which assumes a parallel organization with many processing routes and cross-talk. Methods: A group of 182 ischemic stroke patients was assessed with a new diagnostic set-up for the investigation of a comprehensive range of visuosensory mid-range functions: color, shape, location, orientation, correlated motion, contrast and texture. With logistic regression analyses we investigated the predictive value of these mid-range functions for deficits in visuoconstruction (Copy of the Rey-Complex Figure Test), visual emotion recognition (Ekman 60 Faces Test of the FEEST) and visual memory (computerized Doors-test). Results: Results showed that performance on most mid-range visual tasks could not predict performance on higher-order visual cognitive tasks. Correlations were low to weak. Impaired visuoconstruction and visual memory were only modestly predicted by a worse location perception. Impaired emotion perception was modestly predicted by a worse orientation perception. In addition, double dissociations were found: there were patients with selective deficits in mid-range visual functions without higher-order visual deficits and vice versa. Conclusions: Our findings are not in line with the hierarchical, two-pathway model. Instead, the findings are more in line with alternative “patchwork” models, arguing for a parallel organization with many processing routes and cross-talk. However, future studies are needed to test these alternative models. |
Raphael Vallat; Başak Türker; Alain Nicolas; Perrine Ruby High dream recall frequency is associated with increased creativity and default mode network connectivity Journal Article In: Nature and Science of Sleep, vol. 14, pp. 265–275, 2022. @article{Vallat2022,Introduction: Several results suggest that the frequency of dream recall is positively correlated with personality traits such as creativity and openness to experience. In addition, neuroimaging results have evidenced different neurophysiological profiles in high dream recallers (HR) and low dream recallers (LR) during both sleep and wakefulness, specifically within regions of the default mode network (DMN). These findings are consistent with the emerging view that dreaming and mind wandering pertain to the same family of spontaneous mental processes, subserved by the DMN. Methods: To further test this hypothesis, we measured the DMN functional connectivity during resting wakefulness, together with personality and cognitive abilities (including creativity) in 28 HR and 27 LR. Results: As expected, HR demonstrated a greater DMN connectivity than LR, higher scores of creativity, and no significant difference in memory abilities. However, there was no significant correlation between creativity scores and DMN connectivity. Discussion: These results further demonstrate that there are trait neurophysiological and psychological differences between individuals who frequently recall their dreams and those who do not. They support the forebrain and the DMN hypotheses of dreaming and leave open the possibility that increased activity in the DMN promotes creative-thinking during both wakefulness and sleep. Further work is needed to test whether activity in the DMN is causally associated with creative-thinking. |
Cem Uran; Alina Peter; Andreea Lazar; William Barnes; Johanna Klon-Lipok; Katharine A. Shapcott; Rasmus Roese; Pascal Fries; Wolf Singer; Martin Vinck Predictive coding of natural images by V1 firing rates and rhythmic synchronization Journal Article In: Neuron, vol. 110, no. 7, pp. 1240–1257, 2022. @article{Uran2022,Predictive coding is an important candidate theory of self-supervised learning in the brain. Its central idea is that sensory responses result from comparisons between bottom-up inputs and contextual predictions, a process in which rates and synchronization may play distinct roles. We recorded from awake macaque V1 and developed a technique to quantify stimulus predictability for natural images based on self-supervised, generative neural networks. We find that neuronal firing rates were mainly modulated by the contextual predictability of higher-order image features, which correlated strongly with human perceptual similarity judgments. By contrast, V1 gamma ($gamma$)-synchronization increased monotonically with the contextual predictability of low-level image features and emerged exclusively for larger stimuli. Consequently, $gamma$-synchronization was induced by natural images that are highly compressible and low-dimensional. Natural stimuli with low predictability induced prominent, late-onset beta ($beta$)-synchronization, likely reflecting cortical feedback. Our findings reveal distinct roles of synchronization and firing rates in the predictive coding of natural images. |
Anne E. Urai; Tobias H. Donner Persistent activity in human parietal cortex mediates perceptual choice repetition bias Journal Article In: Nature Communications, vol. 13, no. 1, pp. 1–15, 2022. @article{Urai2022,Humans and other animals tend to repeat or alternate their previous choices, even when judging sensory stimuli presented in a random sequence. It is unclear if and how sensory, associative, and motor cortical circuits produce these idiosyncratic behavioral biases. Here, we combined behavioral modeling of a visual perceptual decision with magnetoencephalographic (MEG) analyses of neural dynamics, across multiple regions of the human cerebral cortex. We identified distinct history-dependent neural signals in motor and posterior parietal cortex. Gamma-band activity in parietal cortex tracked previous choices in a sustained fashion, and biased evidence accumulation toward choice repetition; sustained beta-band activity in motor cortex inversely reflected the previous motor action, and biased the accumulation starting point toward alternation. The parietal, not motor, signal mediated the impact of previous on current choice and reflected individual differences in choice repetition. In sum, parietal cortical signals seem to play a key role in shaping choice sequences. |
Rob Udale; Moc Tram Tran; Sanjay Manohar; Masud Husain Dynamic in-flight shifts of working memory resources across saccades Journal Article In: Journal of Experimental Psychology: Human Perception and Performance, vol. 48, no. 1, pp. 21–36, 2022. @article{Udale2022,Little is known about how memory resources are allocated in natural vision across sequential eye movements and fixations, as people actively extract information from the visual environment. Here, we used gaze-contingent eye tracking to examine how such resources are dynamically reallocated from old to new information entering working memory. As participants looked sequentially at items, we interrupted the process at different times by extinguishing the display as a saccade was initiated. After a brief interval, participants were probed on one of the items that had been presented. Paradoxically, across all experiments, the final (unfixated) saccade target was recalled more precisely when more items had previously been fixated, that is, with longer rather than shorter saccade sequences. This result is difficult to explain on current models of working memory because recall error, even for the final item, is typically higher as memory load increases. The findings could however be accounted for by a model that describes how resources are dynamically reallocated on a moment-by-moment basis. During each saccade, the target is encoded by consuming a proportion of currently available resources from a limited working memory, as well as by reallocating resources away from previously encoded items. These findings reveal how working memory resources are shifted across memoranda in active vision. |
James Turner Analysing the relationship between L2 production and different stages of L2 processing: Eye-tracking and acoustic evidence for a novel contrast Journal Article In: Journal of Phonetics, vol. 91, pp. 1–15, 2022. @article{Turner2022,This study analyses the relationship between native English speakers' perception and production of the novel French /y/–/u/ contrast. Acoustic data were extracted from the learners' production of French minimal pairs contrasting these French vowels and compared with their processing of the same items in a Visual World eye-tracking task. Results reveal that the vowel most acoustically similar to the learners' native English /u/ vowel, French /y/, is both easier to identify at early processing stages and more acoustically similar to a native French control group in production, indicating a perception-production relationship. Furthermore, analyses of individual variation reveal that the learners who process both /y/ and /u/ more successfully at later processing stages are also more likely to mark a greater distinction between these phonemes in production. Together, these results indicate a relationship between L2 processing and L2 production at multiple levels. Implications for current L2 speech models are discussed. |
Jung-Yueh Tu; Yu-Fu Chien The role of categorical perception and acoustic details in the processing of Mandarin tonal alternations in contexts: An eye-tracking study Journal Article In: Frontiers in Psychology, vol. 12, pp. 1–14, 2022. @article{Tu2022,This study investigated the perception of Mandarin tonal alternations in disyllabic words. In Mandarin, a low-dipping Tone3 is converted to a high-rising Tone2 when followed by another Tone3, known as third tone sandhi. Although previous studies showed statistically significant differences in F0 between a high-rising Sandhi-Tone3 (T3) and a Tone2, native Mandarin listeners failed to correctly categorize these two tones in perception tasks. The current study utilized the visual-world paradigm in eye-tracking to further examine whether acoustic details in lexical tone aid lexical access in Mandarin. Results showed that Mandarin listeners tend to process Tone2 as Tone2 whereas they tend to first process Sandhi-T3 as both Tone3 and Tone2, then later detect the acoustic differences between the two tones revealed by the sandhi context, and finally activate the target word during lexical access. The eye-tracking results suggest that subtle acoustic details of F0 may facilitate lexical access in automatic fashion in a tone language. |
Monika Tschense; Sebastian Wallot Using measures of reading time regularity (RTR) to quantify eye movement dynamics, and how they are shaped by linguistic information Journal Article In: Journal of Vision, vol. 22, no. 6, pp. 1–21, 2022. @article{Tschense2022,In this article, we present the concept of reading time regularity (RTR) as a measure to capture reading process dynamics. The first study is concerned with examining one of the assumptions of RTR, namely, that process measures of reading, such as eye movement fluctuations and fixation durations, exhibit higher regularity when contingent on sequentially structured information, such as texts. To test this, eye movements of 26 German native speakers were recorded during reading-unrelated and reading-related tasks. To analyze the data, we used recurrence quantification analysis and sample entropy analysis to quantify the degree of temporal structure in time series of gaze steps and fixation durations. The results showed that eye movements become more regular in reading compared to nonreading conditions. These effects were most prominent when calculated on the basis of gaze step data. In a second study, eye movements of 27 native speakers of German were recorded for five conditions with increasing linguistic information. The results replicate the findings of the first study, verifying that these effects are not due to mere differences in task instructions between conditions. Implications for the concept of RTR and for future studies using these metrics in reading research are discussed |
Tawny Tsang; Adam J. Naples; Erin C. Barney; Minhang Xie; Raphael Bernier; Geraldine Dawson; James Dziura; Susan Faja; Shafali Spurling Jeste; James C. McPartland; Charles A. Nelson; Michael Murias; Helen Seow; Catherine Sugar; Sara J. Webb; Frederick Shic; Scott P. Johnson Attention allocation during exploration of visual arrays in ASD: Results from the ABC-CT feasibility study Journal Article In: Journal of Autism and Developmental Disorders, pp. 1–10, 2022. @article{Tsang2022,Visual exploration paradigms involving object arrays have been used to examine salience of social stimuli such as faces in ASD. Recent work suggests performance on these paradigms may associate with clinical features of ASD. We evaluate metrics from a visual exploration paradigm in 4-to-11-year-old children with ASD (n = 23; 18 males) and typical development (TD; n = 23; 13 males). Presented with arrays containing faces and nonsocial stimuli, children with ASD looked less at (p = 0.002) and showed fewer fixations to (p = 0.022) faces than TD children, and spent less time looking at each object on average (p = 0.004). Attention to the screen and faces correlated positively with social and cognitive skills in the ASD group (ps <.05). This work furthers our understanding of objective measures of visual exploration in ASD and its potential for quantifying features of ASD. |
Audrey Trouilloud; Pauline Rossel; Cynthia Faurite; Alexia Roux-Sibilon; Louise Kauffmann; Carole Peyrin Influence of physical features from peripheral vision on scene categorization in central vision Journal Article In: Visual Cognition, vol. 30, no. 6, pp. 425–442, 2022. @article{Trouilloud2022,The spatial resolution of the human visual field decreases considerably from the center to the periphery. However, several studies have highlighted the importance of peripheral vision for scene categorization. In Experiment 1, we investigated if peripheral vision could influence the scene categorization in central vision. We used photographs of indoor and outdoor scenes from which we extracted a central disk and a peripheral ring. Stimuli were composed of a central disk and a peripheral ring that could be either semantically congruent or incongruent. Participants had to categorize the central disk while ignoring the peripheral ring or the peripheral ring while ignoring the central disk. Results revealed a congruence effect of peripheral vision on central vision, as strong as the reverse. In Experiment 2, we investigated the nature of the physical signal in peripheral vision that influences the categorization in central vision. We used either intact, phase-preserved, or amplitude-preserved peripheral rings. Participants had to categorize the central disk while ignoring the peripheral ring. Results showed that only phase-preserved peripheral rings elicited a congruence effect as strong as the one observed with intact peripheral rings. Information contained in the phase spectrum (spatial configuration of the scene) may be critical in peripheral vision. |
Jeshua Tromp; Sander Nieuwenhuis; Peter Murphy The effects of neural gain on reactive cognitive control Journal Article In: Computational Brain and Behavior, vol. 5, no. 3, pp. 422–433, 2022. @article{Tromp2022,Fluctuations in global neural gain, arising from brainstem arousal systems, have been found to shape attention, learning, and decision-making as well as cortical state. Comparatively, little is known about how fluctuations in neural gain affect cognitive control. In the present study, we examined this question using a combination of behavioral methods, pupillometry, and computational modeling. Simulations of a comprehensive model of the Stroop task incorporating task conflict and both proactive and reactive forms of control indicated that increasing global gain led to an overall speeding of reaction times, increased Stroop interference, and decreased Stroop facilitation. Pupil analyses revealed that the pre-trial pupil derivative (i.e., rate of change), a putative non-invasive index of global gain, showed the same diagnostic relationships with the Stroop-task performance of human participants. An analysis of the internal model dynamics suggested that a gain-related increase in task conflict and corresponding (within-trial) increase in reactive control are vital for understanding this pattern of behavioral results. Indeed, a similar connectionist model without this task-conflict-control loop could not account for the results. Our study suggests that spontaneous fluctuations in neural gain can have a significant impact on reactive cognitive control. |
Sébastien Tremblay; Camille Testard; Ron W. Ditullio; Jeanne Inchauspé; Michael Petrides Neural cognitive signals during spontaneous movements in the macaque Journal Article In: Nature Neuroscience, pp. 1–19, 2022. @article{Tremblay2022,The single neuron basis of cognitive processing in primates has mostly been studied in laboratory settings where movements are severely restricted. It is unclear, therefore, how natural movements might affect neural signatures of cognition in the brain. Moreover, studies in mice indicate that body movements, when measured, account for most of the neural dynamics in the cortex. To examine this issue, we recorded from single neuron ensembles in the prefrontal cortex in moving monkeys performing a cognitive task and characterized eyes, head, and body movements using video tracking. Despite significant trial-to-trial movement variability, single neuron tuning could be precisely measured and decision signals accurately decoded on a single-trial basis. Creating or abolishing spontaneous movements through head restraint and task manipulations had no measurable impact on neural responses. However, encoding models showed that uninstructed movements explained as much neural variance as task variables, with most of them aligned to task events. These results demonstrate that cognitive signals in the cortex are robust to natural movements, but also that unmeasured movements are potential confounds in cognitive neurophysiology experiments. |
Tobiasz Trawinski; Chuanli Zang; Simon P. Liversedge; Yao Ge; Nick Donnelly The time-course of fixations in representational paintings: A cross-cultural study Journal Article In: Psychology of Aesthetics, Creativity, and the Arts, pp. 1–16, 2022. @article{Trawinski2022,British and Chinese participants viewed a set of Western representational paintings (henceforth paintings) for later identification in a yes/no discrimination task. Eye movements were recorded while participants viewed the paintings with each painting split into face, theme of the painting and its context regions of interest (ROIs). British participants performed the discrimination task more accurately than Chinese participants. Eye movement data were first analyzed to confirm reliable individual differences in the proportion of fixations made to ROIs, and second, for evidence of a cross-cultural influence in focus on ROIs over the time-course of viewing. The results confirmed that individual differences in the proportion of fixations made to ROIs were reliable across a subset of paintings for both British and Chinese. In the context of the present study, this finding was a precondition to explore the time-course of fixations across ROIs. With respect to the time-course of fixations across ROIs, Chinese participants focused more on the theme, and less on faces (and vice-versa for British participants), in a period starting around 2 s after the onset of viewing. Earlier in viewing there was evidence that Chinese participants had an increased focus on the context. The results (a) extend the findings reported by Trawiński, Zang, et al. (2021) on the impact of the Other Race Effect on the viewing of paintings; (b) show the time course associated with a more general cross-cultural influence on scene perception (Masuda & Nisbett, 2001). |
Chiara Tortelli; Antonella Pomè; Marco Turi; Roberta Igliozzi; David C. Burr; Paola Binda Contextual information modulates pupil size in autistic children Journal Article In: Frontiers in Neuroscience, vol. 16, pp. 1–10, 2022. @article{Tortelli2022,Recent Bayesian models suggest that perception is more “data-driven” and less dependent on contextual information in autistic individuals than others. However, experimental tests of this hypothesis have given mixed results, possibly due to the lack of objectivity of the self-report methods typically employed. Here we introduce an objective no-report paradigm based on pupillometry to assess the processing of contextual information in autistic children, together with a comparison clinical group. After validating in neurotypical adults a child-friendly pupillometric paradigm, in which we embedded test images within an animation movie that participants watched passively, we compared pupillary response to images of the sun and meaningless control images in children with autism vs. age- and IQ-matched children presenting developmental disorders unrelated to the autistic spectrum. Both clinical groups showed stronger pupillary constriction for the sun images compared with control images, like the neurotypical adults. However, there was no detectable difference between autistic children and the comparison group, despite a significant difference in pupillary light responses, which were enhanced in the autistic group. Our report introduces an objective technique for studying perception in clinical samples and children. The lack of statistically significant group differences in our tests suggests that autistic children and the comparison group do not show large differences in perception of these stimuli. This opens the way to further studies testing contextual processing at other levels of perception. |
Aleksandra Tomić; Jorge R. Valdés Kroff Expecting the unexpected: Code-switching as a facilitatory cue in online sentence processing Journal Article In: Bilingualism: Language and Cognition, vol. 25, no. 1, pp. 81–92, 2022. @article{Tomic2022,Despite its prominent use among bilinguals, psycholinguistic studies reported code-switch processing costs (e.g., Meuter & Allport, 1999). This paradox may partly be due to the focus on the code-switch itself instead of its potential subsequent benefits. Motivated by corpus studies on CS patterns and sociopragmatic functions of CS, we asked whether bilinguals use code-switches as a cue to the lexical characteristics of upcoming speech. We report a visual world study testing whether code-switching facilitates the anticipation of lower-frequency words. Results confirm that US Spanish-English bilinguals (n = 30) use minority (Spanish) to majority (English) language code-switches in real-time language processing as a cue that a less frequent word would ensue, as indexed by increased looks at images representing lower- vs. higher-frequency words in the code-switched condition, prior to the target word onset. These results highlight the need to further integrate sociolinguistic and corpus observations into the experimental study of code-switching. |
Svetlana Toldova; Natalia Slioussar; Anastasia Bonch-Osmolovskaya Discourse complexity in the light of eye‐tracking: A pilot Russian language study Journal Article In: Russian Journal of Linguistics, vol. 26, no. 2, pp. 449–470, 2022. @article{Toldova2022,The paper explores the influence of discourse structure on text complexity. We assume that certain types of discourse units are easier to read than others, due to their explicit discourse structure, which makes their informational input more accessible. As a data source, we use the dataset from the MECO corpus, which contains eye movement data for 12 Russian texts read by 35 native speakers. We demonstrate that the approach relying on element ary discourse units (EDUs) can be felicitously used in the analysis of eye movement data, since fixation patterns on EDUs are similar to those on whole sentences. Our analysis has identified EDU outliers, which show shorter time of first fixation than estimated. We arranged these outliers into several groups associated with different discourse structures. First, these are statements with nominal predicates that set exposition of the text or macroproposition and, following those, EDUs that elaborate on the previous statement and signal the beginning of the narrative. Second, they are EDUs that serve as the middle component of a listing or a group of coordinated clauses or phrases. The final group represents EDUs that are part of an opposition, contrast or comparison. Discourse analysis based on EDUs has never been applied to eye movement data, so our project opens many avenues for further research of complexity of discourse structure. |
Leah N. Tobin; Christopher R. Sears; Kristin M. Von Ranson In: Journal of Consulting and Clinical Psychology, pp. 1–15, 2022. @article{Tobin2022,Objective: This cluster randomized controlled trial evaluated the efficacy of participation in the Body Project—a cognitive-dissonance-based preventive intervention that reduces self-reported body dissatisfaction—for reducing body-dissatisfaction-related attentional biases. We hypothesized that women in a Body Project condition would show a greater reduction in attentional biases to weight-related images and words at postintervention than women in a wait-list control condition. Method: Body-dissatisfied university women (N= 168; Mage = 20.50 ± 3.37 years; 42.0% White; MBMI = 23.08 ± 4.45 kg/m2) were randomly assigned to a Body Project, media psychoeducation (i.e., active control), or wait-list control condition. We assessed attentional biases via eye-gaze tracking and body satisfaction using the Body Shape Questionnaire, at baseline and postintervention. Results: Self-reported outcomes from previous literature were replicated. Compared to wait-list, Body Project participation reduced attention to images of thin models ( ps < .05; ds = .19, .24), but not to weight-related words. Compared to wait-list, the media psychoeducation condition reduced attention to fat-related images and words (ds = .17, .18). Conclusions: This study, which replicates previous self-report findings, is the first to find that two preventive interventions reduced an objective outcome (attentional bias to weight-related images) in body-dissatisfied women. |
Elizabeth L. Tighe; Gal Kaldes; Amani Talwar; Scott A. Crossley; Daphne Greenberg; Stephen Skalicky In: Journal of Learning Disabilities, vol. 56, no. 1, pp. 25–42, 2022. @article{Tighe2022,Comprehension monitoring is a meta-cognitive skill that is defined as the ability to self-evaluate one's comprehension of text. Although it is known that struggling adult readers are poor at monitoring their comprehension, additional research is needed to understand the mechanisms underlying comprehension monitoring and their role in reading comprehension in this population. This study used a comprehension monitoring task with struggling adult readers, which included online eye movements (reread and regression path durations) and an offline verbal protocol (oral explanations of key information). We examined whether eye movements predicted accuracy on the passages' reading comprehension questions, a norm-referenced reading assessment, and an offline verbal protocol after controlling for age and traditional component skills (i.e., decoding, oral language, working memory). Regression path duration uniquely predicted accuracy on the questions; however, decoding and oral vocabulary were the most salient predictors of the norm-referenced reading comprehension measure. Regression path duration also predicted the offline verbal protocol, such that those who exhibited longer regression path duration were also better at explaining key information. These results contribute to the literature regarding struggling adults' reading component skills, eye movement behaviors involved in processing connected text, and future considerations in assessing comprehension monitoring. |
Han Tian; Tao Deng; Hongmei Yan Driving as well as on a sunny day? Predicting driver's fixation in rainy weather conditions via a dual-branch visual model Journal Article In: IEEE/CAA Journal of Automatica Sinica, vol. 9, no. 7, pp. 1335–1338, 2022. @article{Tian2022,Considering the lack of rainy driving datasets and the shortage of investigation on saliency prediction models in rainy conditions, we collected an eye tracking dataset from 30 experienced drivers, called DrFixD (rainy). Based on the multiple drivers' attention allocation dataset, we proposed a new model based on the theory of two cortical pathways to predict the salient regions of drivers in rainy weather conditions. |
William Thyer; Kirsten C. S. Adam; Gisella K. Diaz; Itzel N. Velázquez Sánchez; Edward K. Vogel; Edward Awh Storage in visual working memory recruits a content-independent pointer system Journal Article In: Psychological Science, vol. 33, no. 10, pp. 1680–1694, 2022. @article{Thyer2022,Past work has shown that storage in working memory elicits stimulus-specific neural activity that tracks the stored content. Here, we present evidence for a distinct class of load-sensitive neural activity that indexes items without representing their contents per se. We recorded electroencephalogram (EEG) activity while adult human subjects stored varying numbers of items in visual working memory. Multivariate analysis of the scalp topography of EEG voltage enabled precise tracking of the number of individuated items stored and robustly predicted individual differences in working memory capacity. Critically, this signature of working memory load generalized across variations in both the type and number of visual features stored about each item, suggesting that it tracked the number of individuated memory representations and not the content of those memories. We hypothesize that these findings reflect the operation of a capacity-limited pointer system that supports on-line storage and attentive tracking. |
Sabine Thomassen; Kevin Hartung; Wolfgang Einhäuser; Alexandra Bendixen Low-high-low or high-low-high? Pattern effects on sequential auditory scene analysis Journal Article In: The Journal of the Acoustical Society of America, vol. 152, no. 5, pp. 1–11, 2022. @article{Thomassen2022,Sequential auditory scene analysis (ASA) is often studied using sequences of two alternating tones, such as ABAB or ABA_, with “_” denoting a silent gap, and “A” and “B” sine tones differing in frequency (nominally low and high). Many studies implicitly assume that the specific arrangement (ABAB vs ABA_, as well as low-high-low vs high-low-high within ABA_) plays a negligible role, such that decisions about the tone pattern can be governed by other considerations. To explicitly test this assumption, a systematic comparison of different tone patterns for two-tone sequences was performed in three different experiments. Participants were asked to report whether they perceived the sequences as originating from a single sound source (integrated) or from two interleaved sources (segregated). Results indicate that core findings of sequential ASA, such as an effect of frequency separation on the proportion of integrated and segregated percepts, are similar across the different patterns during prolonged listening. However, at sequence onset, the integrated percept was more likely to be reported by the participants in ABA_low-high-low than in ABA_high-low-high sequences. This asymmetry is important for models of sequential ASA, since the formation of percepts at onset is an integral part of understanding how auditory interpretations build up. |
Maria Theobald; Elena Galeano-Keiner; Garvin Brod Predicting vs. guessing: The role of confidence for pupillometric markers of curiosity and surprise Journal Article In: Cognition and Emotion, vol. 36, no. 4, pp. 731–740, 2022. @article{Theobald2022,Asking students to generate a prediction before presenting the correct answer is a popular instructional strategy. This study tested whether a person's degree of confidence in a prediction is related to their curiosity and surprise regarding the answer. For a series of questions about numerical facts, participants (N = 29) generated predictions and rated their confidence in the prediction before seeing the correct answer. The increase in pupil size before viewing the correct answer was used as a physiological marker of curiosity, and the increase in pupil size after viewing the correct answer was used as a physiological marker of surprise. The results revealed that the pupillometric marker of curiosity was most pronounced if students were slightly more confident in their prediction than usual, and it was lower for predictions made with either very high or very low confidence. Furthermore, the results showed that high-confidence prediction errors and low-confidence correct responses yielded a pupillary surprise response, suggesting that highly unexpected results evoke surprise, independent of the correctness of the prediction. Together, results suggest that confidence in a prediction plays an important role in the occurrence of epistemic emotions such as curiosity and surprise. |
Lina Teichmann; Denise Moerel; Anina N. Rich; Chris I. Baker The nature of neural object representations during dynamic occlusion Journal Article In: Cortex, vol. 153, pp. 66–86, 2022. @article{Teichmann2022,Objects disappearing briefly from sight due to occlusion is an inevitable occurrence in everyday life. Yet we generally have a strong experience that occluded objects continue to exist, despite the fact that they objectively disappear. This indicates that neural object representations must be maintained during dynamic occlusion. However, it is unclear what the nature of such representation is and in particular whether it is perception-like or more abstract, for example, reflecting limited features such as position or movement direction only. In this study, we address this question by examining how different object features such as object shape, luminance, and position are represented in the brain when a moving object is dynamically occluded. We apply multivariate decoding methods to Magnetoencephalography (MEG) data to track how object representations unfold over time. Our methods allow us to contrast the representations of multiple object features during occlusion and enable us to compare the neural responses evoked by visible and occluded objects. The results show that object position information is represented during occlusion to a limited extent while object identity features are not maintained through the period of occlusion. Together, this suggests that the nature of object representations during dynamic occlusion is different from visual representations during perception. |
Robert Taylor; Ivan Tomić; David Aagten-Murphy; Paul M. Bays Working memory is updated by reallocation of resources from obsolete to new items Journal Article In: Attention, Perception, and Psychophysics, pp. 1–15, 2022. @article{Taylor2022,Visual working memory (VWM) resources are limited, placing constraints on how much visual information can be simultaneously retained. During visually guided activity, stored information can quickly become outdated, so updating mechanisms are needed to ensure the contents of memory remain relevant to current task goals. In particular, successful deallocation of resources from items that become obsolete is likely to be critical for maintaining the precision of those representations still in memory. The experiments in this study involved presenting two memory arrays of coloured disks in sequence. The appearance of the second array was a cue to replace, rehearse, or add a new colour to the colours in memory. We predicted that successful resource reallocation should result in comparable recall precision when an item was replaced or rehearsed, owing to the removal of pre-replacement features. In contrast, a failure to update WM should lead to comparable precision with a condition in which a new colour was added to memory. We identified a very small proportion (∼5%) of trials in which participants incorrectly reported a feature from the first array in place of its replacement in the second, which we interpreted as a failure to incorporate the information from the second display into memory. Once these trials were discounted, precision estimates were consistent with complete redistribution of resources in the case of updating a single item. We conclude that working memory can be efficiently updated when previous information becomes obsolete, but that this is a demanding active process that occasionally fails. |
Benjamin Tari; Chloe Edgar; Priyanka Persaud; Connor Dalton; Matthew Heath The unidirectional prosaccade switch-cost: No evidence for the passive dissipation of an oculomotor task-set inertia Journal Article In: Experimental Brain Research, vol. 240, no. 7-8, pp. 2061–2071, 2022. @article{Tari2022,Cognitive flexibility is a core component of executive function and supports the ability to ‘switch' between different tasks. Our group has examined the cost associated with switching between a prosaccade (i.e., a standard task requiring a saccade to veridical target location) and an antisaccade (i.e., a non-standard task requiring a saccade mirror-symmetrical to veridical target) in predictable (i.e., AABB) and unpredictable (e.g., AABABłdots) switching paradigms. Results have shown that reaction times (RTs) for a prosaccade preceded by an antisaccade (i.e., task-switch trial) are longer than when preceded by its same task-type (i.e., task-repeat trial), whereas RTs for antisaccade task-switch and task-repeat trials do not differ. The asymmetrical switch-cost has been attributed to an antisaccade task-set inertia that proactively delays a subsequent prosaccade (i.e., the unidirectional prosaccade switch-cost). A salient question arising from previous work is whether the antisaccade task-set inertia passively dissipates or persistently influences prosaccade RTs. Accordingly, participants completed separate AABB (i.e. |
Nathan Tardiff; Lalitta Suriya-Arunroj; Yale E. Cohen; Joshua I. Gold 2022. @book{Tardiff2022,Expectations, such as those arising from either learned rules or recent stimulus regularities, can bias subsequent auditory perception in diverse ways. However, it is not well understood if and how these diverse effects depend on the source of the expectations. Further, it is unknown whether different sources of bias use the same or different computational and physiological mechanisms. We examined how rule-based and stimulus-based expectations influenced behavior and pupil-linked arousal, a marker of certain forms of expectation-based processing, of human subjects performing an auditory frequency-discrimination task. Rule-based cues consistently biased choices and response times (RTs) toward the more-probable stimulus. In contrast, stimulus-based cues had a complex combination of effects, including choice and RT biases toward and away from the frequency of recently presented stimuli. These different behavioral patterns also had: 1) distinct computational signatures, including different modulations of key components of a novel form of a drift-diffusion decision model and 2) distinct physiological signatures, including substantial bias-dependent modulations of pupil size in response to rule-based but not stimulus-based cues. These results imply that different sources of expectations can modulate auditory processing via distinct mechanisms: one that uses arousal-linked, rule-based information and another that uses arousal-independent, stimulus-based information to bias the speed and accuracy of auditory perceptual decisions. |
Xiaoyu Tang; Mengying Yuan; Zhongyu Shi; Min Gao; Rongxia Ren; Wei Ming; Yulin Gao Multisensory integration attenuates visually induced oculomotor inhibition of return Journal Article In: Journal of Vision, vol. 22, no. 4, pp. 1–17, 2022. @article{Tang2022,Inhibition of return (IOR) is a mechanism of the attention system involving bias toward novel stimuli and delayed generation of responses to targets at previously attended locations. According to the two-component theory, IOR consists of a perceptual component and an oculomotor component (oculomotor IOR [O-IOR]) depending on whether the eye movement system is activated. Previous studies have shown that multisensory integration weakens IOR when paying attention to both visual and auditory modalities. However, it remains unclear whether the O-IOR effect attenuated by multisensory integration also occurs when the oculomotor system is activated. Here, using two eye movement experiments, we investigated the effect of multisensory integration on O-IOR using the exogenous spatial cueing paradigm. In Experiment 1, we found a greater visual O-IOR effect compared with audiovisual and auditory O-IOR in divided modality attention. The relative multisensory response enhancement (rMRE) and violations of Miller's bound showed a greater magnitude of multisensory integration in the cued location compared with the uncued location. In Experiment 2, the magnitude of the audiovisual O-IOR effect was significantly less than that of the visual O-IOR in single visual modality selective attention. Implications for the effect of multisensory integration on O-IOR were discussed under conditions of oculomotor system activation, shedding new light on the two-component theory of IOR. |
Pengfei Tang; Zhong Yao; Jing Luan; Jie Xiao How information presentation formats influence usage behaviour of course management systems: Flow diagram navigation versus menu navigation Journal Article In: Behaviour and Information Technology, vol. 41, no. 2, pp. 383–400, 2022. @article{Tang2022a,Educational informatisation (e.g. e-learning, m-learning, massive open online courses (MOOCs)) has actively increased, leading to a greater focus on the design and development of course management systems. In this study, a research model based on cognitive fit theory and scanpath theory is proposed to investigate how information presentation formats (flow diagram navigation versus menu navigation) of a course management system influence user experience and intention. Performance load (cognitive load and kinematic load) and user perception (perceived usefulness and ease of use) are considered to evaluate user experience. The results of an eye tracking experiment utilised in this research reveal the following. First, information presentation formats can significantly influence user experience of course management systems. Second, flow diagram navigation fits students' tasks better and leads to lower performance load and better use perception. Third, performance load and user perception shows a significant effect on user satisfaction and thereby affect the intention. These findings deepen our understanding of the importance of information presentation and enrich its theoretical foundation for course management systems development. Practically, these findings provide designers with guidelines on how to improve user experience and increase use intention by varying information presentation formats. |
Noam Tal-Perry; Shlomit Yuval-Greenberg Contraction bias in temporal estimation Journal Article In: Cognition, vol. 229, pp. 1–9, 2022. @article{TalPerry2022,When asked to compare the perceptual features of two serially presented objects, participants are often biased to over- or under-estimate the difference in magnitude between the stimuli. Overestimation occurs consistently when a) the two stimuli are relatively small in magnitude and the first stimulus is larger in magnitude than the second; or b) the two stimuli are relatively large in magnitude and the first stimulus is smaller in magnitude than the second; underestimation consistently occurs in the complementary cases. This systematic perceptual bias, known as the contraction bias, was demonstrated for a multitude of perceptual features and in various modalities. Here, we tested whether estimation of time-duration is affected by the contraction bias. In each trial of three experiments (n = 20 each), participants compared the duration of two visually presented stimuli. Findings revealed over- and under-estimation effects as predicted by the contraction bias. Here, we discuss this asymmetry and describe how these findings can be explained via a Bayesian inference framework. |
Louisa A. Talipski; Stephanie C. Goodhew; Mark Edwards No effect of spatial attention on the processing of a motion ensemble: Evidence from Posner cueing Journal Article In: Attention, Perception, and Psychophysics, vol. 84, no. 6, pp. 1845–1857, 2022. @article{Talipski2022,The formation of ensemble codes is an efficient means through which the visual system represents vast arrays of information. This has led to the claim that ensemble representations are formed with minimal reliance on attentional resources. However, evidence is mixed regarding the effects of attention on ensemble processing, and researchers do not always make it clear how attention is being manipulated by their paradigm of choice. In this study, we examined the effects of Posner cueing – a well-established method of manipulating spatial attention – on the processing of a global motion stimulus, a naturalistic ensemble that requires the pooling of local motion signals. In Experiment 1, using a centrally presented, predictive attentional cue, we found no effect of spatial attention on global motion performance: Accuracy in invalid trials, where attention was misdirected by the cue, did not differ from accuracy in valid trials, where attention was directed to the location of the motion stimulus. In Experiment 2, we maximized the potential for our paradigm to reveal any attentional effects on global motion processing by using a threshold-based measure of performance; however, despite this change, there was again no evidence of an attentional effect on performance. Together, our results show that the processing of a global motion stimulus is unaffected when spatial attention is misdirected, and speak to the efficiency with which such ensemble stimuli are processed. |
Travis N. Talcott; Alyssa P. Levy; Nicholas Gaspelin Covert attention is attracted to prior target locations: Evidence from the probe paradigm Journal Article In: Attention, Perception, and Psychophysics, vol. 84, no. 3, pp. 1098–1113, 2022. @article{Talcott2022,There is growing evidence that visual attention can be guided by selection history. One example of this is intertrial location priming, whereby attention is attracted to the target location from the previous trial. Most previous demonstrations of location priming have relied on manual response time effects whereby search is speeded when the target location repeats from the previous trial. However, these latency-based effects have recently been challenged as being due to response facilitation that occurs after the target has been found, rather than an attentional bias toward the previous target location. To resolve this, the current study used a probe paradigm to assess whether covert attention is biased to the previous-trial target location. On search trials, participants searched for a specific target shape amongst distractor shapes and made a speeded response to the location ofa dot inside the target. On probe trials, letters briefly appeared at each search location and after a delay, participants were asked to report as many letters as possible. Probe report accuracy was used to assess the likelihood that a given location was attended. Three experiments indicated that probe report accuracy was greatly improved for letters at the previous-trial target location compared with baseline levels. Importantly, this occurred even when strong attentional guidance to the target was encouraged and even when a nontarget stimulus appeared at the primed location. Altogether, the results suggest that covert attention is strongly attracted to the previous target location during visual search. |
Alexander Taikh; Glen E. Bodner In: Canadian Journal of Experimental Psychology, vol. 76, no. 3, pp. 186–192, 2022. @article{Taikh2022,Pupil dilation provides a window into recognition memory processes. During a recognition test, the pupil dilates more in response to a recognized studied item than to a correctly rejected new item. Various explanations for this pupil old/new effect have been offered. By a retrieval effort account, the pupil's response on a recognition test reflects the cognitive effort needed to retrieve items from memory. By a memory strength account, pupil dilation reflects the strength of the subjective memory experience elicited by items at test. To compare these accounts, we varied levels of processing (LOP) at study, then measured pupil dilation on a delayed recognition test during which participants made recollection/familiarity judgements. Pupil dilation at test was similar whether test items had been studied in a deep or shallow LOP task, but was greater when deep, shallow, and new test items were experienced as recollected rather than as familiar. This pattern supports the memory strength account rather than the retrieval effort account of pupil dilation during a recognition test. |
Jérôme Tagu; Árni Kristjánsson Dynamics of attentional and oculomotor orienting in visual foraging tasks Journal Article In: Quarterly Journal of Experimental Psychology, vol. 75, no. 2, pp. 260–276, 2022. @article{Tagu2022a,A vast amount of research has been carried out to understand how humans visually search for targets in their environment. However, this research has typically involved search for one unique target among several distractors. Although this line of research has yielded important insights into the basic characteristics of how humans explore their visual environment, this may not be a very realistic model for everyday visual orientation. Recently, researchers have used multi-target displays to assess orienting in the visual field. Eye movements in such tasks are, however, less well understood. Here, we investigated oculomotor dynamics during four visual foraging tasks differing in target crypticity (feature-based foraging vs. conjunction-based foraging) and the effector type being used for target selection (mouse foraging vs. gaze foraging). Our results show that both target crypticity and effector type affect foraging strategies. These changes are reflected in oculomotor dynamics, feature foraging being associated with focal exploration (long fixations and short-amplitude saccades), and conjunction foraging with ambient exploration (short fixations and high-amplitude saccades). These results provide important new information for existing accounts of visual attention and oculomotor control and emphasise the usefulness of foraging tasks for a better understanding of how humans orient in the visual environment. |
Jérôme Tagu; Árni Kristjánsson The selection balance: Contrasting value, proximity and priming in a multitarget foraging task Journal Article In: Cognition, vol. 218, pp. 1–12, 2022. @article{Tagu2022,A critical question in visual foraging concerns the mechanisms driving the next target selection. Observers first identify a set of candidate targets, and then select the best option among these candidates. Recent evidence suggests that target selection relies on internal biases towards proximity (nearest target from the last selection), priming (target from the same category as the last selection) and value (target associated with high value). Here, we tested the role of eye movements in target selection, and notably whether disabling eye movements during target selection could affect search strategy. We asked observers to perform four foraging tasks differing by selection modality and target value. During gaze foraging, participants had to accurately fixate the targets to select them and could not anticipate the next selection with their eyes, while during mouse foraging they selected the targets with mouse clicks and were free to move their eyes. We moreover manipulated both target value and proximity. Our results revealed notable individual differences in search strategy, confirming the existence of internal biases towards value, proximity and priming. Critically, there were no differences in search strategy between mouse and gaze foraging, suggesting that disabling eye movements during target selection did not affect foraging behaviour. These results importantly suggest that overt orienting is not necessary for target selection. This study provides fundamental information for theoretical conceptions of attentional selection, and emphasizes the importance of covert attention for target selection during visual foraging. |
Georgia F. Symons; William T. O'Brien; Larry Abel; Zhibin Chen; Daniel M. Costello; Terence J. O'Brien; Scott Kolbe; Joanne Fielding; Sandy R. Shultz; Meaghan Clough Monitoring the acute and subacute recovery of cognitive ocular motor changes after a sports-related concussion Journal Article In: Cerebral Cortex, pp. 1–13, 2022. @article{Symons2022,Identifying when recovery from a sports-related concussion (SRC) has occurred remains a challenge in clinical practice. This study investigated the utility of ocular motor (OM) assessment to monitor recovery post-SRC between sexes and compared to common clinical measures. From 139 preseason baseline assessments (i.e. before they sustained an SRC), 18 (12 males, 6 females) consequent SRCs were sustained and the longitudinal follow-ups were collected at 2, 6, and 13 days post-SRC. Participants completed visually guided, antisaccade (AS), and memory-guided saccade tasks requiring a saccade toward, away from, and to a remembered target, respectively. Changes in latency (processing speed), visual–spatial accuracy, and errors were measured. Clinical measures included The Sports Concussion Assessment Tool, King-Devick test, Stroop task, and Digit span. AS latency was significantly longer at 2 days and returned to baseline by 13-days post-SRC in females only (P < 0.001). Symptom numbers recovered from 2 to 6 days and 13 days (P < 0.05). Persistently poorer AS visual–spatial accuracy was identified at 2, 6 and 13 days post-SRC (P < 0.05) in both males and females but with differing trajectories. Clinical measures demonstrated consistent improvement reminiscent of practice effects. OM saccade assessment may have improved utility in tracking recovery compared to conventional measures and between sexes. |
Yuta Suzuki; Hsin-I Liao; Shigeto Furukawa Temporal dynamics of auditory bistable perception correlated with fluctuation of baseline pupil size Journal Article In: Psychophysiology, vol. 59, no. 8, pp. 1–12, 2022. @article{Suzuki2022,A dynamic neural network change, accompanied by cognitive shifts such as internal perceptual alternation in bistable stimuli, is reconciled by the discharge of noradrenergic locus coeruleus neurons. Transient pupil dilation as a consequence of the reconciliation with the neural network in bistable perception has been reported to precede the reported perceptual alternation. Here, we found that baseline pupil size, an index of temporal fluctuation of arousal level over a longer range of timescales than that for the transient pupil changes, relates to the frequency of perceptual alternation in auditory bistability. Baseline pupil size was defined as the mean pupil diameter over a period of 1 s prior to the task requirement (i.e., before the observation period for counting the perceptual alternations in Experiment 1 and reporting whether participants experienced the perceptual alternations in Experiment 2). The results showed that the baseline pupil size monotonically increased with an increasing number of perceptual alternations and its occurrence probability. Furthermore, a cross-correlation analysis indicates that baseline pupil size predicted perceptual alternation at least 35 s before the behavioral response and that the overall correspondence between pupil size and perceptual alternation was maintained over a sustained time window of 45 s at minimum. The overall results suggest that variability of baseline pupil size reflects the stochastic dynamics of arousal fluctuation in the brain related to bistable perception. |
Sai Sun; Chuhua Cai; Rongjun Yu Behavioral and neural representation of expected reward and risk Journal Article In: NeuroImage, vol. 264, pp. 1–13, 2022. @article{Sun2022,When faced with uncertainty, individuals' value-based decisions are influenced by the expected rewards and risks. Understanding how reward and risk are processed and integrated at the behavioral and neural levels is essential for building up utility theories. Using a modified monetary incentive delay task in which the mean of two possible outcomes (expected reward) and the standard deviation (SD) of the possible outcomes (risk) were parametrically manipulated and orthogonalized, we measured eye movements, response times (RTs), and brain activity when participants seek to secure a reward. We found that RTs varied as a function of the mean but not the SD of the potential reward, suggesting that expected rewards are the main driver of RTs. Moreover, the difference between gazes focused on high vs. low value rewards became smaller when the magnitude of the potential reward (mean of possible outcomes) was larger and when risk (SD of possible outcomes) became smaller, highlighting that reward and risk have different effects on attention deployment. Processing the mean reward activated the striatum. The positive striatal connectivity to the amygdala and negative striatal connectivity to the superior frontal gyrus were correlated with individuals' sensitivity to the expected reward. In contrast, processing risk activated the anterior insula. Its positive connectivity to the ventromedial prefrontal cortex and negative connectivity to the anterior midcingulate cortex were correlated with individual differences in risk sensitivity, further suggesting the functional dissociation of reward and risk at the neural level. Our findings, based on several different measures, delineate the distinct representations of reward and risk in non-decision contexts and provide insight into how these utility parameters modulate attention, motivation, and brain networks. |
Longjiao Sui; Nicolas Dirix; Evy Woumans; Wouter Duyck GECO-CN: Ghent Eye-tracking COrpus of sentence reading for Chinese-English bilinguals Journal Article In: Behavior Research Methods, pp. 1–21, 2022. @article{Sui2022,The current work presents the very first eye-tracking corpus of natural reading by Chinese-English bilinguals, whose two languages entail different writing systems and orthographies. Participants read an entire novel in these two languages, presented in paragraphs on screen. Half of the participants first read half of the novel in their native language (Simplified Chinese) and then the rest of the novel in their second language (English), while the other half read in the reverse language order. This article presents some important basic descriptive statistics of reading times and compares the difference between reading in the two languages. However, this unique eye-tracking corpus also allows the exploration of theories of language processing and bilingualism. Importantly, it provides a solid and reliable ground for studying the difference between Eastern and Western languages, understanding the impact and consequences of having a completely different first language on bilingual processing. The materials are freely available for use by researchers interested in (bilingual) reading. |
Benjamin Suarez-Jimenez; Amit Lazarov; Xi Zhu; Daniel S. Pine; Yair Bar-Haim; Yuval Neria Attention allocation to negatively-valenced stimuli in PTSD is associated with reward-related neural pathways Journal Article In: Psychological Medicine, pp. 1–9, 2022. @article{SuarezJimenez2022,Background. In a recent eye-tracking study we found a differential dwell time pattern for negatively-valenced and neutral faces among patients with posttraumatic stress disorder (PTSD), trauma-exposed healthy control (TEHCs), and healthy control (HC) participants. Here, we explored whether these group differences relate to resting-state functional connectivity (rsFC) patterns of brain areas previously linked to both attention processes and PTSD. These encompass the amygdala, dorsal anterior cingulate cortex (dACC), dorsolateral prefrontal cortex (dlPFC), ventrolateral prefrontal cortex (vlPFC), and nucleus accumbens (NAcc).Methods.Ten minutes magnetic resonance imaging rsFC scans were recorded in 17 PTSD patients, 21 TEHCs, and 16 HCs. Participants then completed a free-viewing eye-tracking task assessing attention allocation outside the scanner. Dwell time on negatively-valenced stimuli (DT%) were assessed relative to functional connectivity in the aforementioned seed regions of interest (amygdala, dACC, dlPFC, vlPFC, and NAcc) to whole-brain voxel-wise rsFC.Results. As previously reported, group differences occurred in attention allocation to negative-valence stimuli, with longer dwell time on negatively valence stimuli in the PTSD and TEHC groups than the HC group. Higher DT% correlated with weaker NAcc-orbitofrontal cortex (OFC) connectivity in patients with PTSD. Conversely, a positive association emerged in the HC group between DT% and NAcc-OFC connectivity.Conclusions. While exploratory in nature, present findings may suggest that reward-related brain areas are involved in disengaging attention from negative-valenced stimuli, and possibly in regulating ensuing negative emotions. |
Anna Lena Stroh; Konstantin Grin; Frank Rösler; Davide Bottari; José Ossandón; Bruno Rossion; Brigitte Röder Developmental experiences alter the temporal processing characteristics of the visual cortex: Evidence from deaf and hearing native signers Journal Article In: European Journal of Neuroscience, vol. 55, no. 6, pp. 1629–1644, 2022. @article{Stroh2022,To date, the extent to which early experience shapes the functional characteristics of neural circuits is still a matter of debate. In the present study, we tested whether congenital deafness and/or the acquisition of a sign language alter the temporal processing characteristics of the visual system. Moreover, we investigated whether, assuming cross-modal plasticity in deaf individuals, the temporal processing characteristics of possibly reorganised auditory areas resemble those of the visual cortex. Steady-state visual evoked potentials (SSVEPs) were recorded in congenitally deaf native signers, hearing native signers, and hearing nonsigners. The luminance of the visual stimuli was periodically modulated at 12, 21, and 40 Hz. For hearing nonsigners, the optimal driving rate was 12 Hz. By contrast, for the group of hearing signers, the optimal driving rate was 12 and 21 Hz, whereas for the group of deaf signers, the optimal driving rate was 21 Hz. We did not observe evidence for cross-modal recruitment of auditory cortex in the group of deaf signers. These results suggest a higher preferred neural processing rate as a consequence of the acquisition of a sign language. |