EyeLink fMRI/MEG出版物
所有EyeLink功能磁共振成像和MEG研究出版物(同时进行眼睛跟踪)至2023年(一些早于2024年)均按年份列出。您可以使用Visual Cortex、Neural Plasticity、MEG等关键词搜索出版物。您还可以搜索个人作者姓名。如果我们错过了任何EyeLink功能磁共振成像或MEG文章,请给我们发电子邮件!
2023 |
Christoforos Christoforou; Maria Theodorou; Argyro Fella; Timothy C. Papadopoulos RAN-related neural-congruency: A machine learning approach toward the study of the neural underpinnings of naming speed Journal Article In: Frontiers in Psychology, vol. 14, pp. 1–15, 2023. @article{Christoforou2023, Objective: Naming speed, behaviorally measured via the serial Rapid automatized naming (RAN) test, is one of the most examined underlying cognitive factors of reading development and reading difficulties (RD). However, the unconstrained-reading format of serial RAN has made it challenging for traditional EEG analysis methods to extract neural components for studying the neural underpinnings of naming speed. The present study aims to explore a novel approach to isolate neural components during the serial RAN task that are (a) informative of group differences between children with dyslexia (DYS) and chronological age controls (CAC), (b) improve the power of analysis, and (c) are suitable for deciphering the neural underpinnings of naming speed. Methods: We propose a novel machine-learning-based algorithm that extracts spatiotemporal neural components during serial RAN, termed RAN-related neural-congruency components. We demonstrate our approach on EEG and eye-tracking recordings from 60 children (30 DYS and 30 CAC), under phonologically or visually similar, and dissimilar control tasks. Results: Results reveal significant differences in the RAN-related neural-congruency components between DYS and CAC groups in all four conditions. Conclusion: Rapid automatized naming-related neural-congruency components capture the neural activity of cognitive processes associated with naming speed and are informative of group differences between children with dyslexia and typically developing children. Significance: We propose the resulting RAN-related neural-components as a methodological framework to facilitate studying the neural underpinnings of naming speed and their association with reading performance and related difficulties. |
Carmen Julia Coloma; Ernesto Guerra; Zulema De Barbieri; Andrea Helo; Zulema De Barbieri; Andrea Helo; Carmen Julia; Ernesto Guerra; Zulema De Barbieri; Andrea Helo Article comprehension in monolingual Spanish-speaking children with developmental language disorder: A longitudinal eye tracking study Journal Article In: International Journal of Speech-Language Pathology, pp. 1–13, 2023. @article{Coloma2023, Purpose: Article-noun disagreement in spoken language is a marker of children with developmental language disorder (DLD). However, the evidence is less clear regarding article comprehension. This study investigates article comprehension in monolingual Spanish-speaking children with and without DLD. Method: Eye tracking methodology used in a longitudinal experimental design enabled the examination of real time article comprehension. The children at the time 1 were 40 monolingual Spanish-speaking preschoolers (20 with DLD and 20 with typical language development [TLD]). A year later (time 2), 27 of these children (15 with DLD and 12 with TLD) were evaluated. Children listened to simple phrases while inspecting a four object visual context. The article in the phrase agreed in number and gender with only one of the objects. Result: At the time 1, children with DLD did not use articles to identify the correct image, while children with TLD anticipated the correct picture. At the time 2, both groups used the articles' morphological markers, but children with DLD showed a slower and weaker preference for the correct referent compared to their age-matched peers. Conclusion: These findings suggest a later emergence, but a similar developmental trajectory, of article comprehension in children with DLD compared to their peers with TLD. |
Frances G Cooley; David Quinto-pozos Supplemental material for examining speech-based phonological recoding during reading for adolescent deaf signers Journal Article In: Journal of Experimental Psychology: General, vol. 152, no. 7, pp. 1995–2007, 2023. @article{Cooley2023, Much of the debate regarding literacy development in deaf and hard-of-hearing readers surrounds whether there is dependence on phonological decoding of print to speech for such readers, and the literature is mixed. While some reports of deaf children and adults demonstrate the influence of speech-based processing during reading, others find little to no evidence of speech-sound activation. In order to examine the role of speech- based phonological codes when reading, we utilized eye-tracking to examine eye-gaze behaviors employed by deaf children and a control group of hearing primary-school children when encountering target words in sentences. The target words were of three types: correct, homophonic errors, and nonhomophonic errors.We examined eye-gaze fixations when first encountering target words and, if applicable, when rereading those words. The results revealed that deaf and hearing readers differed in their eye-movement behaviors when re- reading the words, but they did not demonstrate differences for first encounters with the words. Hearing read- ers treated homophonic and nonhomophonic error words differently during their second encounter with the target while deaf readers did not, suggesting that deaf signers did not engage in phonological decoding to the same degree as hearing readers did. Further, deaf signers performed fewer overall regressions to target words than hearing readers, suggesting that they depended less on regressions to resolve errors in the text. |
Carolin Zsigo; Lisa Feldmann; Frans Oort; Charlotte Piechaczek; Jürgen Bartling; Martin Schulte-Rüther; Christian Wachinger; Gerd Schulte-Körne; Ellen Greimel Emotion regulation training for adolescents with major depression: Results from a randomized controlled trial Journal Article In: Emotion, pp. 1–18, 2023. @article{Zsigo2023, Difficulties in emotion regulation (ER) are thought to contribute to the development and maintenance of major depression (MD) in adolescents. In healthy adults, a task-based training of ER has previously proven effective to reduce stress, but no such studies are available for MD. It is also unclear whether findings can be generalized onto adolescent populations. The final sample consisted of n = 70 adolescents with MD, who were randomized to a task-based ER training (n = 36) or a control training (n = 34). Across four sessions, the ER group was trained to downregulate negative affect to negative images via reappraisal, while the control group was instructed to attend the images. Rumination, stress-, and affect-related measures were assessed as primary outcomes, behavioral and neurophysiological responses (late positive potential, LPP), as secondary outcomes. The trial was preregistered at clinicaltrials.gov (NCT03957850). While there was no significant differential effect of the ER training on primary outcomes, we found small to moderate effects on rumination in the ER group, but not the control group. During reappraisal (compared to attend), the ER group showed an unexpected increase of the LPP during the first, but not during later training sessions. Although replication in large, multicenter trials is needed, our findings on effect sizes suggest that ER training might be promising to decrease rumination in adolescent MD. The LPP increase at the first session may represent cognitive effort, which was successfully reduced over the sessions. Future studies should research whether training effects transfer to daily life and are durable over a longer time period. (PsycInfo Database Record (c) 2023 APA, all rights reserved) |
Dan Zhang; Lihua Xu; Yuou Xie; Xiaochen Tang; Yegang Hu; Xu Liu; Guisen Wu; Zhenying Qian; Yingying Tang; Zhi Liu; Tao Chen; HaiChun Liu; Tianhong Zhang; Jijun Wang Eye movement indices as predictors of conversion to psychosis in individuals at clinical high risk Journal Article In: European Archives of Psychiatry and Clinical Neuroscience, vol. 273, no. 3, pp. 553–563, 2023. @article{Zhang2023i, Eye movement abnormalities have been established as an “endophenotype” of schizophrenia. However, less is known about the possibility of these abnormalities as biomarkers for psychosis conversion among clinical high risk (CHR) populations. In the present study, 108 CHR individuals and 70 healthy controls (HC) underwent clinical assessments and eye-tracking tests, comprising fixation stability and free-viewing tasks. According to three-year follow-up outcomes, CHR participants were further stratified into CHR-converter (CHR-C; n = 21) and CHR-nonconverter (CHR-NC; n = 87) subgroups. Prediction models were constructed using Cox regression and logistic regression. The CHR-C group showed more saccades of the fixation stability test (no distractor) and a reduced saccade amplitude of the free-viewing test than HC. Moreover, the CHR-NC group exhibited excessive saccades and an increased saccade amplitude of the fixation stability test (no distractor; with distractor) compared with HC. Furthermore, two indices could effectively discriminate CHR-C from CHR-NC with an area under the receiver-operating characteristic (ROC) curve of 0.80, including the saccade number of the fixation stability test (no distractor) and the saccade amplitude of the free-viewing test. Combined with negative symptom scores of the Scale of Prodromal Symptoms, the area was 0.81. These findings support that eye movement alterations might emerge before the onset of clinically overt psychosis and could assist in predicting psychosis transition among CHR populations. |
Anastasia A. Ziubanova; Anna K. Laurinavichyute; Olga Parshina Does early exposure to spoken and sign language affect reading fluency in deaf and hard-of-hearing adult signers? Journal Article In: Frontiers in Psychology, vol. 14, pp. 1–9, 2023. @article{Ziubanova2023, Introduction: Early linguistic background, and in particular, access to language, lays the foundation of future reading skills in deaf and hard-of-hearing signers. The current study aims to estimate the impact of two factors – early access to sign and/or spoken language – on reading fluency in deaf and hard-of-hearing adult Russian Sign Language speakers. Methods: In the eye-tracking experiment, 26 deaf and 14 hard-of-hearing native Russian Sign Language speakers read 144 sentences from the Russian Sentence Corpus. Analysis of global eye-movement trajectories (scanpaths) was used to identify clusters of typical reading trajectories. The role of early access to sign and spoken language as well as vocabulary size as predictors of the more fluent reading pattern was tested. Results: Hard-of-hearing signers with early access to sign language read more fluently than those who were exposed to sign language later in life or deaf signers without access to speech sounds. No association between early access to spoken language and reading fluency was found. Discussion: Our results suggest a unique advantage for the hard-of-hearing individuals from having early access to both sign and spoken language and support the existing claims that early exposure to sign language is beneficial not only for deaf but also for hard-of-hearing children. |
Ji Su Yeon; Ha Na Jung; Jae-Young Kim; Kyong In Jung; Hae Young Lopilly Park; Chan Kee Park; Hyo Won Kim; Man Soo Kim; Yong Chan Kim Deviated saccadic trajectory as a biometric signature of glaucoma Journal Article In: Translational Vision Science & Technology, vol. 12, no. 7, pp. 1–12, 2023. @article{Yeon2023, Purpose: To investigate whether the trajectories of saccadic eye movements (SEMs) significantly differ between glaucoma patients and controls. Methods: SEMs were recorded by video-based infrared oculography in 53 patients with glaucoma and 41 age-matched controls. Participants were asked to bilaterally view 24°-horizontal, 14°-vertical, and 20°-diagonal eccentric Goldmann III-sized stimuli. SEMs were evaluated with respect to the saccadic reaction time (SRT), the mean velocity, amplitude, and two novel measures: departure angle (DA) and arrival angle (AA). These parameters were compared between the groups and the associations of SEM parameters with glaucoma parameters and integrated visual field defects were investigated. Results: Glaucoma patients exhibited increased mean SRT, DA, and AA values compared with controls for 14°-vertical visual targets (P = 0.05, P < 0.01, and P < 0.01, respectively). The SRT, DA, and AA were significantly associated with the mean and pattern standard deviations of perimetry and with the mean RNFL thickness by OCT (all P < 0.001). Glaucoma was associated with the AA (P = 0.05) and both the SRT (P = 0.01) and DA (P = 0.04) were associated with integrated visual field defects. Conclusions: The saccadic trajectories of glaucoma patients depart in an erroneous path and compensate the disparity by deviating the trajectory at arrival. Translational Relevance: The initial deviation that we observed (despite continuous exposure to the stimulus) suggests the disoriented spatial perception of glaucoma patients which may be relevant to difficulties encountered daily. |
Wei Zhou; Yi Fan; Yulin Chang; Wenjuan Liu; Jiuju Wang; Yufeng Wang Pathogenesis of comorbid adhd and chinese developmental dyslexia: Evidence from eye-movement tracking and rapid automatized naming Journal Article In: Journal of Attention Disorders, vol. 27, no. 3, pp. 294–306, 2023. @article{Zhou2023f, Background: ADHD and Chinese developmental dyslexia (DD) have a very high comorbidity rate; however, which cognitive deficits characterize the comorbidity and when they occur during cognitive processing are still under debate. Methods: Rapid automatic naming (RAN) tasks with eye-movement tracking were conducted with 75 children who were typically developing, had comorbid ADHD and DD, had only ADHD, and had only DD. Results: The clinical groups had longer first fixation durations than the control for RAN digits. Temporal eye-movement measures, such as gaze duration and total reading time, were found to vary between the comorbidity and ADHD groups. Spatial eye-movement measures, such as regression probability and incoming saccade amplitude, differed between the comorbidity and DD groups. Conclusions: These results indicate that investigation with eye-movement measures combined with RAN tasks can strengthen the understanding of the pathogenesis of comorbid ADHD and DD. |
Jaakko Hotta; Jukka Saari; Hanna Harno; Eija Kalso; Nina Forss; Riitta Hari Somatotopic disruption of the functional connectivity of the primary sensorimotor cortex in complex regional pain syndrome type 1 Journal Article In: Human Brain Mapping, vol. 44, no. 17, pp. 6258–6274, 2023. @article{Hotta2023, In complex regional pain syndrome (CRPS), the representation area of the affected limb in the primary sensorimotor cortex (SM1) reacts abnormally during sensory stimulation and motor actions. We recorded 3T functional magnetic resonance imaging resting-state data from 17 upper-limb CRPS type 1 patients and 19 healthy control subjects to identify alterations of patients' SM1 function during spontaneous pain and to find out how the spatial distribution of these alterations were related to peripheral symptoms. Seed-based correlations and independent component analyses indicated that patients' upper-limb SM1 representation areas display (i) reduced interhemispheric connectivity, associated with the combined effect of intensity and spatial extent of limb pain, (ii) increased connectivity with the right anterior insula that positively correlated with the duration of CRPS, (iii) increased connectivity with periaqueductal gray matter, and (iv) disengagement from the other parts of the SM1 network. These findings, now reported for the first time in CRPS, parallel the alterations found in patients suffering from other chronic pain conditions or from limb denervation; they also agree with findings in healthy persons who are exposed to experimental pain or have used their limbs asymmetrically. Our results suggest that CRPS is associated with a sustained and somatotopically specific alteration of SM1 function, that has correspondence to the spatial distribution of the peripheral manifestations and to the duration of the syndrome. |
Satomi Inomata-Terada; Hideki Fukuda; Shin-ichi Tokushige; Shun-ichi Matsuda; Masashi Hamada; Yoshikazu Ugawa; Shoji Tsuji; Yasuo Terao Abnormal saccade profiles in hereditary spinocerebellar degeneration reveal cerebellar contribution to visually guided saccades Journal Article In: Clinical Neurophysiology, vol. 154, pp. 70–84, 2023. @article{InomataTerada2023, Objective: To study how the pathophysiology underlying hereditary spinocerebellar degeneration (spinocerebellar ataxia; SCA) with pure cerebellar manifestation evolves with disease progression using saccade recordings. Methods: We recorded visually- (VGS) and memory-guided saccade (MGS) task performance in a homogeneous population of 20 genetically proven SCA patients (12 SCA6 and eight SCA31 patients) and 19 normal controls. Results: For VGS but not MGS, saccade latency and amplitude were increased and more variable than those in normal subjects, which correlated with cerebellar symptom severity assessed using the International Cooperative Ataxia Rating Scale (ICARS). Parameters with significant correlations with cerebellar symptoms showed an aggravation after disease stage progression (ICARS > 50). The saccade velocity profile exhibited shortened acceleration and prolonged deceleration, which also correlated with disease progression. The main sequence relationship between saccade amplitude and peak velocity as well as saccade inhibitory control were preserved. Conclusions: The cerebellum may be involved in initiating VGS, which was aggravated acutely during disease stage progression. Dysfunction associated with disease progression occurs mainly in the cerebellum and brainstem interaction but may also eventually involve cortical saccade processing. Significance: Saccade recording can reveal cerebellar pathophysiology underlying SCA with disease progression. |
Krista R. Kelly; Kartik Kumar; Reed M. Jost; Christina S. Cheng-Patel; Lori M. Dao; Becky Luu; David Stager; Eileen E. Birch Objective assessment of control compared with clinical triple office control score in children with intermittent exotropia Journal Article In: Journal of AAPOS, vol. 27, no. 5, pp. 291–293, 2023. @article{Kelly2023, Poor control of intermittent exotropia may be used as an indication for surgery. However, control fluctuates during the day and from day to day. The standardized triple office control score (mean of three scores on a 6-point ordinal scale) is representative of repeated assessments throughout the day, but lacks validation against an objective measure of eye movements. We report the agreement between the triple office control score measured by the referring eyecare professional and lab-measured vergence instability using an EyeLink video eye tracker. Near and distance triple office control scores were moderately correlated with vergence instability. Near, but not distance, triple office control score was moderately correlated with the percentage of time intermittent exotropia was manifest during EyeLink recording. Larger triple office control scores for intermittent exotropia provide a meaningful description of larger vergence instability, supporting its use in clinical decisions and as a measure in clinical trials.[Formula presented] |
Kelsey E. Klein; Elizabeth A. Walker; Bob McMurray In: Ear & Hearing, vol. 44, no. 2, pp. 338–357, 2023. @article{Klein2023a, Objective: The objective of this study was to characterize the dynamics of real-time lexical access, including lexical competition among phonologically similar words, and spreading semantic activation in school-age children with hearing aids (HAs) and children with cochlear implants (CIs). We hypothesized that developing spoken language via degraded auditory input would lead children with HAs or CIs to adapt their approach to spoken word recognition, especially by slowing down lexical access. Design: Participants were children ages 9- to 12-years old with normal hearing (NH), HAs, or CIs. Participants completed a Visual World Paradigm task in which they heard a spoken word and selected the matching picture from four options. Competitor items were either phonologically similar, semantically similar, or unrelated to the target word. As the target word unfolded, children's fixations to the target word, cohort competitor, rhyme competitor, semantically related item, and unrelated item were recorded as indices of ongoing lexical access and spreading semantic activation. Results: Children with HAs and children with CIs showed slower fixations to the target, reduced fixations to the cohort competitor, and increased fixations to the rhyme competitor, relative to children with NH. This wait-and-see profile was more pronounced in the children with CIs than the children with HAs. Children with HAs and children with CIs also showed delayed fixations to the semantically related item, although this delay was attributable to their delay in activating words in general, not to a distinct semantic source. Conclusions: Children with HAs and children with CIs showed qualitatively similar patterns of real-time spoken word recognition. Findings suggest that developing spoken language via degraded auditory input causes long-term cognitive adaptations to how listeners recognize spoken words, regardless of the type of hearing device used. Delayed lexical access directly led to delays in spreading semantic activation in children with HAs and CIs. This delay in semantic processing may impact these children's ability to understand connected speech in everyday life. |
Wupadrasta Santosh Kumar; Supratim Ray Healthy ageing and cognitive impairment alter EEG functional connectivity in distinct frequency bands Journal Article In: European Journal of Neuroscience, vol. 58, no. 6, pp. 3432–3449, 2023. @article{Kumar2023, Functional connectivity (FC) indicates the interdependencies between brain signals recorded from spatially distinct locations in different frequency bands, which is modulated by cognitive tasks and is known to change with ageing and cognitive disorders. Recently, the power of narrow-band gamma oscillations induced by visual gratings have been shown to reduce with both healthy ageing and in subjects with mild cognitive impairment (MCI). However, the impact of ageing/MCI on stimulus-induced gamma FC has not been well studied. We recorded electroencephalogram (EEG) from a large cohort (N = 229) of elderly subjects (>49 years) while they viewed large cartesian gratings to induce gamma oscillations and studied changes in alpha and gamma FC with healthy ageing (N = 218) and MCI (N = 11). Surprisingly, we found distinct differences across age and MCI groups in power and FC. With healthy ageing, alpha power did not change but FC decreased significantly. MCI reduced gamma but not alpha FC significantly compared with age and gender matched controls, even when power was matched between the two groups. Overall, our results suggest distinct effects of ageing and disease on EEG power and FC, suggesting different mechanisms underlying ageing and cognitive disorders. |
Changlin Luo; Mengyan Zhu; Xiangling Zhuang; Guojie Ma Food word processing in Chinese reading: A study of restrained eaters Journal Article In: British Journal of Psychology, vol. 114, no. 2, pp. 476–494, 2023. @article{Luo2023a, Food-related attentional bias refers that individuals typically prioritize rewarding food-related cues (e.g. food words and food images) compared with non-food stimuli; however, the findings are inconsistent for restrained eaters. Traditional paradigms used to test food-related attentional bias, such as visual probe tasks and visual search tasks, may not directly and accurately enough to reflect individuals' food-word processing at different cognitive stages. In this study, we introduced the boundary paradigm to investigate food-word attentional bias for both restrained and unrestrained eaters. Eye movements were recorded when they performed a naturalistic sentence-reading task. The results of later-stage analyses showed that food words were fixated on for less time than non-food words, which indicated a superiority of foveal food-word processing for both restrained and unrestrained eaters. The results of early-stage analyses showed that restrained eaters spent more time on pre-target regions in the food-word valid preview conditions, which indicated a parafoveal food-word processing superiority for restrained eaters (i.e. the parafoveal-on-foveal effect). The superiority of foveal food-word processing provides new insights into explaining food-related attentional bias in general groups. Additionally, the enhanced food-word attentional bias in parafoveal processing for restrained eaters illustrates the importance of individual characteristics in studying word recognition. |
Hailong Lyu; David St Clair; Renrong Wu; Philip J. Benson; Wenbin Guo; Guodong Wang; Yi Liu; Shaohua Hu; Jingping Zhao Eye movement abnormalities can distinguish first-episode schizophrenia, chronic schizophrenia, and prodromal patients from healthy controls Journal Article In: Schizophrenia Bulletin Open, vol. 4, no. 1, pp. 1–11, 2023. @article{Lyu2023a, Background: This study attempts to replicate in a Chinese population an earlier UK report that eye movement abnormalities can accurately distinguish schizophrenia (SCZ) cases from healthy controls (HCs). It also seeks to determine whether first-episode SCZ differ from chronic SCZ and whether these eye movement abnormalities are enriched in psychosis risk syndrome (PRS). Methods: The training set included 104 Chinese HC and 60 Chinese patients with SCZ, and the testing set included 20 SCZ patients and 20 HC from a UK cohort. An additional 16 individuals with PRS were also enrolled. Eye movements of all participants were recorded during free-viewing, smooth pursuit, and fixation stability tasks. Group differences in 55 performance measures were compared and a gradient-boosted decision tree model was built for predictive analyses. Results: Extensive eye-movement abnormalities were observed in patients with SCZ on almost all eye-movement tests. On almost all individual variables, first-episode patients showed no statistically significant differences compared with chronic patients. The classification model was able to discriminate patients from controls with an area under the curve of 0.87; the model also classified 88% of PRS individuals as SCZ-like. Conclusions: Our findings replicate and extend the UK results. The overall accuracy of the Chinese study is virtually identical to the UK findings. We conclude that eye-movement abnormalities appear early in the natural history of the disorder and can be considered as potential trait markers for SCZ diathesis. |
Anastasia Pilat; Rebecca J. McLean; Anna Vanina; Robert A. Dineen; Irene Gottlob Clinical features and imaging characteristics in achiasmia Journal Article In: Brain Communications, vol. 5, no. 4, pp. 1–11, 2023. @article{Pilat2023, Achiasmia is a rare visual pathway maldevelopment with reduced decussation of the axons in the optic chiasm. Our aim was to investigate clinical characteristics, macular, optic nerve and brain morphology in achiasmia. A prospective, cross-sectional, observational study of 12 participants with achiasmia [8 males and 4 females; 29.6 ± 18.4 years (mean ± standard deviation)] and 24 gender-, age-, ethnicity- and refraction-matched healthy controls was done. Full ophthalmology assessment, eye movement recording, a high-resolution spectral-domain optical coherence tomography of the macular and optic disc, five-channel visual-evoked responses, eye movement recordings and MRI scans of the brain and orbits were acquired. Achiasmia was confirmed in all 12 clinical participants by visual-evoked responses. Visual acuity in this group was 0.63 ± 0.19 and 0.53 ± 0.19 for the right and left eyes, respectively; most participants had mild refractive errors. All participants with achiasmia had see-saw nystagmus and no measurable stereo vision. Strabismus and abnormal head position were noted in 58% of participants. Optical coherence tomography showed optic nerve hypoplasia with associated foveal hypoplasia in four participants. In the remaining achiasmia participants, macular changes with significantly thinner paracentral inner segment (P = 0.002), wider pit (P = 0.04) and visual flattening of the ellipsoid line were found. MRI demonstrated chiasmatic aplasia in 3/12 (25%), chiasmatic hypoplasia in 7/12 (58%) and a subjectively normal chiasm in 2/12 (17%). Septo-optic dysplasia and severe bilateral optic nerve hypoplasia were found in three patients with chiasmic aplasia/hypoplasia on MRI. In this largest series of achiasmia patients to date, we found for the first time that neuronal abnormalities occur already at the retinal level. Foveal changes, optic nerve hypoplasia and the midline brain anomaly suggest that these abnormalities could be part of the same spectrum, with different manifestations of events during foetal development occurring with varying severity. |
Sotiris Plainis; Emmanouil Ktistakis; Miltiadis K. Tsilimbaris Presbyopia correction with multifocal contact lenses: Evaluation of silent reading performance using eye movements analysis Journal Article In: Contact Lens and Anterior Eye, vol. 46, no. 4, pp. 1–8, 2023. @article{Plainis2023, Purpose: Many activities of daily living rely on reading, thus is not surprising that complaints from presbyopes originate in reading difficulties rather in visual acuity. Here, the effectiveness of presbyopia correction with multifocal contact lenses (CLs) is evaluated using an eye-fixation based method of silent reading performance. Μethods: Visual performance of thirty presbyopic volunteers (age: 50 ± 5 yrs) was assessed monocularly and binocularly following 15 days of wear of monthly disposable CLs (AIR OPTIX™ plus HydraGlyde™, Alcon Laboratories) with: (a) single vision (SV) lenses – uncorrected for near (b) aspheric multifocal (MF) CLs. LogMAR acuity was measured with ETDRS charts. Reading performance was evaluated using standard IReST paragraphs displayed on a screen (0.4 logMAR print size at 40 cm distance). Eye movements were monitored with an infrared eyetracker (Eye-Link II, SR Research Ltd). Data analysis included computation of reading speed, fixation duration, fixations per word and percentage of regressions. Results: Average reading speed was 250 ± 68 and 235 ± 70 wpm, binocularly and monocularly, with SV CLs, improving statistically significantly to 280 ± 67 (p = 0.002) and 260 ± 59 wpm (p = 0.01), respectively, with MF CLs. Moreover, fixation duration, fixations per word and ex-Gaussian parameter of fixation duration, μ, showed a statistically significant improvement when reading with MF CLs, with fixation duration exhibiting the stronger correlation (r = 0.79, p < 0.001) with improvement in reading speed. The correlation between improvement in VA and reading speed was moderate (r = 0.46 |
Antonella Pomè; Sandra Tyralla; Eckart Zimmermann Altered oculomotor flexibility is linked to high autistic traits Journal Article In: Scientific Reports, vol. 13, no. 1, pp. 1–12, 2023. @article{Pome2023, Autism is a multifaced disorder comprising sensory abnormalities and a general inflexibility in the motor domain. The sensorimotor system is continuously challenged to answer whether motion-contingent errors result from own movements or whether they are due to external motion. Disturbances in this decision could lead to the perception of motion when there is none and to an inflexibility with regard to motor learning. Here, we test the hypothesis that altered processing of gaze-contingent sensations are responsible for both the motor inflexibility and the sensory overload in autism. We measured motor flexibility by testing how strong participants adapted in a classical saccade adaptation task. We asked healthy participants, scored for autistic traits, to make saccades to a target that was displaced either in inward or in outward direction during saccade execution. The amount of saccade adaptation, that requires to shift the internal target representation, varied with the autistic symptom severity. The higher participants scored for autistic traits, the less they adapted. In order to test for visual stability, we asked participants to localize the position of the saccade target after they completed their saccade. We found the often-reported saccade-induced mislocalization in low Autistic Quotient (AQ) participants. However, we also found mislocalization in high AQ participants despite the absence of saccade adaptation. Our data suggest that high autistic traits are associated with an oculomotor inflexibility that might produce altered processing of trans-saccadic vision which might increase the perceptual overstimulation that is experienced in autism spectrum disorders (ASD). |
Peter Reddingius; Daniel S. Asfaw; Vera M. Mönter; Nicholas D. Smith; Pete R. Jones; David P. Crabb Data on eye movements of glaucoma patients with asymmetrical visual field loss during free viewing Journal Article In: Data in Brief, vol. 48, pp. 1–7, 2023. @article{Reddingius2023, This paper describes data from Asfaw at al. [1], which examined the eye movements of glaucoma patients (n=15) with pronounced asymmetrical vision loss (visual field loss worse in one eye). This allows for within-subject comparisons between the better and worse eye, thereby controlling for the effects of individual differences between patients. All patients had a clinical diagnosis of open angle glaucoma (OAG). Participants were asked to look at images of nature monocularly (free viewing; fellow eye patched) while gaze was recorded at 1000 Hz using a remote eye tracker (EyeLink 1000). Raw and processed eye tracking data are provided. In addition, clinical (visual acuity, contrast sensitivity and visual field) and demographic information (age, sex) are provided. |
Soroosh Shalileh; Dmitry Ignatov; Anastasiya Lopukhina; Olga Dragoy Identifying dyslexia in school pupils from eye movement and demographic data using artificial intelligence Journal Article In: PLoS ONE, vol. 18, pp. 1–26, 2023. @article{Shalileh2023, This paper represents our research results in the pursuit of the following objectives: (i) to introduce a novel multi-sources data set to tackle the shortcomings of the previous data sets, (ii) to propose a robust artificial intelligence-based solution to identify dyslexia in primary school pupils, (iii) to investigate our psycholinguistic knowledge by studying the importance of the features in identifying dyslexia by our best AI model. In order to achieve the first objective, we collected and annotated a new set of eye-movement-during-reading data. Furthermore, we collected demographic data, including the measure of non-verbal intelligence, to form our three data sources. Our data set is the largest eye-movement data set globally. Unlike the previously introduced binary-class data sets, it contains (A) three class labels and (B) reading speed. Concerning the second objective, we formulated the task of dyslexia prediction as regression and classification problems and scrutinized the performance of 12 classifications and eight regressions approaches. We exploited the Bayesian optimization method to fine-tune the hyperparameters of the models: and reported the average and the standard deviation of our evaluation metrics in a stratified ten-fold cross-validation. Our studies showed that multi-layer perceptron, random forest, gradient boosting, and k-nearest neighbor form the group having the most acceptable results. Moreover, we showed that although separately using each data source did not lead to accurate results, their combination led to a reliable solution. We also determined the importance of the features of our best classifier: our findings showed that the IQ, gender, and age are the top three important features; we also showed that fixation along the y-axis is more important than other fixation data. Dyslexia detection, eye fixation, eye movement, demographic, classification, regression, artificial intelligence. |
Binbin Sun; Bryan Wang; Zhen Wei; Zhe Feng; Zhi Liu Wu; Walid Yassin; William S. Stone; Yan Lin; Xue Jun Kong Identification of diagnostic markers for ASD: A restrictive interest analysis based on EEG combined with eye tracking Journal Article In: Frontiers in Neuroscience, vol. 17, pp. 1–16, 2023. @article{Sun2023, Electroencephalography (EEG) functional connectivity (EFC) and eye tracking (ET) have been explored as objective screening methods for autism spectrum disorder (ASD), but no study has yet evaluated restricted and repetitive behavior (RRBs) simultaneously to infer early ASD diagnosis. Typically developing (TD) children (n = 27) and ASD (n = 32), age- and sex-matched, were evaluated with EFC and ET simultaneously, using the restricted interest stimulus paradigm. Network-based machine learning prediction (NBS-predict) was used to identify ASD. Correlations between EFC, ET, and Autism Diagnostic Observation Schedule-Second Edition (ADOS-2) were performed. The Area Under the Curve (AUC) of receiver-operating characteristics (ROC) was measured to evaluate the predictive performance. Under high restrictive interest stimuli (HRIS), ASD children have significantly higher α band connectivity and significantly more total fixation time (TFT)/pupil enlargement of ET relative to TD children (p = 0.04299). These biomarkers were not only significantly positively correlated with each other (R = 0.716 |
Yasuo Terao; Yoshiko Nomura; Hideki Fukuda; Okihide Hikosaka; Kazue Kimura; Shun-ichi Matsuda; Akihiro Yugeta; Francesco Fisicaro; Kyoko Hoshino; Yoshikazu Ugawa The pathophysiology of Gilles de la Tourette Syndrome: Changes in saccade performance by low-dose L-Dopa and dopamine receptor blockers Journal Article In: Brain Sciences, vol. 13, no. 12, pp. 1–23, 2023. @article{Terao2023, Aim: To elucidate the pathophysiology of Gilles de la Tourette syndrome (GTS), which is associated with prior use of dopamine receptor antagonists (blockers) and treatment by L-Dopa, through saccade performance. Method: In 226 male GTS patients (5–14 years), we followed vocal and motor tics and obsessive–compulsive disorder (OCD) after discontinuing blockers at the first visit starting with low-dose L-Dopa. We recorded visual- (VGS) and memory-guided saccades (MGS) in 110 patients and 26 normal participants. Results: At the first visit, prior blocker users exhibited more severe vocal tics and OCD, but not motor tics, which persisted during follow-up. Patients treated with L-Dopa showed greater improvement of motor tics, but not vocal tics and OCD. Patients with and without blocker use showed similarly impaired MGS performance, while patients with blocker use showed more prominently impaired inhibitory control of saccades, associated with vocal tics and OCD. Discussion: Impaired MGS performance suggested a mild hypodopaminergic state causing reduced direct pathway activity in the (oculo-)motor loops of the basal ganglia–thalamocortical circuit. Blocker use may aggravate vocal tics and OCD due to disinhibition within the associative and limbic loops. The findings provide a rationale for discouraging blocker use and using low-dose L-Dopa in GTS. |
Yasuo Terao; Shin-ichi Tokushige; Satomi Inomata-Terada; Tai Miyazaki; Naoki Kotsuki; Francesco Fisicaro; Yoshikazu Ugawa How do patients with Parkinson's disease and cerebellar ataxia read aloud? -Eye–voice coordination in text reading Journal Article In: Frontiers in Neuroscience, vol. 17, pp. 1–25, 2023. @article{Terao2023a, Background: The coordination between gaze and voice is closely linked when reading text aloud, with the gaze leading the reading position by a certain eye–voice lead (EVL). How this coordination is affected is unknown in patients with cerebellar ataxia and parkinsonism, who show oculomotor deficits possibly impacting coordination between different effectors. Objective: To elucidate the role of the cerebellum and basal ganglia in eye–voice coordination during reading aloud, by studying patients with Parkinson's disease (PD) and spinocerebellar degeneration (SCD). Methods: Participants were sixteen SCD patients, 18 PD patients, and 30 age-matched normal subjects, all native Japanese speakers without cognitive impairment. Subjects read aloud Japanese texts of varying readability displayed on a monitor in front of their eyes, consisting of Chinese characters and hiragana (Japanese phonograms). The gaze and voice reading the text was simultaneously recorded by video-oculography and a microphone. A custom program synchronized and aligned the gaze and audio data in time. Results: Reading speed was significantly reduced in SCD patients (3.53 ± 1.81 letters/s), requiring frequent regressions to compensate for the slow reading speed. In contrast, PD patients read at a comparable speed to normal subjects (4.79 ± 3.13 letters/s vs. 4.71 ± 2.38 letters/s). The gaze scanning speed, excluding regressive saccades, was slower in PD patients (9.64 ± 4.26 letters/s) compared to both normal subjects (12.55 ± 5.42 letters/s) and SCD patients (10.81 ± 4.52 letters/s). PD patients' gaze could not far exceed that of the reading speed, with smaller allowance for the gaze to proceed ahead of the reading position. Spatial EVL was similar across the three groups for all texts (normal: 2.95 ± 1.17 letters/s, PD: 2.95 ± 1.51 letters/s, SCD: 3.21 ± 1.35 letters/s). The ratio of gaze duration to temporal EVL was lowest for SCD patients (normal: 0.73 ± 0.50, PD: 0.70 ± 0.37, SCD: 0.40 ± 0.15). Conclusion: Although coordination between voice and eye movements and normal eye-voice span was observed in both PD and SCD, SCD patients made frequent regressions to manage the slowed vocal output, restricting the ability for advance processing of text ahead of the gaze. In contrast, PD patients experience restricted reading speed primarily due to slowed scanning, limiting their maximum reading speed but effectively utilizing advance processing of upcoming text. |
Valldeflors Vinuela-Navarro; Joan Goset; Mikel Aldaba; Clara Mestre; Cristina Rovira-Gay; Neus Cano; Mar Ariza; Bàrbara Delàs; Maite Garolera; Meritxell Vilaseca Eye movements in patients with post-COVID condition Journal Article In: Biomedical Optics Express, vol. 14, no. 8, pp. 1–14, 2023. @article{VinuelaNavarro2023, Eye movement control is impaired in some neurological conditions, but the impact of COVID-19 on eye movements remains unknown. This study aims to investigate differences in oculomotor function and pupil response in individuals who suffer post-COVID-19 condition (PCC) with cognitive deficits. Saccades, smooth pursuit, fixation, vergence and pupillary response were recorded using an eye tracker. Eye movements and pupil response parameters were computed. Data from 16 controls, 38 COVID mild (home recovery) and 19 COVID severe (hospital admission) participants were analyzed. Saccadic latencies were shorter in controls (183 ± 54 ms) than in COVID mild (236 ± 83 ms) and COVID severe (227 ± 42 ms) participants (p = 0.017). Fixation stability was poorer in COVID mild participants (Bivariate Contour Ellipse Area of 0.80 ± 1.61° 2 vs 0.36 ± 0.65 ° 2 for controls |
Veronica Whitford; Narissa Byers; Gillian A. O'Driscoll; Debra Titone Eye movements and the perceptual span in disordered reading: A comparison of schizophrenia and dyslexia Journal Article In: Schizophrenia Research: Cognition, vol. 34, pp. 1–13, 2023. @article{Whitford2023, Increasing evidence of a common neurodevelopmental etiology between schizophrenia and developmental dyslexia suggests that neurocognitive functions, such as reading, may be similarly disrupted. However, direct comparisons of reading performance in these disorders have yet to be conducted. To address this gap in the literature, we employed a gaze-contingent moving window paradigm to examine sentence-level reading fluency and perceptual span (breadth of parafoveal processing) in adults with schizophrenia (dataset from Whitford et al., 2013) and psychiatrically healthy adults with dyslexia (newly collected dataset). We found that the schizophrenia and dyslexia groups exhibited similar reductions in sentence-level reading fluency (e.g., slower reading rates, more regressions) compared to matched controls. Similar reductions were also found for standardized language/reading and executive functioning measures. However, despite these reductions, the dyslexia group exhibited a larger perceptual span (greater parafoveal processing) than the schizophrenia group, potentially reflecting a disruption in normal foveal-parafoveal processing dynamics. Taken together, our findings suggest that reading and reading-related functions are largely similarly disrupted in schizophrenia and dyslexia, providing additional support for a common neurodevelopmental etiology. |
Leonhard H. Drescher; C. Nico Boehler; Jan R. Wiersema A pupillometric investigation of state regulation in adults scoring high versus low on ADHD symptomatology Journal Article In: Acta Psychologica, vol. 235, pp. 1–10, 2023. @article{Drescher2023, According to the state regulation deficit (SRD) account, ADHD is associated with difficulties regulating tonic arousal levels, which may be due to inefficient effort allocation. We aimed to test the SRD account by using a target detection task with three different event rates (ER; 700 ms, 1800 ms, 6000 ms), in order to manipulate the tonic arousal state and its effects on performance and pupil indices in adults with high (n = 40) versus low (n = 36) ADHD symptom levels. In an additional condition, a fast ER (700 ms) was accompanied by auditory white noise (WN), to further increase tonic arousal level. The ER manipulation had a clear effect on RT and variability of RT. These effects were more pronounced for the high-ADHD group, especially for variability of RT with decreasing ER, suggestive of deficient upregulation of a tonic arousal state in that group, in line with their self-reported SRDs in daily life. Adding WN to the fast condition led to more errors, however similarly for both groups. Contrary to our predictions, the ER manipulation had no effect on tonic pupil size (as a measure of tonic arousal). Phasic pupil amplitude (as a measure of cognitive effort) linearly increased with decreasing ER, suggesting more effort allocation during slower ERs. WN decreased phasic pupil amplitude, but had no impact on tonic pupil size. Importantly, however, no ADHD-related differences were present for the pupil indices. In conclusion, adults with elevated levels of ADHD symptoms reported more SRDs in daily life and showed a performance pattern that suggests difficulties in upregulating but not downregulating the tonic arousal state. Surprisingly, these findings were not accompanied by group differences in pupillometric indices. This casts some doubts on the relationship between these measures of autonomic nervous system activity and state regulation, in particular in the context of ADHD symptomatology. |
Kacie Dunham-Carr; Jacob I. Feldman; David M. Simon; Sarah R. Edmunds; Alexander Tu; Wayne Kuang; Julie G. Conrad; Pooja Santapuram; Mark T. Wallace; Tiffany G. Woynaroski The processing of audiovisual speech is linked with vocabulary in autistic and monautistic children: An ERP study Journal Article In: Brain Sciences, vol. 13, no. 7, pp. 1–15, 2023. @article{DunhamCarr2023, Explaining individual differences in vocabulary in autism is critical, as understanding and using words to communicate are key predictors of long-term outcomes for autistic individuals. Differences in audiovisual speech processing may explain variability in vocabulary in autism. The efficiency of audiovisual speech processing can be indexed via amplitude suppression, wherein the amplitude of the event-related potential (ERP) is reduced at the P2 component in response to audiovisual speech compared to auditory-only speech. This study used electroencephalography (EEG) to measure P2 amplitudes in response to auditory-only and audiovisual speech and norm-referenced, standardized assessments to measure vocabulary in 25 autistic and 25 nonautistic children to determine whether amplitude suppression (a) differs or (b) explains variability in vocabulary in autistic and nonautistic children. A series of regression analyses evaluated associations between amplitude suppression and vocabulary scores. Both groups demonstrated P2 amplitude suppression, on average, in response to audiovisual speech relative to auditory-only speech. Between-group differences in mean amplitude suppression were nonsignificant. Individual differences in amplitude suppression were positively associated with expressive vocabulary through receptive vocabulary, as evidenced by a significant indirect effect observed across groups. The results suggest that efficiency of audiovisual speech processing may explain variance in vocabulary in autism. |
Matt J. Dunn; Perry Carter; Jay Self; Helena Lee; Fatima Shawkat Eyetracking-enhanced VEP for nystagmus Journal Article In: Scientific Reports, vol. 13, no. 1, pp. 1–6, 2023. @article{Dunn2023, Visual evoked potentials (VEPs) are an important prognostic indicator of visual ability in patients with nystagmus. However, VEP testing requires stable fixation, which is impossible with nystagmus. Fixation instability reduces VEP amplitude, and VEP reliability is therefore low in this important patient group. We investigated whether VEP amplitude can be increased using an eye tracker by triggering acquisition only during slow periods of the waveform. Data were collected from 10 individuals with early-onset nystagmus. VEP was obtained under continuous (standard) acquisition, or triggered during periods of low eye velocity, as detected by an eye tracker. VEP amplitude was compared using Bonferroni corrected paired samples t-tests. VEP amplitude is significantly increased when triggered during low eye velocity (95% CI 1.42–6.83 µV, t(15) = 3.25 |
Ciara Egan; Joshua S. Payne; Manon W. Jones In: Neuropsychologia, vol. 184, pp. 1–8, 2023. @article{Egan2023, Readers with developmental dyslexia are known to be impaired in representing and accessing phonology, but their ability to process meaning is generally considered to be intact. However, neurocognitive studies show evidence of a subtle semantic processing deficit in dyslexic readers, relative to their typically-developing peers. Here, we compared dyslexic and typical adult readers on their ability to judge semantic congruency (congruent vs. inconcongruent) in short, two-word phrases, which were further manipulated for phonological relatedness (alliterating vs. non-alliterating); “dazzling-diamond”; “sparkling-diamond”; “dangerous-diamond”; and “creepy-diamond”. At the level of behavioural judgement, all readers were less accurate when evaluating incongruent alliterating items compared with incongruent non-aliterating, suggesting that phonological patterning creates the illusion of semantic congruency (as per Egan et al., 2020). Dyslexic readers showed a similar propensity for this form-meaning relationship despite a phonological processing impairment as evidenced in the cognitive and literacy indicative assessments. Dyslexic readers also showed an overall reduction in the ability to accurately judge semantic congruency, suggestive of a subtle semantic impairment. Whilst no group differences emerged in the electrophysiological measures, our pupil dilation measurements revealed a global tendency for dyslexic readers to manifest a reduced attentional response to these word stimuli, compared with typical readers. Our results show a broad manifestation of neurocognitive differences in adult dyslexic and typical readers' processing of print, at the level of autonomic arousal as well as in higher level semantic judgements. |
Ciara Egan; Anna Siyanova-Chanturia; Paul Warren; Manon W. Jones As clear as glass: How figurativeness and familiarity impact simile processing in readers with and without dyslexia Journal Article In: Quarterly Journal of Experimental Psychology, vol. 76, no. 2, pp. 231–247, 2023. @article{Egan2023a, For skilled readers, idiomatic language confers faster access to overall meaning compared with non-idiomatic language, with a processing advantage for figurative over literal interpretation. However, currently very little research exists to elucidate whether atypical readers—such as those with developmental dyslexia—show such a processing advantage for figurative interpretations of idioms, or whether their reading impairment implicates subtle differences in semantic access. We wanted to know whether an initial figurative interpretation of similes, for both typical and dyslexic readers, is dependent on familiarity. Here, we tracked typical and dyslexic readers' eye movements as they read sentences containing similes (e.g., as cold as ice), orthogonally manipulated for novelty (e.g., familiar: as cold as ice, novel: as cold as snow) and figurativeness (e.g., literal: as cold as ice [low temperature], figurative: as cold as ice [emotionally distant]), with figurativeness being defined by the sentence context. Both participant groups exhibited a processing advantage for familiar and figurative similes over novel and literal similes. However, compared with typical readers, participants with dyslexia had greater difficulty processing similes both when they were unfamiliar and when the context biased the simile meaning towards a literal rather than a figurative interpretation. Our findings suggest a semantic processing anomaly in dyslexic readers, which we discuss in light of recent literature on sentence-level semantic processing. |
Yunwei Fan; Li Li; Ping Chu; Qian Wu; Yuan Wang; Wen Hong Cao; Ningdong Li Clinical analysis of eye movement-based data in the medical diagnosis of amblyopia Journal Article In: Methods, vol. 213, pp. 26–32, 2023. @article{Fan2023a, Amblyopia is an abnormal visual processing-induced developmental disorder of the central nervous system that affects static and dynamic vision, as well as binocular visual function. Currently, changes in static vision in one eye are the gold standard for amblyopia diagnosis. However, there have been few comprehensive analyses of changes in dynamic vision, especially eye movement, among children with amblyopia. Here, we proposed an optimization scheme involving a video eye tracker combined with an “artificial eye” for comprehensive examination of eye movement in children with amblyopia; we sought to improve the diagnostic criteria for amblyopia and provide theoretical support for practical treatment. The resulting eye movement data were used to construct a deep learning approach for diagnostic and predictive applications. Through efforts to manage the uncooperativeness of children with strabismus who could not complete the eye movement assessment, this study quantitatively and objectively assessed the clinical implications of eye movement characteristics in children with amblyopia. Our results indicated that an amblyopic eye is always in a state of adjustment, and thus is not “lazy.” Additionally, we found that the eye movement parameters of amblyopic eyes and eyes with normal vision are significantly different. Finally, we identified eye movement parameters that can be used to supplement and optimize the diagnostic criteria for amblyopia, providing a diagnostic basis for evaluation of binocular visual function. |
Leslie Guadron; Samuel A. Titchener; Carla J. Abbott; Lauren N. Ayton; John Opstal; Matthew A. Petoe; Jeroen Goossens The saccade main sequence in patients with retinitis pigmentosa and advanced age-related macular degeneration Journal Article In: Investigative Ophthalmology & Visual Science, vol. 64, no. 3, pp. 1–18, 2023. @article{Guadron2023, PURPOSE. Most eye-movement studies in patients with visual field defects have examined the strategies that patients use while exploring a visual scene, but they have not investigated saccade kinematics. In healthy vision, saccade trajectories follow the remarkably stereotyped “main sequence”: saccade duration increases linearly with saccade amplitude; peak velocity also increases linearly for small amplitudes, but approaches a saturation limit for large amplitudes. Recent theories propose that these relationships reflect the brain's attempt to optimize vision when planning eye movements. Therefore, in patients with bilateral retinal damage, saccadic behavior might differ to optimize vision under the constraints imposed by the visual field defects. METHODS. We compared saccadic behavior of patients with central vision loss, due to age-related macular degeneration (AMD), and patients with peripheral vision loss, due to retinitis pigmentosa (RP), to that of controls with normal vision (NV) using a horizontal saccade task. RESULTS. Both patient groups demonstrated deficits in saccade reaction times and target localization behavior, as well as altered saccade kinematics. Saccades were generally slower and the shape of the velocity profiles were often atypical, especially in the patients with RP. In the patients with AMD, the changes were far less dramatic. For both groups, saccade kinematics were affected most when the target was in the subjects' blind field. CONCLUSIONS. We conclude that defects of the central and peripheral retina have distinct effects on the saccade main sequence, and that visual inputs play an important role in planning the kinematics of a saccade. |
J. Hartman; J. Saffran; R. Litovsky Word learning in deaf adults who use cochlear implants: The role of talker variability and attention to the mouth Journal Article In: Ear & Hearing, pp. 1–14, 2023. @article{Hartman2023, OBJECTIVES: Although cochlear implants (CIs) facilitate spoken language acquisition, many CI listeners experience difficulty learning new words. Studies have shown 29that highly variable stimulus input and audiovisual cues improve speech perception in CI listeners. However, less is known whether these two factors improve perception in a word learning context. Furthermore, few studies have examined how CI listeners direct their gaze to efficiently capture visual information available on a talker's face. The purpose of this study was two-fold: (1) to examine whether talker variability could improve word learning in CI listeners and (2) to examine how CI listeners direct their gaze while viewing a talker speak. DESIGN: Eighteen adults with CIs and 10 adults with normal hearing (NH) learned eight novel word-object pairs spoken by a single talker or six different talkers (multiple talkers). The word learning task comprised of nonsense words following the phonotactic rules of English. Learning was probed using a novel talker in a two-alternative forced-choice eye gaze task. Learners' eye movements to the mouth and the target object (accuracy) were tracked over time. RESULTS: Both groups performed near ceiling during the test phase, regardless of whether they learned from the same talker or different talkers. However, compared to listeners with NH, CI listeners directed their gaze significantly more to the talker's mouth while learning the words. CONCLUSIONS: Unlike NH listeners who can successfully learn words without focusing on the talker's mouth, CI listeners tended to direct their gaze to the talker's mouth, which may facilitate learning. This finding is consistent with the hypothesis that CI listeners use a visual processing strategy that efficiently captures redundant audiovisual speech cues available at the mouth. Due to ceiling effects, however, it is unclear whether talker variability facilitated word learning for adult CI listeners, an issue that should be addressed in future work using more difficult listening conditions. |
Kara Hawthorne; Susan J. Loveall In: Journal of Speech, Language, and Hearing Research, vol. 66, no. 9, pp. 3606–3621, 2023. @article{Hawthorne2023, Purpose: Pronouns are referentially ambiguous: For example, “she” could refer to any female. Nonetheless, errors in pronoun interpretation rarely occur for adults with typical development (TD) due to several strategies implicitly shared between the talker and listener. The purpose of this study was to test the impacts of syntactic, semantic, and prosodic prominence on pronoun interpre-tation for adults with intellectual and developmental disabilities (IDD) and TD. Method: Adults with IDD (n =28) andTD (n = 27) listened to ministories involving a pronoun with two potential antecedents that varied in syntactic, semantic, and prag-matic prominence. Subject/first-mentioned antecedents are more syntactically prominent than object antecedents. Semantic prominence was manipulated via verb transitivity: Subjects are more semantically prominent when the verb is highly transitive (e.g., “hit” vs. “see,” a low-transitivity verb for which the subject is merely experiencing the action). Pragmatic prominence was manipulated by placing pro-sodic focus on one of the two potential antecedents. Eye gaze to images represent-ing the potential antecedents was tracked as a measure of online processing. Responses to a follow-up pronoun interpretation question were also recorded. Results: Adults with TD used syntactic, semantic, and—in early processing— pragmatic prominence when interpreting ambiguous pronouns. Adults with IDD were sensitive to syntactic prominence but to a significantly lesser extent than their peers with TD. Conclusions: Pronouns are an integral part of everyday conversation, and when the conversational partners do not share common strategies to link ambiguous pronouns with their antecedents, misunderstandings will occur. Results show that adults with IDD only weakly share pronoun interpretation strategies with adults with TD, suggesting that pronouns may be an important focus for inter-vention for this population. |
Yang Zhou; Ou Zhu; David J. Freedman Posterior parietal cortex plays a causal role in abstract memory-based visual categorical decisions Journal Article In: Journal of Neuroscience, vol. 43, no. 23, pp. 4315–4328, 2023. @article{Zhou2023c, Neural activity in the lateral intraparietal cortex (LIP) correlates with both sensory evaluation and motor planning underlying visuomotor decisions. We previously showed that LIP plays a causal role in visually-based perceptual and categorical decisions, and preferentially contributes to evaluating sensory stimuli over motor planning. In that study, however, monkeys reported their decisions with a saccade to a colored target associated with the correct motion category or direction. Since LIP is known to play a role in saccade planning, it remains unclear whether LIP's causal role in such decisions extend to decision-making tasks which do not involve saccades. Here, we employed reversible pharmacological inactivation of LIP neural activity while two male monkeys performed delayed match to category (DMC) and delayed match to sample (DMS) tasks. In both tasks, monkeys needed to maintain gaze fixation throughout the trial and report whether a test stimulus was a categorical match or nonmatch to the previous sample stimulus by releasing a touch bar. LIP inactivation impaired monkeys' behavioral performance in both tasks, with deficits in both accuracy and reaction time (RT). Furthermore, we recorded LIP neural activity in the DMC task targeting the same cortical locations as in the inactivation experiments. We found significant neural encoding of the sample category, which was correlated with monkeys' categorical decisions in the DMC task. Taken together, our results demonstrate that LIP plays a generalized role in visual categorical decisions independent of the task-structure and motor response modality. |
Ying Joey Zhou; Aarti Ramchandran; Saskia Haegens Alpha oscillations protect working memory against distracters in a modality-specific way Journal Article In: NeuroImage, vol. 278, pp. 1–9, 2023. @article{Zhou2023d, Alpha oscillations are thought to be involved in suppressing distracting input in working-memory tasks. Yet, the spatial-temporal dynamics of such suppression remain unclear. Key questions are whether such suppression reflects a domain-general inattentiveness mechanism, or occurs in a stimulus- or modality-specific manner within cortical areas most responsive to the distracters; and whether the suppression is proactive (i.e., preparatory) or reactive. Here, we addressed these questions using a working-memory task where participants had to memorize an array of visually presented digits and reproduce one of them upon being probed. We manipulated the presence of distracters and the sensory modality in which distracters were presented during memory maintenance. Our results show that sensory areas most responsive to visual and auditory distracters exhibited stronger alpha power increase after visual and auditory distracter presentation respectively. These results suggest that alpha oscillations underlie distracter suppression in a reactive, modality-specific manner. |
Dandan Zhu; Xuan Shao; Qiangqiang Zhou; Xiongkuo Min; Guangtao Zhai; Xiaokang Yang A novel lightweight audio-visual saliency model for videos Journal Article In: ACM Transactions on Multimedia Computing, Communications and Applications, vol. 19, no. 4, pp. 1–22, 2023. @article{Zhu2023, Audio information has not been considered an important factor in visual attention models regardless of many psychological studies that have shown the importance of audio information in the human visual perception system. Since existing visual attention models only utilize visual information, their performance is limited but also requires high-computational complexity due to the limited information available. To overcome these problems, we propose a lightweight audio-visual saliency (LAVS) model for video sequences. To the best of our knowledge, this article is the first trial to utilize audio cues for an efficient deep-learning model for the video saliency estimation. First, spatial-temporal visual features are extracted by the lightweight receptive field block (RFB) with the bidirectional ConvLSTM units. Then, audio features are extracted by using an improved lightweight environment sound classification model. Subsequently, deep canonical correlation analysis (DCCA) aims at capturing the correspondence between audio and spatial-temporal visual features, thus obtaining a spatial-temporal auditory saliency. Lastly, the spatial-temporal visual and auditory saliency are fused to obtain the audio-visual saliency map. Extensive comparative experiments and ablation studies validate the performance of the LAVS model in terms of effectiveness and complexity. |
Xi Zhu; Amit Lazarov; Sarah Dolan; Yair Bar-Haim; Daniel G. Dillon; Diego A. Pizzagalli; Franklin Schneier Resting state connectivity predictors of symptom change during gaze-contingent music reward therapy of social anxiety disorder Journal Article In: Psychological Medicine, vol. 53, no. 7, pp. 3115–3123, 2023. @article{Zhu2023a, Background Social anxiety disorder (SAD) is common, first-line treatments are often only partially effective, and reliable predictors of treatment response are lacking. Here, we assessed resting state functional connectivity (rsFC) at pre-treatment and during early treatment as a potential predictor of response to a novel attention bias modification procedure, gaze-contingent music reward therapy (GC-MRT). Methods Thirty-two adults with SAD were treated with GC-MRT. rsFC was assessed with multi-voxel pattern analysis of fMRI at pre-treatment and after 2-3 weeks. For comparison, 20 healthy control (HC) participants without treatment were assessed twice for rsFC over the same time period. All SAD participants underwent clinical evaluation at pre-treatment, early-treatment (week 2-3), and post-treatment. Results SAD and depressive symptoms improved significantly from pre-treatment to post-treatment. After 2-3 weeks of treatment, decreased connectivity between the executive control network (ECN) and salience network (SN), and increased connectivity within the ECN predicted improvement in SAD and depressive symptoms at week 8. Increased connectivity between the ECN and default mode network (DMN) predicted greater improvement in SAD but not depressive symptoms at week 8. Connectivity within the DMN decreased significantly after 2-3 weeks of treatment in the SAD group, while no changes were found in HC over the same time interval. Conclusion We identified early changes in rsFC during a course of GC-MRT for SAD that predicted symptom change. Connectivity changes within the ECN, ECN-DMN, and ECN-SN may be related to mechanisms underlying the clinical effects of GC-MRT and warrant further study in controlled trials. |
Laoura Ziaka; Athanassios Protopapas Cognitive control beyond single-item tasks: insights from pupillometry, gaze, and behavioral measures Journal Article In: Journal of Experimental Psychology: Human Perception and Performance, vol. 49, no. 7, pp. 968–988, 2023. @article{Ziaka2023, Cognitive control has been typically examined using single-item tasks. This has implications for the generalizability of theories of control implementation. Previous studies have revealed that different control demands are posed by tasks depending on whether they present stimuli individually (i.e., single-item) or simultaneously in array format (i.e., multi-item). In the present study, we tracked within-task performance in single-item and multi-item Stroop tasks using simultaneous pupillometry, gaze, and behavioral response measures, aiming to explore the implications of format differences for cognitive control. The results indicated within-task performance decline in the multi-item version of the Stroop task, accompanied by pupil constriction and dwell time increase, in both the incongruent and the neutral condition. In contrast, no performance decline or dwell time increase was observed in the course of the single-item version of the task.We interpret these findings in terms of capacity constraints on cognitive control, with implications for cognitive control research, and highlight the need for better understanding of the cognitive demands of multi-item tasks. |
Artyom Zinchenko; Markus Conci; Hermann J. Müller; Thomas Geyer Environmental regularities mitigate attentional misguidance in contextual cueing of visual search Journal Article In: Journal of Experimental Psychology: Learning, Memory, and Cognition, pp. 1–13, 2023. @article{Zinchenko2023, Visual search is faster when a fixed target location is paired with a spatially invariant (vs. randomly changing) distractor configuration, thus indicating that repeated contexts are learned, thereby guiding attention to the target (contextual cueing [CC]). Evidence for memory-guided attention has also been revealed with electrophysiological (electroencephalographic [EEG]) recordings, starting with an enhanced early posterior neg- ativity (N1pc), which signals a preattentive bias toward the target, and, subsequently, attentional and postselective components, such as the posterior contralateral negativity (PCN) and contralateral delay activ- ity (CDA), respectively. Despite effective learning, relearning of previously acquired contexts is inflexible: The CC benefits disappear when the target is relocated to a new position within an otherwise invariant context and corresponding EEG correlates are diminished. The present study tested whether global statistical properties that induce predictions going beyond the immediate invariant layout can facilitate contextual relearning. Global statistical regularities were implemented by presenting repeated and nonrepeated displays in separate streaks (mini blocks) of trials in the relocation phase, with individual displays being presented in a fixed and thus predictable order. Our results revealed a significant CC effect (and an associated modulation of the N1pc, PCN, and CDA components) during initial learning. Critically, the global statistical regularities in the relocation phase also resulted in a reliable CC effect, thus revealing effective relearning with predictive streaks. Moreover, this relearning was reflected in an enhanced PCN amplitude for repeated relative to non- repeated contexts. Temporally ordered contexts may thus adapt memory-based guidance of attention, par- ticularly the allocation of covert attention in the visual display. |
Feriel Zoghlami; Matteo Toscani Foveal to peripheral extrapolation of facial emotion Journal Article In: Perception, vol. 52, no. 7, pp. 514–523, 2023. @article{Zoghlami2023, Peripheral vision is characterized by poor resolution. Recent evidence from brightness perception suggests that missing information is filled out with information at fixation. Here we show a novel filling-out mechanism: when participants are presented with a crowd of faces, the perceived emotion of faces in peripheral vision is biased towards the emotion of the face at fixation. This mechanism is particularly important in social situations where people often need to perceive the overall mood of a crowd. Some faces in the crowd are more likely to catch people's attention and be looked at directly, while others are only seen peripherally. Our findings suggest that the perceived emotion of these peripheral faces, and the overall perceived mood of the crowd, is biased by the emotions of the faces that people look at directly. |
Eirini Zormpa; Antje S. Meyer; Laurel E. Brehm In conversation, answers are remembered better than the questions themselves Journal Article In: Journal of Experimental Psychology: Learning, Memory, and Cognition, vol. 49, no. 12, pp. 1971–1988, 2023. @article{Zormpa2023, Language is used in communicative contexts to identify and successfully transmit new information that should be later remembered. In three studies, we used question–answer pairs, a naturalistic device for focus- ing information, to examine how properties of conversations inform later item memory. In Experiment 1, participants viewed three pictures while listening to a recorded question–answer exchange between two peo- ple about the locations oftwo of the displayed pictures. In a memory recognition test conducted online a day later, participants recognized the names of pictures that served as answers more accurately than the names of pictures that appeared as questions. This suggests that this type of focus indeed boosts memory. In Experiment 2, participants listened to the same items embedded in declarative sentences. There was a reduced memory benefit for the second item, confirming the role of linguistic focus on later memory beyond a simple serial-position effect. In Experiment 3, two participants asked and answered the same questions about objects in a dialogue. Here, answers continued to receive a memory benefit, and this focus effect was accentuated by language production such that information-seekers remembered the answers to their questions better than information-givers remembered the questions they had been asked. Combined, these studies show how people's memory for conversation is modulated by the referential status of the items men- tioned and by the speaker's roles of the conversation participants. |
Xibo Zuo; Ying Ling; Todd Jackson Testing links between pain-related biases in visual attention and recognition memory: An eye-tracking study based on an impending pain paradigm Journal Article In: Quarterly Journal of Experimental Psychology, vol. 76, no. 5, pp. 1057 –1071, 2023. @article{Zuo2023, Although separate lines of research have evaluated pain-related biases in attention or memory, laboratory studies examining links between attention and memory for pain-related information have received little consideration. In this eye-tracking experiment, we assessed relations between pain-related attention biases (ABs) and recognition memory biases (MBs) among 122 pain-free adults randomly assigned to impending pain (n = 59) versus impending touch (n = 63) conditions, wherein offsets of trials that included pain images were followed by subsequent possibly painful and non-painful somatosensory stimulation, respectively. Gaze biases of participants were assessed during presentations of pain-neutral (P-N) and happy-neutral (H-N) face image pairs within these conditions. Subsequently, condition differences in recognition accuracy for previously viewed versus novel pained and happy face images were examined. Overall gaze durations were significantly longer for pain (vs. neutral) faces that signalled impending pain than impending non-painful touch, particularly among the less resilient in the former condition. Impending pain cohorts also exhibited comparatively better recognition accuracy for both pained and happy face images. Finally, longer gaze durations on pain faces that signalled potential pain, but not potential touch, were related to more accurate recognition of previously viewed pain faces. In sum, pain cues that signal potential personal discomfort maintain visual attention more fully and are subsequently recognised more accuracy than are pain cues that signal non-painful touch stimulation. |
M. J. Nelson; S. Moeller; M. Seckin; E. J. Rogalski; M. M. Mesulam; R. S. Hurley The eyes speak when the mouth cannot: Using eye movements to interpret omissions in primary progressive aphasia Journal Article In: Neuropsychologia, vol. 184, pp. 1–9, 2023. @article{Nelson2023, Though it may seem simple, object naming is a complex multistage process that can be impaired by lesions at various sites of the language network. Individuals with neurodegenerative disorders of language, known as primary progressive aphasias (PPA), have difficulty with naming objects, and instead frequently say “I don't know” or fail to give a vocal response at all, known as an omission. Whereas other types of naming errors (paraphasias) give clues as to which aspects of the language network have been compromised, the mechanisms underlying omissions remain largely unknown. In this study, we used a novel eye tracking approach to probe the cognitive mechanisms of omissions in the logopenic and semantic variants of PPA (PPA-L and PPA-S). For each participant, we identified pictures of common objects (e.g., animals, tools) that they could name aloud correctly, as well as pictures that elicited an omission. In a separate word-to-picture matching task, those pictures appeared as targets embedded among an array with 15 foils. Participants were given a verbal cue and tasked with pointing to the target, while eye movements were monitored. On trials with correctly-named targets, controls and both PPA groups ceased visual search soon after foveating the target. On omission trials, however, the PPA-S group failed to stop searching, and went on to view many foils “post-target”. As further indication of impaired word knowledge, gaze of the PPA-S group was subject to excessive “taxonomic capture”, such that they spent less time viewing the target and more time viewing related foils on omission trials. In contrast, viewing behavior of the PPA-L group was similar to controls on both correctly-named and omission trials. These results indicate that the mechanisms of omission in PPA differ by variant. In PPA-S, anterior temporal lobe degeneration causes taxonomic blurring, such that words from the same category can no longer be reliably distinguished. In PPA-L, word knowledge remains relatively intact, and omissions instead appear to be caused by downstream factors (e.g., lexical access, phonological encoding). These findings demonstrate that when words fail, eye movements can be particularly informative. |
Jenny A. Nij Bijvank; Sam N. Hof; Stefanos E. Prouskas; Menno M. Schoonheim; Bernard M. J. Uitdehaag; Laurentius J. Rijn; Axel Petzold A novel eye-movement impairment in multiple sclerosis indicating widespread cortical damage Journal Article In: Brain, vol. 146, no. 6, pp. 2476–2488, 2023. @article{NijBijvank2023, In multiple sclerosis, remyelination trials have yet to deliver success like that achieved for relapse rates with disease course modifying treatment trials. The challenge is to have a clinical, functional outcome measure. Currently, there are none that have been validated, other than visual evoked potentials in optic neuritis. Like vision, quick eye movements (saccades) are heavily dependent on myelination. We proposed that it is possible to extrapolate from demyelination of the medial longitudinal fasciculus in the brainstem to quantitative assessment of cortical networks governing saccadic eye movements in multiple sclerosis. We have developed and validated a double-step saccadic test, which consists of a pair of eye movements towards two stimuli presented in quick succession (the demonstrate eye movement networks with saccades protocol). In this single-centre, cross-sectional cohort study we interrogated the structural and functional relationships of double-step saccades in multiple sclerosis. Data were collected for double-step saccades, cognitive function (extended Rao's Brief Repeatable Battery), disability (Expanded Disability Status Scale) and visual functioning in daily life (National Eye Institute Visual Function Questionnaire). MRI was used to quantify grey matter atrophy and multiple sclerosis lesion load. Multivariable linear regression models were used for analysis of the relationships between double-step saccades and clinical and MRI metrics. We included 209 individuals with multiple sclerosis (mean age 54.3 ± 10.5 years, 58% female, 63% relapsing-remitting multiple sclerosis) and 60 healthy control subjects (mean age 52.1 ± 9.2 years, 53% female). The proportion of correct double-step saccades was significantly reduced in multiple sclerosis (mean 0.29 ± 0.22) compared to controls (0.45 ± 0.22, P < 0.001). Consistent with this, there was a significantly larger double-step dysmetric saccadic error in multiple sclerosis (mean vertical error −1.18 ± 1.20°) compared to controls (−0.54 ± 0.86°, P < 0.001). Impaired double-step saccadic metrics were consistently associated with more severe global and local grey matter atrophy (correct responses—cortical grey matter: β = 0.42, P < 0.001), lesion load (vertical error: β = −0.28, P < 0.001), progressive phenotypes, more severe physical and cognitive impairment (correct responses—information processing: β = 0.46, P < 0.001) and visual functioning. In conclusion, double-step saccades represent a robust metric that revealed a novel eye-movement impairment in individuals with multiple sclerosis. Double-step saccades outperformed other saccadic tasks in their statistical relationship with clinical, cognitive and visual functioning, as well as global and local grey matter atrophy. Double-step saccades should be evaluated longitudinally and tested as a potential novel outcome measure for remyelination trials in multiple sclerosis. |
Ryan M. O'Leary; Jonathan Neukam; Thomas A. Hansen; Alexander J. Kinney; Nicole Capach; Mario A. Svirsky; Arthur Wingfield In: Trends in Hearing, vol. 27, pp. 1–22, 2023. @article{OLeary2023a, Speech that has been artificially accelerated through time compression produces a notable deficit in recall of the speech content. This is especially so for adults with cochlear implants (CI). At the perceptual level, this deficit may be due to the sharply degraded CI signal, combined with the reduced richness of compressed speech. At the cognitive level, the rapidity of time-compressed speech can deprive the listener of the ordinarily available processing time present when speech is delivered at a normal speech rate. Two experiments are reported. Experiment 1 was conducted with 27 normal-hearing young adults as a proof-of-concept demonstration that restoring lost processing time by inserting silent pauses at linguistically salient points within a time-compressed narrative (“time-restoration”) returns recall accuracy to a level approximating that for a normal speech rate. Noise vocoder conditions with 10 and 6 channels reduced the effectiveness of time-restoration. Pupil dilation indicated that additional effort was expended by participants while attempting to process the time-compressed narratives, with the effortful demand on resources reduced with time restoration. In Experiment 2, 15 adult CI users tested with the same (unvocoded) materials showed a similar pattern of behavioral and pupillary responses, but with the notable exception that meaningful recovery of recall accuracy with time-restoration was limited to a subgroup of CI users identified by better working memory spans, and better word and sentence recognition scores. Results are discussed in terms of sensory-cognitive interactions in data-limited and resource-limited processes among adult users of cochlear implants. |
Henri Olkoniemi; Mikko Hurme; Henry Railo Neurologically healthy humans' ability to make saccades toward unseen targets Journal Article In: Neuroscience, vol. 513, pp. 111–125, 2023. @article{Olkoniemi2023a, Some patients with a visual field loss due to a lesion in the primary visual cortex (V1) can shift their gaze to stimuli presented in their blind visual field. The extent to which a similar “blindsight” capacity is present in neurologically healthy individuals remains unknown. Using retinotopically navigated transcranial magnetic stimulation (TMS) of V1 (Experiment 1) and metacontrast masking (Experiment 2) to suppress conscious vision, we examined neurologically healthy humans' ability to make saccadic eye movements toward visual targets that they reported not seeing. In the TMS experiment, the participants were more likely to initiate a saccade when a stimulus was presented, and they reported not seeing it, than in trials which no stimulus was presented. However, this happened only in a very small proportion (∼8%) of unseen trials, suggesting that saccadic reactions were largely based on conscious perception. In both experiments, saccade landing location was influenced by unconscious information: When the participants denied seeing the target but made a saccade, the saccade was made toward the correct location (TMS: 68%, metacontrast: 63%) more often than predicted by chance. Signal detection theoretic measures suggested that in the TMS experiment, saccades toward unseen targets may have been based on weak conscious experiences. In both experiments, reduced visibility of the target stimulus was associated with slower and less precise gaze shifts. These results suggest that saccades made by neurologically healthy humans may be influenced by unconscious information, although the initiation of saccades is largely based on conscious vision. |
Francesca Ales; Luciano Giromini; Lara Warmelink; Megan Polden; Thomas Wilcockson; Claire Kelly; Christina Winters; Alessandro Zennaro; Trevor Crawford On the use of eye movements in symptom validity assessment of feigned schizophrenia Journal Article In: Psychological Injury and Law, vol. 16, no. 1, pp. 83–97, 2023. @article{Ales2023a, Assessing the credibility of reported mental health problems is critical in a variety of assessment situations, particularly in forensic contexts. Previous research has examined how the assessment of performance validity can be improved through the use of bio-behavioral measures (e.g., eye movements). To date, however, there is a paucity of literature on the use of eye tracking technology in assessing the validity of presented symptoms of schizophrenia, a disorder that is known to be associated with oculomotor abnormalities. Thus, we collected eye tracking data from 83 healthy individuals during the completion of the Inventory of Problems – 29 and investigated whether the oculomotor behavior of participants instructed to feign schizophrenia would differ from those of control participants asked to respond honestly. Results showed that feigners had a longer dwell time and a greater number of fixations in the feigning-keyed response options, regardless of whether they eventually endorsed those options (d > 0.80). Implications on how eye tracking technology can deepen comprehension on simulation strategies are discussed, as well as the potential of investigating eye movements to advance the field of symptom validity assessment. |
Matthew Kimble; Olivia Cappello; Kevin Fleming Hypervigilance and depression as predictors of eye tracking to ambiguous pictures in trauma survivors Journal Article In: International Journal of Psychophysiology, vol. 187, pp. 27–33, 2023. @article{Kimble2023, Hypervigilance, attentional bias, and negative views of the world play a significant role in post trauma symptomatology and can be associated with both clinical depression and posttraumatic stress. However, both theory and research suggest there may be discernible differences in attentional patterns between these two outcomes. While depression may be associated with a general negativity bias, posttraumatic stress may be specifically associated with visual scanning, hypervigilance, and threat detection. In this study, seventy-seven community trauma survivors completed self-assessments for hypervigilance, depression, and posttraumatic cognitions and then had their eyes tracked while looking at a series of thirty neutral but ambiguous and complex pictures on a computer screen. Mean age of the sample was 36.3 with 52 % of the sample identifying as female. We found that hypervigilance scores and negative views of the world predicted both the number of fixations and area of the picture covered. These factors did not predict pupil size. These findings suggest that there are discernable gaze patterns after trauma associated with posttraumatic stress but not depression. Specifically, ambiguous pictures generate more fixations and scanning that is associated with vigilance but not depression. |
Clare Kirtley; Christopher Murray; Phillip B. Vaughan; Benjamin W. Tatler Navigating the narrative: An eye-tracking study of readers' strategies when reading comic page layouts Journal Article In: Applied Cognitive Psychology, vol. 37, no. 1, pp. 52–70, 2023. @article{Kirtley2023, In multimedia stimuli (e.g., comics), the reader must follow a narrative in which text and image both contribute information, and artists may use more irregular layouts which must still be followed correctly. While previous work has found that the external structure (outlines) of panels is a major contributor to navigation decisions in comics, other studies have shown that panel content can affect reading order. The present studies use eye-tracking to investigate these contributions further. In Experiment 1, the reading behaviors on six layout variations were compared. The influence of the external structure was replicated, but an effect of text location was also found for one layout type. Experiment 2 focused on variations of this particular layout, manipulating the location of text within critical panels. Panel content was a consistent effect for all variations. While most navigation decisions are made using the external structure, content becomes key when resolving ambiguous layouts. |
Janina Klautke; Celia Foster; W. Pieter Medendorp; Tobias Heed Dynamic spatial coding in parietal cortex mediates tactile-motor transformation Journal Article In: Nature Communications, vol. 14, no. 1, pp. 1–18, 2023. @article{Klautke2023, Movements towards touch on the body require integrating tactile location and body posture information. Tactile processing and movement planning both rely on posterior parietal cortex (PPC) but their interplay is not understood. Here, human participants received tactile stimuli on their crossed and uncrossed feet, dissociating stimulus location relative to anatomy versus external space. Participants pointed to the touch or the equivalent location on the other foot, which dissociates sensory and motor locations. Multi-voxel pattern analysis of concurrently recorded fMRI signals revealed that tactile location was coded anatomically in anterior PPC but spatially in posterior PPC during sensory processing. After movement instructions were specified, PPC exclusively represented the movement goal in space, in regions associated with visuo-motor planning and with regional overlap for sensory, rule-related, and movement coding. Thus, PPC flexibly updates its spatial codes to accommodate rule-based transformation of sensory input to generate movement to environment and own body alike. |
Nathalie Klein Selle; Kristina Suchotzki; Yoni Pertzov; Matthias Gamer Orienting versus inhibition: The theory behind the ocular-based Concealed Information Test Journal Article In: Psychophysiology, vol. 60, no. 3, pp. 1–13, 2023. @article{KleinSelle2023, When trying to conceal one's knowledge, various ocular changes occur. However, which cognitive mechanisms drive these changes? Do orienting or inhibition—two processes previously associated with autonomic changes—play a role? To answer this question, we used a Concealed Information Test (CIT) in which participants were either motivated to conceal (orienting + inhibition) or reveal (orienting only) their knowledge. While pupil size increased in both motivational conditions, the fixation and blink CIT effects were confined to the conceal condition. These results were mirrored in autonomic changes, with skin conductance increasing in both conditions while heart rate decreased solely under motivation to conceal. Thus, different cognitive mechanisms seem to drive ocular responses. Pupil size appears to be linked to the orienting of attention (akin to skin conductance changes), while fixations and blinks rather seem to reflect arousal inhibition (comparable to heart rate changes). This knowledge strengthens CIT theory and illuminates the relationship between ocular and autonomic activity. |
Devi S. Klein; Miguel A. Lago; Craig K. Abbey; Miguel P. Eckstein A 2d synthesized image improves the 3d search for foveated visual systems Journal Article In: IEEE Transactions on Medical Imaging, vol. 42, no. 8, pp. 2176–2188, 2023. @article{Klein2023, Current medical imaging increasingly relies on 3D volumetric data making it difficult for radiologists to thoroughly search all regions of the volume. In some applications (e.g., Digital Breast Tomosynthesis), the volumetric data is typically paired with a synthesized 2D image (2D-S) generated from the corresponding 3D volume. We investigate how this image pairing affects the search for spatially large and small signals. Observers searched for these signals in 3D volumes, 2D-S images, and while viewing both. We hypothesize that lower spatial acuity in the observers' visual periphery hinders the search for the small signals in the 3D images. However, the inclusion of the 2D-S guides eye movements to suspicious locations, improving the observer's ability to find the signals in 3D. Behavioral results show that the 2D-S, used as an adjunct to the volumetric data, improves the localization and detection of the small (but not large) signal compared to 3D alone. There is a concomitant reduction in search errors as well. To understand this process at a computational level, we implement a Foveated Search Model (FSM) that executes human eye movements and then processes points in the image with varying spatial detail based on their eccentricity from fixations. The FSM predicts human performance for both signals and captures the reduction in search errors when the 2D-S supplements the 3D search. Our experimental and modeling results delineate the utility of 2D-S in 3D search - reduce the detrimental impact of low-resolution peripheral processing by guiding attention to regions of interest, effectively reducing errors. |
Lena Klever; Marie Christin Beyvers; Katja Fiehler; Pascal Mamassian; Jutta Billino Cross-modal metacognition: Visual and tactile confidence share a common scale Journal Article In: Journal of Vision, vol. 23, no. 5, pp. 1–16, 2023. @article{Klever2023, Humans can judge the quality of their perceptual decisions—an ability known as perceptual confidence. Previous work suggested that confidence can be evaluated on an abstract scale that can be sensory modality-independent or even domain-general. However, evidence is still scarce on whether confidence judgments can be directly made across visual and tactile decisions. Here, we investigated in a sample of 56 adults whether visual and tactile confidence share a common scale by measuring visual contrast and vibrotactile discrimination thresholds in a confidence-forced choice paradigm. Confidence judgments were made about the correctness of the perceptual decision between two trials involving either the same or different modalities. To estimate confidence efficiency, we compared discrimination thresholds obtained from all trials to those from trials judged to be relatively more confident. We found evidence for metaperception because higher confidence was associated with better perceptual performance in both modalities. Importantly, participants were able to judge their confidence across modalities without any costs in metaperceptual sensitivity and only minor changes in response times compared to unimodal confidence judgments. In addition, we were able to predict cross-modal confidence well from unimodal judgments. In conclusion, our findings show that perceptual confidence is computed on an abstract scale and that it can assess the quality of our decisions across sensory modalities. |
Michaela Klímová; Ilona M. Bloem; Sam Ling Attention preserves the selectivity of feature-tuned normalization Journal Article In: Journal of neurophysiology, vol. 130, no. 4, pp. 990–998, 2023. @article{Klimova2023, Attention and divisive normalization both contribute to making visual processing more efficient. Attention selectively increases the neural gain of relevant information in the early visual cortex, resulting in stronger perceived salience for attended regions or features. Divisive normalization improves processing efficiency by suppressing responses to homogeneous inputs and highlighting salient boundaries, facilitating sparse coding of inputs. Theoretical and empirical research suggest a tight link between attention and normalization, wherein attending to a stimulus results in a release from normalization, thereby allowing for an increase in neural response gain. In the present study, we address whether attention alters the qualitative properties of normalization. Specifically, we examine how attention influences the feature-tuned nature of normalization, whereby suppression is stronger between visual stimuli whose orientation contents are similar, and weaker when the orientations are different. Ten human observers viewed stimuli that varied in orientation content while we acquired fMRI BOLD responses under two attentional states: attending toward or attending away from the stimulus. Our results indicate that attention does not alter the specificity of feature-tuned normalization. Instead, attention seems to enhance visuocortical responses evenly, regardless of the degree of orientation similarity within the stimulus. Since visuocortical responses exhibit adaptation to statistical regularities in natural scenes, we conclude that while attention can selectively increase the gain of responses to attended items, it does not appear to alter the ecologically relevant correspondence between orientation differences and strength of tuned normalization.NEW & NOTEWORTHY The magnitude of visuocortical BOLD responses scales with orientation differences in visual stimuli, with the strongest response suppression for collinear stimuli and least suppression for orthogonal, in a way that appears to match natural scene statistics. We examined the effects of attention on this feature-tuned property of suppression and found that while attending to a stimulus increases the overall gain of visuocortical responses, the qualitative properties of feature-tuning remain unchanged, suggesting attention preserves tuned normalization properties. |
Marina Klimovich; Simon P. Tiffin-Richards; Tobias Richter In: Journal of Research in Reading, vol. 46, no. 2, pp. 123–142, 2023. @article{Klimovich2023, Background: Commercial speed-reading training programs are typically marketed with the promise to dramatically increase reading speed without impairing comprehension. From the perspective of reading psychology, it seems quite unlikely that speed-reading training can indeed have such effects. However, research on the effectiveness of modern speed-reading training programs on reading performance in typical readers is sparse. The present study had two goals. First, we sought to extend prior research on speed-reading by assessing the effects of a speed-reading application on reading performance in a pre-training and post-training design with a control group. Second, we aimed to identify the mechanism underlying speed-reading training programs. Methods: We assessed reading speed, comprehension and eye movements of 30 German-speaking undergraduates (Mage = 22.77 years |
Emily J. Knight; Edward G. Freedman; Evan J. Myers; Alaina S. Berruti; Leona A. Oakes; Cody Zhewei Cao; Sophie Molholm; John J. Foxe Severely attenuated visual feedback processing in children on the autism spectrum Journal Article In: Journal of Neuroscience, vol. 43, no. 13, pp. 2424–2438, 2023. @article{Knight2023, Individuals on the autism spectrum often exhibit atypicality in their sensory perception, but the neural underpinnings of these perceptual differences remain incompletely understood. One proposed mechanism is an imbalance in higher-order feedback re-entrant inputs to early sensory cortices during sensory perception, leading to increased propensity to focus on local object features over global context. We explored this theory by measuring visual evoked potentials during contour integration as considerable work has revealed that these processes are largely driven by feedback inputs from higher-order ventral visual stream regions. We tested the hypothesis that autistic individuals would have attenuated evoked responses to illusory contours compared with neurotypical controls. Electrophysiology was acquired while 29 autistic and 31 neurotypical children (7-17 years old, inclusive of both males and females) passively viewed a random series of Kanizsa figure stimuli, each consisting of four inducers that were aligned either at random rotational angles or such that contour integration would form an illusory square. Autistic children demonstrated attenuated automatic contour integration over lateral occipital regions relative to neurotypical controls. The data are discussed in terms of the role of predictive feedback processes on perception of global stimulus features and the notion that weakened “priors” may play a role in the visual processing anomalies seen in autism. |
John Chi Wa Ko; Mandy M. Cheng; Wendy J. Green In: European Accounting Review, pp. 2–28, 2023. @article{Ko2023, Using eye-tracking technology, we examine whether the information processing patterns of nonprofessional investors with a directional investment preference are affected by performance information presented based on either a focus on stakeholders (stakeholder format) or on strategic goals (strategic theme format). We find that when a company's financial performance has declined but nonfinancial performance has improved, a strategic theme (stakeholder) format causes investors in a long investment position to focus on negative financial information to a lesser (greater) extent than those in a short investment position. These results indicate that a strategic theme format encourages biased investors to draw on favorable nonfinancial information to support their position, whereas a stakeholder format causes them to closely scrutinize unfavorable financial information. We also find that the level of bias in investors' earnings forecasts is lower when information is presented in a strategic theme format than in a stakeholder format; however, a supplementary experiment finds that this result is reversed when a company's financial performance has improved but its nonfinancial performance has declined. Our results have implications for external report preparers, standard setters, and analysts. |
Damian Koevoet; Marnix Naber; Christoph Strauch; Rosyl S. Somai; Stefan Van der Stigchel Differential aspects of attention predict the depth of visual working memory encoding: Evidence from pupillometry Journal Article In: Journal of Vision, vol. 23, no. 6, pp. 1–11, 2023. @article{Koevoet2023, What determines how much one encodes into visual working memory? Traditionally, encoding depth is considered to be indexed by spatiotemporal properties of gaze, such as gaze position and dwell time. Although these properties inform about where and how long one looks, they do not necessarily inform about the current arousal state or how strongly attention is deployed to facilitate encoding. Here, we found that two types of pupillary dynamics predict how much information is encoded during a copy task. The task involved encoding a spatial pattern of multiple items for later reproduction. Results showed that smaller baseline pupil sizes preceding and stronger pupil orienting responses during encoding predicted that more information was encoded into visual working memory. Additionally, we show that pupil size reflects not only how much but also how precisely material is encoded. We argue that a smaller pupil size preceding encoding is related to increased exploitation, whereas larger pupil constrictions signal stronger attentional (re)orienting to the to-be-encoded pattern. Our findings support the notion that the depth of visual working memory encoding is the integrative outcome of differential aspects of attention: how alert one is, how much attention one deploys, and how long it is deployed. Together, these factors determine how much information is encoded into visual working memory. |
Damian Koevoet; Christoph Strauch; Marnix Naber; Stefan Van Stigchel The costs of paying overt and covert attention assessed with pupillometry Journal Article In: Psychological Science, vol. 34, no. 8, pp. 887–898, 2023. @article{Koevoet2023a, Attention can be shifted with or without an accompanying saccade (i.e., overtly or covertly, respectively). Thus far, it is unknown how cognitively costly these shifts are, yet such quantification is necessary to understand how and when attention is deployed overtly or covertly. In our first experiment (N = 24 adults), we used pupillometry to show that shifting attention overtly is more costly than shifting attention covertly, likely because planning saccades is more complex. We pose that these differential costs will, in part, determine whether attention is shifted overtly or covertly in a given context. A subsequent experiment (N = 24 adults) showed that relatively complex oblique saccades are more costly than relatively simple saccades in horizontal or vertical directions. This provides a possible explanation for the cardinal-direction bias of saccades. The utility of a cost perspective as presented here is vital to furthering our understanding of the multitude of decisions involved in processing and interacting with the external world efficiently. |
Živa Korda; Sonja Walcher; Christof Körner; Mathias Benedek Effects of internally directed cognition on smooth pursuit eye movements: A systematic examination of perceptual decoupling Journal Article In: Attention, Perception, & Psychophysics, vol. 85, no. 4, pp. 1159–1178, 2023. @article{Korda2023, Eye behavior differs between internally and externally directed cognition and thus is indicative of an internal versus external attention focus. Recent work implicated perceptual decoupling (i.e., eye behavior becoming less determined by the sensory environment) as one of the key mechanisms involved in these attention-related eye movement differences. However, it is not yet understood how perceptual decoupling depends on the characteristics of the internal task. Therefore, we systematically examined effects of varying internal task demands on smooth pursuit eye movements. Specifically, we evaluated effects of the internal workload (control vs. low vs. high) and of internal task (arithmetic vs. visuospatial). The results of multilevel modelling showed that effects of perceptual decoupling were stronger for higher workload, and more pronounced for the visuospatial modality. Effects also followed a characteristic time-course relative to internal operations. The findings provide further support of the perceptual decoupling mechanism by showing that it is sensitive to the degree of interference between external and internal information. |
Hannes M. Körner; Franz Faul; Antje Nuthmann In: Attention, Perception, & Psychophysics, vol. 85, no. 6, pp. 1868–1887, 2023. @article{Koerner2023, The presence of a weapon in a scene has been found to attract observers' attention and to impair their memory of the person holding the weapon. Here, we examined the role of attention in this weapon focus effect (WFE) under different viewing conditions. German participants viewed stimuli in which a man committed a robbery while holding a gun or a cell phone. The stimuli were based on material used in a recent U.S. study reporting large memory effects. Recording eye movements allowed us to test whether observers' attention in the gun condition shifted away from the perpetrator towards the gun, compared with the phone condition. When using videos (Experiment 1), weapon presence did not appear to modulate the viewing time for the perpetrator, whereas the evidence concerning the critical object remained inconclusive. When using slide shows (Experiment 2), the gun attracted more gaze than the phone, replicating previous research. However, the attentional shift towards the weapon did not come at a cost of viewing time on the perpetrator. In both experiments, observers focused their attention predominantly on the depicted people and much less on the gun or phone. The presence of a weapon did not cause participants to recall fewer details about the perpetrator's appearance in either experiment. This null effect was replicated in an online study using the original videos and testing more participants. The results seem at odds with the attention-shift explanation of the WFE. Moreover, the results indicate that the WFE is not a universal phenomenon. |
Svetlana Kovalenko; Anton Mamonov; Vladislav Kuznetsov; Alexandr Bulygin; Irina Shoshina; Ivan Brak; Alexey Kashevnik OperatorEYEVP: Operator dataset for fatigue detection based on eye movements, heart rate data, and video information Journal Article In: Sensors, vol. 23, no. 13, pp. 1–35, 2023. @article{Kovalenko2023, Detection of fatigue is extremely important in the development of different kinds of preventive systems (such as driver monitoring or operator monitoring for accident prevention). The presence of fatigue for this task should be determined with physiological and objective behavioral indicators. To develop an effective model of fatigue detection, it is important to record a dataset with people in a state of fatigue as well as in a normal state. We carried out data collection using an eye tracker, a video camera, a stage camera, and a heart rate monitor to record a different kind of signal to analyze them. In our proposed dataset, 10 participants took part in the experiment and recorded data 3 times a day for 8 days. They performed different types of activity (choice reaction time, reading, correction test Landolt rings, playing Tetris), imitating everyday tasks. Our dataset is useful for studying fatigue and finding indicators of its manifestation. We have analyzed datasets that have public access to find the best for this task. Each of them contains data of eye movements and other types of data. We evaluated each of them to determine their suitability for fatigue studies, but none of them fully fit the fatigue detection task. We evaluated the recorded dataset by calculating the correspondences between eye-tracking data and CRT (choice reaction time) that show the presence of fatigue. |
Kenji W. Koyano; Elena M. Esch; Julie J. Hong; Elena N. Waidmann; Haitao Wu; David A. Leopold Progressive neuronal plasticity in primate visual cortex during stimulus familiarization Journal Article In: Science Advances, vol. 9, no. 12, pp. 1–12, 2023. @article{Koyano2023, The primate brain is equipped to learn and remember newly encountered visual stimuli such as faces and objects. In the macaque inferior temporal (IT) cortex, neurons mark the familiarity of a visual stimulus through response modification, often involving a decrease in spiking rate. Here, we investigate the emergence of this neural plasticity by longitudinally tracking IT neurons during several weeks of familiarization with face images. We found that most neurons in the anterior medial (AM) face patch exhibited a gradual decline in their late-phase visual responses to multiple stimuli. Individual neurons varied from days to weeks in their rates of plasticity, with time constants determined by the number of days of exposure rather than the cumulative number of presentations. We postulate that the sequential recruitment of neurons with experience-modified responses may provide an internal and graded measure of familiarity strength, which is a key mnemonic component of visual recognition. |
Sofia Krasovskaya; Árni Kristjánsson; W. Joseph MacInnes Microsaccade rate activity during the preparation of pro- and antisaccades Journal Article In: Attention, Perception, & Psychophysics, vol. 85, no. 7, pp. 2257–2276, 2023. @article{Krasovskaya2023, Microsaccades belong to the category of fixational micromovements and may be crucial for image stability on the retina. Eye movement paradigms typically require fixational control, but this does not eliminate all oculomotor activity. The antisaccade task requires a planned eye movement in the direction opposite of an onset, allowing separation of planning and execution. We build on previous studies of microsaccades in the antisaccade task using a combination of fixed and mixed pro- and antisaccade blocks. We hypothesized that microsaccade rates may be reduced prior to the execution of antisaccades as compared with regular saccades (prosaccades). In two experiments, we measured microsaccades in four conditions across three trial blocks: one block each of fixed prosaccade and antisaccade trials, and a mixed block where both saccade types were randomized. We anticipated that microsaccade rates would be higher prior to antisaccades than prosaccades due to the need to preemptively suppress reflexive saccades during antisaccade generation. In Experiment 1, with monocular eye tracking, there was an interaction between the effects of saccade and block type on microsaccade rates, suggesting lower rates on antisaccade trials, but only within mixed blocks. In Experiment 2, eye tracking was binocular, revealing suppressed microsaccade rates on antisaccade trials. A cluster permutation analysis of the microsaccade rate over the course of a trial did not reveal any particular critical time for this difference in microsaccade rates. Our findings suggest that microsaccade rates reflect the degree of suppression of the oculomotor system during the antisaccade task. |
Frauke Kraus; Jonas Obleser; Björn Herrmann Pupil size sensitivity to listening demand depends on motivational state Journal Article In: eNeuro, vol. 10, no. 12, pp. 1–12, 2023. @article{Kraus2023, Motivation plays a role when a listener needs to understand speech under acoustically demanding conditions. Previous work has demonstrated pupil-linked arousal being sensitive to both listening demands and motivational state during listening. It is less clear how motivational state affects the temporal evolution of the pupil size and its relation to subsequent behavior. We used an auditory gap detection task (N = 33) to study the joint impact of listening demand and motivational state on the pupil size response and examine its temporal evolution. Task difficulty and a listener's motivational state were orthogonally manipulated through changes in gap duration and monetary reward prospect. We show that participants' performance decreased with task difficulty, but that reward prospect enhanced performance under hard listening conditions. Pupil size increased with both increased task difficulty and higher reward prospect, and this reward prospect effect was largest under difficult listening conditions. Moreover, pupil size time courses differed between detected and missed gaps, suggesting that the pupil response indicates upcoming behavior. Larger pre-gap pupil size was further associated with faster response times on a trial-by-trial within-participant level. Our results reiterate the utility of pupil size as an objective and temporally sensitive measure in audiology. However, such assessments of cognitive resource recruitment need to consider the individual's motivational state. |
Frauke Kraus; Sarah Tune; Jonas Obleser; Björn Herrmann Neural α oscillations and pupil size differentially index cognitive demand under competing audiovisual task conditions Journal Article In: Journal of Neuroscience, vol. 43, no. 23, pp. 4352–4364, 2023. @article{Kraus2023a, Cognitive demand is thought to modulate two often used, but rarely combined, measures: pupil size and neural α (8–12 Hz) oscillatory power. However, it is unclear whether these two measures capture cognitive demand in a similar way under complex audiovisual-task conditions. Here we recorded pupil size and neural α power (using electroencephalography), while human participants of both sexes concurrently performed a visual multiple object-tracking task and an auditory gap detection task. Difficulties of the two tasks were manipulated independent of each other. Participants' performance decreased in accuracy and speed with increasing cognitive demand. Pupil size increased with increasing difficulty for both the auditory and the visual task. In contrast, α power showed diverging neural dynamics: parietal α power decreased with increasing difficulty in the visual task, but not with increasing difficulty in the auditory task. Furthermore, independent of task difficulty, within-participant trial-by-trial fluctuations in pupil size were negatively correlated with α power. Difficulty-induced changes in pupil size and α power, however, did not correlate, which is consistent with their different cognitive-demand sensitivities. Overall, the current study demonstrates that the dynamics of the neurophysiological indices of cognitive demand and associated effort are multifaceted and potentially modality-dependent under complex audiovisual-task conditions. |
Anika Krause; Christian H. Poth Maintaining eye fixation relieves pressure of cognitive action control Journal Article In: iScience, vol. 26, no. 9, pp. 1–16, 2023. @article{Krause2023, Cognitive control enables humans to behave guided by their current goals and intentions. Cognitive control in one task generally suffers when humans try to engage in another task on top. However, we discovered an additional task that supports conflict resolution. In two experiments, participants performed a spatial cognitive control task. For different blocks of trials, they either received no instruction regarding eye movements or were asked to maintain the eyes fixated on a stimulus. The additional eye fixation task did not reduce task performance, but selectively ameliorated the adverse effects of cognitive conflicts on reaction times (Experiment 1). Likewise, in urgent situations, the additional task reduced performance impairments due to stimulus-driven processing overpowering cognitive control (Experiment 2). These findings suggest that maintaining eye fixation locks attentional resources that would otherwise induce spatial cognitive conflicts. This reveals an attentional disinhibition that boosts goal-directed action by relieving pressure from cognitive control. |
Linda Krauze; Mara Delesa-Velina; Tatjana Pladere; Gunta Krumina Why 2D layout in 3D images matters: Evidence from visual search and eyetracking Journal Article In: Journal of Eye Movement Research, vol. 16, no. 1, pp. 1–12, 2023. @article{Krauze2023, Precise perception of three-dimensional (3D) images is crucial for a rewarding experience when using novel displays. However, the capability of the human visual system to perceive binocular disparities varies across the visual field meaning that depth perception might be affected by the two-dimensional (2D) layout of items on the screen. Nevertheless, potential difficulties in perceiving 3D images during free viewing have received only a little attention so far, limiting opportunities to enhance visual effectiveness of information presentation. The aim of this study was to elucidate how the 2D layout of items in 3D images impacts visual search and distribution of maintaining attention based on the analysis of the viewer's gaze. Participants were searching for a target which was projected one plane closer to the viewer compared to distractors on a multi-plane display. The 2D layout of items was manipulated by changing the item distance from the center of the display plane from 2° to 8°. As a result, the targets were identified correctly when the items were displayed close to the center of the display plane, however, the number of errors grew with an increase in distance. Moreover, correct responses were given more often when subjects paid more attention to targets compared to other items on the screen. However, a more balanced distribution of attention over time across all items was characteristic of the incorrectly completed trials. Thus, our results suggest that items should be displayed close to each other in a 2D layout to facilitate precise perception of 3D images and considering distribution of attention maintenance based on eye-tracking might be useful in the objective assessment of user experience for novel displays |
Isabel Kreis; Lei Zhang; Matthias Mittner; Leonard Syla; Claus Lamm; Gerit Pfuhl In: Cognitive, Affective, & Behavioral Neuroscience, vol. 23, no. 3, pp. 727–741, 2023. @article{Kreis2023, Aberrant belief updating due to misestimation of uncertainty and an increased perception of the world as volatile (i.e., unstable) has been found in autism and psychotic disorders. Pupil dilation tracks events that warrant belief updating, likely reflecting the adjustment of neural gain. However, whether subclinical autistic or psychotic symptoms affect this adjustment and how they relate to learning in volatile environments remains to be unraveled. We investigated the relationship between behavioral and pupillometric markers of subjective volatility (i.e., experience of the world as unstable), autistic traits, and psychotic-like experiences in 52 neurotypical adults with a probabilistic reversal learning task. Computational modeling revealed that participants with higher psychotic-like experience scores overestimated volatility in low-volatile task periods. This was not the case for participants scoring high on autistic-like traits, who instead showed a diminished adaptation of choice-switching behavior in response to risk. Pupillometric data indicated that individuals with higher autistic- or psychotic-like trait and experience scores differentiated less between events that warrant belief updating and those that do not when volatility was high. These findings are in line with misestimation of uncertainty accounts of psychosis and autism spectrum disorders and indicate that aberrancies are already present at the subclinical level. |
Philipp Kreyenmeier; Anna Schroeger; Rouwen Cañal-Bruland; Markus Raab; Miriam Spering Rapid audiovisual integration guides predictive actions Journal Article In: eNeuro, vol. 10, no. 8, pp. 1–10, 2023. @article{Kreyenmeier2023, Natural movements, such as catching a ball or capturing prey, typically involve multiple senses. Yet, laboratory studies on human movements commonly focus solely on vision and ignore sound. Here, we ask how visual and auditory signals are integrated to guide interceptive movements. Human observers tracked the brief launch of a simulated baseball, randomly paired with batting sounds of varying intensities, and made a quick pointing movement at the ball. Movement end points revealed systematic overestimation of target speed when the ball launch was paired with a loud versus a quiet sound, although sound was never informative. This effect was modulated by the availability of visual information; sounds biased interception when the visual presentation duration of the ball was short. Amplitude of the first catch-up saccade, occurring;125 ms after target launch, revealed early integration of audiovisual information for trajectory estimation. This sound-induced bias was reversed during later predictive saccades when more visual information was available. Our findings sug-gest that auditory and visual signals are integrated to guide interception and that this integration process must occur early at a neural site that receives auditory and visual signals within an ultrashort time span. |
Alina Krug; Lisa Valentina Eberhardt; Anke Huckauf Transient attention does not alter the eccentricity effect in estimation of duration Journal Article In: Attention, Perception, & Psychophysics, pp. 1–12, 2023. @article{Krug2023, Previous research investigating the influence of stimulus eccentricity on perceived duration showed an increasing duration underestimation with increasing eccentricity. Based on studies showing that precueing the stimulus location prolongs perceived duration, one might assume that this eccentricity effect is influenced by spatial attention. In the present study, we assessed the influence of transient covert attention on the eccentricity effect in duration estimation in two experiments, one online and one in a laboratory setting. In a duration estimation task, participants judged whether a comparison stimulus presented near or far from fixation with a varying duration was shorter or longer than a standard stimulus presented foveally with a constant duration. To manipulate transient covert attention, either a transient luminance cue was used (valid cue) to direct attention to the position of the subsequent peripheral comparison stimulus or all positions were marked by luminance (neutral cue). Results of both experiments yielded a greater underestimation of duration for the far than for the near stimulus, replicating the eccentricity effect. Although cueing was effective (i.e., shorter response latencies for validly cued stimuli), cueing did not alter the eccentricity effect on estimation of duration. This indicates that cueing leads to covert attentional shifts but does not account for the eccentricity effect in perceived duration. |
Justin B. Kueser; Ryan Peters; Arielle Borovsky The role of semantic similarity in verb learning events: Vocabulary-related changes across early development Journal Article In: Journal of Experimental Child Psychology, vol. 226, pp. 1–19, 2023. @article{Kueser2023, Verb meaning is challenging for children to learn across varied events. This study examined how the taxonomic semantic similarity of the nouns in novel verb learning events in a progressive alignment learning condition differed from the taxonomic dissimilarity of nouns in a dissimilar learning condition in supporting near (similar) and far (dissimilar) verb generalization to novel objects in an eye-tracking task. A total of 48 children in two age groups (23 girls; younger: 21–24 months |
Mrinmayi Kulkarni; Allison E. Nickel; Greta N. Minor; Deborah E. Hannula; Mrinmayi Kulkarni; Allison E. Nickel; Greta N. Minor; Deborah E. Hannula Control of memory retrieval alters memory-based eye movements Journal Article In: Journal of Experimental Psychology: Learning, Memory, and Cognition, pp. 1–22, 2023. @article{Kulkarni2023, Past work has shown that eye movements are affected by long-term memory across different tasks and instructional manipulations. In the current study, we tested whether these memory-based eye movements persist when memory retrieval is under intentional control. Participants encoded multiple scenes with six objects (three faces; three tools). Next, they completed a memory regulation and visual search task, while undergoing eye tracking. Here, scene cues were presented and participants either retrieved the encoded associate, suppressed it, or substituted it with a specific object from the other encoded category. Following a delay, a search display consisting of six dots intermixed with the six encoded objects was presented. Participants' task was to fixate one remaining dot after five had disappeared. Incidental viewing of the objects was of interest. Results revealed that performance in a final recognition phase was impaired for suppressed pairs, but only when the associate was a tool. During the search task, incidental associate viewing was lower when participants attempted to control retrieval, whereas one object from the nonassociate category was most viewed in the substitute condition. Additionally, viewing patterns in the search phase were related to final recognition performance, but the direction of this association differed between conditions. Overall, these results suggest that eye movements are attracted to information retrieved from long-term memory and held active (the associate in the retrieve condition, or an object from the other category in the sub- stitute condition). Furthermore, the level of viewing may index the strength of the representation of retrieved information. |
Jens Kürten; Tim Raettig; Julian Gutzeit; Lynn Huestegge Preparing for simultaneous action and inaction: Temporal dynamics and target levels of inhibitory control Journal Article In: Journal of Experimental Psychology: Human Perception and Performance, vol. 49, no. 7, pp. 1068–1082, 2023. @article{Kuerten2023, When a single action is required, along with the simultaneous inhibition of another action, this typically results in frequent false-positive executions of the latter (inhibition failures). The absence of inhibitory demands in dual-action trials can render performance less error-prone (and sometimes faster) than in single-action trials. In the present study, we investigated the temporal dynamics of inhibitory control difficulties by varying the preparation time (for simultaneous action execution and inhibition). In two experiments, participants responded to a single peripheral visual target either with an eye movement toward it (Single Saccade), with a spatially corresponding button press (Single Manual), or with both responses simultaneously (Dual Action) as indicated by a color cue. Preparation time was manipulated via the cue-stimulus interval within blocks (Experiment 1) and between blocks (Experiment 2). Overall, responses were faster with longer (vs. shorter) preparation time. Crucially, however, our results reveal the exact dynamics of how inhibition failures (and thus dual-action benefits) in both response modalities substantially decrease with longer preparation, even though the cue did not contain information regarding the fully specified response that needed to be inhibited (i.e., its direction). These results highlight the role of sufficient preparation time not only for efficient action execution but also for concurrent inhibitory performance. The study contradicts the idea that inhibition can only be exerted globally or on the level of a fully specified response. Instead, it may also be directed at effector system representations or all associated responses, suggesting a highly flexible targeting of inhibitory control in cognition. |
Jens Kürten; Tim Raettig; Julian Gutzeit; Lynn Huestegge In: Psychological Research, vol. 87, no. 2, pp. 410–424, 2023. @article{Kuerten2023a, Previous research has shown that the simultaneous execution of two actions (instead of only one) is not necessarily more difficult but can actually be easier (less error-prone), in particular when executing one action requires the simultaneous inhibition of another action. Corresponding inhibitory demands are particularly challenging when the to-be-inhibited action is highly prepotent (i.e., characterized by a strong urge to be executed). Here, we study a range of important potential sources of such prepotency. Building on a previously established paradigm to elicit dual-action benefits, participants responded to stimuli with single actions (either manual button press or saccade) or dual actions (button press and saccade). Crucially, we compared blocks in which these response demands were randomly intermixed (mixed blocks) with pure blocks involving only one type of response demand. The results highlight the impact of global (action-inherent) sources of action prepotency, as reflected in more pronounced inhibitory failures in saccade vs. manual control, but also more local (transient) sources of influence, as reflected in a greater probability of inhibition failures following trials that required the to-be-inhibited type of action. In addition, sequential analyses revealed that inhibitory control (including its failure) is exerted at the level of response modality representations, not at the level of fully specified response representations. In sum, the study highlights important preconditions and mechanisms underlying the observation of dual-action benefits. |
Jan W. Kurzawski; Augustin Burchell; Darshan Thapa; Jonathan Winawer; Najib J. Majaj; Denis G. Pelli The Bouma law accounts for crowding in 50 observers Journal Article In: Journal of Vision, vol. 23, no. 8, pp. 1–34, 2023. @article{Kurzawski2023, Crowding is the failure to recognize an object due to surrounding clutter. Our visual crowding survey measured 13 crowding distances (or “critical spacings”) twice in each of 50 observers. The survey includes three eccentricities (0, 5, and 10 deg), four cardinal meridians, two orientations (radial and tangential), and two fonts (Sloan and Pelli). The survey also tested foveal acuity, twice. Remarkably, fitting a two-parameter model—the well-known Bouma law, where crowding distance grows linearly with eccentricity—explains 82% of the variance for all 13 × 50 measured log crowding distances, cross-validated. An enhanced Bouma law, with factors for meridian, crowding orientation, target kind, and observer, explains 94% of the variance, again cross-validated. These additional factors reveal several asymmetries, consistent with previous reports, which can be expressed as crowding-distance ratios: 0.62 horizontal:vertical, 0.79 lower:upper, 0.78 right:left, 0.55 tangential:radial, and 0.78 Sloan-font:Pelli-font. Across our observers, peripheral crowding is independent of foveal crowding and acuity. Evaluation of the Bouma factor, b (the slope of the Bouma law), as a biomarker of visual health would be easier if there were a way to compare results across crowding studies that use different methods.We define a standardized Bouma factor b' that corrects for differences from Bouma's 25 choice alternatives, 75% threshold criterion, and linearly symmetric flanker placement. For radial crowding on the right meridian, the standardized Bouma factor b' is 0.24 for this study, 0.35 for Bouma (1970), and 0.30 for the geometric mean across five representative modern studies, including this one, showing good agreement across labs, including Bouma's. Simulations, confirmed by data, show that peeking can skew estimates of crowding (e.g., greatly decreasing the mean or doubling the SD of log b). Using gaze tracking to prevent peeking, individual differences are robust, as evidenced by the much larger 0.08 SD of log b across observers than the mere 0.03 test–retest SD of log b measured in half an hour. The ease of measurement of crowding enhances its promise as a biomarker for dyslexia and visual health. |
Nawras Kurzom; Ilaria Lorenzi; Avi Mendelsohn Increasing the complexity of isolated musical chords benefits concurrent associative memory formation Journal Article In: Scientific Reports, vol. 13, no. 1, pp. 1–12, 2023. @article{Kurzom2023, The effects of background music on learning and memory are inconsistent, partially due to the intrinsic complexity and diversity of music, as well as variability in music perception and preference. By stripping down musical harmony to its building blocks, namely discrete chords, we explored their effects on memory formation of unfamiliar word-image associations. Chords, defined as two or more simultaneously played notes, differ in the number of tones and inter-tone intervals, yielding varying degrees of harmonic complexity, which translate into a continuum of consonance to dissonance percepts. In the current study, participants heard four different types of musical chords (major, minor, medium complex, and high complex chords) while they learned new word-image pairs of a foreign language. One day later, their memory for the word-image pairs was tested, along with a chord rating session, in which they were required to assess the musical chords in terms of perceived valence, tension, and the extent to which the chords grabbed their attention. We found that musical chords containing dissonant elements were associated with higher memory performance for the word-image pairs compared with consonant chords. Moreover, tension positively mediated the relationship between roughness (a key feature of complexity) and memory, while valence negatively mediated this relationship. The reported findings are discussed in light of the effects that basic musical features have on tension and attention, in turn affecting cognitive processes of associative learning. |
Yuna Kwak; Nina M. Hanning; Marisa Carrasco Presaccadic attention sharpens visual acuity Journal Article In: Scientific Reports, vol. 13, no. 1, pp. 1–11, 2023. @article{Kwak2023, Visual perception is limited by spatial resolution, the ability to discriminate fine details. Spatial resolution not only declines with eccentricity but also differs for polar angle locations around the visual field, also known as ‘performance fields'. To compensate for poor peripheral resolution, we make rapid eye movements—saccades—to bring peripheral objects into high-acuity foveal vision. Already before saccade onset, visual attention shifts to the saccade target location and prioritizes visual processing. This presaccadic shift of attention improves performance in many visual tasks, but whether it changes resolution is unknown. Here, we investigated whether presaccadic attention sharpens peripheral spatial resolution; and if so, whether such effect interacts with performance fields asymmetries. We measured acuity thresholds in an orientation discrimination task during fixation and saccade preparation around the visual field. The results revealed that presaccadic attention sharpens acuity, which can facilitate a smooth transition from peripheral to foveal representation. This acuity enhancement is similar across the four cardinal locations; thus, the typically robust effect of presaccadic attention does not change polar angle differences in resolution. |
Rosa Lafer-Sousa; Karen Wang; Reza Azadi; Emily Lopez; Simon Bohn; Arash Afraz Behavioral detectability of optogenetic stimulation of inferior temporal cortex varies with the size of concurrently viewed objects Journal Article In: Current Research in Neurobiology, vol. 4, pp. 1–7, 2023. @article{LaferSousa2023, We have previously demonstrated that macaque monkeys can behaviorally detect a subtle optogenetic impulse delivered to their inferior temporal (IT) cortex. We have also shown that the ability to detect the cortical stimulation impulse varies depending on some characteristics of the visual images viewed at the time of brain stimulation, revealing the visual nature of the perceptual events induced by stimulation of the IT cortex. Here we systematically studied the effect of the size of viewed objects on behavioral detectability of optogenetic stimulation of the central IT cortex. Surprisingly, we found that behavioral detection of the same optogenetic impulse highly varies with the size of the viewed object images. Reduction of the object size in four steps from 8 to 1 degree of visual angle significantly decreased detection performance. These results show that identical stimulation impulses delivered to the same neural population induce variable perceptual events depending on the mere size of the objects viewed at the time of brain stimulation. |
Charlene L. M. Lam; Tom J. Barry; Jenny Yiend; Tatia M. C. Lee The role of consciousness in threat extinction learning Journal Article In: Consciousness and Cognition, vol. 116, pp. 1–12, 2023. @article{Lam2023, Extinction learning is regarded as a core mechanism underlying exposure therapy. The extent to which learned threats can be extinguished without conscious awareness is a controversial and on-going debate. We investigated whether implicit vs. explicit exposure to a threatened stimulus can modulate defence responses measured using pupillometry. Healthy participants underwent a threat conditioning paradigm in which one of the conditioned stimuli (CS) was perceptually suppressed using continuous flash suppression (CFS). Participants' pupillary responses, CS pleasantness ratings, and trial-by-trial awareness of the CS were recorded. During Extinction, participants' pupils dilated more in the trials in which they were unaware of the CS than in those in which they were aware of it (Cohen's d = 0.57). After reinstatement, the percentage of fear recovery was greater for the CFS-suppressed CS than the CS with full awareness. The current study suggests that the modulation of fear responses by extinction with reduced visual awareness is weaker compared to extinction with full perceptual awareness. |
Yuxiang Lan; Qunyue Liu; Zhipeng Zhu Exploring landscape design intensity effects on visual preferences and eye fixations in urban forests: Insights from eye tracking technology Journal Article In: Forests, vol. 14, no. 8, pp. 1–16, 2023. @article{Lan2023, Individuals' preferences for urban forest scenes are an essential factor in the design process. This study explores the connection between landscape design intensity, visual preferences, and eye fixations in urban forest scenes. Five pictures representing different urban forest scenes (plaza, lawn, garden path, pond, and rockery) were selected as stimuli, representing the original landscape design intensity. Three additional levels of design intensity (low, moderate, and high) were created by modifying the landscape elements of the original picture. A group of 50 participants was randomly assigned to observe the four levels of design intensity pictures within each type of landscape using eye-tracking technology. They also rated their preferences for each scene. In total, 250 participants took part in the study, with five groups observing five types of urban forest scenes. The results indicate that landscape design intensity has a positive impact on visual preferences, with moderate design intensity showing the strongest effect. However, the influence of design intensity and preferences also depends on the specific landscape scene. The fixation data did not show a significant relationship with design intensity but were associated with the type of landscape scene. In conclusion, this study suggests that moderate design intensity is recommended for urban forest design. However, it also highlights the importance of considering the specific landscape scene type. The research provides valuable insights into urban forest design and contributes to the understanding of eye-tracking technology in landscape perception studies. |
E. Landová; I. Štolhoferová; B. Vobrubová; J. Polák; K. Sedláčková; M. Janovcová; S. Rádlová; D. Frynta In: Scientific Reports, vol. 13, no. 1, pp. 1–13, 2023. @article{Landova2023, Spiders are among the animals evoking the highest fear and disgust and such a complex response might have been formed throughout human evolution. Ironically, most spiders do not present a serious threat, so the evolutionary explanation remains questionable. We suggest that other chelicerates, such as scorpions, have been potentially important in the formation and fixation of the spider-like category. In this eye-tracking study, we focused on the attentional, behavioral, and emotional response to images of spiders, scorpions, snakes, and crabs used as task-irrelevant distractors. Results show that spider-fearful subjects were selectively distracted by images of spiders and crabs. Interestingly, these stimuli were not rated as eliciting high fear contrary to the other animals. We hypothesize that spider-fearful participants might have mistaken crabs for spiders based on their shared physical characteristics. In contrast, subjects with no fear of spiders were the most distracted by snakes and scorpions which supports the view that scorpions as well as snakes are prioritized evolutionary relevant stimuli. We also found that the reaction time increased systematically with increasing subjective fear of spiders only when using spiders (and crabs to some extent) but not snakes and scorpions as distractors. The maximal pupil response covered not only the attentional and cognitive response but was also tightly correlated with the fear ratings of the picture stimuli. However, participants' fear of spiders did not affect individual reactions to scorpions measured by the maximal pupil response. We conclude that scorpions are evolutionary fear-relevant stimuli, however, the generalization between scorpions and spiders was not supported in spider-fearful participants. This result might be important for a better understanding of the evolution of spider phobia. |
Elke B. Lange; Lauren K. Fink Eye blinking, musical processing, and subjective states—A methods account Journal Article In: Psychophysiology, vol. 60, no. 10, pp. 1–20, 2023. @article{Lange2023, Affective sciences often make use of self-reports to assess subjective states. Seeking a more implicit measure for states and emotions, our study explored spontaneous eye blinking during music listening. However, blinking is understudied in the context of research on subjective states. Therefore, a second goal was to explore different ways of analyzing blink activity recorded from infra-red eye trackers, using two additional data sets from earlier studies differing in blinking and viewing instructions. We first replicate the effect of increased blink rates during music listening in comparison with silence and show that the effect is not related to changes in self-reported valence, arousal, or to specific musical features. Interestingly, but in contrast, felt absorption reduced participants' blinking. The instruction to inhibit blinking did not change results. From a methodological perspective, we make suggestions about how to define blinks from data loss periods recorded by eye trackers and report a data-driven outlier rejection procedure and its efficiency for subject-mean analyses, as well as trial-based analyses. We ran a variety of mixed effects models that differed in how trials without blinking were treated. The main results largely converged across accounts. The broad consistency of results across different experiments, outlier treatments, and statistical models demonstrates the reliability of the reported effects. As recordings of data loss periods come for free when interested in eye movements or pupillometry, we encourage researchers to pay attention to blink activity and contribute to the further understanding of the relation between blinking, subjective states, and cognitive processing. |
Liu Hong-Zhi; Yang Xing-Lan; Li Qiu-Yue; Wei Zi-Han Preference of dimension-based difference in intertemporal choice: Eye-tracking evidence Journal Article In: Acta Psychologica Sinica, vol. 55, no. 4, pp. 612–625, 2023. @article{HongZhi2023, In the field of intertemporal choice, considerable empirical evidence from behavioral and process data supports the use of dimension-based models. The existing dimension-based models provide qualitative explanations for an individual's intertemporal choice and focus on “which dimension is the greater difference dimension”, but ignore the preference of dimension-based difference (i.e., “how much different of the difference between the two dimensions”). In the present study, we used eye-tracking technology to examine the relationship between the preference of dimension-based difference and the information searching process. The results in the two experiments consistently revealed that response time, gaze transition entropy (a measure of visual scanning efficiency), and stationary gaze entropy (a measure of the level of even distribution across different areas of interest) could negatively predict the preference of dimension-based difference. Our findings highlighted the correlation between the preference of dimension-based difference and the information searching process, providing further process evidence for dimension-based intertemporal models. |
Alex J. Hoogerbrugge; Christoph Strauch; Tanja C. W. Nijboer; Stefan Van Stigchel Don't hide the instruction manual: A dynamic trade-off between using internal and external templates during visual search Journal Article In: Journal of Vision, vol. 23, no. 7, pp. 1–14, 2023. @article{Hoogerbrugge2023, Visual search is typically studied by requiring participants to memorize a template initially, for which they subsequently search in a crowded display. Search in daily life, however, often involves templates that remain accessible externally, and may therefore be (re)attended for just-in-time encoding or to refresh internal template representations. Here, we show that participants indeed use external templates during search when given the chance. This behavior was observed during both simple and complex search, scaled with task difficulty, and was associated with improved performance. Furthermore, we show that participants used external sampling not only to offload memory, but also as a means of verifying whether the template was remembered correctly at the end of trials.We conclude that the external world may not only provide the challenge (e.g., distractors), but may dynamically ease search. These results argue for extensions of state-of-the-art models of search, because external sampling seems to be used frequently, in at least two ways and is actually beneficial for task performance. Our findings support a model of visual working memory that emphasizes a resource-efficient trade-off between storing and (re)attending external information. |
Holger Hopp; Sarah Schimke; Freya Gastmann; David Öwerdieck; Gregory J. Poarch Processing to learn noncanonical word orders: Exploring linguistic and cognitive predictors of reanalysis in early L2 sentence comprehension Journal Article In: Studies in Second Language Acquisition, pp. 1–24, 2023. @article{Hopp2023, To test the contributions of processing to L2 syntax learning, this study explores (cross-) linguistic and cognitive predictors of sentence reanalysis in the L2 comprehension of relative clauses among low-intermediate L1 German adolescent learners of L2 English. Specifically, we test the degree to which L2 comprehension is affected by L2 proficiency, reanalysis ability in a related, earlier-acquired L2 structure (questions), reanalysis ability of relative clauses in the L1, cognitive control, and cognitive capacity. In visual-world eye-tracking experiments, 141 adolescent German-speaking L2 learners of English selected target pictures for auditorily presented questions and relative clauses in the L1 and in the L2. The results showed a strong subject preference for L2 relative clauses. Learners' L2 proficiency and their processing of object questions in the L2 predicted reanalysis for object relatives in eye movements, reaction times, and comprehension accuracy. In contrast, there was no evidence that cognitive control or working memory systematically affected the processing of object relatives. These findings suggest that linguistic processing outweighs cognitive processing in accounting for individual differences in low-intermediate L2 acquisition of complex grammar. Specifically, learners recruit shared processing mechanisms and routines across grammatical structures to pave a way in the acquisition of syntax. |
Monja Hoven; Alejandro Hirmas; Jan Engelmann; Ruth Holst The role of attention in decision-making under risk in gambling disorder: An eye-tracking study Journal Article In: Addictive Behaviors, vol. 138, pp. 1–10, 2023. @article{Hoven2023, Gambling disorder (GD) is a behavioural addiction characterized by impairments in decision-making, favouring risk- and reward-prone choices. One explanatory factor for this behaviour is a deviation in attentional processes, as increasing evidence indicates that GD patients show an attentional bias toward gambling stimuli. However, previous attentional studies have not directly investigated attention during risky decision-making. 26 patients with GD and 29 healthy matched controls (HC) completed a mixed gambles task combined with eye-tracking to investigate attentional biases for potential gains versus losses during decision-making under risk. Results indicate that compared to HC, GD patients gambled more and were less loss averse. GD patients did not show a direct attentional bias towards gains (or relative to losses). Using a recent (neuro)economics model that considers average attention and trial-wise deviations in average attention, we conducted fine-grained exploratory analyses of the attentional data. Results indicate that the average attention for gains in GD patients moderated the effect of gain value on gambling choices, whereas this was not the case for HC. GD patients with high average attention for gains started gambling at less high gain values. A similar trend-level effect was found for losses, where GD patients with high average attention for losses stopped gambling at lower loss values. This study gives more insight into how attentional processes in GD play a role in gambling behaviour, which could have implications for the development of future treatments focusing on attentional training or for the development of interventions that increase the salience of losses. |
Scott S. Hsieh; David A. Cook; Akitoshi Inoue; Hao Gong; Parvathy Sudhir Pillai; Matthew P. Johnson; Shuai Leng; Lifeng Yu; Jeff L. Fidler; David R. Holmes Iii; Rickey E. Carter; Cynthia H. Mccollough; Joel G. Fletcher Understanding reader variability: A 25-radiologist study on liver metastasis detection at CT Journal Article In: Radiology, vol. 306, no. 2, pp. 1–10, 2023. @article{Hsieh2023, Background: Substantial interreader variability exists for common tasks in CT imaging, such as detection of hepatic metastases. This variability can undermine patient care by leading to misdiagnosis. Purpose: To determine the impact of interreader variability associated with (a) reader experience, (b) image navigation patterns (eg, eye movements, workstation interactions), and (c) eye gaze time at missed liver metastases on contrast-enhanced abdominal CT images. Materials and Methods: In a single-center prospective observational trial at an academic institution between December 2020 and February 2021, readers were recruited to examine 40 contrast-enhanced abdominal CT studies (eight normal, 32 containing 91 liver metastases). Readers circumscribed hepatic metastases and reported confidence. The workstation tracked image navigation and eye movements. Performance was quantified by using the area under the jackknife alternative free-response receiver operator charac- teristic (JAFROC-1) curve and per-metastasis sensitivity and was associated with reader experience and image navigation variables. Differences in area under JAFROC curve were assessed with the Kruskal-Wallis test followed by the Dunn test, and effects of image navigation were assessed by using the Wilcoxon signed-rank test. Results: Twenty-five readers (median age, 38 years; IQR, 31–45 years; 19 men) were recruited and included nine subspecialized abdominal radiologists, five nonabdominal staff radiologists, and 11 senior residents or fellows. Reader experience explained differences in area under the JAFROC curve, with abdominal radiologists demonstrating greater area under the JAFROC curve (mean, 0.77; 95% CI: 0.75, 0.79) than trainees (mean, 0.71; 95% CI: 0.69, 0.73) (P = .02) or nonabdominal subspecialists (mean, 0.69; 95% CI: 0.60, 0.78) (P = .03). Sensitivity was similar within the reader experience groups (P = .96). Image navigation variables that were associated with higher sensitivity included longer interpretation time (P = .003) and greater use of coronal images (P < .001). The eye gaze time was at least 0.5 and 2.0 seconds for 71% (266 of 377) and 40% (149 of 377) of missed metastases, respectively. Conclusion: Abdominal radiologists demonstrated better discrimination for the detection of liver metastases on abdominal contrast-enhanced CT images. Missed metastases frequently received at least a brief eye gaze. Higher sensitivity was associated with longer interpretation time and greater use of liver display windows and coronal images. |
Jie Hu; Arkady Konovalov; Christian C. Ruff A unified neural account of contextual and individual differences in altruism Journal Article In: eLife, vol. 12, pp. 1–36, 2023. @article{Hu2023, Altruism is critical for cooperation and productivity in human societies but is known to vary strongly across contexts and individuals. The origin of these differences is largely unknown, but may in principle reflect variations in different neurocognitive processes that temporally unfold during altruistic decision making (ranging from initial perceptual processing via value computations to final integrative choice mechanisms). Here, we elucidate the neural origins of individual and contextual differences in altruism by examining altruistic choices in different inequality contexts with computational modeling and electroencephalography (EEG). Our results show that across all contexts and individuals, wealth distribution choices recruit a similar late decision process evident in model-predicted evidence accumulation signals over parietal regions. Contextual and individual differences in behavior related instead to initial processing of stimulus-locked inequality-related value information in centroparietal and centrofrontal sensors, as well as to gamma-band synchronization of these value-related signals with parietal response-locked evidence-accumulation signals. Our findings suggest separable biological bases for individual and contextual differences in altruism that relate to differences in the initial processing of choice-relevant information. |
Jeff Huang; Donald Brien; Brian C. Coe; Giulia Longoni; Donald J. Mabbott; Douglas P. Munoz; E. Ann Yeh Delayed oculomotor response associates with optic neuritis in youth with demyelinating disorders Journal Article In: Multiple Sclerosis and Related Disorders, vol. 79, pp. 1–9, 2023. @article{Huang2023a, Introduction: Impairment in visual and cognitive functions occur in youth with demyelinating disorders such as multiple sclerosis, neuromyelitis optica spectrum disorder, and myelin oligodendrocyte glycoprotein antibody-associated disease. Quantitative behavioral assessment using eye-tracking and pupillometry can provide functional metrics for important prognostic and clinically relevant information at the bedside. Methods: Children and adolescents diagnosed with demyelinating disorders and healthy, age-matched controls completed an interleaved pro- and anti-saccade task using video-based eye-tracking and underwent spectral-domain optical coherence tomography examination for evaluation of retinal nerve fiber layer and ganglion cell inner plexiform layer thickness. Low-contrast visual acuity and Symbol Digit Modalities Test were performed for visual and cognitive functional assessments. We assessed saccade and pupil parameters including saccade reaction time, direction error rate, pupil response latency, peak constriction time, and peak constriction and dilation velocities. Generalized Estimating Equations were used to examine the association of eye-tracking parameters with optic neuritis history, structural metrics, and visual and cognitive scores. Results: The study included 36 demyelinating disorders patients, aged 8–18 yrs. (75% F; median = 15.22 yrs. |
Jiawen Huang; Isabel Velarde; Wei Ji Ma; Christopher Baldassano Schema-based predictive eye movements support sequential memory encoding Journal Article In: eLife, vol. 12, pp. 1–19, 2023. @article{Huang2023b, When forming a memory of an experience that is unfolding over time, we can use our schematic knowledge about the world (constructed based on many prior episodes) to predict what will transpire. We developed a novel paradigm to study how the development of a complex schema influences predictive processes during perception and impacts sequential memory. Participants learned to play a novel board game (“4-in-a-row”) across six training sessions, and repeatedly performed a memory test in which they watched and recalled sequences of moves from the game. We found that participants gradually became better at remembering sequences from the game as their schema developed, driven by improved accuracy for schema-consistent moves. Eye tracking revealed that increased predictive eye movements during encoding, which were most prevalent in expert players, were associated with better memory. Our results identify prediction as a mechanism by which schematic knowledge can improve episodic memory. |
Ling Huang; Jingyi Wang; Qionghua He; Chu Li; Yueling Sun; Carol A. Seger; Xilin Zhang A source for category-induced global effects of feature-based attention in human prefrontal cortex Journal Article In: Cell Reports, vol. 42, no. 9, pp. 1–20, 2023. @article{Huang2023d, Global effects of feature-based attention (FBA) are generally limited to stimuli sharing the same or similar features, as hypothesized in the “feature-similarity gain model.” Visual perception, however, often reflects categories acquired via experience/learning; whether the global-FBA effect can be induced by the categorized features remains unclear. Here, human subjects were trained to classify motion directions into two discrete categories and perform a classical motion-based attention task. We found a category-induced global-FBA effect in both the middle temporal area (MT+) and frontoparietal areas, where attention to a motion direction globally spread to unattended motion directions within the same category, but not to those in a different category. Effective connectivity analysis showed that the category-induced global-FBA effect in MT+ was derived by feedback from the inferior frontal junction (IFJ). Altogether, our study reveals a category-induced global-FBA effect and identifies a source for this effect in human prefrontal cortex, implying that FBA is of greater ecological significance than previously thought. |
Yiru Huang; Zitian Liu; Zidong Chen; Zongyi Zhan; Le Gao; Jingyi Hu; Yanyan Wu; Fang-Fang Yan; Daming Deng; Chang-Bing Huang; Minbin Yu Visual crowding reveals field- and axis-specific cortical miswiring after long-term axial misalignment in strabismic patients without amblyopia Journal Article In: Investigative Ophthalmology & Visual Science, vol. 64, no. 1, pp. 1–11, 2023. @article{Huang2023, PURPOSE. Inspired by physiological and neuroimaging findings that revealed squint- induced modification of cortical volume and visual receptive field in early visual areas, we hypothesized that strabismic eyes without amblyopia manifest an increase in critical spacing of visual crowding, an essential bottleneck on object recognition and reliable psychophysical index of cortical organization. METHODS. We used real-time eye tracking to ensure gaze-contingent display and examined visual crowding in patients with horizontal concomitant strabismus (both esotropia and exotropia) but without amblyopia and age-matched normal controls. RESULTS. Nineteen patients with exotropia (12 men, mean ± SD = 22.89 ± 7.82 years), matched normal controls (7 men, mean ± SD = 23.07 ± 1.07 years) participated in this 21 patients with esotropia (10 men, mean ± SD = 23.48 ± 6.95 years), and 14 age- study. We found that patients with strabismus without amblyopia showed significantly larger critical spacing with nasotemporal asymmetry in only the radial axis that related to the strabismus pattern, with exotropia exhibiting stronger temporal hemifield crowding and esotropia exhibiting stronger nasal hemifield crowding, in both the deviated and fixating eyes. Moreover, the magnitude of crowding change was related to the duration and degree of strabismic deviation. CONCLUSIONS. Using visual crowding as a psychophysical index of cortical organization, our study demonstrated significantly greater peripheral visual crowding with nasotemporal asymmetry in only the radial axis in patients with strabismus without amblyopia, indicating the existence of hemifield- and axis-specific miswiring of cortical processing in object recognition induced by long-term adaptation to ocular misalignment. |
Yiru Huang; Zitian Liu; Mingqin Wang; Le Gao; Yanyan Wu; Jingyi Hu; Zhenyu Zhang; Fang-Fang Yan; Daming Deng; Chang-Bing Huang; Minbin Yu Cortical reorganization after optical alignment in strabismic patients outside of critical period Journal Article In: Investigative Ophthalmology & Visual Science, vol. 64, no. 11, pp. 1–13, 2023. @article{Huang2023f, PURPOSE. To measure visual crowding, an essential bottleneck on object recognition and reliable psychophysical index of cortex organization, in older children and adults with horizontal concomitant strabismus before and after strabismus surgery. METHODS. Using real-time eye tracking to ensure gaze-contingent display, we examined the peripheral visual crowding effects in older children and adults with horizontal concomitant strabismus but without amblyopia before and after strabismus surgery. Patients were asked to discriminate the orientation of the central tumbling E target letter with flankers arranged along the radial or tangential axis in the nasal or temporal hemifield at different eccentricities (5° or 10°). The critical spacing value, which is the minimum space between the target and the flankers required for correct discrimination, was obtained for comparisons before and after strabismus surgery. RESULTS. Twelve individuals with exotropia (6 males, 21.75 ± 7.29 years, mean ± SD) and 15 individuals with esotropia (6 males, 24.13 ± 5.96 years) participated in this study. We found that strabismic individuals showed significantly larger critical spacing with nasotemporal asymmetry along the radial axis that related to the strabismus pattern, with exotropes exhibiting stronger temporal field crowding and esotropes exhibiting stronger nasal field crowding before surgical alignment. After surgery, the critical spacing was reduced and rebalanced between the nasal and temporal hemifields. Furthermore, the postoperative recovery of stereopsis was associated with the extent of nasotemporal balance of critical spacing. CONCLUSIONS. We find that optical realignment (i.e., strabismus surgery) can normalize the enlarged visual crowding effects, a reliable psychophysical index of cortical organization, in the peripheral visual field of older children and adults with strabismus and rebalance the nasotemporal asymmetry of crowding, promoting the recovery of postoperative stereopsis. Our results indicated a potential of experience-dependent cortical organization after axial alignment even for individuals who are out of the critical period of visual development, illuminating the capacity and limitations of optics on sensory plasticity and emphasizing the importance of ocular correction for clinical practice. |
Zhibang Huang; Zhimei Niu; Sheng Li Reactivation-induced memory integration prevents proactive interference in perceptual learning Journal Article In: Journal of Vision, vol. 23, no. 5, pp. 1–15, 2023. @article{Huang2023h, We acquire perceptual skills through experience to adapt ourselves to the changing environment. Accomplishing an effective skill acquisition is a main purpose of perceptual learning research. Given the often observed learning effect specificity, multiple perceptual learnings with shared parameters could serve to improve the generalization of the learning effect. However, the interference between the overlapping memory traces of different learnings may impede this effort. Here, we trained human participants on an orientation discrimination task.We observed a proactive interference effect that the first training blocked the second training at its untrained location. This was a more pronounced effect than the well-known location specificity in perceptual learning.We introduced a short reactivation of the first training before the second training and successfully eliminated the proactive interference when the second training was inside the reconsolidation time window of the reactivated first training. Interestingly, we found that practicing an irrelevant task at the location of the second training immediately after the reactivation of the first training could also restore the effect of the second training but in a smaller magnitude, even if the second training was conducted outside of the reconsolidation window. We proposed a two-level mechanism of reactivation-induced memory integration to account for these results. The reactivation-based procedure could integrate either the previously trained and untrained locations or the two trainings at these locations, depending on the activated representations during the reconsolidation process. The findings provide us with new insight into the roles of long-term memory mechanisms in perceptual learning. |
Qian Huangfu; Hong Li; Yuanyuan Ban; Jiamei He An eye-tracking study on the effects of displayed teacher enthusiasm on students' learning procedural knowledge of Chemistry in video lectures Journal Article In: Journal of Chemical Education, pp. 1–11, 2023. @article{Huangfu2023, Teacher enthusiasm is known to affect students' learning in traditional classroom environments, but it is unclear how displayed teacher enthusiasm can optimize learning of chemistry procedural knowledge in multimedia learning environments. In this context, the present study used eye-tracking technology and quantitative analysis to examine how displayed teacher enthusiasm in video lectures affects students' positive emotions, visual attention, cognitive load, and learning outcomes. Measures were collected from 128 eighth-grade middle school students. An EyeLink 1000 Plus eye-tracker was used to capture the students' eye movements. The percentage of total fixation duration, percentage of fixation count, mean pupil size, and blink rate were used as metrics to analyze the eye-gaze data. The results showed that an enthusiastic teacher positively affected students' positive emotions, reduced students' cognitive load, and made students more concentrated on the learning-content area. Additionally, the higher level of displayed teacher enthusiasm improved learners' learning outcomes. |
Christoph Huber-Huber; David Melcher Saccade execution increases the preview effect with faces: An EEG and eye-tracking coregistration study Journal Article In: Attention, Perception, & Psychophysics, pp. 1–17, 2023. @article{HuberHuber2023, Under naturalistic viewing conditions, humans conduct about three to four saccadic eye movements per second. These dynamics imply that in real life, humans rarely see something completely new; there is usually a preview of the upcoming foveal input from extrafoveal regions of the visual field. In line with results from the field of reading research, we have shown with EEG and eye-tracking coregistration that an extrafoveal preview also affects postsaccadic visual object processing and facilitates discrimination. Here, we ask whether this preview effect in the fixation-locked N170, and in manual responses to the postsaccadic target face (tilt discrimination), requires saccade execution. Participants performed a gaze-contingent experiment in which extrafoveal face images could change their orientation during a saccade directed to them. In a control block, participants maintained stable gaze throughout the experiment and the extrafoveal face reappeared foveally after a simulated saccade latency. Compared with this no-saccade condition, the neural and the behavioral preview effects were much larger in the saccade condition. We also found shorter first fixation durations after an invalid preview, which is in contrast to reading studies. We interpret the increased preview effect under saccade execution as the result of the additional sensorimotor processes that come with gaze behavior compared with visual perception under stable fixation. In addition, our findings call into question whether EEG studies with fixed gaze capture key properties and dynamics of active, natural vision. |
Tinghu Kang; Shu Luo; Ping Wang; Tinghao Tang Influence of figure information on attention distribution in Chinese landscape painting Journal Article In: Heliyon, vol. 9, no. 4, pp. 1–10, 2023. @article{Kang2023, Chinese landscape painting is a complex form of visual art. More researchers pay more attention to the creation process and expressed intention of landscape painting. However, the appreciation of works of visual art is often related to cognitive processing, and it is influenced by the content of the works. This study hypothesized that the information of the figure in landscape paintings could guide the allocation of attention and affect cognitive processing. To test this hypothesis, the vertical landscape paintings of the Song and Ming Dynasties were used as experimental materials in the experiment, and the eye-movement technology was applied to record and compare the differences of the eye-movement indexes of landscape paintings with and without figures. The results showed that the dwell time of landscape painting with figure was significantly longer than that of landscape painting without figure, and the dwell time of the interest area of the figure was significantly longer than that of the interest area without figure. However, the first three fixation duration of the interest area with figures is significantly less than that of the interest area without figure, and there was no difference in the saccade counts and the distribution of fixation points between different landscape paintings. It suggested that the figure in the landscape painting can attract peoples' attention, but it does not have attention priority. Meanwhile, peoples tend to holistic processing when they viewing the vertical landscape paintings, and it is not influenced by the information of figure. |
Tinghu Kang; Tinghao Tang; Peizhi Zhang; Shu Luo; Huanhuan Qi Metacognitive prompts and numerical ordinality in solving word problems: An eye-tracking study Journal Article In: British Journal of Educational Psychology, vol. 93, no. 3, pp. 862–877, 2023. @article{Kang2023a, Background: The ability to translate concrete manipulatives into abstract mathematical formulas can aid in the solving of mathematical word problems among students, and metacognitive prompts play a significant role in enhancing this process. Aims: Based on the concept of semantic congruence, we explored the effects of metacognitive prompts and numerical ordinality on information searching and cognitive processing, throughout the process of solving mathematical word problems among primary school students in China. Sample: Participants included 73 primary school students (38 boys and 35 girls) with normal or corrected visual acuity. Methods: This study was based on a 2 (prompt information: no-prompt, metacognitive-prompt) × 2 (number attribute: cardinal number, ordinal number) mixed experimental design. We analysed multiple eye-movement indices, such as fixation duration, saccadic amplitude, and pupil size, since they pertained to the areas of interest. Results: When solving both types of problems, pupil sizes were significantly smaller under the metacognitive-prompt condition compared with the no-prompt condition, and shorter dwell time for specific sentences, conditional on metacognitive prompts, indicated the optimization of the presented algorithm. Additionally, the levels of fixation durations and saccadic amplitudes were significantly higher when solving ordinal number word problems compared with solving ordinal number problems, indicating that primary school students were less efficient in reading and faced increased levels of difficulty when solving ordinal number problems. Conclusions: The results indicate that for Chinese upper-grade primary school students, cognitive load was lower in the metacognitive prompting condition and when solving cardinal problems, and higher when solving ordinal problems. |