全部EyeLink出版物
以下列出了截至2023年(包括2024年初)的所有12000多份同行评审的EyeLink研究出版物。您可以使用“视觉搜索”、“平滑追踪”、“帕金森氏症”等关键字搜索出版物库。您还可以搜索个人作者的姓名。可以在解决方案页面上找到按研究领域分组的眼动追踪研究。如果我们错过了任何EyeLink眼动追踪论文,请 给我们发电子邮件!
2023 |
Martin Zettersten; Daniel Yurovsky; Tian Linger Xu; Sarp Uner; Angeline Sin Mei Tsui; Rose M. Schneider; Annissa N. Saleh; Stephan C. Meylan; Virginia A. Marchman; Jessica Mankewitz; Kyle MacDonald; Bria Long; Molly Lewis; George Kachergis; Kunal Handa; Benjamin DeMayo; Alexandra Carstensen; Mika Braginsky; Veronica Boyce; Naiti S. Bhatt; Claire Augusta Bergey; Michael C. Frank Peekbank: An open, large-scale repository for developmental eye-tracking data of children's word recognition Journal Article In: Behavior Research Methods, vol. 55, no. 5, pp. 2485–2500, 2023. @article{Zettersten2023, The ability to rapidly recognize words and link them to referents is central to children's early language development. This ability, often called word recognition in the developmental literature, is typically studied in the looking-while-listening paradigm, which measures infants' fixation on a target object (vs. a distractor) after hearing a target label. We present a large-scale, open database of infant and toddler eye-tracking data from looking-while-listening tasks. The goal of this effort is to address theoretical and methodological challenges in measuring vocabulary development. We first present how we created the database, its features and structure, and associated tools for processing and accessing infant eye-tracking datasets. Using these tools, we then work through two illustrative examples to show how researchers can use Peekbank to interrogate theoretical and methodological questions about children's developing word recognition ability. |
Biao Zeng; Guoxing Yu; Nabil Hasshim; Shanhu Hong Primacy of mouth over eyes to perceive audiovisual Mandarin lexical tones Journal Article In: Journal of Eye Movement Research, vol. 16, no. 4, pp. 1–12, 2023. @article{Zeng2023, The visual cues of lexical tones are more implicit and much less investigated than consonants and vowels, and it is still unclear what facial areas contribute to facial tones identification. This study investigated Chinese and English speakers' eye movements when they were asked to identify audiovisual Mandarin lexical tones. The Chinese and English speakers were presented with an audiovisual clip of Mandarin monosyllables (for instance, /ă/, /à/, /ĭ/, /ì/) and were asked to identify whether the syllables were a dipping tone (/ă/, / ĭ/) or a falling tone (/ à/, /ì/). These audiovisual syllables were presented in clear, noisy and silent (absence of audio signal) conditions. An eye-tracker recorded the participants' eye movements. Results showed that the participants gazed more at the mouth than the eyes. In addition, when acoustic conditions became adverse, both the Chinese and English speakers increased their gaze duration at the mouth rather than at the eyes. The findings suggested that the mouth is the primary area that listeners utilise in their perception of audiovisual lexical tones. The similar eye movements between the Chinese and English speakers imply that the mouth acts as a perceptual cue that provides articulatory information, as opposed to social and pragmatic information. |
Nina Zdorova; Olga Parshina; Bela Ogly; Irina Bagirokova; Ekaterina Krasikova; Anastasiia Ziubanova; Shamset Unarokova; Susanna Makerova; Olga Dragoy Eye movement corpora in Adyghe and Russian: An eye-tracking study of sentence reading in bilinguals Journal Article In: Frontiers in Psychology, vol. 14, pp. 1–12, 2023. @article{Zdorova2023a, The present study expands the eye-tracking-while reading research toward less studied languages of different typological classes (polysynthetic Adyghe vs. synthetic Russian) that use a Cyrillic script. In the corpus reading data from the two languages, we confirmed the widely studied effects of word frequency and word length on eye movements in Adyghe-Russian bilingual individuals for both languages. We also confirmed morphological effects in Adyghe reading (part-of-speech class and the number of lexical affixes) that were previously shown in some morphologically-rich languages. Importantly, we demonstrated that bilinguals' reading in Adyghe does differ quantitatively (the effect of language on reading times) and qualitatively (different effects of landing and previous/upcoming words on the eye movements within a current word) from their reading in Russian. |
Nina Zdorova; Svetlana Malyutina; Anna Laurinavichyute; Anastasiia Kaprielova; Anastasia Ziubanova; Anastasiya Lopukhina Do we rely on good-enough processing in reading under auditory and visual noise? Journal Article In: PLoS ONE, vol. 18, pp. 1–19, 2023. @article{Zdorova2023, Noise, as part of real-life communication flow, degrades the quality of linguistic input and affects language processing. According to predictions of the noisy-channel and good-enough processing models, noise should make comprehenders rely more on word-level semantics instead of actual syntactic relations. However, empirical evidence supporting this prediction is still lacking. For the first time, we investigated whether auditory (three-talker babble) and visual (short idioms appearing next to a target sentence on the screen) noise would trigger greater reliance on semantics and make readers of Russian sentences process the sentences superficially. Our findings suggest that, although Russian speakers generally relied on semantics in sentence comprehension, neither auditory nor visual noise increased this reliance. The only effect of noise on semantic processing was found in reading speed under auditory noise measured by first fixation duration: only without noise, the semantically implausible sentences were read slower than semantically plausible ones. These results do not support the predictions of the study based on the noisy-channel and good-enough processing models, which is discussed in light of the methodological differences among the studies of noise and their possible limitations. |
Andrea M. Zawoyski; Scott P. Ardoin; Katherine S. Binder The impact of test-taking strategies on eye movements of elementary students during reading comprehension assessment Journal Article In: School Psychology, vol. 38, no. 1, pp. 59–66, 2023. @article{Zawoyski2023, Teachers often encourage students to use test-taking strategies during reading comprehension assessments, but these strategies are not always evidence-based. One common strategy involves teaching students to read the questions before reading an associated passage. Research findings comparing the passage-first (PF) and questions-first (QF) strategies are mixed. The present study employed eye-tracking technology to record 84 third and fourth-grade participants' eye movements (EMs) as they read a passage and responded to multiple-choice (MC) questions using PF and QF strategies in a within-subject design. Although there were no significant differences between groups in accuracy on MC questions, EM measures revealed that the PF condition was superior to the QF condition for elementary readers in terms of efficiency in reading and responding to questions. These findings suggest that the PF strategy supports a more comprehensive understanding of the text. Ultimately, within the PF condition, students required less time to obtain the same accuracy outcomes they attained when reading in the QF condition. School psychologists can improve reading comprehension instruction by encouraging the importance of teaching children to gain meaning from the text rather than search the passage for answers to MC questions |
Alessandro Zanini; Audrey Dureux; Janahan Selvanayagam; Stefan Everling Ultra-high field fMRI identifies an action-observation network in the common marmoset Journal Article In: Communications Biology, vol. 6, no. 1, pp. 1–11, 2023. @article{Zanini2023, The observation of others' actions activates a network of temporal, parietal and premotor/prefrontal areas in macaque monkeys and humans. This action-observation network (AON) has been shown to play important roles in social action monitoring, learning by imitation, and social cognition in both species. It is unclear whether a similar network exists in New-World primates, which separated from Old-Word primates ~35 million years ago. Here we used ultra-high field fMRI at 9.4 T in awake common marmosets (Callithrix jacchus) while they watched videos depicting goal-directed (grasping food) or non-goal-directed actions. The observation of goal-directed actions activates a temporo-parieto-frontal network, including areas 6 and 45 in premotor/prefrontal cortices, areas PGa-IPa, FST and TE in occipito-temporal region and areas V6A, MIP, LIP and PG in the occipito-parietal cortex. These results show overlap with the humans and macaques' AON, demonstrating the existence of an evolutionarily conserved network that likely predates the separation of Old and New-World primates. |
Chuanli Zang; Ying Fu; Hong Du; Xuejun Bai; Guoli Yan; Simon P. Liversedge Processing multiconstituent units: Preview effects during reading of Chinese words, idioms, and phrases Journal Article In: Journal of Experimental Psychology: Learning, Memory, and Cognition, pp. 1–21, 2023. @article{Zang2023a, Arguably, the most contentious debate in the field of eye movement control in reading has centered on whether words are lexically processed serially or in parallel during reading. Chinese is character-based and unspaced, meaning the issue of how lexical processing is operationalized across potentially ambiguous, multicharacter strings is not straightforward. We investigated Chinese readers' processing of frequently occurring multiconstituent units (MCUs), that is, linguistic units composed of more than a single word, that might be represented lexically as a single representation. In Experiment 1, we manipulated the linguistic category of a two-constituent Chinese string (word, MCU, or phrase) and the preview of its second constituent (identical or pseudocharacter) using the boundary paradigm with the boundary located before the twoconstituent string. A robust preview effect was obtained when the second constituent, alongside the first, formed a word or MCU, but not a phrase, suggesting that frequently occurring MCUs are lexicalized and processed parafoveally as single units during reading. In Experiment 2, we further manipulated the phrase type of a two-constituent but three-character Chinese string (idiom with a one-character modifier and a twocharacter noun, or matched phrase) and the preview of the second constituent noun (identity or pseudocharacter). A greater preview effect was obtained for idioms than phrases, indicating that idioms are processed to a greater extent in the parafovea than matched phrases. Together, the results of these two experiments suggest that lexical identification processes in Chinese can be operationalized over linguistic units that are larger than an individual word. |
Tania S. Zamuner; Theresa Rabideau; Margarethe McDonald; H. Henny Yeung Developmental change in children's speech processing of auditory and visual cues: An eyetracking study Journal Article In: Journal of Child Language, vol. 50, pp. 27–51, 2023. @article{Zamuner2023, This study investigates how children aged two to eight years (N = 129) and adults (N = 29) use auditory and visual speech for word recognition. The goal was to bridge the gap between apparent successes of visual speech processing in young children in visual-looking tasks, with apparent difficulties of speech processing in older children from explicit behavioural measures. Participants were presented with familiar words in audio-visual (AV), audio-only (A-only) or visual-only (V-only) speech modalities, then presented with target and distractor images, and looking to targets was measured. Adults showed high accuracy, with slightly less target-image looking in the V-only modality. Developmentally, looking was above chance for both AV and A-only modalities, but not in the V-only modality until 6 years of age (earlier on /k/-initial words). Flexible use of visual cues for lexical access develops throughout childhood. |
Tom Zalmenson; Omer Azriel; Yair Bar-Haim Enhanced recognition of disgusted expressions occurs in spite of attentional avoidance at encoding Journal Article In: Frontiers in Psychology, vol. 13, pp. 1–8, 2023. @article{Zalmenson2023, Introduction: Negative emotional content is prioritized in memory. Prioritized attention to negative stimuli has been suggested to mediate this valence-memory association. However, research suggests only a limited role for attention in this observed memory advantage. We tested the role of attention in memory for disgusted facial expressions, a powerful social–emotional stimulus. Methods: We measured attention using an incidental, free-viewing encoding task and memory using a surprise memory test for the viewed expressions. Results and Discussion: Replicating prior studies, we found increased attentional dwell-time for neutral over disgusted expressions at encoding. However, contrary to the attention-memory link hypothesis, disgusted faces were better remembered than neutral faces. Although dwell-time was found to partially mediate the association between valence and memory, this effect was much weaker than the opposite direct effect. These findings point to independence of memory for disgusted faces from attention during encoding. |
Abdullah Zafar; Claudia Martin Calderon; Anne Marie Yeboah; Kristine Dalton; Elizabeth Irving; Ewa Niechwiej-Szwedo Investigation of camera-free eye-tracking glasses compared to a video-based system Journal Article In: Sensors, vol. 23, no. 18, pp. 1–18, 2023. @article{Zafar2023, Technological advances in eye-tracking have resulted in lightweight, portable solutions that are capable of capturing eye movements beyond laboratory settings. Eye-tracking devices have typically relied on heavier, video-based systems to detect pupil and corneal reflections. Advances in mobile eye-tracking technology could facilitate research and its application in ecological settings; more traditional laboratory research methods are able to be modified and transferred to real-world scenarios. One recent technology, the AdHawk MindLink, introduced a novel camera-free system embedded in typical eyeglass frames. This paper evaluates the AdHawk MindLink by comparing the eye-tracking recordings with a research “gold standard”, the EyeLink II. By concurrently capturing data from both eyes, we compare the capability of each eye tracker to quantify metrics from fixation, saccade, and smooth pursuit tasks—typical elements in eye movement research—across a sample of 13 adults. The MindLink system was capable of capturing fixation stability within a radius of less than 0.5 (Formula presented.), estimating horizontal saccade amplitudes with an accuracy of 0.04 (Formula presented.) ± 2.3 (Formula presented.), vertical saccade amplitudes with an accuracy of 0.32 (Formula presented.) ± 2.3 (Formula presented.), and smooth pursuit speeds with an accuracy of 0.5 to 3 (Formula presented.), depending on the pursuit speed. While the performance of the MindLink system in measuring fixation stability, saccade amplitude, and smooth pursuit eye movements were slightly inferior to the video-based system, MindLink provides sufficient gaze-tracking capabilities for dynamic settings and experiments. |
Mengxi Yun; Masafumi Nejime; Takashi Kawai; Jun Kunimatsu; Hiroshi Yamada; Hyung Goo R. Kim; Masayuki Matsumoto Distinct roles of the orbitofrontal cortex, ventral striatum, and dopamine neurons in counterfactual thinking of decision outcomes Journal Article In: Science Advances, vol. 9, no. 32, pp. 1–14, 2023. @article{Yun2023, Individuals often assess past decisions by comparing what was gained with what would have been gained had they acted differently. Thoughts of past alternatives that counter what actually happened are called “counterfactuals.” Recent theories emphasize the role of the prefrontal cortex in processing counterfactual outcomes in decision-making, although how subcortical regions contribute to this process remains to be elucidated. Here we report a clear distinction among the roles of the orbitofrontal cortex, ventral striatum and midbrain dopamine neurons in processing counterfactual outcomes in monkeys. Our findings suggest that actually gained and counterfactual outcome signals are both processed in the cortico-subcortical network constituted by these regions but in distinct manners and integrated only in the orbitofrontal cortex in a way to compare these outcomes. This study extends the prefrontal theory of counterfactual thinking and provides key insights regarding how the prefrontal cortex cooperates with subcortical regions to make decisions using counterfactual information. |
Wenwen Yu; Yiwei Li; Xueying Cao; Licheng Mo; Yuming Chen; Dandan Zhang The role of ventrolateral prefrontal cortex on voluntary emotion regulation of social pain Journal Article In: Human Brain Mapping, vol. 44, no. 13, pp. 4710–4721, 2023. @article{Yu2023b, The right ventrolateral prefrontal cortex (rVLPFC) is highly engaged in emotion regulation of social pain. However, there is still lack of both inhibition and excitement evidence to prove the causal relationship between this brain region and voluntary emotion regulation. This study used high-frequency (10 Hz) and low-frequency (1 Hz) repetitive transcranial magnetic stimulation (rTMS) to separately activate or inhibit the rVLPFC in two groups of participants. We recorded participants' emotion ratings as well as their social attitude and prosocial behaviors following emotion regulation. Also, we used eye tracker to record the changes of pupil diameter to measure emotional feelings objectively. A total of 108 healthy participants were randomly assigned to the activated, inhibitory or sham rTMS groups. They were required to accomplish three sequential tasks: the emotion regulation (cognitive reappraisal) task, the favorability rating task, and the donation task. Results show that the rVLPFC-inhibitory group reported more negative emotions and showed larger pupil diameter while the rVLPFC-activated group showed less negative emotions and reduced pupil diameter during emotion regulation (both compared with the sham rTMS group). In addition, the activated group gave more positive social evaluation to peers and donated more money to a public welfare activity than the rVLPFC-inhibitory group, among which the change of social attitude was mediated by regulated emotion. Taken together, these findings reveal that the rVLPFC plays a causal role in voluntary emotion regulation of social pain and can be a potential brain target in treating deficits of emotion regulation in psychiatric disorders. |
Qiuchen Yu; Jiangfeng Gou; Yan Li; Zhongling Pi; Jiumin Yang Introducing support for learner control: Temporal and organizational cues in instructional videos Journal Article In: British Journal of Educational Technology, pp. 1–24, 2023. @article{Yu2023a, Instructional videos risk overloading learners' limited working memory resources due to the transient information effect. Learner control is one way to mitigate this concern, but has shown almost zero overall effect and considerable heterogeneity. Consequently, it is essential to identify when learner control is most beneficial. The present study examined the influence of cues on learners' behaviour, cognitive process, metacognition and learning performance in an interactive learning environment. Employing a 2 (temporal cues: without vs. with) × 2 (organizational cues: without vs. with) between-subject design, 117 participants were randomly assigned to one of four conditions: no cues, temporal cues, organizational cues and temporal cues + organizational cues. Among these, temporal cues (ie, progress bar) serve as time-related signals designed to regulate pacing, and organizational cues (ie, table of contents) provide a structural framework for the content. Significant cueing effects were observed for both cue types at germane cognitive load and transfer. Notably, our results indicate that organizational cues effectively guide learners' attention towards the underlying structure, thus promoting cognitive processing. These unique benefits are evident in improved topic recall, retention and monitoring accuracy. Importantly, combined temporal cues and organizational cues were seen to not only allow learners to exhibit more engagement behaviours (ie, skimming) but also assist learners in accurately judging their learning. These findings strongly support the recommendation to use cues to enhance the effectiveness of learner control. Practitioner notes What is already known about this topic Instructional videos may overload limited working memory resources due to the transient information effect. The overall effect of including learner control within educational technology was almost zero (g = 0.05) but showed higher heterogeneity. It is unclear whether embedding various cues in an instructional video improves the effectiveness of learner control. What this paper adds Both temporal and organizational cues aided in increasing learners' germane cognitive load and enhancing their transfer. Organizational cues helped learners understand the underlying structure, thus facilitating deeper cognitive processing, improved metacognition and ultimately boosted learning performance. Combined temporal and organizational cues lead to engagement behaviours and accurate self-monitoring. Implications for practice and/or policy Providing instructional support is important in assisting learners with the complexities of learner-controlled instruction. Embedding cues help learners process the content deeply by giving learners control over the instructional video. |
Haojue Yu; Miyoung Kwon Central and peripheral visual field examination Journal Article In: Investigative Ophthalmology & Visual Science, vol. 64, no. 13, pp. 1–14, 2023. @article{Yu2023, PURPOSE. Although foveal vision provides fine spatial information, parafoveal and peripheral vision are also known to be important for efficient reading behaviors. Here we systematically investigate how different types and sizes of visual field defects affect the way visual information is acquired via eye movements during reading. METHODS. Using gaze-contingent displays, simulated scotomas were induced in 24 adults with normal or corrected-to-normal vision during a reading task. The study design included peripheral and central scotomas of varying sizes (aperture or scotoma size of 2°, 4°, 6°, 8°, and 10°) and no-scotoma conditions. Eye movements (e.g., forward/backward saccades, fixations, microsaccades) were plotted as a function of either the aperture or scotoma size, and their relationships were characterized by the best fitting model. RESULTS. When the aperture size of the peripheral scotoma decreased below 6° (11 visible letters), there were significant decreases in saccade amplitude and velocity, as well as substantial increases in fixation duration and the number of fixations. Its dependency on the aperture size is best characterized by an exponential decay or growth function in log-linear coordinates. However, saccade amplitude and velocity, fixation duration, and forward/regressive saccades increased more or less linearly with increasing central scotoma size in log-linear coordinates. CONCLUSIONS. Our results showed differential impacts of central and peripheral vision loss on reading behaviors while lending further support for the importance of foveal and parafoveal vision in reading. These apparently deviated oculomotor behaviors may in part reflect optimal reading strategies to compensate for the loss of visual information. |
Michael C. W. Yip Tracking the time-course of spoken word recognition of Cantonese Chinese in sentence context: Evidence from eye movements Journal Article In: Psychonomic Bulletin & Review, pp. 1–11, 2023. @article{Yip2023, In this study, we conducted an eye-tracking experiment to investigate the effects of sentence context and tonal information on spoken word recognition processes in Cantonese Chinese. We recruited 60 native Cantonese listeners to participate in the eye-tracking experiment. The target words (phonologically similar words) were manipulated to either (1) a congruent context or (2) an incongruent context in the experiment. The resulting eye-movement patterns in the incongruent context condition clearly revealed that (1) sentence context produced a garden-path effect in the initial stage of the spoken word recognition processes and then (2) the lexical tone of the word (bottom-up information) overrode the contextual effects to help listeners to discriminate between different similar-sounding words during lexical access. In conclusion, the patterns of eye-tracking data show the interactive processes between the lexical tone (an acoustic cue within a Cantonese word) and sentence context played in different phases to the spoken word recognition of Cantonese Chinese. |
Yang Yiling; Katharine Shapcott; Alina Peter; Johanna Klon-Lipok; Huang Xuhui; Andreea Lazar; Wolf Singer Robust encoding of natural stimuli by neuronal response sequences in monkey visual cortex Journal Article In: Nature Communications, vol. 14, no. 1, pp. 1–18, 2023. @article{Yiling2023a, Parallel multisite recordings in the visual cortex of trained monkeys revealed that the responses of spatially distributed neurons to natural scenes are ordered in sequences. The rank order of these sequences is stimulus-specific and maintained even if the absolute timing of the responses is modified by manipulating stimulus parameters. The stimulus specificity of these sequences was highest when they were evoked by natural stimuli and deteriorated for stimulus versions in which certain statistical regularities were removed. This suggests that the response sequences result from a matching operation between sensory evidence and priors stored in the cortical network. Decoders trained on sequence order performed as well as decoders trained on rate vectors but the former could decode stimulus identity from considerably shorter response intervals than the latter. A simulated recurrent network reproduced similarly structured stimulus-specific response sequences, particularly once it was familiarized with the stimuli through non-supervised Hebbian learning. We propose that recurrent processing transforms signals from stationary visual scenes into sequential responses whose rank order is the result of a Bayesian matching operation. If this temporal code were used by the visual system it would allow for ultrafast processing of visual scenes. |
Yang Yiling; Johanna Klon-Lipok; Wolf Singer Joint encoding of stimulus and decision in monkey primary visual cortex Journal Article In: Cerebral Cortex, pp. 1–6, 2023. @article{Yiling2023, We investigated whether neurons in monkey primary visual cortex (V1) exhibit mixed selectivity for sensory input and behavioral choice. Parallel multisite spiking activity was recorded from area V1 of awake monkeys performing a delayed match-to-sample task. The monkeys had to make a forced choice decision of whether the test stimulus matched the preceding sample stimulus. The population responses evoked by the test stimulus contained information about both the identity of the stimulus and with some delay but before the onset of the motor response the forthcoming choice. The results of subspace identification analysis indicate that stimulus-specific and decision-related information coexists in separate subspaces of the high-dimensional population activity, and latency considerations suggest that the decision-related information is conveyed by top-down projections. |
Ji Su Yeon; Ha Na Jung; Jae-Young Kim; Kyong In Jung; Hae Young Lopilly Park; Chan Kee Park; Hyo Won Kim; Man Soo Kim; Yong Chan Kim Deviated saccadic trajectory as a biometric signature of glaucoma Journal Article In: Translational Vision Science & Technology, vol. 12, no. 7, pp. 1–12, 2023. @article{Yeon2023, Purpose: To investigate whether the trajectories of saccadic eye movements (SEMs) significantly differ between glaucoma patients and controls. Methods: SEMs were recorded by video-based infrared oculography in 53 patients with glaucoma and 41 age-matched controls. Participants were asked to bilaterally view 24°-horizontal, 14°-vertical, and 20°-diagonal eccentric Goldmann III-sized stimuli. SEMs were evaluated with respect to the saccadic reaction time (SRT), the mean velocity, amplitude, and two novel measures: departure angle (DA) and arrival angle (AA). These parameters were compared between the groups and the associations of SEM parameters with glaucoma parameters and integrated visual field defects were investigated. Results: Glaucoma patients exhibited increased mean SRT, DA, and AA values compared with controls for 14°-vertical visual targets (P = 0.05, P < 0.01, and P < 0.01, respectively). The SRT, DA, and AA were significantly associated with the mean and pattern standard deviations of perimetry and with the mean RNFL thickness by OCT (all P < 0.001). Glaucoma was associated with the AA (P = 0.05) and both the SRT (P = 0.01) and DA (P = 0.04) were associated with integrated visual field defects. Conclusions: The saccadic trajectories of glaucoma patients depart in an erroneous path and compensate the disparity by deviating the trajectory at arrival. Translational Relevance: The initial deviation that we observed (despite continuous exposure to the stimulus) suggests the disoriented spatial perception of glaucoma patients which may be relevant to difficulties encountered daily. |
Jacob L. Yates; Shanna H. Coop; Gabriel H. Sarch; Ruei Jr Wu; Daniel A. Butts; Michele Rucci; Jude F. Mitchell Detailed characterization of neural selectivity in free viewing primates Journal Article In: Nature Communications, vol. 14, no. 1, pp. 1–11, 2023. @article{Yates2023, Fixation constraints in visual tasks are ubiquitous in visual and cognitive neuroscience. Despite its widespread use, fixation requires trained subjects, is limited by the accuracy of fixational eye movements, and ignores the role of eye movements in shaping visual input. To overcome these limitations, we developed a suite of hardware and software tools to study vision during natural behavior in untrained subjects. We measured visual receptive fields and tuning properties from multiple cortical areas of marmoset monkeys who freely viewed full-field noise stimuli. The resulting receptive fields and tuning curves from primary visual cortex (V1) and area MT match reported selectivity from the literature which was measured using conventional approaches. We then combined free viewing with high-resolution eye tracking to make the first detailed 2D spatiotemporal measurements of foveal receptive fields in V1. These findings demonstrate the power of free viewing to characterize neural responses in untrained animals while simultaneously studying the dynamics of natural behavior. |
Yao Yao; Katrina Connell; Stephen Politzer-Ahles Hearing emotion in two languages: A pupillometry study of Cantonese–Mandarin bilinguals' perception of affective cognates in L1 and L2 Journal Article In: Bilingualism: Language and Cognition, vol. 26, no. 4, pp. 795–808, 2023. @article{Yao2023d, Differential affective processing has been widely documented for bilinguals: L1 affective words elicit higher levels of arousal and stronger emotionality ratings than L2 affective words (Pavlenko, 2012). In this study, we focus on two closely related Chinese languages, Mandarin and Cantonese, whose affective lexicons are highly overlapping, with shared lexical items that only differ in pronunciation across languages. We recorded L1 Cantonese – L2 Mandarin bilinguals' pupil responses to auditory tokens of Cantonese and Mandarin affective words. Our results showed that Cantonese–Mandarin bilinguals had stronger pupil responses when the affective words were pronounced in Cantonese (L1) than when the same words were pronounced in Mandarin (L2). The effect was most evident in taboo words and among bilinguals with lower L2 proficiency. We discuss the theoretical implications of the findings in the frameworks of exemplar theory and models of the bilingual lexicon. |
Yao Yao; Katrina Connell; Stephen Politzer-Ahles Hearing emotion in two languages : A pupillometry study of Cantonese – Mandarin bilinguals ' perception of affective cognates in L1 and L2 Journal Article In: Bilingualism: Language and Cognition, pp. 1–14, 2023. @article{Yao2023, Differential affective processing has been widely documented for bilinguals: L1 affective words elicit higher levels of arousal and stronger emotionality ratings than L2 affective words (Pavlenko, 2012). In this study, we focus on two closely related Chinese languages, Mandarin and Cantonese, whose affective lexicons are highly overlapping, with shared lexical items that only differ in pronunciation across languages. We recorded L1 Cantonese – L2 Mandarin bilinguals' pupil responses to auditory tokens of Cantonese and Mandarin affective words. Our results showed that Cantonese–Mandarin bilinguals had stronger pupil responses when the affective words were pronounced in Cantonese (L1) than when the same words were pronounced in Mandarin (L2). The effect was most evident in taboo words and among bilinguals with lower L2 proficiency. We discuss the theoretical implications of the findings in the frameworks of exemplar theory and models of the bilingual lexicon. © |
Panpan Yao; Xin Jiang; Xinwei Chen; Xingshan Li Explore the processing unit of L2 Chinese learners in on-line Chinese reading Journal Article In: Second Language Research, pp. 1–17, 2023. @article{Yao2023c, The present study explored the processing units of high-proficiency second language (L2) Chinese learners in on-line reading in an eye-tracking experiment. The critical aim was to investigate how learners segment continuous characters into words without the aid of word boundary demarcations. Based on previous studies, the embedded words of 2- and 3-character incremental words were manipulated to be either plausible or implausible with the preceding verbs, while the incremental words themselves were always plausible. The results revealed an effect of the plausibility manipulation, which suggested that L2 Chinese learners activated embedded words first and integrated embedded words with previous sentence context as soon as they read them. |
Panpan Yao; David Hall; Hagit Borer; Linnaea Stockall Dutch–Mandarin learners' online use of syntactic cues to anticipate mass vs. count interpretations Journal Article In: Second Language Research, pp. 1–38, 2023. @article{Yao2023b, It remains unclear whether late second language learners (L2ers) can acquire sufficient knowledge about unique-to-L2 constructions through implicit learning to build anticipations during real-time processing. To tackle this question, we conducted a visual world paradigm experiment to investigate high-proficiency late first-language Dutch second-language Mandarin Chinese learners' online processing of syntactic cues to count vs. mass interpretations in Chinese which are unique-to-L2 and never explicitly taught. The results showed that late Dutch–Mandarin learners were sensitive to a mass-biased syntactic cue in real-time processing, and exhibited some native-like anticipatory behaviour. These findings indicate that late L2ers can acquire unique-to-L2 constructions through implicit learning, and can automatically use this knowledge to make predictions. |
Mengna Yao; Bincheng Wen; Mingpo Yang; Jiebin Guo; Haozhou Jiang; Chao Feng; Yilei Cao; Huiguang He; Le Chang High-dimensional topographic organization of visual features in the primate temporal lobe Journal Article In: Nature Communications, vol. 14, no. 1, pp. 1–23, 2023. @article{Yao2023a, The inferotemporal cortex supports our supreme object recognition ability. Numerous studies have been conducted to elucidate the functional organization of this brain area, but there are still important questions that remain unanswered, including how this organization differs between humans and non-human primates. Here, we use deep neural networks trained on object categorization to construct a 25-dimensional space of visual features, and systematically measure the spatial organization of feature preference in both male monkey brains and human brains using fMRI. These feature maps allow us to predict the selectivity of a previously unknown region in monkey brains, which is corroborated by additional fMRI and electrophysiology experiments. These maps also enable quantitative analyses of the topographic organization of the temporal lobe, demonstrating the existence of a pair of orthogonal gradients that differ in spatial scale and revealing significant differences in the functional organization of high-level visual areas between monkey and human brains. |
Xiaozhi Yang; Ian Krajbich A dynamic computational model of gaze and choice in multi-attribute decisions Journal Article In: Psychological Review, vol. 130, no. 1, pp. 52–70, 2023. @article{Yang2023e, When making decisions, how people allocate their attention influences their choices. One empirical finding is that people are more likely to choose the option that they have looked at more. This relation has been formalized with the attentional drift-diffusion model (aDDM; Krajbich et al., 2010). However, options often have multiple attributes, and attention is also thought to govern the relative weighting of those attributes (Roe et al., 2001). Little is known about how these two distinct features of the choice process interact; we still lack a model (and tests of that model) that incorporate both option- and attribute-wise attention. Here, we propose a multi-attribute attentional drift-diffusion model (maaDDM) to account for attentional discount factors on both options and attributes. We then use five eye-tracking datasets (two-alternative, two-attribute preferential tasks) from different choice domains to test the model. We find very stable option-level and attribute-level attentional discount factors across datasets, though nonfixated options are consistently discounted more than nonfixated attributes. Additionally, we find that people generally discount the nonfixated attribute of the nonfixated option in a multiplicative way, and so that feature is consistently discounted the most. Finally, we also find that gaze allocation reflects attribute weights, with more gaze to higher-weighted attributes. In summary, our work uncovers an intricate interplay between attribute weights, gaze processes, and preferential choice. |
Xiaomeng Yang; Fuxing Wang; Richard E. Mayer; Xiangen Hu; Chuanhua Gu Ocular foundations of the spatial contiguity principle: Designing multimedia materials for parafoveal vision Journal Article In: Journal of Educational Psychology, vol. 115, no. 8, pp. 1125–1140, 2023. @article{Yang2023d, The spatial contiguity principle is that people learn and perform better when corresponding printed text and graphics are placed near rather than far from each other on the screen or page. This is a well-established design principle in multimedia learning. However, there is insufficient research to establish the appropriate distance between text and graphics that is conducive for integrative processing. The current study examines a new objective indicator of spatial contiguity based on the characteristics of human visual processing, and hypothesizes that corresponding text and graphic information presented within parafoveal vision promotes integrative processing better than information in peripheral vision. Experiments 1 and 2 asked participants to judge the similarities of two text–picture cards and found that presenting the two cards within parafoveal vision (rather than peripheral vision) led to faster comparison (in both Experiments) and higher scores (only in Experiment 2) for a simple version of the comparison task, but did not lower cognitive load. Experiment 3 found that students who viewed an onscreen multimedia lesson that presented corresponding text–picture information in parafoveal vision (rather than peripheral vision) scored higher on retention and application tests and experienced lower cognitive load measured by a secondary task. Across all three experiments, eye-tracking results showed presenting corresponding text–picture information in parafoveal vision yielded more integrative saccades and longer fixation time on text, indicating that spatial contiguity encourages integrative processing. This study replicates and extends the spatial contiguity effect, and offers a new quantifiable indicator of spatial continuity for the future research. |
Tianqi Yang; Yang He; Lin Wu; Hui Wang; Xiuchao Wang; Yahong Li; Yaning Guo; Shengjun Wu; Xufeng Liu The effects of object size on spatial orientation: An eye movement study Journal Article In: Frontiers in Neuroscience, vol. 17, pp. 1–8, 2023. @article{Yang2023c, Introduction: The processing of visual information in the human brain is divided into two streams, namely, the dorsal and ventral streams, object identification is related to the ventral stream and motion processing is related to the dorsal stream. Object identification is interconnected with motion processing, object size was found to affect the information processing of motion characteristics in uniform linear motion. However, whether the object size affects the spatial orientation is still unknown. Methods: Thirty-eight college students were recruited to participate in an experiment based on the spatial visualization dynamic test. Eyelink 1,000 Plus was used to collect eye movement data. The final direction difference (the difference between the final moving direction of the target and the final direction of the moving target pointing to the destination point), rotation angle (the rotation angle of the knob from the start of the target movement to the moment of key pressing) and eye movement indices under conditions of different object sizes and motion velocities were compared. Results: The final direction difference and rotation angle under the condition of a 2.29°-diameter moving target and a 0.76°-diameter destination point were significantly smaller than those under the other conditions (a 0.76°-diameter moving target and a 0.76°-diameter destination point; a 0.76°-diameter moving target and a 2.29°-diameter destination point). The average pupil size under the condition of a 2.29°-diameter moving target and a 0.76°-diameter destination point was significantly larger than the average pupil size under other conditions (a 0.76°-diameter moving target and a 0.76°-diameter destination point; a 0.76°-diameter moving target and a 2.29°-diameter destination point). Discussion: A relatively large moving target can resist the landmark attraction effect in spatial orientation, and the influence of object size on spatial orientation may originate from differences in cognitive resource consumption. The present study enriches the interaction theory of the processing of object characteristics and motion characteristics and provides new ideas for the application of eye movement technology in the examination of spatial orientation ability. |
Tianqi Yang; Yaning Guo; Xianyang Wang; Shengjun Wu; Xiuchao Wang; Hui Wang; Xufeng Liu The influence of representational gravity on spatial orientation: An eye movement study Journal Article In: Current Psychology, pp. 1–9, 2023. @article{Yang2023b, Spatial orientation is a fundamental subject in aviation psychology. The influence of representational gravity can lead to systematic errors during uniform linear motion. However, it remains unclear whether representational gravity during motion can affect spatial orientation. In this study, college students from Xi'an, China were recruited to participate in an experiment based on the Spatial Visualization Dynamic Test. We compared the accuracy of spatial orientation estimation and eye movement indices when the main direction of spatial orientation was in the lower right versus when it was in the upper right. The results revealed that individuals were prone to overestimate the adjustment angle when the main direction of spatial orientation was in the lower right, and underestimate the adjustment angle when the main direction of spatial orientation was in the upper right; the average pupil size was significantly larger when the main direction of spatial orientation was in the lower right than that when the main direction of spatial orientation was in the upper right. In conclusion, spatial orientation in motion was influenced by representational gravity, and when representational gravity aligned with the main direction of spatial orientation, it led to increased cognitive resource consumption. |
Ruyi Yang; Peng Zhao; Liyang Wang; Chenli Feng; Chen Peng; Zhexuan Wang; Yingying Zhang; Minqian Shen; Kaiwen Shi; Shijun Weng; Chunqiong Dong; Fu Zeng; Tianyun Zhang; Xingdong Chen; Shuiyuan Wang; Yiheng Wang; Yuanyuan Luo; Qingyuan Chen; Yuqing Chen; Chengyong Jiang; Shanshan Jia; Zhaofei Yu; Jian Liu; Fei Wang; Su Jiang; Wendong Xu; Liang Li; Gang Wang; Xiaofen Mo; Gengfeng Zheng; Aihua Chen; Xingtao Zhou; Chunhui Jiang; Yuanzhi Yuan; Biao Yan; Jiayi Zhang Assessment of visual function in blind mice and monkeys with subretinally implanted nanowire arrays as artificial photoreceptors Journal Article In: Nature Biomedical Engineering, pp. 1–37, 2023. @article{Yang2023a, Retinal prostheses could restore image-forming vision in conditions of photoreceptor degeneration. However, contrast sensitivity and visual acuity are often insufficient. Here we report the performance, in mice and monkeys with induced photoreceptor degeneration, of subretinally implanted gold-nanoparticle-coated titania nanowire arrays providing a spatial resolution of 77.5 μm and a temporal resolution of 3.92 Hz in ex vivo retinas (as determined by patch-clamp recording of retinal ganglion cells). In blind mice, the arrays allowed for the detection of drifting gratings and flashing objects at light-intensity thresholds of 15.70–18.09 μW mm–2, and offered visual acuities of 0.3–0.4 cycles per degree, as determined by recordings of visually evoked potentials and optomotor-response tests. In monkeys, the arrays were stable for 54 weeks, allowed for the detection of a 10-μW mm–2 beam of light (0.5° in beam angle) in visually guided saccade experiments, and induced plastic changes in the primary visual cortex, as indicated by long-term in vivo calcium imaging. Nanomaterials as artificial photoreceptors may ameliorate visual deficits in patients with photoreceptor degeneration. |
Chaoqing Yang; Linlin He; Yucheng Liu; Ziyang Lin; Lizhu Luo; Shan Gao Anti-saccades reveal impaired attention control over negative social evaluation in individuals with depressive symptoms Journal Article In: Journal of Psychiatric Research, vol. 165, pp. 64–69, 2023. @article{Yang2023, Depressed individuals are excessively sensitive to negative information but blunt to positive information, which has been considered as vulnerability to depression. Here, we focused on inhibitory control over attentional bias on social evaluation in individuals with depression. We engaged individuals with and without depressive symptoms (categorized by Beck Depression Inventory-II) in a novel attention control task using positive and negative evaluative adjectives as self-referential feedback given by social others. Participants were instructed to look at sudden onset feedback targets (pro-saccade) or the mirror location of the targets (anti-saccade) when correct saccade latencies and saccade errors were collected. The two indices showed that while both groups displayed longer latencies and more errors for anti-saccade relative to pro-saccade responses depressed individuals spent more time reacting correctly and made more errors than non-depressed individuals in the anti-saccade trials and such group differences were not observed in the pro-saccade trials. Although group differences in correct anti-saccade latencies were found for both positive and negative stimuli, depressed individuals spent more time making correct anti-saccade responses to negative social feedback than to positive ones whereas non-depressed individuals featured longer correct anti-saccade latencies for positive relative to negative evaluations. Our results suggest that depressed individuals feature an impaired ability in attention control for self-referential evaluations, notably those of negative valence, shedding new light on depression-distorted self-schema and corresponding social dysfunctions. |
Zhihao Yan; Zeyang Yang; Mark D. Griffiths “Danmu” preference, problematic online video watching, loneliness and personality: An eye-tracking study and survey study Journal Article In: BMC Psychiatry, vol. 23, no. 1, pp. 1–13, 2023. @article{Yan2023b, ‘Danmu' (i.e., comments that scroll across online videos), has become popular on several Asian online video platforms. Two studies were conducted to investigate the relationships between Danmu preference, problematic online video watching, loneliness and personality. Study 1 collected self-report data on the study variables from 316 participants. Study 2 collected eye-tracking data of Danmu fixation (duration, count, and the percentages) from 87 participants who watched videos. Results show that fixation on Danmu was significantly correlated with problematic online video watching, loneliness, and neuroticism. Self-reported Danmu preference was positively associated with extraversion, openness, problematic online video watching, and loneliness. The studies indicate the potential negative effects of Danmu preference (e.g., problematic watching and loneliness) during online video watching. The study is one of the first empirical investigations of Danmu and problematic online video watching using eye-tracking software. Online video platforms could consider adding more responsible use messaging relating to Danmu in videos. Such messages may help users to develop healthier online video watching habits. |
Ming Yan; Jinger Pan Joint effects of individual reading skills and word properties on Chinese children's eye movements during sentence reading Journal Article In: Scientific Reports, vol. 13, no. 1, pp. 1–10, 2023. @article{Yan2023a, Word recognition during the reading of continuous text has received much attention. While a large body of research has investigated how linguistic properties of words affect eye movements during reading, it remains to be established how individual differences in reading skills affect momentary cognitive processes during sentence reading among typically developing Chinese readers. The present study set out to test the joint influences of word properties and individual reading skills on eye movements during reading among Chinese children. We recorded eye movements of 30 grade 3 (G3) children and 27 grade 5 (G5) children when they read sentences silently for comprehension. Predictors of linear mixed models included word frequency, visual complexity, and launch site distance, in addition to the participants' offline psychometric performances in rapid naming, morphological awareness, word segmenting, and character recognition. The results showed that word properties affected word recognition during sentence reading in both G3 and G5 children. Moreover, word segmenting predicted the G3 children's fixation durations and the G5 children's fixation location, whereas rapid naming predicted the G5 children's fixation duration. Implications are discussed based on the current findings, in light of how different literacy skills contribute to reading development. |
Ming Yan; Yingyi Luo; Jinger Pan Monolingual and bilingual phonological activation in Cantonese Journal Article In: Bilingualism: Language and Cognition, vol. 26, no. 4, pp. 751–761, 2023. @article{Yan2023, Previous research has provided evidence for cross-language phonological activation during visual word recognition. However, such findings mainly came from alphabetic languages, and readers' familiarity with the two scripts might differ. The present study aimed to test whether such cross-language phonological activation can be observed in Chinese, a logographic script, without the confounding factor of script familiarity as readers read the same script in different languages. Cantonese–Mandarin bilinguals were tested in an eye-tracking experiment in which they were instructed to read sentences silently. A target word in the sentence was replaced by either a homophone in both Cantonese and Mandarin, a homophone in Cantonese or in Mandarin only, or an unrelated character. The results showed that native Cantonese readers could activate phonological representations of L1 and L2 while reading Chinese sentences silently. However, the degree to which they relied on phonological decoding in L1 and L2 varied in the two languages. |
Shuwei Xue; Jana Lüdtke; Arthur M. Jacobs Once known, twice hedonic: Enjoying Shakespeare's sonnets through rereading-a deep learning perspective Journal Article In: Psychology of Aesthetics, Creativity, and the Arts, pp. 1–14, 2023. @article{Xue2023a, Reading poetry is a popular hobby, but what does it involve in terms of the mind? Through quantitative nar- rative analysis, we computed seven surface features and two affective–semantic features of Shakespeare's sonnets and then added them to predict readers' eye movements during reading. Using the neural nets model, we found that the gaze duration, the regression time, the total reading time, and the fixation probability all depended mainly on surface features, no matter how often a poem was read. We also found that word-based valence and arousal were important as well and became more important in the course of repeated readings. In the last reading, valence became as important as the main surface features. Findings imply that the first impression of a poem is due mainly to surface features but then becomes enriched by meaning and mood. |
Licheng Xue; Ying Xiao; Tianying Qing; Urs Maurer; Wei Wang; Huidong Xue; Xuchu Weng; Jing Zhao Attention to the fine-grained aspect of words in the environment emerges in preschool children with high reading ability Journal Article In: Visual Cognition, vol. 31, no. 1, pp. 85–96, 2023. @article{Xue2023, Attention to words is closely related to the process of learning to read. However, it remains unclear how attention to words in environmental print (such as words on product labels) is changed with the growth of preschool children's reading ability. We thus used eye tracking technique to compare attention to words in environmental print in children at low (32, 15 males, 5.12 years) and high (32, 17 males, 5.16 years) reading levels during a free viewing task. To characterize which aspects of visual word form children attend to, we constructed three types of stimuli embedded in the same context: words in environment print, symbol strings (similar shape to words but without strokes), and character strings (comparable with words in the number of strokes and the structures). We observed that children at both reading levels showed lower percentages of fixations and fixation time in words relative to symbol strings, suggesting they start to attend to the coarse aspect of visual word form. Interestingly, only children at higher reading level showed lower percentages of fixations and fixation time for words relative to character strings, suggesting that attention to the fine-grained aspect of visual word form emerged, and was closely to reading ability. |
Zhenjie Xu; Jie Hu; Yingying Wang Bilateral eye movements disrupt the involuntary perceptual representation of trauma-related memories Journal Article In: Behaviour Research and Therapy, vol. 165, pp. 1–10, 2023. @article{Xu2023c, Bilateral eye movement (EM) is a critical component in eye movement desensitization and reprocessing (EMDR), an effective treatment for post-traumatic stress disorder. However, the role of bilateral EM in alleviating trauma-related symptoms is unclear. Here we hypothesize that bilateral EM selectively disrupts the perceptual representation of traumatic memories. We used the trauma film paradigm as an analog for trauma experience. Nonclinical participants viewed trauma films followed by a bilateral EM intervention or a static Fixation period as a control. Perceptual and semantic memories for the film were assessed with different measures. Results showed a significant decrease in perceptual memory recognition shortly after the EM intervention and subsequently in the frequency and vividness of film-related memory intrusions across one week, relative to the Fixation condition. The EM intervention did not affect the explicit recognition of semantic memories, suggesting a dissociation between perceptual and semantic memory disruption. Furthermore, the EM intervention effectively reduced psychophysiological affective responses, including the skin conductance response and pupil size, to film scenes and subjective affective ratings of film-related intrusions. Together, bilateral EMs effectively reduce the perceptual representation and affective response of trauma-related memories. Further theoretical developments are needed to elucidate the mechanism of bilateral EMs in trauma treatment. |
Ying Xu; Jia-Qiong Xie; Fu-Xing Wang; Rebecca L. Monk; James Gaskin; Jin-Liang Wang The impact of Weibo features on user's information comprehension: The mediating role of cognitive load Journal Article In: Social Science Computer Review, vol. 41, no. 6, pp. 2010–2028, 2023. @article{Xu2023d, Social media, such as Microblogs, have become an important source for people to obtain information. However, we know little about how this would influence our comprehension over online information. Based on the cognitive load theory, this research explores whether and how two important features of Weibo, which are the feedback function and information fragmentation, would increase cognitive load and may in turn hinder users' information comprehension in Weibo. A 2 (feedback or non-feedback) × 2 (strong-interference or weak-interference information) between-participants experimental design was conducted. Our results revealed that the Weibo feedback function and interference information exerted a negative impact over information comprehension via inducing increased cognitive load. Specifically, these results deepened our understanding regarding the impact of Weibo features on online information comprehension and suggest the mechanism by which this occurs. This finding has implications for how to minimize the potential cost of using Weibo and maximize the adaptive development of social media. |
Mengran Xu; Katelyn Rowe; Christine Purdon To approach or to avoid: The role of ambivalent motivation towards high calorie food images in restrained eaters Journal Article In: Cognitive Therapy and Research, vol. 47, no. 4, pp. 669–680, 2023. @article{Xu2023b, Background: Individuals who engage in restrained eating are often torn between eating enjoyment and weight control. Recent research found visual attention to threat varied according to motivation, and people with ambivalent motivation about threat showed greater anxiety. Methods: A total number of 225 individuals high in restrained eating completed a passive viewing task in which they were presented with image pairs of high calorie food and neutral objects while their eye movements were tracked. Participants also rated their motivation to look towards and away from food images and completed measures of mood and thought-shape fusion. Results: Two-thirds of participants reported strong motivation to look at food images, and the rest were highly motivated to avoid, were indifferent, or were ambivalent. Visual attention to food images varied according to motivation. Ambivalent individuals had higher thought-shape fusion scores and were more restrained in their eating than engagers and indifferent individuals. Conclusions: These findings suggest that motivation to attend to and avoid food images are important factors to study, as they are associated with attentional biases and eating pathology. Clinical implications are also discussed. |
Luzi Xu; Zhong Yang; Huichao Ji; Wei Chen; Zhuomian Lin; Yushang Huang; Xiaowei Ding Direct evidence for proactive suppression of salient-but-irrelevant emotional information inputs Journal Article In: Emotion, vol. 23, no. 7, pp. 2039–2058, 2023. @article{Xu2023a, It has long been debated whether emotional information inherently captures attention. The mainstream view suggests that the attentional processing of emotional information is automatic and difficult to be controlled. Here, we provide direct evidence that salient-but-irrelevant emotional information inputs can be proactively suppressed. First, we demonstrated that both negative and positive emotional distractors (fearful and happy faces) induced attentional capture effects (i.e., more attention allocated to emotional distractors than neutral distractors) in the singleton-detection mode (Experiment 1), but attentional suppression effects (i.e., less attention allocated to emotional distractors than neutral distractors) in the feature-search mode that strengthened task motivation (Experiment 2). The suppression effects in the feature-search mode disappeared when emotional information was disrupted through face inversion, showing that the suppression effects were driven by emotional information rather than low-level visual factors (Experiment 3). Furthermore, the suppression effects also disappeared when the identity of emotional faces became unpredictable (Experiment 4), suggesting that the suppression was highly dependent on the predictability of emotional distractors. Importantly, we reproduced the suppression effects using eye-tracking methods and found that there was no attentional capture by emotional distractors before the appearance of the attentional suppression effects (Experiment 5). These findings suggest that irrelevant emotional stimuli that have the potential to cause distraction can be proactively suppressed by the attention system |
Kunyu Xu; Yu-Min Ku; Chenlu Ma; Chien-Hui Lin; Wan-Chen Chang Development of comprehension monitoring skill in Chinese children: Evidence from eye movement and probe interviews Journal Article In: Metacognition and Learning, pp. 1–19, 2023. @article{Xu2023, As an important construct in the cognitive process, comprehension monitoring has received much scholarly attention. Researchers have recognized comprehension monitoring as an ability closely linked with children's reading comprehension ability and working memory capacity. Evidence is also abundant to prove that comprehension monitoring skill develops with age. It remains unclear, however, how these factors interact during reading, particularly in low-grade children. Many previous empirical studies have only employed online or offline measurements to examine children's monitoring performance, which might lead to unsolid conclusions. In this study, we utilized both online eye-tracking measures and offline probe interviews to quantify the developmental features (i.e., evaluation and regulation) of comprehension monitoring skills among Chinese beginning readers. The results indicated that the comprehension monitoring performance, as quantified by eye-tracking measures, was positively related to their reading comprehension ability and working memory capacity. Moreover, the first-graders' performances lacked online regulation skills during the error-detecting tasks, while second-graders had relatively developed online monitoring performance. Additionally, the eye-tracking measures were found as a predictor for children's performances in probe interviews, as the readers with high comprehension ability and working memory capacity successfully reported more errors embedded in the self-designed reading materials. Therefore, the findings support the claim that children's comprehension monitoring is a developing skill associated with reading comprehension and working memory capacity and further question the existence of comprehension monitoring skills in beginning readers, especially first-graders. |
Jianping Xiong; Lili Yu; Aaron Veldre; Erik D. Reichle; Sally Andrews A multitask comparison of word- and character-frequency effects in Chinese reading Journal Article In: Journal of Experimental Psychology: Learning, Memory, and Cognition, vol. 49, no. 5, pp. 793–811, 2023. @article{Xiong2023, In this study, we examined the effects of word and character frequency across three commonly used word-identification tasks (lexical decision, naming, and sentence reading) using the same set of twocharacter target words (N = 60) and participants (N = 82). Facilitatory effects of word frequency were observed across all three tasks. The character-frequency effects, however, were facilitatory for naming but inhibitory for both lexical decision and reading. Further correlational analyses indicated that participants' performance (as measured using overall response latencies and the sizes of the frequency effects) was not consistent across tasks but was relatively reliable within the lexical-decision and reading tasks. These findings are discussed in relation to what is known about the reading of Chinese versus alphabetic scripts, word-identification tasks, and models of word identification. |
Zedong Xie; Meng Zhang; Zunping Ma The impact of mental simulation on subsequent tourist experience–dual evidence from eye tracking and self-reported measurement Journal Article In: Current Issues in Tourism, vol. 26, no. 18, pp. 2915–2930, 2023. @article{Xie2023c, Tourism research has always sought to find ways to improve tourists' experience evaluation and create added value for them. However, the academic community has focused on the on-site and post-travel stages of tourists, and neglected the pre-travel stage. This study examines the influence of guided mental simulation of an upcoming tourist experience on subsequent on-site tourist experience and experience evaluation. The research simulated real-world experience with tour videos shot from the first-person perspective, and measured the variables using both eye movements and self-reporting. Multivariate ANOVA and multigroup analysis were then performed on the data. The results showed that a process simulation of tourists having an engagement experience and an outcome simulation of tourists having a sight-seeing experience resulted in a higher engagement level and higher emotional response during the on-site experience, higher evaluation of the experience, and a greater impact of engagement level on their evaluation. This study expands the research on tourists' psychological experience in the pre-travel stage. Results indicate that the period from the moment consumers book or purchase the tourist product to the moment they actually embark on the tourist experience is a valuable marketing window. |
Xin-Yu Xie; Maria Concetta Morrone; David C. Burr Serial dependence in orientation judgments at the time of saccades Journal Article In: Journal of Vision, vol. 23, no. 7, pp. 1–13, 2023. @article{Xie2023b, We actively seek information from the environment through saccadic eye movements, necessitating continual integration of presaccadic and postsaccadic signals, which are displaced on the retina by each saccade.We tested whether trans-saccadic integration may be related to serial dependence (a measure of how perceptual history influences current perception) by measuring how viewing a presaccadic stimulus affects the perceived orientation of a subsequent test stimulus presented around the time of a saccade. Participants reproduced the position, and orientation of a test stimulus presented around a 16° saccade. The reproduced position was mislocalized toward the saccadic target, agreeing with previous work. The reproduced orientation was attracted toward the prior stimulus and regressed to the mean orientation. These results suggest that both short and long-term past information affects trans-saccadic perception, most strongly when the test stimulus is presented perisaccadically. This study unites the fields of serial dependence and trans-saccadic perception, leading to potential new insights of how information is transferred and accumulated across saccades. |
Weizhen Xie; Weiwei Zhang Pupillary evidence reveals the influence of conceptual association on brightness perception Journal Article In: Psychonomic Bulletin & Review, vol. 30, no. 4, pp. 1388–1395, 2023. @article{Xie2023a, Our visual experience often varies based on momentary thoughts and feelings. For example, when positive concepts are invoked, visual objects may appear brighter (e.g., a “brighter” smile). However, it remains unclear whether this phenomenological experience is driven by a genuine top-down modulation of brightness perception or by a mere response bias. To investigate this issue, we use pupillometry as a more objective measure of perceived brightness. We asked participants to judge the brightness level of an isoluminant gray color patch after evaluating the valence of a positive or negative word. We found that the gray color patch elicited greater pupillary light reflex and more frequent “brighter” responses after observers had evaluated the valence of a positive word. As pupillary light reflex is unlikely driven by voluntary control, these results suggest that the conceptual association between affect and luminance can modulate brightness perception. |
Pei Xie; Han-Bin Sang; Chao-Zheng Huang; Ai-Bao Zhou Effect of body-related information on food attentional bias in women with body weight dissatisfaction Journal Article In: Scientific Reports, vol. 13, no. 1, pp. 1–10, 2023. @article{Xie2023, Women with body weight dissatisfaction (BWD) have long-term negative assessments of their body weight, which are often associated with poor eating behavior. In this study, we investigated the effect of body-related information on the food cue processing and attention of women with BWD. Sixty-eight women were recruited and assigned to either a BWD (NPSS-F > 2) (n = 32) or a no body weight dissatisfaction (NBWD) group (NPSS-F < 1) (n = 36). We measured attentional bias to food cues (high- and low-calorie) with a food probe task after exposure to body-related information and recorded eye tracking data. Body-related images were presented prior to a pair of stimulus images (food–neutral or neutral–neutral). Body-related information and food type were repeated measure factors in our study. Our results showed that the first fixation duration bias for high-calorie foods was significantly longer than for low-calorie foods after exposure to overweight cues in the BWD group. Compared with the NBWD group, the BWD group showed longer first fixation duration bias for high-calorie foods after exposure to overweight cues. The direction for high-calorie foods was significantly more often than that for low-calorie foods in the BWD group after exposure to body-related information. Our findings suggest that compared to women with NBWD, women with BWD may be more susceptible to body-related information, resulting in increased attention to high-calorie foods. |
Mo Xiaohong; Xie Zhihao; Luh Ding-Bang A hybrid macro and micro method for consumer emotion and behavior research Journal Article In: IEEE Access, vol. 11, pp. 83430–83445, 2023. @article{Xiaohong2023, To investigate impacts of intelligent and fashion factors of sports bras on consumers' emotions, decision-making and behavior, a quantitative analysis method combing macro affective computing and micro emotion data was proposed. The context where a consumer purchased sports bras was first simulated. In this process, an eye tracker and a multi-channel physiological recorder were utilized to collect physiological signal data from participants in an experimental setting. Then, big data and machine learning were both adopted to macroscopically perform data pre-processing, build a computational model, fulfill relevant prediction and evaluation, analyze correlations in physiological data features, and explore potential values existing in data. Furthermore, highly correlated data features were extracted to investigate micro causalities and identify reasons why consumer behavior and decision-making were supported by data about emotional physiology. The proposed method may provide considerably reliable data support for designers, product service providers, and other practitioners. As an innovative and universal integration approach, it has the potential to be applied in medical science, psychology, management science and other fields. |
Xue-Zhen Xiao; Gaoding Jia; Aiping Wang Semantic preview benefit of Tibetan-Chinese bilinguals during Chinese reading Journal Article In: Language Learning and Development, vol. 19, no. 1, pp. 1–15, 2023. @article{Xiao2023a, When reading Chinese, skilled native readers regularly gain a preview benefit (PB) when the parafoveal word is orthographically or semantically related to the target word. Evidence shows that non-native, beginning Chinese readers can obtain an orthographic PB during Chinese reading, which indicates the parafoveal processing of low-level visual information. However, whether non-native Chinese readers who are more proficient in Chinese can make use of high-level parafoveal information remains unknown. Therefore, this study examined parafoveal processing during Chinese reading among Tibetan-Chinese bilinguals with high Chinese proficiency and compared their PB effects with those from native Chinese readers. Tibetan-Chinese bilinguals demonstrated both orthographic and semantic PB but did not show phonological PB and only differed from native Chinese in the identical PB when preview characters were identical to the targets. These findings demonstrate that non-native Chinese readers can extract semantic information from parafoveal preview during Chinese reading and highlight the modulation of parafoveal processing efficiency by reading proficiency. The results are in line with the direct route to access the mental lexicon of visual Chinese characters among non-native Chinese speakers. |
Naiqi G. Xiao; Lauren L. Emberson Visual perception is highly flexible and context dependent in young infants: A case of top-down-modulated motion perception Journal Article In: Psychological Science, vol. 34, no. 8, pp. 875–886, 2023. @article{Xiao2023, Top-down modulation is an essential cognitive component in human perception. Despite mounting evidence of top-down perceptual modulation in adults, it is largely unknown whether infants can engage in this cognitive function. Here, we examined top-down modulation of motion perception in 6- to 8-month-old infants (recruited in North America) via their smooth-pursuit eye movements. In four experiments, we demonstrated that infants' perception of motion direction can be flexibly shaped by briefly learned predictive cues when no coherent motion is available. The current findings present a novel insight into infant perception and its development: Infant perceptual systems respond to predictive signals engendered from higher-level learning systems, leading to a flexible and context-dependent modulation of perception. This work also suggests that the infant brain is sophisticated, interconnected, and active when placed in a context in which it can learn and predict. |
Yanfang Xia; Jelena Wehrli; Samuel Gerster; Marijn Kroes; Maxime Houtekamer; Dominik R. Bach Measuring human context fear conditioning and retention after consolidation Journal Article In: Learning and Memory, vol. 30, no. 7, pp. 139–150, 2023. @article{Xia2023a, Fear conditioning is a laboratory paradigm commonly used to investigate aversive learning and memory. In context fear conditioning, a configuration of elemental cues (conditioned stimulus [CTX]) predicts an aversive event (unconditioned stimulus [US]). To quantify context fear acquisition in humans, previous work has used startle eyeblink responses (SEBRs), skin conductance responses (SCRs), and verbal reports, but different quantification methods have rarely been compared. Moreover, preclinical intervention studies mandate recall tests several days after acquisition, and it is unclear how to induce and measure context fear memory retention over such a time interval. First, we used a semi-immersive virtual reality paradigm. In two experiments (N = 23 and N = 28), we found successful declarative learning and memory retention over 7 d but no evidence of other conditioned responses. Next, we used a configural fear conditioning paradigm with five static room images as CTXs in two experiments (N = 29 and N = 24). Besides successful declarative learning and memory retention after 7 d, SCR and pupil dilation in response to CTX onset differentiated CTX+/CTX− during acquisition training, and SEBR and pupil dilation differentiated CTX+/CTX− during the recall test, with medium to large effect sizes for the most sensitive indices (SEBR: Hedge's g = 0.56 and g = 0.69; pupil dilation: Hedge's g = 0.99 and g = 0.88). Our results demonstrate that with a configural learning paradigm, context fear memory retention can be demonstrated over 7 d, and we provide robust and replicable measurement methods to this end. |
Xinyi Xia; Yanping Liu; Lili Yu; Erik D. Reichle Are there preferred viewing locations in Chinese reading? Evidence from eye-tracking and computer simulations Journal Article In: Journal of Experimental Psychology: Learning, Memory, and Cognition, vol. 49, no. 4, pp. 607–625, 2023. @article{Xia2023b, The Chinese writing system is different from English in that individual words both comprise one to four characters and are not separated by clear word boundaries (e.g., interword spaces). These differences raise the question of how readers of Chinese know where to move their eyes to support efficient lexical processing? The widely accepted default-targeting hypothesis suggests that Chinese readers direct their eyes to a small number of preferred-viewing locations (PVLs), such as the beginning or middle of upcoming words. In this article, we report two eye-movement experiments testing this hypothesis. In both experiments, participants read sentences comprising entirely two-character words, but either without (Experiment 1) or with (Experiment 2) explicit knowledge of this structure prior to their participation. The results of both experiments indicate the absence of PVLs. Simulations using implemented versions of a simple oculomotor-based hypothesis, two variants of the default-targeting hypothesis, and the hypothesis that saccade lengths are modulated as a function of estimated parafoveal-processing difficulty (i.e., dynamic-adjustment hypothesis) suggest that the latter provides the best account of saccadictargeting during Chinese reading. These results are discussed in relation to broader issues of eye-movement control during reading and how models of such must be modified to provide more accurate accounts of the reading of Chinese and other languages |
Tiansheng Xia; Yingqi Yan; Jiayue Guo Color in web-advertising: The effect of color hue contrast on web satisfaction and advertising memory Journal Article In: Current Psychology, pp. 1–14, 2023. @article{Xia2023, There has been a growth in e-commerce, presenting consumers with varied forms of advertising. A key goal of web advertising is to leave a lasting impression on the user, and web satisfaction is an important measure of the quality and usability of a web page after an ad is placed on it. This experiment manipulated participants' purpose in web browsing (free browsing versus goal oriented) and the color combination of the web background and the vertical-ad background (high or low hue contrast) to predict users' satisfaction with the web page and the degree of ad recall. The psychological mechanisms of this effect were also explored using an eye-tracking device to record and analyze eye movements. The participants were 120 university students, 64.2% of whom were female and 35.8% of whom were male. During free browsing, participants could simulate the daily use of a browser to browse the web and were given 120 s to do so, and in the task-oriented browsing condition, participants were told in advance that they had to summarize the headlines of each news item one at a time within 120 s. The results showed that, in the free-viewing task, the hue contrast between the ad–web background colors negatively affected web satisfaction and ad memory whereas there was no significant difference in this effect in the goal-oriented task. Furthermore, in the free-viewing task, the level of attentional intrusion mediated the effect of ad–web hue contrast on the degree of ad recall; color harmony mediated the effect of hue contrast on the user's evaluation of web satisfaction. These results can act as a new reference for web design research and marketing practice. |
Nicholas J. Wyche; Mark Edwards; Stephanie C. Goodhew An updating-based working memory load alters the dynamics of eye movements but not their spatial extent during free viewing of natural scenes Journal Article In: Attention, Perception, & Psychophysics, pp. 1–22, 2023. @article{Wyche2023, The relationship between spatial deployments of attention and working memory load is an important topic of study, with clear implications for real-world tasks such as driving. Previous research has generally shown that attentional breadth broadens under higher load, while exploratory eye-movement behaviour also appears to change with increasing load. However, relatively little research has compared the effects of working memory load on different kinds of spatial deployment, especially in conditions that require updating of the contents of working memory rather than simple retrieval. The present study undertook such a comparison by measuring participants' attentional breadth (via an undirected Navon task) and their exploratory eye-movement behaviour (a free-viewing recall task) under low and high updating working memory loads. While spatial aspects of task performance (attentional breadth, and peripheral extent of image exploration in the free-viewing task) were unaffected by the load manipulation, the exploratory dynamics of the free-viewing task (including fixation durations and scan-path lengths) changed under increasing load. These findings suggest that temporal dynamics, rather than the spatial extent of exploration, are the primary mechanism affected by working memory load during the spatial deployment of attention. Further, individual differences in exploratory behaviour were observed on the free-viewing task: all metrics were highly correlated across working memory load blocks. These findings suggest a need for further investigation of individual differences in eye-movement behaviour; potential factors associated with these individual differences, including working memory capacity and persistence versus flexibility orientations, are discussed. |
Yushu Wu; Chunyu Kit Hong Kong Corpus of Chinese Sentence and Passage Reading Journal Article In: Scientific Data, vol. 10, no. 1, pp. 1–13, 2023. @article{Wu2023e, Recent years have witnessed a mushrooming of reading corpora that have been built by means of eye tracking. This article showcases the Hong Kong Corpus of Chinese Sentence and Passage Reading (HKC for brevity), featured by a natural reading of logographic scripts and unspaced words. It releases 28 eye-movement measures of 98 native speakers reading simplified Chinese in two scenarios: 300 one-line single sentences and 7 multiline passages of 5,250 and 4,967 word tokens, respectively. To verify its validity and reusability, we carried out (generalised) linear mixed-effects modelling on the capacity of visual complexity, word frequency, and reading scenario to predict eye-movement measures. The outcomes manifest significant impacts of these typical (sub)lexical factors on eye movements, replicating previous findings and giving novel ones. The HKC provides a valuable resource for exploring eye movement control; the study contrasts the different scenarios of single-sentence and passage reading in hopes of shedding new light on both the universal nature of reading and the unique characteristics of Chinese reading. |
Junru Wu; Min Li; Wenbo Ma; Zhihao Zhang; Mingsha Zhang; Xuemei Li In: Gerontology, vol. 69, no. 3, pp. 321–335, 2023. @article{Wu2023d, Background: Among the elderly, dementia is a common and disabling disorder with primary manifestations of cognitive impairments. Diagnosis and intervention in its early stages is the key to effective treatment. Nowadays, the test of cognitive function relies mainly on neuropsychological tests, such as the Mini-Mental State Examination (MMSE) and Montreal Cognitive Assessment (MoCA). However, they have noticeable shortcomings, e.g., the biases of subjective judgments from physicians and the cost of the labor of these well-trained physicians. Thus, advanced and objective methods are urgently needed to evaluate cognitive functions. Methods: We developed a cognitive assessment system through measuring the saccadic eye movements in three tasks. The cognitive functions were evaluated by both our system and the neuropsychological tests in 310 subjects, and the evaluating results were directly compared. Results: In general, most saccadic parameters correlate well with the MMSE and MoCA scores. Moreover, some subjects with high MMSE and MoCA scores have high error rates in performing these three saccadic tasks due to various errors. The primary error types vary among tasks, indicating that different tasks assess certain specific brain functions preferentially. Thus, to improve the accuracy of evaluation through saccadic tasks, we built a weighted model to combine the saccadic parameters of the three saccadic tasks, and our model showed a good diagnosis performance in detecting patients with cognitive impairment. Conclusion: The comprehensive analysis of saccadic parameters in multiple tasks could be a reliable, objective, and sensitive method to evaluate cognitive function and thus to help diagnose cognitive impairments. |
Hao Wu; Zhentao Zuo; Zejian Yuan; Tiangang Zhou; Yan Zhuo; Nanning Zheng; Badong Chen Neural representation of gestalt grouping and attention effect in human visual cortex Journal Article In: Journal of Neuroscience Methods, vol. 399, no. 28, pp. 1–11, 2023. @article{Wu2023c, Background: The brain aggregates meaningless local sensory elements to form meaningful global patterns in a process called perceptual grouping. Current brain imaging studies have found that neural activities in V1 are modulated during visual grouping. However, how grouping is represented in each of the early visual areas, and how attention alters these representations, is still unknown. New method: We adopted MVPA to decode the specific content of perceptual grouping by comparing neural activity patterns between gratings and dot lattice stimuli which can be grouped with proximity law. Furthermore, we quantified the grouping effect by defining the strength of grouping, and assessed the effect of attention on grouping. Results: We found that activity patterns to proximity grouped stimuli in early visual areas resemble these to grating stimuli with the same orientations. This similarity exists even when there is no attention focused on the stimuli. The results also showed a progressive increase of representational strength of grouping from V1 to V3, and attention modulation to grouping is only significant in V3 among all the visual areas. Comparison with existing methods: Most of the previous work on perceptual grouping has focused on how activity amplitudes are modulated by grouping. Using MVPA, the present work successfully decoded the contents of neural activity patterns corresponding to proximity grouping stimuli, thus shed light on the availability of content-decoding approach in the research on perceptual grouping. Conclusions: Our work found that the content of the neural activity patterns during perceptual grouping can be decoded in the early visual areas under both attended and unattended task, and provide novel evidence that there is a cascade processing for proximity grouping through V1 to V3. The strength of grouping was larger in V3 than in any other visual areas, and the attention modulation to the strength of grouping was only significant in V3 among all the visual areas, implying that V3 plays an important role in proximity grouping. |
Hao Wu; Yuding Zhang; Qiong Luo; Zhengzhou Zhu The magnitude representations of fractions of Chinese students: Evidence from behavioral experiment and eye-tracking Journal Article In: Current Psychology, pp. 1–16, 2023. @article{Wu2023b, Early knowledge of fractions can largely predict later mathematical performance, and a comprehensive and in-depth understanding of fractions is fundamental to learning more advanced mathematics. The study aimed to explore the influencing factors and age characteristics of magnitude representations of fractions by a fraction comparison task, using subjects' eye-movement measures as direct evidence and the results of linear regression analyses as indirect evidence. The results found that the number of digits of fractions' components and types of fraction pairs jointly influence the magnitude representations of fractions. For one-digit fraction pairs with and without common components, componential representation is favored; for two-digit fraction pairs with common components, componential representation is preferred, while for two-digit fraction pairs without common components, holistic representation is selected. The representation styles are consistent across university students, junior high school students and primary school students, and there are significant age differences in representation levels, with university students being more flexible in their use of representation strategies of fractions than the other two ages, and junior high school students showing the same level with the primary school students. These results suggest that not only Chinese university students, but also Chinese primary and junior high school students can select and adapt representation strategies of fractions according to the characteristics and complexity of fraction processing tasks. The eye-movement technique can largely compensate for the shortcomings of the regression analysis paradigm and better reveal the critical cognitive processes involved in the processing of fractions. |
Fei Wu; Zhibing Gao; Changlin Luo; Tuo Zhang; Xiangling Zhuang; Guojie Ma The effect of unit number and inter-unit distance on perceived food portion size Journal Article In: Food Quality and Preference, vol. 107, no. 199, pp. 1–12, 2023. @article{Wu2023a, Previous studies have demonstrated that perceived portion size of food influences consumption, so modifying perceived portion size may affect food intake. The present study evaluated the effects of unit number and inter-unit distance on perceived food portion size through eye-tracking and behavioral experiments. After observing one reference portion size picture, 34 participants in Experiment 1 and 29 participants in Experiment 2 evaluated 60 chocolate pictures with 10 different total portion sizes, with a unit number of 9 or 16 and an inter-unit distance of 100%, 120%, or 130%. The results demonstrated that unit number and inter-unit distance independently influenced the perception of overall portion size, while only the unit number could influence the perception of unit portion size. Making estimations about unit portion size requires more cognitive resources than that of overall portion size. These findings imply that we can adjust people's perceived portion sizes by varying the inter-unit distance or unit number of foods, thus nudging individuals to make more rational portion size decisions. |
Chenjing Wu; Hongyan Zhu; Yameng Zhang; Wei Zhang; Xianyou He Sensitivity to moral goodness under different aesthetic contexts Journal Article In: Ethics and Behavior, pp. 1–15, 2023. @article{Wu2023, Does context influence our appreciation of beauty? To answer this question, two experiments were conducted to determine the effect of contextual aesthetics on the recognition of moral behavior. Experiment 1 demonstrated that individuals in a high-aesthetic context had a quicker recognition time for moral behavior than those in a low-aesthetic context. In a low-aesthetic context, individuals recognize immoral behavior more quickly than in a high aesthetic context. Individuals showed greater recognition rates for moral behavior in a high aesthetic context and higher recognition for immoral behaviors in a low aesthetic context for behavior with unclear information. Experiment 2 revealed that individual fixation counts were smaller under the conditions of high aesthetic context and moral behavior than under the conditions of low aesthetic context and moral behavior, indicating a correlation between low aesthetic context and immoral behavior. This study shows that high aesthetic context facilitates the recognition of moral behavior, which has implications for moral education. |
Clare Wright; Jun Wang The role of visual processing in learning Mandarin characters Journal Article In: Journal of the European Second Language Association, vol. 7, no. 1, pp. 31–45, 2023. @article{Wright2023, This study explored whether beginner-level learners use radicals to learn written Chinese characters in making form-meaning paired-associate mappings, one of the key components in written character acquisition and word learning (Chan et al., 2020; Kintsch, 1988). Eyegaze patterns during new word-learning was measured to indicate visual focus, along with visual working memory (VWM) capacity, hitherto unexamined at beginner-level for Chinese (Chen et al., 2018; Godfroid, 2019). The experiment compared ease of recall across three groups of characters with different semantic radicals (nominal and verbal) and different visual salience. Greater visual salience rather than semantic class was predicted to foster ease of recall (Bax, 2013; Godfroid, 2019). Thirty-five adult Anglophone ab-initio learners of Chinese took part, recruited after five weeks at a language institute in China. Participants completed a computer- based self-paced character learning test and a VWM shape recall test. They then took a randomized character recall test; eyegaze patterns measured fixations on target radical areas during learning and testing phases. During testing, nominal recall was significantly the fastest and most accurate of the three types (p < .001). There were no significant correlations for accuracy of recall with VWM or eyegaze patterns. These findings, although tentative, suggest that some linguistic element of noun-learning comes “for free” (e.g., Gentner, 1982) even at beginner-level level. The study has timely implications for theoretical and pedagogical understanding of Chinese word learning processes, given the rapidly expanding area of Mandarin Chinese language learning in both taught and self-study app-based contexts. |
Christian Wolf; Markus Lappe Motivation by reward jointly improves speed and accuracy, whereas task-relevance and meaningful images do not Journal Article In: Attention, Perception, & Psychophysics, vol. 85, no. 3, pp. 930–948, 2023. @article{Wolf2023, Visual selection is characterized by a trade-off between speed and accuracy. Speed or accuracy of the selection process can be affected by higher level factors—for example, expecting a reward, obtaining task-relevant information, or seeing an intrinsically relevant target. Recently, motivation by reward has been shown to simultaneously increase speed and accuracy, thus going beyond the speed–accuracy-trade-off. Here, we compared the motivating abilities of monetary reward, task-relevance, and image content to simultaneously increase speed and accuracy. We used a saccadic distraction task that required suppressing a distractor and selecting a target. Across different blocks successful target selection was followed either by (i) a monetary reward, (ii) obtaining task-relevant information, or (iii) seeing the face of a famous person. Each block additionally contained the same number of irrelevant trials lacking these consequences, and participants were informed about the upcoming trial type. We found that postsaccadic vision of a face affected neither speed nor accuracy, suggesting that image content does not affect visual selection via motivational mechanisms. Task relevance increased speed but decreased selection accuracy, an observation compatible with a classical speed–accuracy trade-off. Motivation by reward, however, simultaneously increased response speed and accuracy. Saccades in all conditions deviated away from the distractor, suggesting that the distractor was suppressed, and this deviation was strongest in the reward block. Drift-diffusion modelling revealed that task-relevance affected behavior by affecting decision thresholds, whereas motivation by reward additionally increased the rate of information uptake. The present findings thus show that the three consequences differ in their motivational abilities. |
Joost De Winter; Toine Koelmans; Maarten Kokshoorn; Kars Van Der Valk A role of peripheral vision in chess? Evidence from a gaze-contingent method Journal Article In: Journal of Expertise, vol. 6, no. 1, pp. 23–38, 2023. @article{Winter2023, Chunking theory and previous eye-tracking studies suggest that expert chess players use peripheral vision to judge chess positions and determine the best moves to play. However, the role of peripheral vision in chess has largely been inferred rather than tested through controlled experimentation. In this study, we used a gaze-contingent paradigm in a reconstruction task, similar to the one initially used by De Groot (1946). It was hypothesized that the smaller the gaze-contingent window while memorizing a chess position, the smaller the differences in reconstruction accuracy between novice and expert players. Participants viewed 30 chess positions for 20 seconds, after which they reconstructed this position. This was done for four different window sizes as well as for full visibility of the board. The results, as measured by Cohen's d effect sizes between experts and novices of the proportion of correctly placed pieces, supported the above hypothesis, with experts performing much better but losing much of their performance advantage for the smallest window size. A complementary find-the-best-move task and additional eye-movement analyses showed that experts had a longer median fixation duration and more spatially concentrated scan patterns than novice players. These findings suggest a key contribution of peripheral vision and are consistent with the prevailing chunking theory. |
Hanna E. Willis; I. Betina Ip; Archie Watt; Jon Campbell; Saad Jbabdi; William T. Clarke; Matthew R. Cavanaugh; Krystel R. Huxlin; Kate E. Watkins; Marco Tamietto; Holly Bridge GABA and glutamate in hMT+ link to individual differences in residual visual function after occipital stroke Journal Article In: Stroke, vol. 54, no. 9, pp. 2286–2295, 2023. @article{Willis2023, BACKGROUND: Damage to the primary visual cortex following an occipital stroke causes loss of conscious vision in the contralateral hemifield. Yet, some patients retain the ability to detect moving visual stimuli within their blind field. The present study asked whether such individual differences in blind field perception following loss of primary visual cortex could be explained by the concentration of neurotransmitters γ-aminobutyric acid (GABA) and glutamate or activity of the visual motion processing, human middle temporal complex (hMT+). METHODS: We used magnetic resonance imaging in 19 patients with chronic occipital stroke to measure the concentration of neurotransmitters GABA and glutamate (proton magnetic resonance spectroscopy) and functional activity in hMT+ (functional magnetic resonance imaging). We also tested each participant on a 2-interval forced choice detection task using high-contrast, moving Gabor patches. We then measured and assessed the strength of relationships between participants' residual vision in their blind field and in vivo neurotransmitter concentrations, as well as visually evoked functional magnetic resonance imaging activity in their hMT+. Levels of GABA and glutamate were also measured in a sensorimotor region, which served as a control. RESULTS: Magnetic resonance spectroscopy-derived GABA and glutamate concentrations in hMT+ (but not sensorimotor cortex) strongly predicted blind-field visual detection abilities. Performance was inversely related to levels of both inhibitory and excitatory neurotransmitters in hMT+ but, surprisingly, did not correlate with visually evoked blood oxygenation level-dependent signal change in this motion-sensitive region. CONCLUSIONS: Levels of GABA and glutamate in hMT+ appear to provide superior information about motion detection capabilities inside perimetrically defined blind fields compared to blood oxygenation level-dependent signal changes - in essence, serving as biomarkers for the quality of residual visual processing in the blind-field. Whether they also reflect a potential for successful rehabilitation of visual function remains to be determined. |
Craig A. Williamson; Jari J. Morganti; Hannah E. Smithson Bright-light distractions and visual performance Journal Article In: Frontiers in Psychology, vol. 14, pp. 1–11, 2023. @article{Williamson2023, Visual distractions pose a significant risk to transportation safety, with laser attacks against aircraft pilots being a common example. This study used a research-grade High Dynamic Range (HDR) display to produce bright-light distractions for 12 volunteer participants performing a combined visual task across central and peripheral visual fields. The visual scene had an average luminance of 10 cd∙m−2 with targets of approximately 0.5° angular size, while the distractions had a maximum luminance of 9,000 cd∙m−2 and were 3.6° in size. The dependent variables were the mean fixation duration during task execution (representative of information processing time), and the critical stimulus duration required to support a target level of performance (representative of task efficiency). The experiment found a statistically significant increase in mean fixation duration, rising from 192 ms without distractions to 205 ms with bright-light distractions (p = 0.023). This indicates a decrease in visibility of the low contrast targets or an increase in cognitive workload that required greater processing time for each fixation in the presence of the bright-light distractions. Mean critical stimulus duration was not significantly affected by the distraction conditions used in this study. Future experiments are suggested to replicate driving and/or piloting tasks and employ bright-light distractions based on real-world data, and we advocate the use of eye-tracking metrics as sensitive measures of changes in performance. |
Louis Williams; Kelsey J. Mulder; Andrew Charlton-Perez; Matthew Lickiss; Alison Black; Rachel McCloy; Eugene McSorley; Joe Young Understanding representations of uncertainty, an eye-tracking study-part 2: The effect of expertise Journal Article In: Geoscience Communication, vol. 6, no. 3, pp. 111–123, 2023. @article{Williams2023, As the ability to make predictions regarding uncertainty information representing natural hazards increases, an important question for those designing and communicating hazard forecasts is how visualizations of uncertainty influence understanding amongst the intended, potentially varied, target audiences. End-users have a wide range of differing expertise and backgrounds, possibly influencing the decision-making process they undertake for a given forecast presentation. Our previous, Part 1 study (Mulder et al., 2023) examined how the presentation of uncertainty information influenced end-user decision making. Here, we shift the focus to examine the decisions and reactions of participants with differing areas of expertise (meteorology, psychology, and graphic-communication students) when presented with varied hypothetical forecast representations (boxplot, fan plot, or spaghetti plot with and without median lines) using the same eye-tracking methods and experiments. Participants made decisions about a fictional scenario involving the choices between ships of different sizes in the face of varying ice thickness forecasts. Eye movements to the graph area and key and how they changed over time (early, intermediate, and later viewing periods) were examined. More fixations (maintained gaze on one location) and more fixation time were spent on the graph and key during early and intermediate periods of viewing, particularly for boxplots and fan plots. The inclusion of median lines led to less fixations being made on all graph types during early and intermediate viewing periods. No difference in eye movement behaviour was found due to expertise; however, those with greater expertise were more accurate in their decisions, particularly during more difficult scenarios. Where scientific producers seek to draw users to the central estimate, an anchoring line can significantly reduce cognitive load, leading both experts and non-experts to make more rational decisions. When asking users to consider extreme scenarios or uncertainty, different prior expertise can lead to significantly different cognitive loads for processing information, with an impact on one's ability to make appropriate decisions. |
Sobanawartiny Wijeakumar; Samuel H. Forbes; Vincent A. Magnotta; Sean Deoni; Kiara Jackson; Vinay P. Singh; Madhuri Tiwari; Aarti Kumar; John P. Spencer Stunting in infancy is associated with atypical activation of working memory and attention networks Journal Article In: Nature Human Behaviour, vol. 7, no. 12, pp. 2199–2211, 2023. @article{Wijeakumar2023, Stunting is associated with poor long-term cognitive, academic and economic outcomes, yet the mechanisms through which stunting impacts cognition in early development remain unknown. In a first-ever neuroimaging study conducted on infants from rural India, we demonstrate that stunting impacts a critical, early-developing cognitive system—visual working memory. Stunted infants showed poor visual working memory performance and were easily distractible. Poor performance was associated with reduced engagement of the left anterior intraparietal sulcus, a region involved in visual working memory maintenance and greater suppression in the right temporoparietal junction, a region involved in attentional shifting. When assessed one year later, stunted infants had lower problem-solving scores, while infants of normal height with greater left anterior intraparietal sulcus activation showed higher problem-solving scores. Finally, short-for-age infants with poor physical growth indices but good visual working memory performance showed more positive outcomes suggesting that intervention efforts should focus on improving working memory and reducing distractibility in infancy. |
Christian Wienke; Marcus Grueschow; Aiden Haghikia; Tino Zaehle In: Journal of Neuroscience, vol. 43, no. 36, pp. 6306–6319, 2023. @article{Wienke2023, Transcutaneous auricular vagus nerve stimulation (taVNS) has been proposed to activate the locus ceruleus-noradrenaline (LC-NA) system. However, previous studies failed to find consistent modulatory effects of taVNS on LC-NA biomarkers. Previous studies suggest that phasic taVNS may be capable of modulating LC-NA biomarkers such as pupil dilation and alpha oscillations. However, it is unclear whether these effects extend beyond pure sensory vagal nerve responses. Critically, the potential of the pupillary light reflex as an additional taVNS biomarker has not been explored so far. Here, we applied phasic active and sham taVNS in 29 subjects (16 female, 13 male) while they performed an emotional Stroop task (EST) and a passive pupil light reflex task (PLRT). We recorded pupil size and brain activity dynamics using a combined Magnetoencephalography (MEG) and pupillometry design. Our results show that phasic taVNS significantly increased pupil dilation and performance during the EST. During the PLRT, active taVNS reduced and delayed pupil constriction. In the MEG, taVNS increased frontal-midline theta and alpha power during the EST, whereas occipital alpha power was reduced during both the EST and PLRT. Our findings provide evidence that phasic taVNS systematically modulates behavioral, pupillary, and electrophysiological parameters of LC-NA activity during cognitive processing. Moreover, we demonstrate for the first time that the pupillary light reflex can be used as a simple and effective proxy of taVNS efficacy. These findings have important implications for the development of noninvasive neuromodulation interventions for various cognitive and clinical applications. |
Bogusława Whyatt; Olga Witczak; Ewa Tomczak-Łukaszewska; Olha Lehka-Paul The proof of the translation process is in the reading of the target text: An eyetracking reception study Journal Article In: Ampersand, vol. 11, pp. 1–10, 2023. @article{Whyatt2023, This article is an attempt to bridge the divide between translation process research (TPR) which has investigated how translators as specialised bilingual professionals use their expertise to translate texts and translation reception which explores how the texts are read and received by the target language readers. Over the last thirty years, TPR has provided empirically grounded findings to demonstrate the complexity of the cognitive processes in the translator's mind but much less empirical interest has been paid to how translated texts are read and processed by the readers. To redress this imbalance, we hypothesise that the cognitive effort invested in reading a translated text can be taken as proof of how successful the translation process has been. We report on an exploratory study in which two groups of participants read a high-quality and a low-quality translation of the same text while their eye movements were recorded by an eyetracker. We compare the readers' cognitive effort indexed by character-adjusted dwell time, number of runs and re-reading in the second and third run with the translators' character-adjusted cognitive effort invested in producing the target texts. The results show that the relationship between the translation process and the reading experience is not straightforward and depends on the quality of the target text. |
Robert L. Whitwell; Mehul A. Garach; Melvyn A. Goodale; Irene Sperandio In: Philosophical Transactions of the Royal Society B: Biological Sciences, vol. 378, no. 1869, pp. 1–11, 2023. @article{Whitwell2023, Perceiving and grasping an object present an animal with different sets of computational problems. The solution in primates entails the specialization of separate neural networks for visual processing with different object representations. This explains why the Ebbinghaus illusion minimally affects the grasping hand's in-flight aperture, which normally scales with target size, even though the size of the target disc remains misperceived. An attractive alternative account, however, posits that grasps are refractory to the illusion because participants fixate on the target and fail to attend to the surrounding context. To test this account, we tracked both limb and gaze while participants made forced-choice judgments of relative disc size in the Ebbinghaus illusion or did so in combination with grasping or manually estimating the size of one of the discs. We replicated the classic dissociation: grasp aperture was refractory to the measured illusory effect on perceived size, while judgments and manual estimates of disc size were not. Importantly, the number of display-wide saccades per second and the percentage of total fixation time or fixations directed at the selected disc failed to explain the dissociation. Our findings support the contention that object perception and goal-directed action rely on distinct visual representations. This article is part of a discussion meeting issue 'New approaches to 3D vision'. |
Jonathon Whitlock; Ryan Hubbard; Huiyu Ding; Lili Sahakyan Trial-level fluctuations in pupil dilation at encoding reflect strength of relational binding. Journal Article In: Journal of Experimental Psychology: Learning, Memory, and Cognition, pp. 1–18, 2023. @article{Whitlock2023, Eye-tracking methodologies have revealed that eye movements and pupil dilations are influenced by our previous experiences. Dynamic fluctuations in pupil size during learning reflect in part the formation of memories for learned information, while viewing behavior during memory testing is influenced by memory retrieval and drawn to previously learned associations. However, no study to date has linked fluctuations in pupil dilation at encoding to the magnitude of viewing behavior at test. The current investigation involved monitoring eye movements both in single item recognition and relational recognition tasks. In the item task, all faces were presented with the same background scene and memory for faces was subsequently tested, whereas in the relational task each face was presented with its own unique background scene and memory for the face-scene association was subsequently tested. Pupil size changes during encoding predicted the magnitude of preferential viewing during test, as well as future recognition accuracy. These effects emerged only in the relational task, but not in the item task, and were replicated in an additional experiment in which stimulus luminance was more tightly controlled. A follow-up experiment and additional analyses ruled out differences in orienting instructions or number of fixations to the encoding display as explanations of the observed effects. The results shed light on the links between pupil dilation, memory encoding, and eye movement patterns during recognition and suggest that trial-level fluctuations in pupil dilation during encoding reflect relational binding of items to their context rather than general memory formation or strength. |
Veronica Whitford; Narissa Byers; Gillian A. O'Driscoll; Debra Titone Eye movements and the perceptual span in disordered reading: A comparison of schizophrenia and dyslexia Journal Article In: Schizophrenia Research: Cognition, vol. 34, pp. 1–13, 2023. @article{Whitford2023, Increasing evidence of a common neurodevelopmental etiology between schizophrenia and developmental dyslexia suggests that neurocognitive functions, such as reading, may be similarly disrupted. However, direct comparisons of reading performance in these disorders have yet to be conducted. To address this gap in the literature, we employed a gaze-contingent moving window paradigm to examine sentence-level reading fluency and perceptual span (breadth of parafoveal processing) in adults with schizophrenia (dataset from Whitford et al., 2013) and psychiatrically healthy adults with dyslexia (newly collected dataset). We found that the schizophrenia and dyslexia groups exhibited similar reductions in sentence-level reading fluency (e.g., slower reading rates, more regressions) compared to matched controls. Similar reductions were also found for standardized language/reading and executive functioning measures. However, despite these reductions, the dyslexia group exhibited a larger perceptual span (greater parafoveal processing) than the schizophrenia group, potentially reflecting a disruption in normal foveal-parafoveal processing dynamics. Taken together, our findings suggest that reading and reading-related functions are largely similarly disrupted in schizophrenia and dyslexia, providing additional support for a common neurodevelopmental etiology. |
Alex L. White; Kendrick N. Kay; Kenny A. Tang; Jason D. Yeatman Engaging in word recognition elicits highly specific modulations in visual cortex Journal Article In: Current Biology, vol. 33, no. 7, pp. 1308–1320, 2023. @article{White2023, A person's cognitive state determines how their brain responds to visual stimuli. The most common such effect is a response enhancement when stimuli are task relevant and attended rather than ignored. In this fMRI study, we report a surprising twist on such attention effects in the visual word form area (VWFA), a region that plays a key role in reading. We presented participants with strings of letters and visually similar shapes, which were either relevant for a specific task (lexical decision or gap localization) or ignored (during a fixation dot color task). In the VWFA, the enhancement of responses to attended stimuli occurred only for letter strings, whereas non-letter shapes evoked smaller responses when attended than when ignored. The enhancement of VWFA activity was accompanied by strengthened functional connectivity with higher-level language regions. These task-dependent modulations of response magnitude and functional connectivity were specific to the VWFA and absent in the rest of visual cortex. We suggest that language regions send targeted excitatory feedback into the VWFA only when the observer is trying to read. This feedback enables the discrimination of familiar and nonsense words and is distinct from generic effects of visual attention. |
Mirjam C. M. Wever; Lisanne A. E. M. Houtum; Loes H. C. Janssen; Wilma G. M. Wentholt; Iris M. Spruit; Marieke S. Tollenaar; Geert Jan Will; Bernet M. Elzinga In: Cognitive, Affective, & Behavioral Neuroscience, vol. 23, no. 6, pp. 1598–1609, 2023. @article{Wever2023, One of the most prevalent nonverbal, social phenomena known to automatically elicit self- and other-referential processes is eye contact. By its negative effects on the perception of social safety and views about the self and others, childhood emotional maltreatment (CEM) may fundamentally affect these processes. To investigate whether the socioaffective consequences of CEM may become visible in response to (prolonged) eye gaze, 79 adult participants (mean [M]age = 49.87, standard deviation [SD]age = 4.62) viewed videos with direct and averted gaze of an unfamiliar other and themselves while we recorded self-reported mood, eye movements using eye-tracking, and markers of neural activity using fMRI. Participants who reported higher levels of CEM exhibited increased activity in ventromedial prefrontal cortex to one's own, but not to others', direct gaze. Furthermore, in contrast to those who reported fewer of such experiences, they did not report a better mood in response to a direct gaze of self and others, despite equivalent amounts of time spent looking into their own and other peoples' eyes. The fact that CEM is associated with enhanced neural activation in a brain area that is crucially involved in self-referential processing (i.e., vmPFC) in response to one's own direct gaze is in line with the chronic negative impact of CEM on a person's self-views. Interventions that directly focus on targeting maladaptive self-views elicited during eye gaze to self may be clinically useful. |
Jacob A. Westerberg; Jeffrey D. Schall; Geoffrey F. Woodman; Alexander Maier Feedforward attentional selection in sensory cortex Journal Article In: Nature Communications, vol. 14, no. 1, pp. 1–17, 2023. @article{Westerberg2023, Salient objects grab attention because they stand out from their surroundings. Whether this phenomenon is accomplished by bottom-up sensory processing or requires top-down guidance is debated. We tested these alternative hypotheses by measuring how early and in which cortical layer(s) neural spiking distinguished a target from a distractor. We measured synaptic and spiking activity across cortical columns in mid-level area V4 of male macaque monkeys performing visual search for a color singleton. A neural signature of attentional capture was observed in the earliest response in the input layer 4. The magnitude of this response predicted response time and accuracy. Errant behavior followed errant selection. Because this response preceded top-down influences and arose in the cortical layer not targeted by top-down connections, these findings demonstrate that feedforward activation of sensory cortex can underlie attentional priority. |
Ana Werkmann Horvat; Marianna Bolognesi; Nadja Althaus Attention to the source domain of conventional metaphorical expressions: Evidence from an eye tracking study Journal Article In: Journal of Pragmatics, vol. 215, pp. 131–144, 2023. @article{WerkmannHorvat2023, This study investigates whether the metaphorical status of conventional expressions can be reactivated when elements of the source domain are present in the context. In indirect metaphors the source domain (or literal meaning) is not expressed (e.g., The father cut the budget). The literal meaning of cutting remains latently encoded in the predicate and readers' attention is not required to move from the finance domain to the domain of physical cuts. Such conventional metaphoric expressions are likely to be processed via lexical disambiguation of a polysemous (metaphorical) verb. Using an eye tracking combined with a forced-choice semantic relatedness task we investigated whether by adding linguistic material referring to the source domain (e.g., father cut the budget like grass), we can direct readers' attention to the source domain of the metaphorical predicate and stimulate them to interpret conventional metaphorical expressions by means of cross-domain mapping. The results indicate that in the reactivated condition participants dwell on the object (budget) significantly longer in their second run and when they regress to it after the final region than where there is no source domain activation. These findings may offer new insight into the limited experimental evidence related to the deliberate metaphor theory. |
Shirui Wen; Huangyemin Zhang; Kailing Huang; Xiaojie Wei; Ke Yang; Quan Wang; Li Feng Impaired orienting function detected through eye movements in patients with temporal lobe epilepsy Journal Article In: Frontiers in Neuroscience, vol. 17, pp. 1–10, 2023. @article{Wen2023, Objective: Patients with temporal lobe epilepsy (TLE) often exhibit attention function impairment. The orienting network is the subsystem of the attention network that has not been fully studied. In this study, we used eye-tracking technology with an attention network test (ANT)-based task to assess the orienting function of TLE patients, aiming to characterize their eye movement patterns. Methods: A total of 37 TLE patients and 29 healthy controls (HCs) completed the ANT task based on eye-tracking technology. Orienting function damage was mainly assessed by the ANT orienting effect. Eye movement metrics, such as mean first goal-directed saccade latency (MGSL), total saccades, and saccade amplitudes, were compared between groups Results: The TLE patients had a significantly lower ANT orienting effect (HC, 54.05 ± 34.05; TLE, 32.29 ± 39.54) and lower eye-tracking orienting effect (HC, 116.98 ± 56.59; TLE, 86.72 ± 59.10) than those of the HCs. The larger orienting effects indicate that orienting responses are faster when receiving a spatial cue compared with a center cue. In the spatial cue condition, compared with HCs, the TLE group showed a longer first goal-directed saccade latency (HC, 76.77 ± 58.87ms; TLE, 115.14 ± 59.15ms), more total saccades (HC, 28.46 ± 12.30; TLE, 36.69 ± 15.13), and larger saccade amplitudes (HC, 0.75◦ ± 0.60◦; TLE, 1.36◦ ± 0.89◦). Furthermore, there was a positive correlation of the orienting-effect score between the ANT task and eye-tracking metrics (r = 0.58, p < 0.05). Conclusion: We innovatively developed a new detection method using eye-tracking technology in combination with an ANT-based task to detect the orienting function in TLE patients. The current research demonstrated that TLE patients had a significant orienting dysfunction with a specific saccade pattern characterized by a longer first goal-directed saccade latency, more total saccades, and larger saccade amplitudes. These oculomotor metrics are likely to be a better indicator of orienting function and may potentially be used for behavioral-based interventions and long-term cognition monitoring in TLE patients. |
Kim Lara Weiss; Stefan Hawelka; Florian Hutzler; Sarah Schuster Stronger functional connectivity during reading contextually predictable words in slow readers Journal Article In: Scientific Reports, vol. 13, no. 1, pp. 1–10, 2023. @article{Weiss2023, The effect of word predictability is well-documented in terms of local brain activation, but less is known about the functional connectivity among those regions associated with processing predictable words. Evidence from eye movement studies showed that the effect is much more pronounced in slow than in fast readers, suggesting that speed-impaired readers rely more on sentence context to compensate for their difficulties with visual word recognition. The present study aimed to investigate differences in functional connectivity of fast and slow readers within core regions associated with processing predictable words. We hypothesize a stronger synchronization between higher-order language areas, such as the left middle temporal (MTG) and inferior frontal gyrus (IFG), and the left occipito-temporal cortex (OTC) in slow readers. Our results show that slow readers exhibit more functional correlations among these connections; especially between the left IFG and OTC. We interpret our results in terms of the lexical quality hypothesis which postulates a stronger involvement of semantics on orthographic processing in (speed-)impaired readers. |
Zi-Han Wei; Yan Liang; Ci-Juan Liang; Hong-Zhi Liu Information search processing affects social decisions Journal Article In: Journal of Behavioral Decision Making, vol. 36, no. 5, pp. 1–11, 2023. @article{Wei2023a, Social decisions often require individuals to balance conflicts between their own selfish interests and the need for equality. The way information about available options is presented can have an impact on how people process information and make social decisions. In this study, we examined the effect of information presentation on social decisions in a mini-dictator game, where participants must make binary choices about how to allocate money between themselves and another participant. We conducted two tasks with different presentation styles: the attribute-based task, where attributes such as own payoffs or others' payoffs were displayed sequentially, and the alternative-based task, where alternatives were displayed sequentially. We found that participants in the attribute-based task made more selfish choices and were less sensitive to equality than those in the alternative-based task. The direction of information search and the complexity level of information processing played a mediating role in the effect of task on social decisions. Our findings highlight the relationship between information search and social decisions, shedding light on the mechanisms and processes that underlie social decision-making. |
Yanjun Wei; Yingjuan Tang; Adam John Privitera Functional priority of syntax over semantics in Chinese 'ba' construction: Evidence from eye-tracking during natural reading Journal Article In: Language and Cognition, pp. 1–21, 2023. @article{Wei2023, Studies on sentence processing in inflectional languages support that syntactic structure building functionally precedes semantic processing. Conversely, most EEG studies of Chinese sentence processing do not support the priority of syntax. One possible explanation is that the Chinese language lacks morphological inflections. Another explanation may be that the presentation of separate sentence components on individual screens in EEG studies disrupts syntactic framework construction during sentence reading. The present study investigated this explanation using a self-paced reading experiment mimicking rapid serial visual presentation in EEG studies and an eye-tracking experiment reflecting natural reading. In both experiments, Chinese 'ba' sentences were presented to Chinese young adults in four conditions that differed across the dimensions of syntactic and semantic congruency. Evidence supporting the functional priority of syntax over semantics was limited to only the natural reading context, in which syntactic violations blocked the processing of semantics. Additionally, we observed a later stage of integrating plausible semantics with a failed syntax. Together, our findings extend the functional priority of syntax to the Chinese language and highlight the importance of adopting more ecologically valid methods when investigating sentence reading. |
Jelena M. Wehrli; Yanfang Xia; Benjamin Offenhammer; Birgit Kleim; Daniel Müller; Dominik R. Bach Effect of the matrix metalloproteinase inhibitor doxycycline on human trace fear memory Journal Article In: eNeuro, vol. 10, no. 2, pp. 1–13, 2023. @article{Wehrli2023, Learning to predict threat is of adaptive importance, but aversive memory can also become disadvantageous and burdensome in clinical conditions such as posttraumatic stress disorder (PTSD). Pavlovian fear conditioning is a laboratory model of aversive memory and thought to rely on structural synaptic reconfiguration involving matrix metalloproteinase (MMP)9 signaling. It has recently been suggested that the MMP9-inhibiting antibiotic doxycycline, applied before acquisition training in humans, reduces fear memory retention after one week. This previous study used cued delay fear conditioning, in which predictors and outcomes overlap in time. However, temporal separation of predictors and outcomes is common in clinical conditions. Learning the association of temporally separated events requires a partly different neural circuitry, for which the role of MMP9 signaling is not yet known. Here, we investigate the impact of doxycycline on long-interval (15 s) trace fear conditioning in a randomized controlled trial with 101 (50 females) human participants. We find no impact of the drug in our preregistered analyses. Exploratory post hoc analyses of memory retention suggested a serum level-dependent effect of doxycycline on trace fear memory retention. However, effect size to distinguish CS+/CS in the placebo group turned out to be smaller than in previously used delay fear conditioning protocols, which limits the power of statistical tests. Our results suggest that doxycycline effect on trace fear conditioning in healthy individuals is smaller and less robust than anticipated, potentially limiting its clinical application potential. |
Taylor D. Webb; Matthew G. Wilson; Henrik Odéen; Jan Kubanek Sustained modulation of primate deep brain circuits with focused ultrasonic waves Journal Article In: Brain Stimulation, vol. 16, no. 3, pp. 798–805, 2023. @article{Webb2023, Background: Transcranial focused ultrasound has the potential to noninvasively modulate deep brain circuits and impart sustained, neuroplastic effects. Objective: Bring the approach closer to translations by demonstrating sustained modulation of deep brain circuits and choice behavior in task-performing non-human primates. Methods: Low-intensity transcranial ultrasound of 30 s in duration was delivered in a controlled manner into deep brain targets (left or right lateral geniculate nucleus; LGN) of non-human primates while the subjects decided whether a left or a right visual target appeared first. While the animals performed the task, we recorded intracranial EEG from occipital screws. The ultrasound was delivered into the deep brain targets daily for a period of more than 6 months. Results: The brief stimulation induced effects on choice behavior that persisted up to 15 minutes and were specific to the sonicated target. Stimulation of the left/right LGN increased the proportion of rightward/leftward choices. These effects were accompanied by an increase in gamma activity over visual cortex. The contralateral effect on choice behavior and the increase in gamma, compared to sham stimulation, suggest that the stimulation excited the target neural circuits. There were no detrimental effects on the animals' discrimination performance over the months-long course of the stimulation. Conclusion: This study demonstrates that brief, 30-s ultrasonic stimulation induces neuroplastic effects specifically in the target deep brain circuits, and that the stimulation can be applied daily without detrimental effects. These findings encourage repeated applications of transcranial ultrasound to malfunctioning deep brain circuits in humans with the goal of providing a durable therapeutic reset. |
Noriya Watanabe; Kosuke Miyoshi; Koji Jimura; Daisuke Shimane; Ruedeerat Keerativittayayut; Kiyoshi Nakahara; Masaki Takeda Multimodal deep neural decoding reveals highly resolved spatiotemporal profile of visual object representation in humans Journal Article In: NeuroImage, vol. 275, pp. 1–19, 2023. @article{Watanabe2023, Perception and categorization of objects in a visual scene are essential to grasp the surrounding situation. Recently, neural decoding schemes, such as machine learning in functional magnetic resonance imaging (fMRI), has been employed to elucidate the underlying neural mechanisms. However, it remains unclear as to how spatially distributed brain regions temporally represent visual object categories and sub-categories. One promising strategy to address this issue is neural decoding with concurrently obtained neural response data of high spatial and temporal resolution. In this study, we explored the spatial and temporal organization of visual object representations using concurrent fMRI and electroencephalography (EEG), combined with neural decoding using deep neural networks (DNNs). We hypothesized that neural decoding by multimodal neural data with DNN would show high classification performance in visual object categorization (faces or non-face objects) and sub-categorization within faces and objects. Visualization of the fMRI DNN was more sensitive than that in the univariate approach and revealed that visual categorization occurred in brain-wide regions. Interestingly, the EEG DNN valued the earlier phase of neural responses for categorization and the later phase of neural responses for sub-categorization. Combination of the two DNNs improved the classification performance for both categorization and sub-categorization compared with fMRI DNN or EEG DNN alone. These deep learning-based results demonstrate a categorization principle in which visual objects are represented in a spatially organized and coarse-to-fine manner, and provide strong evidence of the ability of multimodal deep learning to uncover spatiotemporal neural machinery in sensory processing. |
Scott N. J. Watamaniuk; Jeremy B. Badler; Stephen J. Heinen Peripheral targets attenuate miniature eye movements during fixation Journal Article In: Scientific Reports, vol. 13, no. 1, pp. 1–9, 2023. @article{Watamaniuk2023, Fixating a small dot is a universal technique for stabilizing gaze in vision and eye movement research, and for clinical imaging of normal and diseased retinae. During fixation, microsaccades and drifts occur that presumably benefit vision, yet microsaccades compromise image stability and usurp task attention. Previous work suggested that microsaccades and smooth pursuit catch-up saccades are controlled by similar mechanisms. This, and other previous work showing fewer catch-up saccades during smooth pursuit of peripheral targets suggested that a peripheral target might similarly mitigate microsaccades. Here, human observers fixated one of three stimuli: a small central dot, the center of a peripheral, circular array of small dots, or a central/peripheral stimulus created by combining the two. The microsaccade rate was significantly lower with the peripheral array than with the dot. However, inserting the dot into the array increased the microsaccade rate to single-dot levels. Drift speed also decreased with the peripheral array, both with and without the central dot. Eye position variability was higher with the array than with the composite stimulus. The results suggest that analogous to the foveal pursuit, foveating a stationary target engages the saccadic system likely compromising retinal-image stability. In contrast, fixating a peripheral stimulus improves stability, thereby affording better retinal imaging and releasing attention for experimental tasks. |
Zi-yang Wang; Li Liu; Yu Liu A multi-source behavioral and physiological recording system for cognitive assessment Journal Article In: Scientific Reports, vol. 13, no. 1, pp. 1–12, 2023. @article{Wang2023n, Cognitive assessment has a broad application prospect, including estimate of childhood neuro development and maturation, diagnosis of neurodegenerative diseases, and selection for special profession. With the development of computer technique and behavioral recording sensors, the method of cognitive assessment has been replaced from paper scale test to human–computer interaction. We can not only obtain the results of tasks, but also make it possible to acquire multiple behavioral and physiological data during the task. However, there is still a strong challenge of recording multi-source data synchronously during multi-dimensional cognitive assessments. Therefore, we built a multi-source cognitive assessment system can record multi-pattern behavioral and physiological data and feedback at different spatiotemporal levels. Under this system, we developed a multi-source diagnostic toolset for cognitive assessment, including eye tracking, hand movement, EEG and human–computer interaction data during the cognitive task. 238 participants with different mental disorders were assessed using this system. The results showed that our diagnostic toolset can be used to study the behavioral abnormalities of patients with mental disorders through the characteristics of multi-source data. Furthermore, this system can provide some objective diagnostic criteria such as behavioral characters and EEG features for diagnosis of mental disorders. |
Zhiyun Wang; Qingfang Zhang Ageing of grammatical advance planning in spoken sentence production: An eye movement study Journal Article In: Psychological Research, no. 2001, pp. 1–18, 2023. @article{Wang2023m, This study used an image-description paradigm with concurrent eye movement recordings to investigate differences of grammatical advance planning between young and older speakers in spoken sentence production. Participants were asked to produce sentences with simple or complex initial phrase structures (IPS) in Experiment 1 while producing individual words in Experiment 2. Young and older speakers showed comparable speaking latencies in sentence production task, whereas older speakers showed longer latencies than young speakers in word production task. Eye movement data showed that compared with young speakers, older speakers had higher fixation percentage on object 1, lower percentage of gaze shift from object 1 to 2, and lower fixation percentage on object 2 in simple IPS sentences, while they showed similar fixation percentage on object 1, similar percentage of gaze shift from object 1 to 2, and lower fixation percentage on object 2 in complex IPS sentences, indicating a decline of grammatical encoding scope presenting on eye movement patterns. Meanwhile, speech analysis showed that older speakers presented longer utterance duration, slower speech rate, and longer and more frequently occurred pauses in articulation, indicating a decline of speech articulation in older speakers. Thus, our study suggests that older speakers experience an ageing effect in the sentences with complex initial phrases due to limited cognitive resources. |
Youxi Wang; Suke Duan; Guojie Ma; Wei Shen Segmentation of spoken overlapping ambiguity strings in chinese: An eye-tracking study Journal Article In: Journal of Speech, Language, and Hearing Research, vol. 66, no. 12, pp. 4913–4933, 2023. @article{Wang2023l, PURPOSE: Using the printed-word paradigm with eye tracking, this study conducted three experiments to examine (a) how multiple words in spoken overlapping ambiguity strings (OASs) are activated, (b) how word frequency influences the word segmentation of spoken OASs, and (c) whether the multiple words in spoken OASs are activated competitively or independently. METHOD: In this study, participants listened to a four-character spoken OAS (ABCD) and were presented with a visual display composed of a semantic associate of the "middle word" (BC; Experiments 1 and 2) or the "left word" (AB; Experiment 3) and two distractors. In Experiment 1, the word frequency of the middle words was manipulated to be higher than that of the neighbor words. In Experiment 2, the word frequency of the middle words was manipulated to be either higher or lower than that of the neighbor words. In Experiment 3, participants listened to either spoken OASs (ABCD) or spoken unambiguous strings (ABEF). RESULTS: In Experiment 1, we observed a significant semantic competition effect; that is, more fixations fell on the semantic competitors than on distractors, suggesting that the semantic information of the middle words in the spoken OASs was activated. In Experiment 2, the semantic competition effect was only observed in the high-frequency condition and was absent in the low-frequency condition. In Experiment 3, the results showed significant semantic competition effects for the left words under both conditions, and the observed effect was similar between the ambiguity condition and the control condition. CONCLUSIONS: These findings show that multiple words in spoken OASs are all activated and the activation level is modulated by word frequency. In addition, multiple words in the spoken OASs may be processed independently during spoken comprehension. |
Xinrui Wang; Hui Jing Lu; Hanran Li; Lei Chang Childhood environmental unpredictability and experimentally primed uncertainty in relation to intuitive versus deliberate visual search Journal Article In: Current Psychology, pp. 1–14, 2023. @article{Wang2023k, Visual search is an integral part of animal life. Two search strategies, intuitive vs. deliberate search, are adopted by almost all animals including humans to adapt to different extent of environmental uncertainty. In two eye-tracking experiments involving simple visual search (Study 1) and complex information search (Study 2), we used the evolutionary life history (LH) approach to investigate the interaction between childhood environmental unpredictability and primed concurrent uncertainty in enabling these two search strategies. The results indicate that when individuals with greater childhood unpredictability were exposed to uncertainty cues, they exhibited intuitive rather than deliberate visual search (i.e., fewer fixations, reduced dwell time, a larger saccade size, and fewer repetitive inspections relative to individuals with lower childhood unpredictability). We conclude that childhood environment is crucial in calibrating LH including visual and cognitive strategies to adaptively respond to current environmental conditions. |
Wei Wang; Liat Kofler; Chapman Lindgren; Max Lobel; Amanda Murphy; Qiwen Tong; Kemar Pickering AI for psychometrics: Validating machine learning models in measuring emotional intelligence with eye-tracking techniques Journal Article In: Journal of Intelligence, vol. 11, no. 9, pp. 1–28, 2023. @article{Wang2023j, AI, or artificial intelligence, is a technology of creating algorithms and computer systems that mimic human cognitive abilities to perform tasks. Many industries are undergoing revolutions due to the advances and applications of AI technology. The current study explored a burgeoning field—Psychometric AI, which integrates AI methodologies and psychological measurement to not only improve measurement accuracy, efficiency, and effectiveness but also help reduce human bias and increase objectivity in measurement. Specifically, by leveraging unobtrusive eye-tracking sensing techniques and performing 1470 runs with seven different machine-learning classifiers, the current study systematically examined the efficacy of various (ML) models in measuring different facets and measures of the emotional intelligence (EI) construct. Our results revealed an average accuracy ranging from 50–90%, largely depending on the percentile to dichotomize the EI scores. More importantly, our study found that AI algorithms were powerful enough to achieve high accuracy with as little as 5 or 2 s of eye-tracking data. The research also explored the effects of EI facets/measures on ML measurement accuracy and identified many eye-tracking features most predictive of EI scores. Both theoretical and practical implications are discussed. |
Tao Wang; Mingyao Geng; Yue Wang; Min Zhao; Tongquan Zhou; Yiming Yang Chinese EFL learners different from English natives in cataphora resolution: Evidence from eye-tracking studies Journal Article In: Frontiers in Psychology, vol. 14, pp. 1–18, 2023. @article{Wang2023i, Previous studies on English natives have shown that encountering an English cataphoric pronoun triggers an active search for its antecedent and this searching process is modulated by syntactic constraints. It remains unknown whether the conclusion is universal to EFL (English as a Foreign Language) learners, particularly those with distinct L1 like Chinese in linguistic typology. Therefore, this study used two eye-tracking experiments to investigate how Chinese EFL learners resolve English cataphora. The experiments adopted the gender-mismatch paradigm. Experiment 1 investigated whether Chinese EFL learners with different proficiency would adopt the similar processing pattern to English natives and found that gender congruency elicited longer reading times than gender incongruency between the first potential antecedent and the cataphoric pronoun, the effect early observed in high-proficiency relative to low-proficiency learners. Experiment 2 explored whether the cataphora resolution process was modulated by Binding Principle B and revealed that longer first fixation durations and first pass reading times were observed in gender-mismatch than in gender-match conditions no matter the antecedents are binding-accessible or not while longer regression path durations occurred in gender-mismatch than in gender-match conditions only as the antecedents are binding-accessible. Taken together, these results indicate that Chinese EFL learners also adopt an active search mechanism to resolve cataphoric pronouns, yet along a processing path distinct from English natives'. Specifically, Chinese EFL learners predictively link a cataphoric pronoun to the first potential antecedent in the sentence but only a gender-matching antecedent can prompt them to engage in deep processing of the antecedent. Moreover, the processing time varies with the learners' English proficiency. Furthermore, unlike native English speakers' early application of syntactic constraints in their cataphora resolution, Chinese EFL learners try to establish co-reference relations between cataphoric pronouns and antecedents regardless of following or flouting Binding Principle B in early processing stages whereas they exclusively link the cataphoric pronouns to the binding-accessible antecedents in late processing stages. This study adds evidence to the Shallow Structure Hypothesis whereby L2 learners resort to lexical prior to syntactic cues to process sentences in general, which is just opposite to the fashion adopted by the natives. |
Kangning Wang; Shuang Qiu; Wei Wei; Yukun Zhang; Shengpei Wang; Huiguang He; Minpeng Xu; Tzyy Ping Jung; Dong Ming A multimodal approach to estimating vigilance in SSVEP-based BCI Journal Article In: Expert Systems with Applications, vol. 225, pp. 1–16, 2023. @article{Wang2023h, Brain-computer interface (BCI) is a communication system that allows a direct connection between the human brain and external devices, which is able to provide assistance and improve the quality of life for people with disabilities. Vigilance is an important cognitive state and plays an important role in human–computer interaction. In BCI tasks, the low-vigilance state of the BCI user would lead to the performance degradation. Therefore, it is desirable to develop an efficient method to estimate the vigilance state of BCI users. In this study, we built a 4-target BCI system based on steady-state visual evoked potential (SSVEP) for cursor control. Electroencephalogram (EEG) and electrooculogram (EOG) were recorded simultaneously from 18 subjects during a 90-min continuous cursor-control BCI task. We proposed a multimodal vigilance estimating network, named MVENet, to estimate the vigilance state of BCI users through the multimodal signals. In this architecture, a spatial-temporal convolution module with an attention mechanism was adopted to explore the temporal-spatial information of the EEG features, and a long short-term memory module was utilized to learn the temporal dependencies of EOG features. Moreover, a fusion mechanism was built to fuse the EEG representations and EOG representations effectively. Experimental results showed that the proposed network achieved a better performance than the compared methods. These results demonstrate the feasibility and effectiveness of our methods for estimating the vigilance state of BCI users. |
Kangning Wang; Shuang Qiu; Wei Wei; Weibo Yi; Huiguang He; Minpeng Xu; Tzyy Ping Jung; Dong Ming Investigating EEG-based cross-session and cross-task vigilance estimation in BCI systems Journal Article In: Journal of Neural Engineering, vol. 20, no. 5, pp. 1–18, 2023. @article{Wang2023g, Objective. The state of vigilance is crucial for effective performance in brain-computer interface (BCI) tasks, and therefore, it is essential to investigate vigilance levels in BCI tasks. Despite this, most studies have focused on vigilance levels in driving tasks rather than on BCI tasks, and the electroencephalogram (EEG) patterns of vigilance states in different BCI tasks remain unclear. This study aimed to identify similarities and differences in EEG patterns and performances of vigilance estimation in different BCI tasks and sessions. Approach. To achieve this, we built a steady-state visual evoked potential-based BCI system and a rapid serial visual presentation-based BCI system and recruited 18 participants to carry out four BCI experimental sessions over four days. Main results. Our findings demonstrate that specific neural patterns for high and low vigilance levels are relatively stable across sessions. Differential entropy features significantly differ between different vigilance levels in all frequency bands and between BCI tasks in the delta and theta frequency bands, with the theta frequency band features playing a critical role in vigilance estimation. Additionally, prefrontal, temporal, and occipital regions are more relevant to the vigilance state in BCI tasks. Our results suggest that cross-session vigilance estimation is more accurate than cross-task estimation. Significance. Our study clarifies the underlying mechanisms of vigilance state in two BCI tasks and provides a foundation for further research in vigilance estimation in BCI applications. |
Jingwen Wang; Jinmian Yang; Chris Biemann; Xingshan Li Mechanism of semantic processing of lexicalized and novel compound words: An eye movement study Journal Article In: Journal of Experimental Psychology: Learning, Memory, and Cognition, vol. 49, no. 11, pp. 1812–1822, 2023. @article{Wang2023f, The integration of semantic information of compound words with context is a crucial aspect of reading comprehension. In two eye-tracking experiments, we used two-character and four-character Chinese lexicalized and novel compound words to investigate how Chinese readers integrate semantic information ofcompound words with contexts in the present study. By manipulating the temporary plausibility of the first constituent through varying the preceding verb, we aimed to investigate how readers process semantic information of compound words during normal reading. A significant plausibility effect pattern in the first constituent region was observed for the four-character novel words, but not for the lexicalized compound words and two-character novel compound words. However, for both two-character and four-character novel compound words, a reverse plausibility effect was found in the second constituent region. This was not the case for lexicalized compound words. These results indicate that novel compound words are integrated with the context in a decompositional manner, while lexicalized compound words are integrated holistically. |
Jiahui Wang Mind wandering in videos that integrate instructor's visuals: An eye tracking study Journal Article In: Innovations in Education and Teaching International, pp. 1–16, 2023. @article{Wang2023e, With an increasing number of videos integrating instructor's visuals on screen, we know little about the impacts of this design on mind wandering. The study aims to investigate a) how instructor visibility impacts mind wandering; b) the relationship between mind wandering and retention performance; c) how visual behaviour during video-watching influences mind wandering. Each participant watched a video with or without instructor visibility, while their visual behaviour was recorded by an eye tracker. Retention performance was measured at the completion of the video. Mind wandering was inferred via global self-report measure and objective eye tracking measure. Both measures of mind wandering indicated the instructor visible video resulted in less mind wandering. Findings suggested mind wandering impaired retention performance. Additionally, visual attention to the instructor was associated with less mind wandering. |
Haozhe Zac Wang; Yan Tat Wong A novel simulation paradigm utilising MRI-derived phosphene maps for cortical prosthetic vision Journal Article In: Journal of Neural Engineering, vol. 20, no. 4, pp. 1–18, 2023. @article{Wang2023d, Objective. We developed a realistic simulation paradigm for cortical prosthetic vision and investigated whether we can improve visual performance using a novel clustering algorithm. Approach. Cortical visual prostheses have been developed to restore sight by stimulating the visual cortex. To investigate the visual experience, previous studies have used uniform phosphene maps, which may not accurately capture generated phosphene map distributions of implant recipients. The current simulation paradigm was based on the Human Connectome Project retinotopy dataset and the placement of implants on the cortices from magnetic resonance imaging scans. Five unique retinotopic maps were derived using this method. To improve performance on these retinotopic maps, we enabled head scanning and a density-based clustering algorithm was then used to relocate centroids of visual stimuli. The impact of these improvements on visual detection performance was tested. Using spatially evenly distributed maps as a control, we recruited ten subjects and evaluated their performance across five sessions on the Berkeley Rudimentary Visual Acuity test and the object recognition task. Main results. Performance on control maps is significantly better than on retinotopic maps in both tasks. Both head scanning and the clustering algorithm showed the potential of improving visual ability across multiple sessions in the object recognition task. Significance. The current paradigm is the first that simulates the experience of cortical prosthetic vision based on brain scans and implant placement, which captures the spatial distribution of phosphenes more realistically. Utilisation of evenly distributed maps may overestimate the performance that visual prosthetics can restore. This simulation paradigm could be used in clinical practice when making plans for where best to implant cortical visual prostheses. |
Danhui Wang; Man Zeng; Han Zhao; Lei Gao; Shan Li; Zibei Niu; Xuejun Bai; Xiaolei Gao Effects of syllable boundaries in Tibetan reading Journal Article In: Scientific Reports, vol. 13, no. 314, pp. 1–10, 2023. @article{Wang2023, Interword spaces exist in the texts of many languages that use alphabetic writing systems. In most cases, interword spaces, as a kind of word boundary information, play an important role in the reading process of readers. Tibetan also uses alphabetic writing, its text has no spaces between words as word boundary markers. Instead, there are intersyllable tshegs (“."), which are superscript dots. Interword spaces play an important role in reading as word boundary information. Therefore, it is interesting to investigate the role of tshegs and what effect replacing tshegs with spaces will have on Tibetan reading. To answer these questions, Experiment 1 was conducted in which 72 Tibetan undergraduates read three-syllable-boundary conditions (normal, spaced, and untsheged). However, in Experiment 1, because we performed the experimental operations of deleting tshegs and replacing tshegs, the spatial information distribution of Tibetan sentences under different operating conditions was different, which may have a certain potential impact on the experimental results. To rule out the underlying confounding factor, in Experiment 2, 58 undergraduates read sentences for both untsheged and alternating-color conditions. Overall, the global and local analyses revealed that tshegs, spaces, and alternating-color markers as syllable boundaries can help readers segment syllables in Tibetan reading. In Tibetan reading, both spaces and tshegs are effective visual syllable segmentation cues, and spaces are more effective visual syllable segmentation cues than tshegs. |
Chin-An Wang; Neil G. Muggleton; Yi-Hsuan Chang; Cesar Barquero; Ying-Chun Kuo Time-on-task effects on human pupillary and saccadic metrics after theta burst transcranial magnetic stimulation over the frontal eye field Journal Article In: IBRO Neuroscience Reports, vol. 15, pp. 364–375, 2023. @article{Wang2023c, Pupil size undergoes constant changes primarily influenced by ambient luminance. These changes are referred to as the pupillary light reflex (PLR), where the pupil transiently constricts in response to light. PLR kinematics provides valuable insights into autonomic nervous system function and have significant clinical applications. Recent research indicates that attention plays a role in modulating the PLR, and the circuit involving the frontal eye field (FEF) and superior colliculus is causally involved in controlling this pupillary modulation. However, there is limited research exploring the role of the human FEF in these pupillary responses, and its impact on PLR metrics remains unexplored. Additionally, although the protocol of continuous theta-burst stimulation (cTBS) is well-established, the period of disruption after cTBS is yet to be examined in pupillary responses. Our study aimed to investigate the effects of FEF cTBS on pupillary and saccadic metrics in relation to time spent performing a task (referred to as time-on-task). We presented a bright stimulus to induce the PLR in visual- and memory-delay saccade tasks following cTBS over the right FEF or vertex. FEF cTBS, compared to vertex cTBS, resulted in decreased baseline pupil size, peak constriction velocities, and amplitude. Furthermore, the time-on-task effects on baseline pupil size, peak amplitude, and peak time differed between the two stimulation conditions. In contrast, the time-on-task effects on saccadic metrics were less pronounced between the two conditions. In summary, our study provides the first evidence that FEF cTBS affects human PLR metrics and that these effects are modulated by time-on-task. |
Chao Wang; Mitchell Reid Pond LaPointe; Shree Venkateshan; Guang Zhao; Weidong Tao; Hong-Jin Sun; Bruce Milliken Item-specific control of attention capture: An eye movement study Journal Article In: Quarterly Journal of Experimental Psychology, vol. 76, no. 1, pp. 117–132, 2023. @article{Wang2023o, Measures of attentional capture are sensitive to attentional control settings. Recent research suggests that such control settings can be linked associatively to specific items. Rapid item-specific retrieval of these control settings can then modulate measures of attentional capture. However, the processes that produce this item-specific control of attentional capture are unclear. The current study addressed this issue by examining eye-movement patterns associated with the item-specific proportion congruency effect (ISPC). Participants searched for a shape singleton target in search displays that also contained a colour singleton—the colour singleton was either the same item as the shape singleton (congruent trials) or a different item (incongruent trials). The relative proportions of congruent and incongruent trials were manipulated separately for two distinct item types that were randomly intermixed. Response times (RTs) were faster on congruent than incongruent trials, and this congruency effect was larger for high-proportion congruent (HPC) than low-proportion congruent (LPC) items. Eye movement data revealed a higher proportion of saccades towards the distractor and longer dwell times on the distractor in the HPC condition. These results suggest that item-specific associative learning can influence the strength of representation of the task goal (e.g., find the odd shape), a form of selection history effect in visual search. |
Andi Wang; Ana Pellicer-Sánchez Examining the effectiveness of bilingual subtitles for comprehension: An eye-tracking study Journal Article In: Studies in Second Language Acquisition, vol. 45, no. 4, pp. 882–905, 2023. @article{Wang2023b, The present study examined the relative effectiveness of bilingual subtitles for L2 viewing comprehension, compared to other subtitling types. Learners' allocation of attention to the image and subtitles/captions in different viewing conditions, as well as the relationship between attention and comprehension, were also investigated. A total of 112 Chinese learners of English watched an English documentary clip in one of four conditions (bilingual subtitles, captions, L1 subtitles, no subtitles) while their eye movements were recorded. The results revealed that bilingual subtitles were as beneficial as L1 subtitles for comprehension, which both outscored captions and no subtitles. Participants using bilingual subtitles spent significantly more time processing L1 than L2 lines. L1 lines in bilingual subtitles were processed significantly longer than in L1 subtitles, but L2 lines were processed significantly shorter than in captions. No significant relationship was found between the processing time and comprehension for either the L1 or L2 lines of bilingual subtitles. |
Ailian Wang; Jing Pan; Caihong Jiang; Jia Jin Create the best first glance: The cross-cultural effect of image background on purchase intention Journal Article In: Decision Support Systems, vol. 170, pp. 1–12, 2023. @article{Wang2023a, As globalization drives more firms toward cross-border e-commerce (CBEC), a well-designed decision support system becomes crucial to gain a competitive edge in the international market. Product images, a vital aspect of the system interface, play a significant role in shaping users' first impressions, facilitating seller-buyer information interaction, and ultimately enhancing users' decisions making in the system. Across a series of studies, this research investigates the effect of cultural differences (thinking style: holistic vs. analytic) on image background and reveals the underlying mechanism. Results show that online consumers from cultures characterized by holistic thinking style (Chinese sample) are more prone to purchase products presented with contextual backgrounds than those with white backgrounds, while this effect is absent for online consumers from cultures that tend to think in an analytic way (American sample). This effect is also observed when the thinking style is primed within the culture in separate samples from the United States and China. Study 3 employs eye-tracking technology and shows that holistic thinking, compared to analytic thinking, results in an asymmetry in cognitive effort to purchase the same products framed with contextual and white background images. Specifically, contextual (vs. white) background information greatly assists holistic thinking consumers in understanding the product, enabling them to spend less cognitive effort on product information processing. Instead, the cognitive effort that analytic thinking consumers spare in the product information is not affected by the background. Finally, we discuss theoretical contributions and practical insights for CBEC retailers and system designers that the findings indicate. |
Yingjia Wan; Yipu Wei; Baorui Xu; Liqi Zhu; Michael K. Tanenhaus Musical coordination affects children's perspective-taking, but musical synchrony does not Journal Article In: Developmental Science, pp. 1–13, 2023. @article{Wan2023, Perspective-taking, which is important for communication and social activities, can be cultivated through joint actions, including musical activities in children. We examined how rhythmic activities requiring coordination affect perspective-taking in a referential communication task with 100 Chinese 4- to 6-year-old children. In Study 1, 5- to 6-year-old children played an instrument with a virtual partner in one of three coordination conditions: synchrony, asynchrony, and antiphase synchrony. Eye movements were then monitored with the partner giving instructions to identify a shape referent which included a pre-nominal scalar adjective (e.g., big cubic block). When the target contrast (a small cubic block) was in the shared ground and a competitor contrast was occluded for the partner, participants who used perspective differences could, in principle, identify the intended referent before the shape was named. We hypothesized that asynchronous and antiphase synchronous musical activities, which require self- other distinction, might have stronger effects on perspective-taking than synchronous activity. Children in the asynchrony and antiphase synchrony conditions, but not the synchrony condition, showed anticipatory looks at the target, demonstrating real-time use of the partner's perspective. Study 2 was conducted to determine if asynchrony and antiphase asynchrony resulted in perspective-taking that otherwise would not have been observed, or if synchronous coordination inhibited perspective-taking that wouldotherwise have occurred. We found no evidence for online perspective-taking in 4-to 6-year-old children without music manipulation. Therefore, playing instruments asynchronously or in alternation, but not synchronously, increases perspective-taking in children of this age, likely by training self-other distinction and control. |
Yingjia Wan; Yipu Wei; Baorui Xu; Liqi Zhu; Michael K. Tanenhaus Musical coordination affects children's perspective-taking, but musical synchrony does not Journal Article In: Developmental Science, vol. 26, no. 5, pp. 1–13, 2023. @article{Wan2023a, Perspective-taking, which is important for communication and social activities, can be cultivated through joint actions, including musical activities in children. We examined how rhythmic activities requiring coordination affect perspective-taking in a referential communication task with 100 Chinese 4- to 6-year-old children. In Study 1, 5- to 6-year-old children played an instrument with a virtual partner in one of three coordination conditions: synchrony, asynchrony, and antiphase synchrony. Eye movements were then monitored with the partner giving instructions to identify a shape referent which included a pre-nominal scalar adjective (e.g., big cubic block). When the target contrast (a small cubic block) was in the shared ground and a competitor contrast was occluded for the partner, participants who used perspective differences could, in principle, identify the intended referent before the shape was named. We hypothesized that asynchronous and antiphase synchronous musical activities, which require self-other distinction, might have stronger effects on perspective-taking than synchronous activity. Children in the asynchrony and antiphase synchrony conditions, but not the synchrony condition, showed anticipatory looks at the target, demonstrating real-time use of the partner's perspective. Study 2 was conducted to determine if asynchrony and antiphase asynchrony resulted in perspective-taking that otherwise would not have been observed, or if synchronous coordination inhibited perspective-taking that would otherwise have occurred. We found no evidence for online perspective-taking in 4- to 6-year-old children without music manipulation. Therefore, playing instruments asynchronously or in alternation, but not synchronously, increases perspective-taking in children of this age, likely by training self-other distinction and control. A video abstract of this article can be viewed at https://youtu.be/TM9h_GpFlsA. Research Highlights: This study is the first to show that rhythmic coordination, a form of non-linguistic interaction, can affect children's performance in a subsequent linguistic task. Eye-movement data revealed that children's perspective-taking in language processing was facilitated by prior asynchronous and antiphase synchronous musical interactions, but not by synchronous coordination. The results challenge the common “similar is better” view, suggesting that maintaining self-other distinction may benefit social interactions that involve representing individual differences. |