EyeLink Reading and Language Eye-Tracking Publications
All EyeLink reading and language research publications up until 2023 (with some early 2024s) are listed below by year. You can search the publications using keywords such as Visual World, Comprehension, Speech Production, etc. You can also search for individual author names. If we missed any EyeLink reading or language articles, please email us!
2024 |
Lei Yuan; Miriam Novack; David Uttal; Steven Franconeri Language systematizes attention: How relational language enhances relational representation by guiding attention Journal Article In: Cognition, vol. 243, pp. 1–14, 2024. @article{Yuan2024, Language can affect cognition, but through what mechanism? Substantial past research has focused on how labeling can elicit categorical representation during online processing. We focus here on a particularly powerful type of language-relational language-and show that relational language can enhance relational representation in children through an embodied attention mechanism. Four-year-old children were given a color-location conjunction task, in which they were asked to encode a two-color square, split either vertically or horizontally (e.g., red on the left, blue on the right), and later recall the same configuration from its mirror reflection. During the encoding phase, children in the experimental condition heard relational language (e.g., "Red is on the left of blue"), while those in the control condition heard generic non-relational language (e.g., "Look at this one, look at it closely"). At recall, children in the experimental condition were more successful at choosing the correct relational representation between the two colors compared to the control group. Moreover, they exhibited different attention patterns as predicted by the attention shift account of relational representation (Franconeri et al., 2012). To test the sustained effect of language and the role of attention, during the second half of the study, the experimental condition was given generic non-relational language. There was a sustained advantage in the experimental condition for both behavioral accuracies and signature attention patterns. Overall, our findings suggest that relational language enhances relational representation by guiding learners' attention, and this facilitative effect persists over time even in the absence of language. Implications for the mechanism of how relational language can enhance the learning of relational systems (e.g., mathematics, spatial cognition) by guiding attention will be discussed. |
Monica Vanoncini; Stefanie Hoehl; Birgit Elsner; Sebastian Wallot; Natalie Boll-Avetisyan; Ezgi Kayhan Mother-infant social gaze dynamics relate to infant brain activity and word segmentation Journal Article In: Developmental Cognitive Neuroscience, vol. 65, pp. 1–8, 2024. @article{Vanoncini2024, The ‘social brain', consisting of areas sensitive to social information, supposedly gates the mechanisms involved in human language learning. Early preverbal interactions are guided by ostensive signals, such as gaze patterns, which are coordinated across body, brain, and environment. However, little is known about how the infant brain processes social gaze in naturalistic interactions and how this relates to infant language development. During free-play of 9-month-olds with their mothers, we recorded hemodynamic cortical activity of ´social brain` areas (prefrontal cortex, temporo-parietal junctions) via fNIRS, and micro-coded mother's and infant's social gaze. Infants' speech processing was assessed with a word segmentation task. Using joint recurrence quantification analysis, we examined the connection between infants' ´social brain` activity and the temporal dynamics of social gaze at intrapersonal (i.e., infant's coordination, maternal coordination) and interpersonal (i.e., dyadic coupling) levels. Regression modeling revealed that intrapersonal dynamics in maternal social gaze (but not infant's coordination or dyadic coupling) coordinated significantly with infant's cortical activity. Moreover, recurrence quantification analysis revealed that intrapersonal maternal social gaze dynamics (in terms of entropy) were the best predictor of infants' word segmentation. The findings support the importance of social interaction in language development, particularly highlighting maternal social gaze dynamics. |
H. Ershaid; M. Lizarazu; D. J. McLaughlin; M. Cooke; O. Simantiraki; M. Koutsogiannaki; M. Lallier Contributions of listening effort and intelligibility to cortical tracking of speech in adverse listening conditions Journal Article In: Cortex, vol. 172, pp. 54–71, 2024. @article{Ershaid2024, Cortical tracking of speech is vital for speech segmentation and is linked to speech intelligibility. However, there is no clear consensus as to whether reduced intelligibility leads to a decrease or an increase in cortical speech tracking, warranting further investigation of the factors influencing this relationship. One such factor is listening effort, defined as the cognitive resources necessary for speech comprehension, and reported to have a strong negative correlation with speech intelligibility. Yet, no studies have examined the relationship between speech intelligibility, listening effort, and cortical tracking of speech. The aim of the present study was thus to examine these factors in quiet and distinct adverse listening conditions. Forty-nine normal hearing adults listened to sentences produced casually, presented in quiet and two adverse listening conditions: cafeteria noise and re- verberant speech. Electrophysiological responses were registered with electroencephalogram, and listening effort was estimated subjectively using self-reported scores and objectively using pupillometry. Results indicated varying impacts of adverse conditions on intelligibility, listening effort, and cortical tracking of speech, depending on the preservation of the speech temporal envelope. The more distorted envelope in the reverberant condition led to higher listening effort, as reflected in higher subjective scores, increased pupil diameter, and stronger cortical tracking of speech in the delta band. These findings suggest that using measures of listening effort in addition to those of intelligibility is useful for interpreting cortical tracking of speech results. Moreover, reading and phonological skills of participants were positively correlated with listening effort in the cafeteria condition, suggesting a special role of expert language skills in processing speech in this noisy condition. Implications for future research and theories linking atypical cortical tracking of speech and reading disorders are further discussed. |
Ethan S. Bromberg-Martin; Yang-Yang Feng; Takaya Ogasawara; J. Kael White; Kaining Zhang; Ilya E. Monosov A neural mechanism for conserved value computations integrating information and rewards Journal Article In: Nature Neuroscience, vol. 27, pp. 1–17, 2024. @article{BrombergMartin2024, Behavioral and economic theory dictate that we decide between options based on their values. However, humans and animals eagerly seek information about uncertain future rewards, even when this does not provide any objective value. This implies that decisions are made by endowing information with subjective value and integrating it with the value of extrinsic rewards, but the mechanism is unknown. Here, we show that human and monkey value judgements obey strikingly conserved computational principles during multi-attribute decisions trading off information and extrinsic reward. We then identify a neural substrate in a highly conserved ancient structure, the lateral habenula (LHb). LHb neurons signal subjective value, integrating information's value with extrinsic rewards, and the LHb predicts and causally influences ongoing decisions. Neurons in key input areas to the LHb largely signal components of these computations, not integrated value signals. Thus, our data uncover neural mechanisms of conserved computations underlying decisions to seek information about the future. |
Maya Campbell; Nicole Oppenheimer; Alex L. White Severe processing capacity limits for sub-lexical features of letter strings Journal Article In: Attention, Perception, & Psychophysics, pp. 1–10, 2024. @article{Campbell2024, When reading, the visual system is confronted with many words simultaneously. How much of that information can a reader process at once? Previous studies demonstrated that low-level visual features of multiple words are processed in parallel, but lexical attributes are processed serially, for one word at a time. This implies that an internal bottleneck lies somewhere between early visual and lexical analysis. We used a dual-task behavioral paradigm to investigate whether this bottleneck lies at the stage of letter recognition or phonological decoding. On each trial, two letter strings were flashed briefly, one above and one below fixation, and then masked. In the letter identification experiment, participants indicated whether a vowel was present in a particular letter string. In the phonological decoding experiment, participants indicated whether the letter string was pronounceable. We compared accuracy in a focused attention condition, in which participants judged only one of the two strings, with accuracy in a divided attention condition, in which participants judged both strings independently. In both experiments, the cost of dividing attention was so large that it supported a serial model: participants were able to process only one letter string per trial. Furthermore, we found a stimulus processing trade-off that is characteristic of serial processing: When participants judged one string correctly, they were less likely to judge the other string correctly. Therefore, the bottleneck that constrains word recognition under these conditions arises at a sub-lexical level, perhaps due to a limit on the efficiency of letter recognition. |
Sara Milligan; Elizabeth R. Schotter Do readers here what they sea?: Effects of lexicality, predictability, and individual differences on the phonological preview benefit Journal Article In: Journal of Memory and Language, vol. 135, pp. 1–14, 2024. @article{Milligan2024, For decades, researchers have debated whether readers benefit from translating visual word forms into phonological codes. A focus of this debate has been on the earliest moments of processing when a word is perceived in parafoveal vision (i.e., phonological preview benefit). A recent meta-analysis (Vasilev et al., 2019) concluded that the phonological preview benefit may be small and unreliable but they did not take into account potentially important stimulus-level or participant-level factors that varied across the included studies. Therefore, we conducted two well-powered experiments that systematically investigated the effects of sentence constraint, preview lexicality, and participant language skills on the phonological preview benefit effect. We found phonological preview benefits that were larger in high versus low constraint sentences, larger for words than pseudowords, and larger for better spellers. We conclude that phonological codes do facilitate early word recognition during reading, but that the phonological preview benefit magnitude depends on subject- and stimulus-level factors. |
Sarah C. Creel; Conor I. Frye Minimal gains for minimal pairs: Difficulty in learning similar-sounding words continues into preschool Journal Article In: Journal of Experimental Child Psychology, vol. 240, pp. 1–27, 2024. @article{Creel2024, A critical indicator of spoken language knowledge is the ability to discern the finest possible distinctions that exist between words in a language—minimal pairs, for example, the distinction between the novel words beesh and peesh. Infants differentiate similar-sounding novel labels like “bih” and “dih” by 17 months of age or earlier in the context of word learning. Adult word learners readily distinguish similar-sounding words. What is unclear is the shape of learning between infancy and adulthood: Is there a nonlinear increase early in development, or is there protracted improvement as experience with spoken language amasses? Three experiments tested monolingual English-speaking children aged 3 to 6 years and young adults. Children underperformed when learning minimal-pair words compared with adults (Experiment 1), compared with learning dissimilar words even when speech materials were optimized for young children (Experiment 2), and when the number of word instances during learning was quadrupled (Experiment 3). Nonetheless, the youngest group readily recognized familiar minimal pairs (Experiment 3). Results are consistent with a lengthy trajectory for detailed sound pattern learning in one's native language(s), although other interpretations are possible. Suggestions for research on developmental trajectories across various age ranges are made. |
Scott P. Ardoin; Katherine S. Binder; Paulina A. Kulesz; Eloise Nimocks; Joshua A. Mellott Examining the influence of passage and student characteristics on test-taking strategies: An eye-tracking study Journal Article In: Learning and Individual Differences, vol. 109, pp. 1–12, 2024. @article{Ardoin2024, Understanding test-taking strategies (TTSs) and the variables that influence TTSs is crucial to understanding what reading comprehension tests measure. We examined how passage and student characteristics were associated with TTSs and their impact on response accuracy. Third (n = 78), fifth (n = 86), and eighth (n = 86) graders read and answered questions associated with six passages. Eye-movement records were used to code TTSs. Results indicated that TTS choice was related to passage and student characteristics. Passage characteristics that make comprehension more difficult resulted in more students choosing a TTS that did not involve reading passages in their entirety before answering questions. TTSs encompassing reading passages in their entirety before answering questions resulted in higher accuracy for 5th and 8th graders. Understanding TTS choices can aid our understanding of the processes measured by reading comprehension tests, what TTS should be encouraged, and what contributes to tests producing different outcomes. Educational relevance statement Schools spend considerable time and money collecting and interpreting the outcomes of reading comprehension tests. To truly understand what these test results mean, we must understand what students are doing when taking reading comprehension tests. Furthermore, we need to know to what extent certain tests and student characteristics might be associated with test-taking strategies that avoid reading passages for comprehension. Finally, teachers need to know whether certain test-taking strategies might positively or negatively impact response accuracy to know what strategies to teach and not to teach. The current study was designed to provide answers relevant to these important educational matters. |
Amanda H. Seidl; Michelle Indarjit; Arielle Borovsky Touch to learn: Multisensory input supports word learning and processing Journal Article In: Developmental Science, vol. 27, no. 1, pp. 1–20, 2024. @article{Seidl2024, Infants experience language in rich multisensory environments. For example, they may first be exposed to the word applesauce while touching, tasting, smelling, and seeing applesauce. In three experiments using different methods we asked whether the number of distinct senses linked with the semantic features of objects would impact word recognition and learning. Specifically, in Experiment 1 we asked whether words linked with more multisensory experiences were learned earlier than words linked fewer multisensory experiences. In Experiment 2, we asked whether 2-year-olds' known words linked with more multisensory experiences were better recognized than those linked with fewer. Finally, in Experiment 3, we taught 2-year-olds labels for novel objects that were linked with either just visual or visual and tactile experiences and asked whether this impacted their ability to learn the new label-to-object mappings. Results converge to support an account in which richer multisensory experiences better support word learning. We discuss two pathways through which rich multisensory experiences might support word learning. |
Adi Shechter; Sivan Medina; David L. Share; Amit Yashar In: Cortex, vol. 171, pp. 319–329, 2024. @article{Shechter2024, Peripheral letter recognition is fundamentally limited not by the visibility of letters but by the spacing between them, i.e., ‘crowding'. Crowding imposes a significant constraint on reading, however, the interplay between crowding and reading is not fully understood. Using a letter recognition task in varying display conditions, we investigated the effects of lexicality (words versus pseudowords), visual hemifield, and transitional letter probability (bigram/trigram frequency) among skilled readers (N = 14. and N = 13) in Hebrew – a script read from right to left. We observed two language-universal effects: a lexicality effect and a right hemifield (left hemisphere) advantage, as well as a strong language-specific effect – a left bigram advantage stemming from the right-to-left reading direction of Hebrew. The latter finding suggests that transitional probabilities are essential for parafoveal letter recognition. The results reveal that script-specific contextual information such as letter combination probabilities is used to accurately identify crowded letters. |
Victor Kuperman; Sascha Schroeder; Daniil Gnetov Word length and frequency effects on text reading are highly similar in 12 alphabetic languages Journal Article In: Journal of Memory and Language, vol. 135, pp. 1–15, 2024. @article{Kuperman2024, Reading research robustly finds that shorter and more frequent words are recognized faster and skipped more often than longer and less frequent words. An empirical question that has not been tested yet is whether languages within the same writing system would produce similarly strong length and frequency effects or whether typological differences between written languages would cause those effects to vary systematically in their magnitude. We analyzed text reading eye-movement data in 12 alphabetic languages from the Multilingual Eye-Movement Corpus (MECO). The languages varied substantially in their word length and frequency distributions as a function of their orthographic depth and morpho-syntactic type. Yet, the effects of word length and frequency on fixation durations and skipping rate were highly similar in size between the languages. This finding suggests a high degree of cross-linguistic universality in the readers' behavioral response to linguistic complexity (indexed by word length) and the amount of experience with the word (indexed by word frequency). These findings run counter to influential theories of single word recognition, which predict orthographic depth of a language to modulate the size of these benchmark effects. They also facilitate development of cross-linguistically generalizable computational models of eye-movement control in reading. |
Marianna Kyriacou Not batting an eye: Figurative meanings of L2 idioms do not interfere with literal uses Journal Article In: Languages, vol. 9, no. 32, pp. 1–15, 2024. @article{Kyriacou2024, Encountering idioms (hit the sack = “go to bed”) in a second language (L2) often results in a literal-first understanding (“literally hit a sack”). The figurative meaning is retrieved later, subject to idiom familiarity and L2 proficiency, and typically at a processing cost. Intriguingly recent findings report the overextension of idiom use in inappropriate contexts by advanced L2 users, with greater L2 proficiency somewhat mitigating this effect. In this study, we tested the tenability of this finding by comparing eye-movement patterns for idioms used literally, vs. literal control phrases (hit the dirt) in an eye-tracking-while-reading paradigm. We hypothesised that if idiom overextension holds, processing delays should be observed for idioms, as the (over)activated but contextually irrelevant figurative meanings would cause interference. In contrast, unambiguous control phrases should be faster to process. The results demonstrated undifferentiated processing for idioms used literally and control phrases across measures, with L2 proficiency affecting both similarly. Therefore, the findings do not support the hypothesis that advanced L2 users overextend idiom use in inappropriate contexts, nor that L2 proficiency modulates this tendency. The results are also discussed in light of potential pitfalls pertaining to idiom priming under typical experimental settings. WABBLE: |
Michela Redolfi; Chiara Melloni Processing adjectives in development: Evidence from eye-tracking Journal Article In: Journal of Child Language, pp. 1–24, 2024. @article{Redolfi2024, Combining adjective meaning with the modified noun is particularly challenging for children under three years. Previous research suggests that in processing noun-adjective phrases children may over-rely on noun information, delaying or omitting adjective interpretation. However, the question of whether this difficulty is modulated by semantic differences among (subsective) adjectives is underinvestigated. A visual-world experiment explores how Italian-learning children (N=38, 2;4–5;3) process noun-adjective phrases and whether their processing strategies adapt based on the adjective class. Our investigation substantiates the proficient integration of noun and adjective semantics by children. Nevertheless, alligning with previous research, a notable asymmetry is evident in the interpretation of nouns and adjectives, the latter being integrated more slowly. Remarkably, by testing toddlers across a wide age range, we observe a developmental trajectory in processing, supporting a continuity approach to children's development. Moreover, we reveal that children exhibit sensitivity to the distinct interpretations associated with each subsective adjective. |
Jukka Hyönä; Lei Cui; Timo T. Heikkilä; Birgitta Paranko; Yun Gao; Xingzhi Su Reading compound words in Finnish and Chinese: An eye-tracking study Journal Article In: Journal of Memory and Language, vol. 134, pp. 1–16, 2024. @article{Hyoenae2024, Two eye-tracking experiments in alphabetic Finnish and two in logographic Chinese examined the recognition of two-constituent compound words in reading. In Finnish, two-constituent compound words vary greatly in length, whereas in Chinese they are identical in length. According to the visual acuity principle (Bertram & Hyönä, 2003), short Finnish compound words and all two-character Chinese compound words that fit in foveal vision are recognized holistically, whereas long Finnish compound words are recognized via components. Experiment 1 in Finnish provided evidence consistent with the account, whereas the results for long compound words presented in condensed font in Experiment 2 were inconsistent with it. In Chinese, the first-character frequency effect was non-significant even when the compound words were presented in large font. The Finnish results suggest that componential processing is necessary when the compound word entails more than 10 letters. The Chinese results are compatible with the Chinese Reading Model (Li & Pollatsek, 2020) that assumes whole-word representations to overrule the activation of components during compound word recognition. |
Aine Ito; Huong Thi Thu Nguyen; Pia Knoeferle German-dominant Vietnamese heritage speakers use semantic constraints of German for anticipation during comprehension in Vietnamese Journal Article In: Bilingualism: Language and Cognition, vol. 27, pp. 57–74, 2024. @article{Ito2024, To test effects of German on anticipation in Vietnamese, we recorded eye-movements during comprehension and manipulated i) verb constraints (different vs. similar in German and Vietnamese) and ii) classifier constraints (absent in German). In each of two experiments, participants listened to Vietnamese sentences like "Mai mac mot chic áo."('Mai wears a [classifier] shirt.'), while viewing four objects. Between experiments, we contrasted bilingual background: L1 Vietnamese-L2 German late bilinguals (Experiment 1) and heritage speakers of Vietnamese in Germany (Experiment 2). Both groups anticipated verb-compatible and classifier-compatible objects upon hearing the verb/classifier. However, when the (verb) constraints differed (e.g., Vietnamese: mac 'wear (a shirt/#earrings)' - German: tragen 'wear (a shirt/earrings)'), the heritage speakers were distracted by the object (earrings) compatible with the German (but not the Vietnamese) verb constraints. These results demonstrate that competing information in the two languages can interfere with anticipation in heritage speakers. |
Simon P. Liversedge; Henri Olkoniemi; Chuanli Zang; Xin Li; Guoli Yan; Xuejun Bai; Jukka Hyönä Universality in eye movements and reading: A replication with increased power Journal Article In: Cognition, vol. 242, pp. 1–19, 2024. @article{Liversedge2024, Liversedge, Drieghe, Li, Yan, Bai and Hyönä (2016) reported an eye movement study that investigated reading in Chinese, Finnish and English (languages with markedly different orthographic characteristics). Analyses of the eye movement records showed robust differences in fine grained characteristics of eye movements between languages, however, overall sentence reading times did not differ. Liversedge et al. interpreted the entire set of results across languages as reflecting universal aspects of processing in reading. However, the study has been criticized as being statistically underpowered (Brysbaert, 2019) given that only 19–21 subjects were tested in each language. Also, given current best practice, the original statistical analyses can be considered to be somewhat weak (e.g., no inclusion of random slopes and no formal comparison of performance between the three languages). Finally, the original study did not include any formal statistical model to assess effects across all three languages simultaneously. To address these (and some other) concerns, we tested at least 80 new subjects in each language and conducted formal statistical modeling of our data across all three languages. To do this, we included an index that captured variability in visual complexity in each language. Unlike the original findings, the new analyses showed shorter total sentence reading times for Chinese relative to Finnish and English readers. The other main findings reported in the original study were consistent. We suggest that the faster reading times for Chinese subjects occurred due to cultural changes that have taken place in the decade or so that lapsed between when the original and current subjects were tested. We maintain our view that the results can be taken to reflect universality in aspects of reading and we evaluate the claims regarding a lack of statistical power that were levelled against the original article. |
Siqi Lyu; Jung-Yueh Tu; Chien-Jer Charles Lin Structural position affects topic transition: An eye tracking study Journal Article In: Language and Linguistics, vol. 25, no. 1, pp. 56–79, 2024. @article{Lyu2024, In an eye-tracking study, we used Chinese double-subject construction [NPa NPb PREDICATE] (e.g., [nage jiezhi]NPa [sheji]NPb [hen tebie]PREDICATE ‘that ring design very special') in a concessive construction like suiran…dan… ‘although…but…' to investigate how the syntactic position of the topic NP (i.e., that ring) affects the comprehension of topic transition in the subsequent clause. We contrasted topics located at a higher pre-connective topic position (e.g., that ring although) and those located at a post-connective subject position (e.g., although that ring). Topic transition was manipulated as either using a subtopic (e.g., workmanship of that ring) or a new topic (e.g., the wedding dress) in the second clause of concession. We found a main effect of topic transition in a batch ofeye-movement measures showing that subtopic transition was preferred over new-topic transition. More importantly, we found interactions on total reading time and total fixations at the topic-suiran region and on total fixations at the post-critical region, with post hoc tests revealing a larger cost of topic transition in the high-topic condition than in the low-topic condition. The results suggest that when a topic NP is located at a higher topic position (i.e., above the connective), it binds the topics of both clauses and induces greater cost when the topics do not form a consistent chain. When the topic NP is located at a local (i.e., post-connective) position, the processing of topic shift or resolution of topic conflict in the second clause is less costly because the second topic is not syntactically bound by the higher topic. Together, the results support a prominent status of the before-connective position in Chinese discourse. Furthermore, they indicate that syntactically induced topicality constrains the processing of topic transition in the subsequent discourse. |
2023 |
Chuanli Zang; Zhichao Zhang; Manman Zhang; Federica Degno; Simon P. Liversedge; Zhang Manman; Federica Degno; Simon P. Liversedge Examining semantic parafoveal-on-foveal effects using a Stroop boundary paradigm Journal Article In: Journal of Memory and Language, vol. 128, pp. 1–14, 2023. @article{Zang2023, The issue of whether lexical processing occurs serially or in parallel has been a central and contentious issue in respect of models of eye movement control in reading for well over a decade. A critical question in this regard concerns whether lexical parafoveal-on-foveal effects exist in reading. Because Chinese is an unspaced and densely packed language, readers may process parafoveal words to a greater extent than they do in spaced alphabetic languages. In two experiments using a novel Stroop boundary paradigm (Rayner, 1975), participants read sentences containing a single-character color-word whose preview was manipulated (identity or pseudocharacter, printed in black [no-color], or in a color congruent or incongruent with the character meaning). Two boundaries were used, one positioned two characters before the target and one immediately to the left of the target. The previews changed from black to color and then back to black as the eyes crossed the first and then the second boundary respectively. In Experiment 1 four color-words (red, green, yellow and blue) were used and in Experiment 2 only red and green color-words were used as targets. Both experiments showed very similar patterns such that reading times were increased for colored compared to no-color previews indicating a parafoveal visual interference effect. Most importantly, however, there were no robust interactive effects. Preview effects were comparable for congruent and incongruent color previews at the pretarget region when the data were combined from both experiments. These results favour serial processing accounts and indicate that even under very favourable experimental conditions, lexical semantic parafoveal-on-foveal effects are minimal. |
Yushu Wu; Chunyu Kit Hong Kong Corpus of Chinese Sentence and Passage Reading Journal Article In: Scientific Data, vol. 10, no. 1, pp. 1–13, 2023. @article{Wu2023e, Recent years have witnessed a mushrooming of reading corpora that have been built by means of eye tracking. This article showcases the Hong Kong Corpus of Chinese Sentence and Passage Reading (HKC for brevity), featured by a natural reading of logographic scripts and unspaced words. It releases 28 eye-movement measures of 98 native speakers reading simplified Chinese in two scenarios: 300 one-line single sentences and 7 multiline passages of 5,250 and 4,967 word tokens, respectively. To verify its validity and reusability, we carried out (generalised) linear mixed-effects modelling on the capacity of visual complexity, word frequency, and reading scenario to predict eye-movement measures. The outcomes manifest significant impacts of these typical (sub)lexical factors on eye movements, replicating previous findings and giving novel ones. The HKC provides a valuable resource for exploring eye movement control; the study contrasts the different scenarios of single-sentence and passage reading in hopes of shedding new light on both the universal nature of reading and the unique characteristics of Chinese reading. |
Xinyi Xia; Yanping Liu; Lili Yu; Erik D. Reichle Are there preferred viewing locations in Chinese reading? Evidence from eye-tracking and computer simulations Journal Article In: Journal of Experimental Psychology: Learning, Memory, and Cognition, vol. 49, no. 4, pp. 607–625, 2023. @article{Xia2023b, The Chinese writing system is different from English in that individual words both comprise one to four characters and are not separated by clear word boundaries (e.g., interword spaces). These differences raise the question of how readers of Chinese know where to move their eyes to support efficient lexical processing? The widely accepted default-targeting hypothesis suggests that Chinese readers direct their eyes to a small number of preferred-viewing locations (PVLs), such as the beginning or middle of upcoming words. In this article, we report two eye-movement experiments testing this hypothesis. In both experiments, participants read sentences comprising entirely two-character words, but either without (Experiment 1) or with (Experiment 2) explicit knowledge of this structure prior to their participation. The results of both experiments indicate the absence of PVLs. Simulations using implemented versions of a simple oculomotor-based hypothesis, two variants of the default-targeting hypothesis, and the hypothesis that saccade lengths are modulated as a function of estimated parafoveal-processing difficulty (i.e., dynamic-adjustment hypothesis) suggest that the latter provides the best account of saccadictargeting during Chinese reading. These results are discussed in relation to broader issues of eye-movement control during reading and how models of such must be modified to provide more accurate accounts of the reading of Chinese and other languages |
Xue-Zhen Xiao; Gaoding Jia; Aiping Wang Semantic preview benefit of Tibetan-Chinese bilinguals during Chinese reading Journal Article In: Language Learning and Development, vol. 19, no. 1, pp. 1–15, 2023. @article{Xiao2023a, When reading Chinese, skilled native readers regularly gain a preview benefit (PB) when the parafoveal word is orthographically or semantically related to the target word. Evidence shows that non-native, beginning Chinese readers can obtain an orthographic PB during Chinese reading, which indicates the parafoveal processing of low-level visual information. However, whether non-native Chinese readers who are more proficient in Chinese can make use of high-level parafoveal information remains unknown. Therefore, this study examined parafoveal processing during Chinese reading among Tibetan-Chinese bilinguals with high Chinese proficiency and compared their PB effects with those from native Chinese readers. Tibetan-Chinese bilinguals demonstrated both orthographic and semantic PB but did not show phonological PB and only differed from native Chinese in the identical PB when preview characters were identical to the targets. These findings demonstrate that non-native Chinese readers can extract semantic information from parafoveal preview during Chinese reading and highlight the modulation of parafoveal processing efficiency by reading proficiency. The results are in line with the direct route to access the mental lexicon of visual Chinese characters among non-native Chinese speakers. |
Jianping Xiong; Lili Yu; Aaron Veldre; Erik D. Reichle; Sally Andrews A multitask comparison of word- and character-frequency effects in Chinese reading Journal Article In: Journal of Experimental Psychology: Learning, Memory, and Cognition, vol. 49, no. 5, pp. 793–811, 2023. @article{Xiong2023, In this study, we examined the effects of word and character frequency across three commonly used word-identification tasks (lexical decision, naming, and sentence reading) using the same set of twocharacter target words (N = 60) and participants (N = 82). Facilitatory effects of word frequency were observed across all three tasks. The character-frequency effects, however, were facilitatory for naming but inhibitory for both lexical decision and reading. Further correlational analyses indicated that participants' performance (as measured using overall response latencies and the sizes of the frequency effects) was not consistent across tasks but was relatively reliable within the lexical-decision and reading tasks. These findings are discussed in relation to what is known about the reading of Chinese versus alphabetic scripts, word-identification tasks, and models of word identification. |
Kunyu Xu; Yu-Min Ku; Chenlu Ma; Chien-Hui Lin; Wan-Chen Chang Development of comprehension monitoring skill in Chinese children: Evidence from eye movement and probe interviews Journal Article In: Metacognition and Learning, pp. 1–19, 2023. @article{Xu2023, As an important construct in the cognitive process, comprehension monitoring has received much scholarly attention. Researchers have recognized comprehension monitoring as an ability closely linked with children's reading comprehension ability and working memory capacity. Evidence is also abundant to prove that comprehension monitoring skill develops with age. It remains unclear, however, how these factors interact during reading, particularly in low-grade children. Many previous empirical studies have only employed online or offline measurements to examine children's monitoring performance, which might lead to unsolid conclusions. In this study, we utilized both online eye-tracking measures and offline probe interviews to quantify the developmental features (i.e., evaluation and regulation) of comprehension monitoring skills among Chinese beginning readers. The results indicated that the comprehension monitoring performance, as quantified by eye-tracking measures, was positively related to their reading comprehension ability and working memory capacity. Moreover, the first-graders' performances lacked online regulation skills during the error-detecting tasks, while second-graders had relatively developed online monitoring performance. Additionally, the eye-tracking measures were found as a predictor for children's performances in probe interviews, as the readers with high comprehension ability and working memory capacity successfully reported more errors embedded in the self-designed reading materials. Therefore, the findings support the claim that children's comprehension monitoring is a developing skill associated with reading comprehension and working memory capacity and further question the existence of comprehension monitoring skills in beginning readers, especially first-graders. |
Licheng Xue; Ying Xiao; Tianying Qing; Urs Maurer; Wei Wang; Huidong Xue; Xuchu Weng; Jing Zhao Attention to the fine-grained aspect of words in the environment emerges in preschool children with high reading ability Journal Article In: Visual Cognition, vol. 31, no. 1, pp. 85–96, 2023. @article{Xue2023, Attention to words is closely related to the process of learning to read. However, it remains unclear how attention to words in environmental print (such as words on product labels) is changed with the growth of preschool children's reading ability. We thus used eye tracking technique to compare attention to words in environmental print in children at low (32, 15 males, 5.12 years) and high (32, 17 males, 5.16 years) reading levels during a free viewing task. To characterize which aspects of visual word form children attend to, we constructed three types of stimuli embedded in the same context: words in environment print, symbol strings (similar shape to words but without strokes), and character strings (comparable with words in the number of strokes and the structures). We observed that children at both reading levels showed lower percentages of fixations and fixation time in words relative to symbol strings, suggesting they start to attend to the coarse aspect of visual word form. Interestingly, only children at higher reading level showed lower percentages of fixations and fixation time for words relative to character strings, suggesting that attention to the fine-grained aspect of visual word form emerged, and was closely to reading ability. |
Shuwei Xue; Jana Lüdtke; Arthur M. Jacobs Once known, twice hedonic: Enjoying Shakespeare's sonnets through rereading-a deep learning perspective Journal Article In: Psychology of Aesthetics, Creativity, and the Arts, pp. 1–14, 2023. @article{Xue2023a, Reading poetry is a popular hobby, but what does it involve in terms of the mind? Through quantitative nar- rative analysis, we computed seven surface features and two affective–semantic features of Shakespeare's sonnets and then added them to predict readers' eye movements during reading. Using the neural nets model, we found that the gaze duration, the regression time, the total reading time, and the fixation probability all depended mainly on surface features, no matter how often a poem was read. We also found that word-based valence and arousal were important as well and became more important in the course of repeated readings. In the last reading, valence became as important as the main surface features. Findings imply that the first impression of a poem is due mainly to surface features but then becomes enriched by meaning and mood. |
Ming Yan; Yingyi Luo; Jinger Pan Monolingual and bilingual phonological activation in Cantonese Journal Article In: Bilingualism: Language and Cognition, vol. 26, no. 4, pp. 751–761, 2023. @article{Yan2023, Previous research has provided evidence for cross-language phonological activation during visual word recognition. However, such findings mainly came from alphabetic languages, and readers' familiarity with the two scripts might differ. The present study aimed to test whether such cross-language phonological activation can be observed in Chinese, a logographic script, without the confounding factor of script familiarity as readers read the same script in different languages. Cantonese–Mandarin bilinguals were tested in an eye-tracking experiment in which they were instructed to read sentences silently. A target word in the sentence was replaced by either a homophone in both Cantonese and Mandarin, a homophone in Cantonese or in Mandarin only, or an unrelated character. The results showed that native Cantonese readers could activate phonological representations of L1 and L2 while reading Chinese sentences silently. However, the degree to which they relied on phonological decoding in L1 and L2 varied in the two languages. |
Ming Yan; Jinger Pan Joint effects of individual reading skills and word properties on Chinese children's eye movements during sentence reading Journal Article In: Scientific Reports, vol. 13, no. 1, pp. 1–10, 2023. @article{Yan2023a, Word recognition during the reading of continuous text has received much attention. While a large body of research has investigated how linguistic properties of words affect eye movements during reading, it remains to be established how individual differences in reading skills affect momentary cognitive processes during sentence reading among typically developing Chinese readers. The present study set out to test the joint influences of word properties and individual reading skills on eye movements during reading among Chinese children. We recorded eye movements of 30 grade 3 (G3) children and 27 grade 5 (G5) children when they read sentences silently for comprehension. Predictors of linear mixed models included word frequency, visual complexity, and launch site distance, in addition to the participants' offline psychometric performances in rapid naming, morphological awareness, word segmenting, and character recognition. The results showed that word properties affected word recognition during sentence reading in both G3 and G5 children. Moreover, word segmenting predicted the G3 children's fixation durations and the G5 children's fixation location, whereas rapid naming predicted the G5 children's fixation duration. Implications are discussed based on the current findings, in light of how different literacy skills contribute to reading development. |
Panpan Yao; David Hall; Hagit Borer; Linnaea Stockall Dutch–Mandarin learners' online use of syntactic cues to anticipate mass vs. count interpretations Journal Article In: Second Language Research, pp. 1–38, 2023. @article{Yao2023b, It remains unclear whether late second language learners (L2ers) can acquire sufficient knowledge about unique-to-L2 constructions through implicit learning to build anticipations during real-time processing. To tackle this question, we conducted a visual world paradigm experiment to investigate high-proficiency late first-language Dutch second-language Mandarin Chinese learners' online processing of syntactic cues to count vs. mass interpretations in Chinese which are unique-to-L2 and never explicitly taught. The results showed that late Dutch–Mandarin learners were sensitive to a mass-biased syntactic cue in real-time processing, and exhibited some native-like anticipatory behaviour. These findings indicate that late L2ers can acquire unique-to-L2 constructions through implicit learning, and can automatically use this knowledge to make predictions. |
Panpan Yao; Xin Jiang; Xinwei Chen; Xingshan Li Explore the processing unit of L2 Chinese learners in on-line Chinese reading Journal Article In: Second Language Research, pp. 1–17, 2023. @article{Yao2023c, The present study explored the processing units of high-proficiency second language (L2) Chinese learners in on-line reading in an eye-tracking experiment. The critical aim was to investigate how learners segment continuous characters into words without the aid of word boundary demarcations. Based on previous studies, the embedded words of 2- and 3-character incremental words were manipulated to be either plausible or implausible with the preceding verbs, while the incremental words themselves were always plausible. The results revealed an effect of the plausibility manipulation, which suggested that L2 Chinese learners activated embedded words first and integrated embedded words with previous sentence context as soon as they read them. |
Yao Yao; Katrina Connell; Stephen Politzer-Ahles Hearing emotion in two languages : A pupillometry study of Cantonese – Mandarin bilinguals ' perception of affective cognates in L1 and L2 Journal Article In: Bilingualism: Language and Cognition, pp. 1–14, 2023. @article{Yao2023, Differential affective processing has been widely documented for bilinguals: L1 affective words elicit higher levels of arousal and stronger emotionality ratings than L2 affective words (Pavlenko, 2012). In this study, we focus on two closely related Chinese languages, Mandarin and Cantonese, whose affective lexicons are highly overlapping, with shared lexical items that only differ in pronunciation across languages. We recorded L1 Cantonese – L2 Mandarin bilinguals' pupil responses to auditory tokens of Cantonese and Mandarin affective words. Our results showed that Cantonese–Mandarin bilinguals had stronger pupil responses when the affective words were pronounced in Cantonese (L1) than when the same words were pronounced in Mandarin (L2). The effect was most evident in taboo words and among bilinguals with lower L2 proficiency. We discuss the theoretical implications of the findings in the frameworks of exemplar theory and models of the bilingual lexicon. © |
Michael C. W. Yip Tracking the time-course of spoken word recognition of Cantonese Chinese in sentence context: Evidence from eye movements Journal Article In: Psychonomic Bulletin & Review, pp. 1–11, 2023. @article{Yip2023, In this study, we conducted an eye-tracking experiment to investigate the effects of sentence context and tonal information on spoken word recognition processes in Cantonese Chinese. We recruited 60 native Cantonese listeners to participate in the eye-tracking experiment. The target words (phonologically similar words) were manipulated to either (1) a congruent context or (2) an incongruent context in the experiment. The resulting eye-movement patterns in the incongruent context condition clearly revealed that (1) sentence context produced a garden-path effect in the initial stage of the spoken word recognition processes and then (2) the lexical tone of the word (bottom-up information) overrode the contextual effects to help listeners to discriminate between different similar-sounding words during lexical access. In conclusion, the patterns of eye-tracking data show the interactive processes between the lexical tone (an acoustic cue within a Cantonese word) and sentence context played in different phases to the spoken word recognition of Cantonese Chinese. |
Haojue Yu; Miyoung Kwon Central and peripheral visual field examination Journal Article In: Investigative Ophthalmology & Visual Science, vol. 64, no. 13, pp. 1–14, 2023. @article{Yu2023, PURPOSE. Although foveal vision provides fine spatial information, parafoveal and peripheral vision are also known to be important for efficient reading behaviors. Here we systematically investigate how different types and sizes of visual field defects affect the way visual information is acquired via eye movements during reading. METHODS. Using gaze-contingent displays, simulated scotomas were induced in 24 adults with normal or corrected-to-normal vision during a reading task. The study design included peripheral and central scotomas of varying sizes (aperture or scotoma size of 2°, 4°, 6°, 8°, and 10°) and no-scotoma conditions. Eye movements (e.g., forward/backward saccades, fixations, microsaccades) were plotted as a function of either the aperture or scotoma size, and their relationships were characterized by the best fitting model. RESULTS. When the aperture size of the peripheral scotoma decreased below 6° (11 visible letters), there were significant decreases in saccade amplitude and velocity, as well as substantial increases in fixation duration and the number of fixations. Its dependency on the aperture size is best characterized by an exponential decay or growth function in log-linear coordinates. However, saccade amplitude and velocity, fixation duration, and forward/regressive saccades increased more or less linearly with increasing central scotoma size in log-linear coordinates. CONCLUSIONS. Our results showed differential impacts of central and peripheral vision loss on reading behaviors while lending further support for the importance of foveal and parafoveal vision in reading. These apparently deviated oculomotor behaviors may in part reflect optimal reading strategies to compensate for the loss of visual information. |
Tania S. Zamuner; Theresa Rabideau; Margarethe McDonald; H. Henny Yeung Developmental change in children's speech processing of auditory and visual cues: An eyetracking study Journal Article In: Journal of Child Language, vol. 50, pp. 27–51, 2023. @article{Zamuner2023, This study investigates how children aged two to eight years (N = 129) and adults (N = 29) use auditory and visual speech for word recognition. The goal was to bridge the gap between apparent successes of visual speech processing in young children in visual-looking tasks, with apparent difficulties of speech processing in older children from explicit behavioural measures. Participants were presented with familiar words in audio-visual (AV), audio-only (A-only) or visual-only (V-only) speech modalities, then presented with target and distractor images, and looking to targets was measured. Adults showed high accuracy, with slightly less target-image looking in the V-only modality. Developmentally, looking was above chance for both AV and A-only modalities, but not in the V-only modality until 6 years of age (earlier on /k/-initial words). Flexible use of visual cues for lexical access develops throughout childhood. |
Chuanli Zang; Ying Fu; Hong Du; Xuejun Bai; Guoli Yan; Simon P. Liversedge Processing multiconstituent units: Preview effects during reading of Chinese words, idioms, and phrases Journal Article In: Journal of Experimental Psychology: Learning, Memory, and Cognition, pp. 1–21, 2023. @article{Zang2023a, Arguably, the most contentious debate in the field of eye movement control in reading has centered on whether words are lexically processed serially or in parallel during reading. Chinese is character-based and unspaced, meaning the issue of how lexical processing is operationalized across potentially ambiguous, multicharacter strings is not straightforward. We investigated Chinese readers' processing of frequently occurring multiconstituent units (MCUs), that is, linguistic units composed of more than a single word, that might be represented lexically as a single representation. In Experiment 1, we manipulated the linguistic category of a two-constituent Chinese string (word, MCU, or phrase) and the preview of its second constituent (identical or pseudocharacter) using the boundary paradigm with the boundary located before the twoconstituent string. A robust preview effect was obtained when the second constituent, alongside the first, formed a word or MCU, but not a phrase, suggesting that frequently occurring MCUs are lexicalized and processed parafoveally as single units during reading. In Experiment 2, we further manipulated the phrase type of a two-constituent but three-character Chinese string (idiom with a one-character modifier and a twocharacter noun, or matched phrase) and the preview of the second constituent noun (identity or pseudocharacter). A greater preview effect was obtained for idioms than phrases, indicating that idioms are processed to a greater extent in the parafovea than matched phrases. Together, the results of these two experiments suggest that lexical identification processes in Chinese can be operationalized over linguistic units that are larger than an individual word. |
Andrea M. Zawoyski; Scott P. Ardoin; Katherine S. Binder The impact of test-taking strategies on eye movements of elementary students during reading comprehension assessment Journal Article In: School Psychology, vol. 38, no. 1, pp. 59–66, 2023. @article{Zawoyski2023, Teachers often encourage students to use test-taking strategies during reading comprehension assessments, but these strategies are not always evidence-based. One common strategy involves teaching students to read the questions before reading an associated passage. Research findings comparing the passage-first (PF) and questions-first (QF) strategies are mixed. The present study employed eye-tracking technology to record 84 third and fourth-grade participants' eye movements (EMs) as they read a passage and responded to multiple-choice (MC) questions using PF and QF strategies in a within-subject design. Although there were no significant differences between groups in accuracy on MC questions, EM measures revealed that the PF condition was superior to the QF condition for elementary readers in terms of efficiency in reading and responding to questions. These findings suggest that the PF strategy supports a more comprehensive understanding of the text. Ultimately, within the PF condition, students required less time to obtain the same accuracy outcomes they attained when reading in the QF condition. School psychologists can improve reading comprehension instruction by encouraging the importance of teaching children to gain meaning from the text rather than search the passage for answers to MC questions |
Nina Zdorova; Svetlana Malyutina; Anna Laurinavichyute; Anastasiia Kaprielova; Anastasia Ziubanova; Anastasiya Lopukhina Do we rely on good-enough processing in reading under auditory and visual noise? Journal Article In: PLoS ONE, vol. 18, pp. 1–19, 2023. @article{Zdorova2023, Noise, as part of real-life communication flow, degrades the quality of linguistic input and affects language processing. According to predictions of the noisy-channel and good-enough processing models, noise should make comprehenders rely more on word-level semantics instead of actual syntactic relations. However, empirical evidence supporting this prediction is still lacking. For the first time, we investigated whether auditory (three-talker babble) and visual (short idioms appearing next to a target sentence on the screen) noise would trigger greater reliance on semantics and make readers of Russian sentences process the sentences superficially. Our findings suggest that, although Russian speakers generally relied on semantics in sentence comprehension, neither auditory nor visual noise increased this reliance. The only effect of noise on semantic processing was found in reading speed under auditory noise measured by first fixation duration: only without noise, the semantically implausible sentences were read slower than semantically plausible ones. These results do not support the predictions of the study based on the noisy-channel and good-enough processing models, which is discussed in light of the methodological differences among the studies of noise and their possible limitations. |
Nina Zdorova; Olga Parshina; Bela Ogly; Irina Bagirokova; Ekaterina Krasikova; Anastasiia Ziubanova; Shamset Unarokova; Susanna Makerova; Olga Dragoy Eye movement corpora in Adyghe and Russian: An eye-tracking study of sentence reading in bilinguals Journal Article In: Frontiers in Psychology, vol. 14, pp. 1–12, 2023. @article{Zdorova2023a, The present study expands the eye-tracking-while reading research toward less studied languages of different typological classes (polysynthetic Adyghe vs. synthetic Russian) that use a Cyrillic script. In the corpus reading data from the two languages, we confirmed the widely studied effects of word frequency and word length on eye movements in Adyghe-Russian bilingual individuals for both languages. We also confirmed morphological effects in Adyghe reading (part-of-speech class and the number of lexical affixes) that were previously shown in some morphologically-rich languages. Importantly, we demonstrated that bilinguals' reading in Adyghe does differ quantitatively (the effect of language on reading times) and qualitatively (different effects of landing and previous/upcoming words on the eye movements within a current word) from their reading in Russian. |
Biao Zeng; Guoxing Yu; Nabil Hasshim; Shanhu Hong Primacy of mouth over eyes to perceive audiovisual Mandarin lexical tones Journal Article In: Journal of Eye Movement Research, vol. 16, no. 4, pp. 1–12, 2023. @article{Zeng2023, The visual cues of lexical tones are more implicit and much less investigated than consonants and vowels, and it is still unclear what facial areas contribute to facial tones identification. This study investigated Chinese and English speakers' eye movements when they were asked to identify audiovisual Mandarin lexical tones. The Chinese and English speakers were presented with an audiovisual clip of Mandarin monosyllables (for instance, /ă/, /à/, /ĭ/, /ì/) and were asked to identify whether the syllables were a dipping tone (/ă/, / ĭ/) or a falling tone (/ à/, /ì/). These audiovisual syllables were presented in clear, noisy and silent (absence of audio signal) conditions. An eye-tracker recorded the participants' eye movements. Results showed that the participants gazed more at the mouth than the eyes. In addition, when acoustic conditions became adverse, both the Chinese and English speakers increased their gaze duration at the mouth rather than at the eyes. The findings suggested that the mouth is the primary area that listeners utilise in their perception of audiovisual lexical tones. The similar eye movements between the Chinese and English speakers imply that the mouth acts as a perceptual cue that provides articulatory information, as opposed to social and pragmatic information. |
Martin Zettersten; Daniel Yurovsky; Tian Linger Xu; Sarp Uner; Angeline Sin Mei Tsui; Rose M. Schneider; Annissa N. Saleh; Stephan C. Meylan; Virginia A. Marchman; Jessica Mankewitz; Kyle MacDonald; Bria Long; Molly Lewis; George Kachergis; Kunal Handa; Benjamin DeMayo; Alexandra Carstensen; Mika Braginsky; Veronica Boyce; Naiti S. Bhatt; Claire Augusta Bergey; Michael C. Frank Peekbank: An open, large-scale repository for developmental eye-tracking data of children's word recognition Journal Article In: Behavior Research Methods, vol. 55, no. 5, pp. 2485–2500, 2023. @article{Zettersten2023, The ability to rapidly recognize words and link them to referents is central to children's early language development. This ability, often called word recognition in the developmental literature, is typically studied in the looking-while-listening paradigm, which measures infants' fixation on a target object (vs. a distractor) after hearing a target label. We present a large-scale, open database of infant and toddler eye-tracking data from looking-while-listening tasks. The goal of this effort is to address theoretical and methodological challenges in measuring vocabulary development. We first present how we created the database, its features and structure, and associated tools for processing and accessing infant eye-tracking datasets. Using these tools, we then work through two illustrative examples to show how researchers can use Peekbank to interrogate theoretical and methodological questions about children's developing word recognition ability. |
Likan Zhan; Peng Zhou The online processing of hypothetical events Journal Article In: Experimental Psychology, vol. 70, no. 2, pp. 108–117, 2023. @article{Zhan2023, Abstract. A conditional statement If P then Q is formed by combining the two propositions P and Q together with the conditional connective If ··· then ···. When embedded under the conditional connective, the two propositions P and Q describe hypothetical events that are not actualized. It remains unclear when such hypothetical thinking is activated in the real-time comprehension of conditional statements. To tackle this problem, we conducted an eye-tracking experiment using the visual world paradigm. Participants' eye movements on the concurrent image were recorded when they were listening to the auditorily presented conditional statements. Depending on when and what critical information is added into the auditory input, there are four possible temporal slots to observe in the online processing of the conditional statement: the sentential connective If, the antecedent P, the consequent Q, and the processing of the sentence following the conditional. We mainly focused on the first three slots. First, the occurrence of the conditional connective should trigger participants to search in the visual world for the event that could not assign a truth-value to the embedded proposition. Second, if the embedded proposition P can be determined as true by an event, the hypothetical property implied by the connective would prevent the participants from excluding the consideration of other events. The consideration of other events would yield more fixations on the events where the proposition is false. |
Wei Zhou; Sile Wang; Ming Yan Fixation-related fMRI analysis reveals the neural basis of natural reading of unspaced and spaced Chinese sentences Journal Article In: Cerebral Cortex, vol. 33, no. 19, pp. 10401–10410, 2023. @article{Zhou2023b, Although there are many eye-movement studies focusing on natural sentence reading and functional magnetic resonance imaging research on reading with serial visual presentation paradigms, there is a scarcity of investigations into the neural mechanism of natural sentence reading. The present study recruited 33 adults to read unspaced and spaced Chinese sentences with the eye tracking and functional magnetic resonance imaging data recorded simultaneously. By using fixation-related functional magnetic resonance imaging analysis, this study showed that natural reading of Chinese sentences produced activations in ventral visual, dorsal attention, and semantic brain regions, which were modulated by the properties of words such as word length and word frequency. The multivoxel pattern analysis showed that the activity pattern in the left middle temporal gyrus could significantly predict the visual layout categories (i.e. unspaced vs. spaced conditions). Dynamic causal modeling analysis showed that there were bidirectional brain connections between the left middle temporal gyrus and the left inferior occipital cortex in the unspaced Chinese sentence reading but not in the spaced reading. These results provide a neural mechanism for the natural reading of Chinese sentences from the perspective of word segmentation. |
Zitong Zhao; Jinfeng Ding; Jiayu Wang; Yiya Chen; Xiaoqing Li The flexibility and representational nature of phonological prediction in listening comprehension: Evidence from the visual world paradigm Journal Article In: Language and Cognition, pp. 1–24, 2023. @article{Zhao2023a, Using the visual world paradigm with printed words, this study investigated the flexibility and representational nature of phonological prediction in real-time speech processing. Native speakers of Mandarin Chinese listened to spoken sentences containing highly predictable target words and viewed a visual array with a critical word and a distractor word on the screen. The critical word was manipulated in four ways: a highly predictable target word, a homophone competitor, a tonal competitor, or an unrelated word. Participants showed a preference for fixating on the homophone competitors before hearing the highly predictable target word. The predicted phonological information waned shortly but was re-activated later around the acoustic onset of the target word. Importantly, this homophone bias was observed only when participants were completing a 'pronunciation judgement' task, but not when they were completing a 'word judgement' task. No effect was found for the tonal competitors. The task modulation effect, combined with the temporal pattern of phonological pre-activation, indicates that phonological prediction can be flexibly generated by top-down mechanisms. The lack of tonal competitor effect suggests that phonological features such as lexical tone are not independently predicted for anticipatory speech processing. |
Bin Zhao; Gaoyan Zhang; Longbiao Wang; Jianwu Dang Multimodal evidence for predictive coding in sentence oral reading Journal Article In: Cerebral Cortex, vol. 33, no. 13, pp. 8620–8632, 2023. @article{Zhao2023, Sentence oral reading requires not only a coordinated effort in the visual, articulatory, and cognitive processes but also supposes a top-down influence from linguistic knowledge onto the visual-motor behavior. Despite a gradual recognition of a predictive coding effect in this process, there is currently a lack of a comprehensive demonstration regarding the time-varying brain dynamics that underlines the oral reading strategy. To address this, our study used a multimodal approach, combining real-time recording of electroencephalography, eye movements, and speech, with a comprehensive examination of regional, inter-regional, sub-network, and whole-brain responses. Our study identified the top-down predictive effect with a phrase-grouping phenomenon in the fixation interval and eye-voice span. This effect was associated with the delta and theta band synchronization in the prefrontal, anterior temporal, and inferior frontal lobes. We also observed early activation of the cognitive control network and its recurrent interactions with the visual-motor networks structurally at the phrase rate. Finally, our study emphasizes the importance of cross-frequency coupling as a promising neural realization of hierarchical sentence structuring and calls for further investigation. |
Anastasia A. Ziubanova; Anna K. Laurinavichyute; Olga Parshina Does early exposure to spoken and sign language affect reading fluency in deaf and hard-of-hearing adult signers? Journal Article In: Frontiers in Psychology, vol. 14, pp. 1–9, 2023. @article{Ziubanova2023, Introduction: Early linguistic background, and in particular, access to language, lays the foundation of future reading skills in deaf and hard-of-hearing signers. The current study aims to estimate the impact of two factors – early access to sign and/or spoken language – on reading fluency in deaf and hard-of-hearing adult Russian Sign Language speakers. Methods: In the eye-tracking experiment, 26 deaf and 14 hard-of-hearing native Russian Sign Language speakers read 144 sentences from the Russian Sentence Corpus. Analysis of global eye-movement trajectories (scanpaths) was used to identify clusters of typical reading trajectories. The role of early access to sign and spoken language as well as vocabulary size as predictors of the more fluent reading pattern was tested. Results: Hard-of-hearing signers with early access to sign language read more fluently than those who were exposed to sign language later in life or deaf signers without access to speech sounds. No association between early access to spoken language and reading fluency was found. Discussion: Our results suggest a unique advantage for the hard-of-hearing individuals from having early access to both sign and spoken language and support the existing claims that early exposure to sign language is beneficial not only for deaf but also for hard-of-hearing children. |
Songzhu Zhang In: Journal of Psycholinguistic Research, vol. 52, no. 6, pp. 2919–2935, 2023. @article{Zhang2023d, This study is based on an experimental method of eye-tracking to investigate how translators perceive and understand translated literary texts and how different stylistic features influence their perception. This methodology allowed us to observe which parts of the text translators focused on the most, providing valuable data on their reading patterns and cognitive processes. Among English-Chinese translators, 95 out of 120 participants (79%) showed a tendency to prioritize faithfully conveying the source text's meaning over crafting a target text that aligns with Chinese stylistically. In the specific context of Chinese-English translation out of the 120 instances examined, the translators exhibited a reduced fixation duration on words in the source language, accounting for 34 instances (28%). This suggests a greater concern for preserving the source text's meaning rather than adapting it to the target culture. This research can assist translators and linguists in translating the stylistic features of English and Chinese literary texts more effectively. Future studies can explore other language stylistic features that may impact translation and compare translation styles across various literary genres and language pairs. |
Lijuan Zhang; Zhiwei Liu; Sainan Zhao; Jingxin Wang Semantic plausibility preferentially affects the semantic preview benefit in Chinese reading: Evidence from an eye-movement study Journal Article In: PeerJ, vol. 11, pp. 1–17, 2023. @article{Zhang2023a, Background: Numerous studies have confirmed that skilled readers can benefit from a semantically related preview word (i.e., semantic preview benefit, SPB), suggesting that readers can extract semantic information from the parafovea to achieve efficient reading. It is still under debate whether the occurrence of this benefit is because of the semantic association between the preview and target words or because of the contextual fit of the preview word in the sentence context. Methods: Two independent factors, preview plausibility (preview plausible/ implausible) and semantic relatedness (semantically related/unrelated), were manipulated, and we further strictly controlled for syntactic plausibility in the present study. Results: The results showed that the first-pass reading times of the target words were significantly shorter in the plausible preview condition than in the implausible preview condition. However, the main effect of semantic relatedness was found only in the gaze duration measure. Discussion: The pattern of results revealed that semantic plausibility affects the semantic preview benefit preferentially in Chinese reading, supporting the contextual fit account. Our findings have implications for a better understanding of parafoveal processing and provide empirical support for the eye-movement control model. |
Wei Zhou; Yi Fan; Yulin Chang; Wenjuan Liu; Jiuju Wang; Yufeng Wang Pathogenesis of comorbid adhd and chinese developmental dyslexia: Evidence from eye-movement tracking and rapid automatized naming Journal Article In: Journal of Attention Disorders, vol. 27, no. 3, pp. 294–306, 2023. @article{Zhou2023f, Background: ADHD and Chinese developmental dyslexia (DD) have a very high comorbidity rate; however, which cognitive deficits characterize the comorbidity and when they occur during cognitive processing are still under debate. Methods: Rapid automatic naming (RAN) tasks with eye-movement tracking were conducted with 75 children who were typically developing, had comorbid ADHD and DD, had only ADHD, and had only DD. Results: The clinical groups had longer first fixation durations than the control for RAN digits. Temporal eye-movement measures, such as gaze duration and total reading time, were found to vary between the comorbidity and ADHD groups. Spatial eye-movement measures, such as regression probability and incoming saccade amplitude, differed between the comorbidity and DD groups. Conclusions: These results indicate that investigation with eye-movement measures combined with RAN tasks can strengthen the understanding of the pathogenesis of comorbid ADHD and DD. |
Jeremy Steffman; Megha Sundara Disentangling the role of biphone probability from neighborhood density in the perception of nonwords Journal Article In: Language and Speech, pp. 1–37, 2023. @article{Steffman2023, In six experiments we explored how biphone probability and lexical neighborhood density influence listeners' categorization of vowels embedded in nonword sequences. We found independent effects of each. Listeners shifted categorization of a phonetic continuum to create a higher probability sequence, even when neighborhood density was controlled. Similarly, listeners shifted categorization to create a nonword from a denser neighborhood, even when biphone probability was controlled. Next, using a visual world eye-tracking task, we determined that biphone probability information is used rapidly by listeners in perception. In contrast, task complexity and irrelevant variability in the stimuli interfere with neighborhood density effects. These results support a model in which both biphone probability and neighborhood density independently affect word recognition, but only biphone probability effects are observed early in processing. |
Patrick Sturt; Nayoung Kwon Agreement attraction in comprehension: Do active dependencies and distractor position play a role? Journal Article In: Language, Cognition and Neuroscience, pp. 1–23, 2023. @article{Sturt2023, Across four eye-tracking studies and one self-paced reading study, we test whether attraction in subject-verb agreement is affected by (a) the relative linear positions of target and distractor, and (b) the active dependency status of the distractor. We find an effect of relative position, with greater attraction in retro-active interference configurations, where the distractor is linearly closer to the critical verb (Subject…Distractor…V) than in pro-active interference where it is more distant (Distractor…Subject…V). However, within pro-active interference configurations, attraction was not affected by the active dependency status of the distractor: attraction effects were similarly small whether or not the distractor was waiting to complete an upcoming dependency at the critical verb, with Bayes Factor analyses showing evidence in favour of a null effect of active dependency status. We discuss these findings in terms of the decay of activation, and whether such decay is affected by maintenance of features in memory. |
Yankui Su; Meiling He; Rongbao Li The effects of background music on English reading comprehension for English foreign language learners: Evidence from an eye movement study Journal Article In: Frontiers in Psychology, vol. 14, pp. 1–10, 2023. @article{Su2023, Based on previous literature, the present study examines the effects of background music on English reading comprehension using eye tracking techniques. All the participants, whose first language was Chinese, were selected from a foreign language college and all of them were sophomores who majored in English. The experiment in this study was a 2 (music tempo: fast and slow) × 2 (text difficulty: difficult and easy) × 2 (background music preference: high and low) mixed design. Both musical tempo and English reading passage were within-subjects factors, and the level of music listening preference was a between-subjects factor. The results showed that the main effect of the music tempo was statistically significant, which indicated that participants read texts more quickly in the fast-tempo music condition than in the slow-tempo music condition. Furthermore, the main effect of the text difficulty was statistically significant. Additionally, the interaction between the text difficulty and music tempo was statistically significant. The music tempo had a greater effect on easy texts than on difficult texts. The results of this study reveal that it is beneficial for people who have a stronger preference for music listening to conduct English reading tasks with fast-tempo music. It is detrimental for people who have little preference for background music listening to complete difficult English reading tasks with slow-tempo music. |
Yongqiang Su; Yixun Li; Hong Li Development and validation of the simplified Chinese Author Recognition Test: Evidence from eye movements of Chinese adults in Mainland China Journal Article In: Journal of Research in Reading, pp. 1–25, 2023. @article{Su2023a, Background: It is well evident that individuals' levels of print exposure are significantly correlated with their reading ability across languages, and an author recognition test is commonly used to measure print exposure objectively. For the first time, the current work developed and validated a Simplified Chinese Author Recognition Test (SCART) and examined its role in explaining Chinese online reading. Methods: In Study 1, we constructed the SCART for readers of simplified Chinese and validated the test using data collected from 203 young adults in Mainland China. Participants were measured on the SCART and three self-report tasks about their reading experiences and habits. Study 2 recruited additional 68 young adults in Mainland and measured their print exposure (with the same tasks used in Study 1), reading-related cognitive ability (working memory, rapid automatic naming, Chinese character reading, and vocabulary knowledge), and Chinese online reading via an eye-tracking passage reading task. Results: Results of Study 1 support the high reliability and validity of the SCART. Results of Study 2 indicate that SCART scores significantly predicted participants' online reading processing while controlling for subjective reading experiences and habits, and reading-related cognitive abilities. Across two studies, we found converging evidence that the in-depth recognition of the authors (i.e., participants have read the books written by these authors) appears to be a better indicator of print exposure than the superficial recognition of the author names. Conclusions: Taken together, this work filled in the gap in the literature by providing an evidence-based, objective print exposure measure for simplified Chinese and contributes to a broader understanding of print exposure and online reading processing across different writing systems. |
Longjiao Sui; Nicolas Dirix; Evy Woumans; Wouter Duyck GECO-CN: Ghent Eye-tracking COrpus of sentence reading for Chinese-English bilinguals Journal Article In: Behavior Research Methods, vol. 55, no. 6, pp. 2743–2763, 2023. @article{Sui2023, The current work presents the very first eye-tracking corpus of natural reading by Chinese-English bilinguals, whose two languages entail different writing systems and orthographies. Participants read an entire novel in these two languages, presented in paragraphs on screen. Half of the participants first read half of the novel in their native language (Simplified Chinese) and then the rest of the novel in their second language (English), while the other half read in the reverse language order. This article presents some important basic descriptive statistics of reading times and compares the difference between reading in the two languages. However, this unique eye-tracking corpus also allows the exploration of theories of language processing and bilingualism. Importantly, it provides a solid and reliable ground for studying the difference between Eastern and Western languages, understanding the impact and consequences of having a completely different first language on bilingual processing. The materials are freely available for use by researchers interested in (bilingual) reading. |
Eunkyung Sung; Sehoon Jung; Sunhee Lee Word recognition in English place assimilation by L1 and L2 listeners: An eye tracking study Journal Article In: Korean Journal of English Language and Linguistics, vol. 23, pp. 175–191, 2023. @article{Sung2023, This study explores the dynamics of lexical activation by comparing the time course of word recognition between assimilated forms (e.g., ca[t p] in cat box) and noncoronal forms (e.g., ca[p] in cap box). Using the Visual World Paradigm, an eye-tracking method, the main goal was to investigate how gradient modification in place assimilation context influences L1 and L2 listeners' real time word recognition in English. Twenty native Korean learners of English, as well as fourteen native English listeners took part in the listening task integrated into the eye-tracking experiment. The participants were given aural input in the form of instructions (e.g., look at the cat/cap box) and asked to pick the word they had just heard between two options (e.g., cat or cap) on the screen while or after they listened to the input. Their eye movements over the visual screen while listening, along with their keyboard-press responses were recorded for the main analysis. The results showed both English and Korean listeners displayed higher proportions of fixations on the target (e.g., cat) than on the competitor words (e.g., cap) in assimilation contexts (e.g., ca[t p] box), as well as higher proportions of fixations on targets (e.g., cap) than on competitors (e.g., cat) in non-assimilation contexts (e.g., ca[p] box). However, the discrepancy of fixation proportions between targets and competitors was more obvious for the English listeners than for the Korean listeners. In other words, although the L2 listenersin addition to L1 listeners were able to use acoustic variations when identifying the target phonemes, the L1 listeners revealed a higher certainty level than their L2 counterparts. Furthermore, the divergence points between targets and competitors wereshown to appear earlier for the L1 listeners than for the L2 listeners. |
Enze Tang; Hongwei Ding Emotion effects in second language processing: Evidence from eye movements in natural sentence reading Journal Article In: Bilingualism: Language and Cognition, pp. 1–20, 2023. @article{Tang2023, There exists insufficient eye-tracking evidence on the differences in emotional word processing between the first language (L1) and second language (L2) readers. This study conducted an eye-tracking experiment to investigate the emotional effects in L2 sentence reading, and to explore the modulation of L2 proficiency and individual emotional states. Adapted from Knickerbocker et al. (2015), the current study recorded eye movements at both early and late processing stages when late Chinese-English bilinguals read emotion-label and neutral target words in natural L2 sentences. Results indicated that L2 readers did not show the facilitation effects of lexical affective connotations during sentence reading, and they even demonstrated processing disadvantages for L2 emotional words. Additionally, the interaction effect between L2 proficiency and emotion was consistently significant for the measure of total reading time in positive words. Measurements of participants' depressive and anxious states were not robustly correlated with eye movement measures. Our findings supplemented new evidence to existing sparse eye-tracking experiments on L2 emotion processing, and lent support to several theoretical frameworks in the bilingual research field, including the Emotional Contexts of Learning Theory, Lexical Quality Hypothesis and Revised Hierarchical Model. |
Jamie Taylor; Yoichi Mukai Bidirectional cross-linguistic influence with different-script languages: Evidence from eye tracking Journal Article In: Applied Psycholinguistics, vol. 44, no. 5, pp. 635–667, 2023. @article{Taylor2023, This study compared patterns of nonselective cross-language activation in L1 and L2 visual word recognition with different-script bilinguals. The aim was to determine (1) whether lexical processing is nonselective in the L1 (as in L2), and (2) if the same cross-linguistic factors affected processing similarly in each language. To examine the time course of activation, eye movements were tracked during lexical decision. Thirty-two Japanese-English bilinguals responded to 250 target words in Japanese and in English. The same participants and items (i.e., cognate translation equivalents) were used to directly compare L1 and L2 processing. Response latencies as well as eye movements representing early and late processing were analyzed using mixed-effects regression modeling. Similar cross-linguistic effects, namely cognate word frequency, phonological similarity, and semantic similarity, were found in both languages. These factors affected processing to different degrees in each language, however. While cognate frequency was significant as early as the first fixation, effects of cross-linguistic phonological and semantic similarity arose later in time. Increased phonological similarity slowed responses in L2 but speeded them in L1, while greater semantic overlap was facilitatory in both languages. Results are discussed from the perspective of the BIA+ model of visual word recognition. |
Yasuo Terao; Shin-ichi Tokushige; Satomi Inomata-Terada; Tai Miyazaki; Naoki Kotsuki; Francesco Fisicaro; Yoshikazu Ugawa How do patients with Parkinson's disease and cerebellar ataxia read aloud? -Eye–voice coordination in text reading Journal Article In: Frontiers in Neuroscience, vol. 17, pp. 1–25, 2023. @article{Terao2023a, Background: The coordination between gaze and voice is closely linked when reading text aloud, with the gaze leading the reading position by a certain eye–voice lead (EVL). How this coordination is affected is unknown in patients with cerebellar ataxia and parkinsonism, who show oculomotor deficits possibly impacting coordination between different effectors. Objective: To elucidate the role of the cerebellum and basal ganglia in eye–voice coordination during reading aloud, by studying patients with Parkinson's disease (PD) and spinocerebellar degeneration (SCD). Methods: Participants were sixteen SCD patients, 18 PD patients, and 30 age-matched normal subjects, all native Japanese speakers without cognitive impairment. Subjects read aloud Japanese texts of varying readability displayed on a monitor in front of their eyes, consisting of Chinese characters and hiragana (Japanese phonograms). The gaze and voice reading the text was simultaneously recorded by video-oculography and a microphone. A custom program synchronized and aligned the gaze and audio data in time. Results: Reading speed was significantly reduced in SCD patients (3.53 ± 1.81 letters/s), requiring frequent regressions to compensate for the slow reading speed. In contrast, PD patients read at a comparable speed to normal subjects (4.79 ± 3.13 letters/s vs. 4.71 ± 2.38 letters/s). The gaze scanning speed, excluding regressive saccades, was slower in PD patients (9.64 ± 4.26 letters/s) compared to both normal subjects (12.55 ± 5.42 letters/s) and SCD patients (10.81 ± 4.52 letters/s). PD patients' gaze could not far exceed that of the reading speed, with smaller allowance for the gaze to proceed ahead of the reading position. Spatial EVL was similar across the three groups for all texts (normal: 2.95 ± 1.17 letters/s, PD: 2.95 ± 1.51 letters/s, SCD: 3.21 ± 1.35 letters/s). The ratio of gaze duration to temporal EVL was lowest for SCD patients (normal: 0.73 ± 0.50, PD: 0.70 ± 0.37, SCD: 0.40 ± 0.15). Conclusion: Although coordination between voice and eye movements and normal eye-voice span was observed in both PD and SCD, SCD patients made frequent regressions to manage the slowed vocal output, restricting the ability for advance processing of text ahead of the gaze. In contrast, PD patients experience restricted reading speed primarily due to slowed scanning, limiting their maximum reading speed but effectively utilizing advance processing of upcoming text. |
Malathi Thothathiri; Jeremy Kirkwood; Abhijeet Patra; Anna Krason; Erica L. Middleton Multimodal measures of sentence comprehension in agrammatism Journal Article In: Cortex, vol. 169, pp. 309–325, 2023. @article{Thothathiri2023, Agrammatic or asyntactic comprehension is a common language impairment in aphasia. We considered three possible hypotheses about the underlying cause of this deficit, namely problems in syntactic processing, over-reliance on semantics, and a deficit in cognitive control. We tested four individuals showing asyntactic comprehension on their comprehension of syntax-semantics conflict sentences (e.g., The robber handcuffed the cop), where semantic cues pushed towards a different interpretation from syntax. Two of the four participants performed above chance on such sentences indicating that not all agrammatic individuals are impaired in structure-based interpretation. We collected additional eyetracking measures from the other two participants, who performed at chance on the conflict sentences. These measures suggested distinct underlying processing profiles in the two individuals. Cognitive assessments further suggested that one participant might have performed poorly due to a linguistic cognitive control impairment while the other had difficulty due to over-reliance on semantics. Together, the results highlight the importance of multimodal measures for teasing apart aphasic individuals' underlying deficits. They corroborate findings from neurotypical adults by showing that semantics can strongly influence comprehension and that cognitive control could be relevant for choosing between competing sentence interpretations. They extend previous findings by demonstrating variability between individuals with aphasia—cognitive control might be especially relevant for patients who are not overly reliant on semantics. Clinically, the identification of distinct underlying problems in different individuals suggests that different treatment paths might be warranted for cases who might look similar on behavioral assessments. |
Elizabeth L. Tighe; Gal Kaldes; Amani Talwar; Scott A. Crossley; Daphne Greenberg; Stephen Skalicky In: Journal of Learning Disabilities, vol. 56, no. 1, pp. 25–42, 2023. @article{Tighe2023, Comprehension monitoring is a meta-cognitive skill that is defined as the ability to self-evaluate one's comprehension of text. Although it is known that struggling adult readers are poor at monitoring their comprehension, additional research is needed to understand the mechanisms underlying comprehension monitoring and their role in reading comprehension in this population. This study used a comprehension monitoring task with struggling adult readers, which included online eye movements (reread and regression path durations) and an offline verbal protocol (oral explanations of key information). We examined whether eye movements predicted accuracy on the passages' reading comprehension questions, a norm-referenced reading assessment, and an offline verbal protocol after controlling for age and traditional component skills (i.e., decoding, oral language, working memory). Regression path duration uniquely predicted accuracy on the questions; however, decoding and oral vocabulary were the most salient predictors of the norm-referenced reading comprehension measure. Regression path duration also predicted the offline verbal protocol, such that those who exhibited longer regression path duration were also better at explaining key information. These results contribute to the literature regarding struggling adults' reading component skills, eye movement behaviors involved in processing connected text, and future considerations in assessing comprehension monitoring. |
Alessandra Valentini; Rachel E. Pye; Carmel Houston-Price; Jessie Ricketts; Julie A. Kirkby Onlineprocessing shows advantages of bimodal listening-while-reading for vocabulary learning: An eye-tracking study Journal Article In: Reading Research Quarterly, vol. 59, no. 1, pp. 79–101, 2023. @article{Valentini2023, Children can learn words incidentally from stories. This kind of learning is enhanced when stories are presented both aurally and in written format, compared to just a written presentation. However, we do not know why this bimodal presentation is beneficial. This study explores two possible explanations: whether the bimodal advantage manifests online during story exposure, or later, at word retrieval. We collected eye-movement data from 34 8-to 9-year-old children exposed to two stories, one presented in written format (reading condition), and the second presented aurally and written at the same time (bimodal condition). Each story included six unfamiliar words (non-words) that were repeated three times, as well as definitions and clues to their meaning. Following exposure, the learning of the new words' meanings was assessed. Results showed that, during story presentation, children spent less time fixating the new words in the bimodal condition, compared to the reading condition, indicating that the bimodal advantage occurs online. Learning was greater in the bimodal condition than the reading condition, which may reflect either an online bimodal advantage during story presentation or an advantage at retrieval. The results also suggest that the bimodal condition was more conducive to learning than the reading condition when children looked at the new words for a shorter amount of time. This is in line with an online advantage of the bimodal condition, as it suggests that less effort is required to learn words in this condition. These results support educational strategies that routinely present new vocabulary in two modalities simultaneously. |
Ine Van der Cruyssen; Gershon Ben-Shakhar; Yoni Pertzov; Nitzan Guy; Quinn Cabooter; Lukas J. Gunschera; Bruno Verschuere The validation of online webcam-based eye-tracking: The replication of the cascade effect, the novelty preference, and the visual world paradigm Journal Article In: Behavior Research Methods, pp. 1–14, 2023. @article{VanderCruyssen2023, The many benefits of online research and the recent emergence of open-source eye-tracking libraries have sparked an interest in transferring time-consuming and expensive eye-tracking studies from the lab to the web. In the current study, we validate online webcam-based eye-tracking by conceptually replicating three robust eye-tracking studies (the cascade effect |
Florence Van Meenen; Nicolas Masson; Leen Catrysse; Liesje Coertjens Taking a closer look at how higher education students process and use (discrepant) peer feedback Journal Article In: Learning and Instruction, vol. 84, pp. 1–11, 2023. @article{VanMeenen2023, Little is known on how students process peer feedback (PF) and use it to improve their work. We asked 59 participants to read the feedback of two peers on a fictional essay and to revise it, while we recorded their gaze behaviour. Regarding the PF processing subphase, discrepant PF led to more transitions, but only for participants who reported the discrepancy afterwards. Counterintuitively, participants who did not report the discrepancy, showed longer first-pass reading times. Concerning the PF use subphase, dwell time on essay correlated positively with the quality of the revised essays assessed by professors. Participants with a high-quality revision spent more time addressing higher order comments, corrected one or two lower order aspects at a time and proofread in the end, in which they went beyond the suggestions provided in the PF. These insights can be used when designing training to foster students' uptake of (discrepant) PF. |
Martin R. Vasilev; Michael Lowman; Katherine Bills; Fabrice B. R. Parmentier; Julie A. Kirkby Unexpected sounds inhibit the movement of the eyes during reading and letter scanning Journal Article In: Psychophysiology, vol. 60, no. 12, pp. 1–19, 2023. @article{Vasilev2023, Novel sounds that unexpectedly deviate from a repetitive sound sequence are well known to cause distraction. Such unexpected sounds have also been shown to cause global motor inhibition, suggesting that they trigger a neurophysiological response aimed at stopping ongoing actions. Recently, evidence from eye movements has suggested that unexpected sounds also temporarily pause the movements of the eyes during reading, though it is unclear if this effect is due to inhibition of oculomotor planning or inhibition of language processes. Here, we sought to distinguish between these two possibilities by comparing a natural reading task to a letter scanning task that involves similar oculomotor demands to reading, but no higher level lexical processing. Participants either read sentences for comprehension or scanned letter strings of these sentences for the letter ‘o' in three auditory conditions: silence, standard, and novel sounds. The results showed that novel sounds were equally distracting in both tasks, suggesting that they generally inhibit ongoing oculomotor processes independent of lexical processing. These results suggest that novel sounds may have a global suppressive effect on eye-movement control. |
Aaron Veldre; Erik D. Reichle; Lili Yu; Sally Andrews Understanding the visual constraints on lexical processing: New empirical and simulation results Journal Article In: Journal of Experimental Psychology: General, vol. 152, no. 3, pp. 693–722, 2023. @article{Veldre2023, Word identification is slower and less accurate outside central vision, but the precise relationship between retinal eccentricity and lexical processing is not well specified by models of either word identification or reading. In a seminal eye-movement study, Rayner and Morrison (1981) found that participants made remarkably accurate naming and lexical-decision responses to words displayed more than 3 degrees from the center of vision—even under conditions requiring fixed gaze. However, the validity of these findings is challenged by a range of methodological limitations. We report a series of gaze-contingent lexical-decision and naming experiments that replicate and extend Rayner and Morrison's study to provide a more accurate estimate of how visual constraints delimit lexical processing. Simulations were conducted using the E-Z Reader model (Reichle et al., 2012) to assess the implications for understanding eye-movement control during reading. Augmenting the model's assumptions about the impact of both eccentricity and visual crowding on the rate of lexical processing provided good fits to the observed data without impairing the model's ability to simulate benchmark eye-movement effects. The findings are discussed with a view toward the development of a complete model of reading |
Marie Vernet; Stéphanie Bellocchi; Jérémy Danna; Delphine Massendari; Marianne Jover; Yves Chaix; Stéphanie Ducrot The determinants of saccade targeting strategy in neurodevelopmental disorders: The influence of suboptimal reading experience Journal Article In: Vision Research, vol. 204, pp. 1–14, 2023. @article{Vernet2023, Whether eye-movements deficits are causal in reading disorders (RD) or rather a consequence of linguistic processing difficulty experienced by disabled readers has been extensively debated. Since RD are frequently comorbid with the Neurofibromatosis type1 (NF1), children with NF1 were used as a comparison group for children with dyslexia in this study. Eye movements were recorded while 21 dyslexic, 20 NF1, and 20 typically developing children performed an oculomotor lateralized bisection task. In this experiment, we manipulated the type of stimulus - discrete (words and strings of hashes) versus continuous (solid lines) - and the visual field where the stimulus was displayed (left vs right). The results showed that (1) only proficient readers (TD and NF1 without RD) showed fully developed oculomotor mechanisms for efficient reading, with a clear preferred viewing location located to the left of the word's centre in both visual fields, and fine-tuned saccade targeting guided by the between-character space information and (2) NF1 poor readers mirrored the dyslexic eye movement behaviour, with less accuracy and more variability in saccadic programming, no sensitivity to the discreteness of the stimuli, particularly in the left visual field. We concluded that disruption to oculomotor behaviour reflects the fact that many of the processes involved in reading are not yet automatized for children with RD, independently of NF1. This suggests that the differences in saccade targeting strategy between children with and without RD would be secondary consequences of their reduced reading experience. |
Margreet Vogelzang; Nanna Fuhrhop; Tobias Mundhenk; Esther Ruigendijk Influence of capitalisation and presence of an article in noun phrase recognition in German: Evidence from eye-tracking Journal Article In: Journal of Research in Reading, vol. 46, no. 3, pp. 294–311, 2023. @article{Vogelzang2023, Background: German is exceptional in its use of noun capitalisation. It has been suggested that sentence-internal capitalisation as in German may benefit processing by specifically marking a noun and thus a noun phrase (NP). However, other cues, such as a determiner, can also indicate an NP. The influence of capitalisation on processing may thus be context-dependent, that is, dependent on other cues. Precisely this context dependency is investigated in the current study: Is there an effect of capitalisation on reading and is this affected by the presence of other cues such as a determiner (specifically, an article)?. Methods: We ran an eye-tracking study with 30 German-speaking adults, measuring fixations during sentence reading. Critical NPs either contained correctly capitalised nouns or not and were presented either with or without a determiner. Results: The results show that both the presence of capitalisation on the noun and the presence of a determiner led to faster reading. When no determiner was present to signal the NP, the presence of noun capitalisation aided reading most. Conclusions: From these results, we conclude that the influence of capitalisation is indeed context dependent: Capitalisation aids processing most when no other cue is present. Thus, different cues play a role in NP recognition. Based on these findings, we argue that noun capitalisation should not be studied in isolation. We argue that a better understanding of capitalisation as a reading aid is relevant for teaching reading strategies. |
Katie Von Holzen; Sandrien Ommen; Katherine S. White; Thierry Nazzi The impact of phonological biases on mispronunciation sensitivity and novel accent adaptation Journal Article In: Language Learning and Development, vol. 19, no. 3, pp. 303–322, 2023. @article{VonHolzen2023, Successful word recognition requires that listeners attend to differences that are phonemic in the language while also remaining flexible to the variation introduced by different voices and accents. Previous work has demonstrated that American-English-learning 19-month-olds are able to balance these demands: although one-off one-feature mispronunciations typically disrupt English-learning toddlers' lexical access, they no longer do after toddlers are exposed to a novel accent in which these changes occur systematically. The flexibility to deal with different types of variation may not be the same for toddlers learning different first languages, however, as language structure shapes early phonological biases. We examined French-learning 19-month-olds' sensitivity and adaptation to a novel accent that shifted either the standard pronunciation of /a/ from [a] to [ɛ] (Experiment 1) or the standard pronunciation of /p/ from [p] to [t] (Experiment 2). In Experiment 1, French-learning toddlers recognized words with /a/ produced as [ɛ], regardless of whether they were previously exposed to an accent that contained this vowel shift or not. In Experiment 2, toddlers did not recognize words with /p/ pronounced as [t] at test unless they were first familiarized with an accent that contained this consonant shift. These findings are consistent with evidence that French-learning toddlers privilege consonants over vowels in lexical processing. Together with previous work, these results demonstrate both differences and similarities in how French- and English-learning children treat variation, in line with their language-specific phonological biases. |
Andi Wang; Ana Pellicer-Sánchez Examining the effectiveness of bilingual subtitles for comprehension: An eye-tracking study Journal Article In: Studies in Second Language Acquisition, vol. 45, no. 4, pp. 882–905, 2023. @article{Wang2023b, The present study examined the relative effectiveness of bilingual subtitles for L2 viewing comprehension, compared to other subtitling types. Learners' allocation of attention to the image and subtitles/captions in different viewing conditions, as well as the relationship between attention and comprehension, were also investigated. A total of 112 Chinese learners of English watched an English documentary clip in one of four conditions (bilingual subtitles, captions, L1 subtitles, no subtitles) while their eye movements were recorded. The results revealed that bilingual subtitles were as beneficial as L1 subtitles for comprehension, which both outscored captions and no subtitles. Participants using bilingual subtitles spent significantly more time processing L1 than L2 lines. L1 lines in bilingual subtitles were processed significantly longer than in L1 subtitles, but L2 lines were processed significantly shorter than in captions. No significant relationship was found between the processing time and comprehension for either the L1 or L2 lines of bilingual subtitles. |
Danhui Wang; Man Zeng; Han Zhao; Lei Gao; Shan Li; Zibei Niu; Xuejun Bai; Xiaolei Gao Effects of syllable boundaries in Tibetan reading Journal Article In: Scientific Reports, vol. 13, no. 314, pp. 1–10, 2023. @article{Wang2023, Interword spaces exist in the texts of many languages that use alphabetic writing systems. In most cases, interword spaces, as a kind of word boundary information, play an important role in the reading process of readers. Tibetan also uses alphabetic writing, its text has no spaces between words as word boundary markers. Instead, there are intersyllable tshegs (“."), which are superscript dots. Interword spaces play an important role in reading as word boundary information. Therefore, it is interesting to investigate the role of tshegs and what effect replacing tshegs with spaces will have on Tibetan reading. To answer these questions, Experiment 1 was conducted in which 72 Tibetan undergraduates read three-syllable-boundary conditions (normal, spaced, and untsheged). However, in Experiment 1, because we performed the experimental operations of deleting tshegs and replacing tshegs, the spatial information distribution of Tibetan sentences under different operating conditions was different, which may have a certain potential impact on the experimental results. To rule out the underlying confounding factor, in Experiment 2, 58 undergraduates read sentences for both untsheged and alternating-color conditions. Overall, the global and local analyses revealed that tshegs, spaces, and alternating-color markers as syllable boundaries can help readers segment syllables in Tibetan reading. In Tibetan reading, both spaces and tshegs are effective visual syllable segmentation cues, and spaces are more effective visual syllable segmentation cues than tshegs. |
Jingwen Wang; Jinmian Yang; Chris Biemann; Xingshan Li Mechanism of semantic processing of lexicalized and novel compound words: An eye movement study Journal Article In: Journal of Experimental Psychology: Learning, Memory, and Cognition, vol. 49, no. 11, pp. 1812–1822, 2023. @article{Wang2023f, The integration of semantic information of compound words with context is a crucial aspect of reading comprehension. In two eye-tracking experiments, we used two-character and four-character Chinese lexicalized and novel compound words to investigate how Chinese readers integrate semantic information ofcompound words with contexts in the present study. By manipulating the temporary plausibility of the first constituent through varying the preceding verb, we aimed to investigate how readers process semantic information of compound words during normal reading. A significant plausibility effect pattern in the first constituent region was observed for the four-character novel words, but not for the lexicalized compound words and two-character novel compound words. However, for both two-character and four-character novel compound words, a reverse plausibility effect was found in the second constituent region. This was not the case for lexicalized compound words. These results indicate that novel compound words are integrated with the context in a decompositional manner, while lexicalized compound words are integrated holistically. |
Tao Wang; Mingyao Geng; Yue Wang; Min Zhao; Tongquan Zhou; Yiming Yang Chinese EFL learners different from English natives in cataphora resolution: Evidence from eye-tracking studies Journal Article In: Frontiers in Psychology, vol. 14, pp. 1–18, 2023. @article{Wang2023i, Previous studies on English natives have shown that encountering an English cataphoric pronoun triggers an active search for its antecedent and this searching process is modulated by syntactic constraints. It remains unknown whether the conclusion is universal to EFL (English as a Foreign Language) learners, particularly those with distinct L1 like Chinese in linguistic typology. Therefore, this study used two eye-tracking experiments to investigate how Chinese EFL learners resolve English cataphora. The experiments adopted the gender-mismatch paradigm. Experiment 1 investigated whether Chinese EFL learners with different proficiency would adopt the similar processing pattern to English natives and found that gender congruency elicited longer reading times than gender incongruency between the first potential antecedent and the cataphoric pronoun, the effect early observed in high-proficiency relative to low-proficiency learners. Experiment 2 explored whether the cataphora resolution process was modulated by Binding Principle B and revealed that longer first fixation durations and first pass reading times were observed in gender-mismatch than in gender-match conditions no matter the antecedents are binding-accessible or not while longer regression path durations occurred in gender-mismatch than in gender-match conditions only as the antecedents are binding-accessible. Taken together, these results indicate that Chinese EFL learners also adopt an active search mechanism to resolve cataphoric pronouns, yet along a processing path distinct from English natives'. Specifically, Chinese EFL learners predictively link a cataphoric pronoun to the first potential antecedent in the sentence but only a gender-matching antecedent can prompt them to engage in deep processing of the antecedent. Moreover, the processing time varies with the learners' English proficiency. Furthermore, unlike native English speakers' early application of syntactic constraints in their cataphora resolution, Chinese EFL learners try to establish co-reference relations between cataphoric pronouns and antecedents regardless of following or flouting Binding Principle B in early processing stages whereas they exclusively link the cataphoric pronouns to the binding-accessible antecedents in late processing stages. This study adds evidence to the Shallow Structure Hypothesis whereby L2 learners resort to lexical prior to syntactic cues to process sentences in general, which is just opposite to the fashion adopted by the natives. |
Youxi Wang; Suke Duan; Guojie Ma; Wei Shen Segmentation of spoken overlapping ambiguity strings in chinese: An eye-tracking study Journal Article In: Journal of Speech, Language, and Hearing Research, vol. 66, no. 12, pp. 4913–4933, 2023. @article{Wang2023l, PURPOSE: Using the printed-word paradigm with eye tracking, this study conducted three experiments to examine (a) how multiple words in spoken overlapping ambiguity strings (OASs) are activated, (b) how word frequency influences the word segmentation of spoken OASs, and (c) whether the multiple words in spoken OASs are activated competitively or independently. METHOD: In this study, participants listened to a four-character spoken OAS (ABCD) and were presented with a visual display composed of a semantic associate of the "middle word" (BC; Experiments 1 and 2) or the "left word" (AB; Experiment 3) and two distractors. In Experiment 1, the word frequency of the middle words was manipulated to be higher than that of the neighbor words. In Experiment 2, the word frequency of the middle words was manipulated to be either higher or lower than that of the neighbor words. In Experiment 3, participants listened to either spoken OASs (ABCD) or spoken unambiguous strings (ABEF). RESULTS: In Experiment 1, we observed a significant semantic competition effect; that is, more fixations fell on the semantic competitors than on distractors, suggesting that the semantic information of the middle words in the spoken OASs was activated. In Experiment 2, the semantic competition effect was only observed in the high-frequency condition and was absent in the low-frequency condition. In Experiment 3, the results showed significant semantic competition effects for the left words under both conditions, and the observed effect was similar between the ambiguity condition and the control condition. CONCLUSIONS: These findings show that multiple words in spoken OASs are all activated and the activation level is modulated by word frequency. In addition, multiple words in the spoken OASs may be processed independently during spoken comprehension. |
Zhiyun Wang; Qingfang Zhang Ageing of grammatical advance planning in spoken sentence production: An eye movement study Journal Article In: Psychological Research, no. 2001, pp. 1–18, 2023. @article{Wang2023m, This study used an image-description paradigm with concurrent eye movement recordings to investigate differences of grammatical advance planning between young and older speakers in spoken sentence production. Participants were asked to produce sentences with simple or complex initial phrase structures (IPS) in Experiment 1 while producing individual words in Experiment 2. Young and older speakers showed comparable speaking latencies in sentence production task, whereas older speakers showed longer latencies than young speakers in word production task. Eye movement data showed that compared with young speakers, older speakers had higher fixation percentage on object 1, lower percentage of gaze shift from object 1 to 2, and lower fixation percentage on object 2 in simple IPS sentences, while they showed similar fixation percentage on object 1, similar percentage of gaze shift from object 1 to 2, and lower fixation percentage on object 2 in complex IPS sentences, indicating a decline of grammatical encoding scope presenting on eye movement patterns. Meanwhile, speech analysis showed that older speakers presented longer utterance duration, slower speech rate, and longer and more frequently occurred pauses in articulation, indicating a decline of speech articulation in older speakers. Thus, our study suggests that older speakers experience an ageing effect in the sentences with complex initial phrases due to limited cognitive resources. |
Yanjun Wei; Yingjuan Tang; Adam John Privitera Functional priority of syntax over semantics in Chinese 'ba' construction: Evidence from eye-tracking during natural reading Journal Article In: Language and Cognition, pp. 1–21, 2023. @article{Wei2023, Studies on sentence processing in inflectional languages support that syntactic structure building functionally precedes semantic processing. Conversely, most EEG studies of Chinese sentence processing do not support the priority of syntax. One possible explanation is that the Chinese language lacks morphological inflections. Another explanation may be that the presentation of separate sentence components on individual screens in EEG studies disrupts syntactic framework construction during sentence reading. The present study investigated this explanation using a self-paced reading experiment mimicking rapid serial visual presentation in EEG studies and an eye-tracking experiment reflecting natural reading. In both experiments, Chinese 'ba' sentences were presented to Chinese young adults in four conditions that differed across the dimensions of syntactic and semantic congruency. Evidence supporting the functional priority of syntax over semantics was limited to only the natural reading context, in which syntactic violations blocked the processing of semantics. Additionally, we observed a later stage of integrating plausible semantics with a failed syntax. Together, our findings extend the functional priority of syntax to the Chinese language and highlight the importance of adopting more ecologically valid methods when investigating sentence reading. |
Kim Lara Weiss; Stefan Hawelka; Florian Hutzler; Sarah Schuster Stronger functional connectivity during reading contextually predictable words in slow readers Journal Article In: Scientific Reports, vol. 13, no. 1, pp. 1–10, 2023. @article{Weiss2023, The effect of word predictability is well-documented in terms of local brain activation, but less is known about the functional connectivity among those regions associated with processing predictable words. Evidence from eye movement studies showed that the effect is much more pronounced in slow than in fast readers, suggesting that speed-impaired readers rely more on sentence context to compensate for their difficulties with visual word recognition. The present study aimed to investigate differences in functional connectivity of fast and slow readers within core regions associated with processing predictable words. We hypothesize a stronger synchronization between higher-order language areas, such as the left middle temporal (MTG) and inferior frontal gyrus (IFG), and the left occipito-temporal cortex (OTC) in slow readers. Our results show that slow readers exhibit more functional correlations among these connections; especially between the left IFG and OTC. We interpret our results in terms of the lexical quality hypothesis which postulates a stronger involvement of semantics on orthographic processing in (speed-)impaired readers. |
Ana Werkmann Horvat; Marianna Bolognesi; Nadja Althaus Attention to the source domain of conventional metaphorical expressions: Evidence from an eye tracking study Journal Article In: Journal of Pragmatics, vol. 215, pp. 131–144, 2023. @article{WerkmannHorvat2023, This study investigates whether the metaphorical status of conventional expressions can be reactivated when elements of the source domain are present in the context. In indirect metaphors the source domain (or literal meaning) is not expressed (e.g., The father cut the budget). The literal meaning of cutting remains latently encoded in the predicate and readers' attention is not required to move from the finance domain to the domain of physical cuts. Such conventional metaphoric expressions are likely to be processed via lexical disambiguation of a polysemous (metaphorical) verb. Using an eye tracking combined with a forced-choice semantic relatedness task we investigated whether by adding linguistic material referring to the source domain (e.g., father cut the budget like grass), we can direct readers' attention to the source domain of the metaphorical predicate and stimulate them to interpret conventional metaphorical expressions by means of cross-domain mapping. The results indicate that in the reactivated condition participants dwell on the object (budget) significantly longer in their second run and when they regress to it after the final region than where there is no source domain activation. These findings may offer new insight into the limited experimental evidence related to the deliberate metaphor theory. |
Alex L. White; Kendrick N. Kay; Kenny A. Tang; Jason D. Yeatman Engaging in word recognition elicits highly specific modulations in visual cortex Journal Article In: Current Biology, vol. 33, no. 7, pp. 1308–1320, 2023. @article{White2023, A person's cognitive state determines how their brain responds to visual stimuli. The most common such effect is a response enhancement when stimuli are task relevant and attended rather than ignored. In this fMRI study, we report a surprising twist on such attention effects in the visual word form area (VWFA), a region that plays a key role in reading. We presented participants with strings of letters and visually similar shapes, which were either relevant for a specific task (lexical decision or gap localization) or ignored (during a fixation dot color task). In the VWFA, the enhancement of responses to attended stimuli occurred only for letter strings, whereas non-letter shapes evoked smaller responses when attended than when ignored. The enhancement of VWFA activity was accompanied by strengthened functional connectivity with higher-level language regions. These task-dependent modulations of response magnitude and functional connectivity were specific to the VWFA and absent in the rest of visual cortex. We suggest that language regions send targeted excitatory feedback into the VWFA only when the observer is trying to read. This feedback enables the discrimination of familiar and nonsense words and is distinct from generic effects of visual attention. |
Veronica Whitford; Narissa Byers; Gillian A. O'Driscoll; Debra Titone Eye movements and the perceptual span in disordered reading: A comparison of schizophrenia and dyslexia Journal Article In: Schizophrenia Research: Cognition, vol. 34, pp. 1–13, 2023. @article{Whitford2023, Increasing evidence of a common neurodevelopmental etiology between schizophrenia and developmental dyslexia suggests that neurocognitive functions, such as reading, may be similarly disrupted. However, direct comparisons of reading performance in these disorders have yet to be conducted. To address this gap in the literature, we employed a gaze-contingent moving window paradigm to examine sentence-level reading fluency and perceptual span (breadth of parafoveal processing) in adults with schizophrenia (dataset from Whitford et al., 2013) and psychiatrically healthy adults with dyslexia (newly collected dataset). We found that the schizophrenia and dyslexia groups exhibited similar reductions in sentence-level reading fluency (e.g., slower reading rates, more regressions) compared to matched controls. Similar reductions were also found for standardized language/reading and executive functioning measures. However, despite these reductions, the dyslexia group exhibited a larger perceptual span (greater parafoveal processing) than the schizophrenia group, potentially reflecting a disruption in normal foveal-parafoveal processing dynamics. Taken together, our findings suggest that reading and reading-related functions are largely similarly disrupted in schizophrenia and dyslexia, providing additional support for a common neurodevelopmental etiology. |
Bogusława Whyatt; Olga Witczak; Ewa Tomczak-Łukaszewska; Olha Lehka-Paul The proof of the translation process is in the reading of the target text: An eyetracking reception study Journal Article In: Ampersand, vol. 11, pp. 1–10, 2023. @article{Whyatt2023, This article is an attempt to bridge the divide between translation process research (TPR) which has investigated how translators as specialised bilingual professionals use their expertise to translate texts and translation reception which explores how the texts are read and received by the target language readers. Over the last thirty years, TPR has provided empirically grounded findings to demonstrate the complexity of the cognitive processes in the translator's mind but much less empirical interest has been paid to how translated texts are read and processed by the readers. To redress this imbalance, we hypothesise that the cognitive effort invested in reading a translated text can be taken as proof of how successful the translation process has been. We report on an exploratory study in which two groups of participants read a high-quality and a low-quality translation of the same text while their eye movements were recorded by an eyetracker. We compare the readers' cognitive effort indexed by character-adjusted dwell time, number of runs and re-reading in the second and third run with the translators' character-adjusted cognitive effort invested in producing the target texts. The results show that the relationship between the translation process and the reading experience is not straightforward and depends on the quality of the target text. |
Chia-Yu Liu; Chao-Jung Wu Effects of working memory and relevant knowledge on reading texts and infographics Journal Article In: Reading and Writing, vol. 36, no. 162, pp. 2319–2343, 2023. @article{Liu2023i, Infographics are a new type of reading material comprising textual and visual information that has been used worldwide. Nonetheless, there has been limited research investigating people's infographic-reading performance and the characteristics of superior readers. This study adopted Chinese texts and infographics as materials and employed eye-tracking technology to assess how working memory and relevant knowledge affected 137 college students' reading comprehension, as indicated by reading accuracy (ACC), and reading efficiency, which in turn was indicated by reading time (RT) and total fixation duration (TFD). For texts, verbal working memory (VWM) exhibited no effects on individuals' reading performance; visuospatial working memory (VSWM) exerted positive effects on both ACC and TFD, and participants with higher knowledge demonstrated better ACC. For infographics, higher-VWM participants showed greater ACC, and higher-VSWM participants displayed a longer RT and TFD, though the effect of knowledge was limited. Moreover, a significant interaction effect of VWM and relevant knowledge on the TFD of infographics was observed, indicating that individuals' prior knowledge or experience might structure schemas in an infographic and then act with VWM to accelerate reading speed. This study improves our understanding of how working memory and relevant knowledge impact the processing of materials with different synthesized levels, and its implications for instruction and research are discussed. |
Priscila López-Beltrán Heritage speakers' processing of the Spanish subjunctive: A pupillometric study Journal Article In: Linguistic Approaches to Bilingualism, pp. 1–47, 2023. @article{LopezBeltran2023, We investigated linguistic knowledge of subjunctive mood in heritage speakers of Spanish who live in a long-standing English-Spanish bilingual community in Albuquerque, New Mexico. Three experiments examine the constraints on subjunctive selection. Experiment 1 and Experiment 2 employed pupillometry to investigate heritage speakers' online sensitivity to the presence of the subjunctive with non-variable governors (Lexical conditioning) and with negated governors (Structural conditioning). Experiment 3 employed an elicited production task to examine production of subjunctive in the same contexts. The findings of the heritage group were compared to those of a group ofSpanish-dominant Mexican bilinguals. Results showed that in comprehension and production, heritage speakers were as sensitive as the Spanish-dominant bilinguals to the lexical and structural factors that condition mood selection. In comprehension, the two groups experienced an increased pupillary dilation in conditions where the indicative was used but the subjunctive was expected. In addition, high- frequency governors and irregular subordinate verbs boosted participants' sensitivity to the presence of the subjunctive. In production, there were no significant differences between heritage speakers and Spanish-dominant bilinguals when producing the subjunctive with non-variable and negated governors. |
Stephanie N. Lovich; Cynthia D. King; David L. K. Murphy; Hossein Abbasi; Patrick Bruns; Christopher A. Shera; Jennifer M. Groh Conserved features of eye movement related eardrum oscillations (EMREOs) across humans and monkeys Journal Article In: Philosophical Transactions of the Royal Society B: Biological Sciences, vol. 378, no. 1886, pp. 1–10, 2023. @article{Lovich2023, Auditory and visual information involve different coordinate systems, with auditory spatial cues anchored to the head and visual spatial cues anchored to the eyes. Information about eye movements is therefore critical for reconciling visual and auditory spatial signals. The recent discovery of eye movement-related eardrum oscillations (EMREOs) suggests that this process could begin as early as the auditory periphery. How this reconciliation might happen remains poorly understood. Because humans and monkeys both have mobile eyes and therefore both must perform this shift of reference frames, comparison of the EMREO across species can provide insights to shared and therefore important parameters of the signal. Here we show that rhesus monkeys, like humans, have a consistent, significant EMREO signal that carries parametric information about eye displacement as well as onset times of eye movements. The dependence of the EMREO on the horizontal displacement of the eye is its most consistent feature, and is shared across behavioural tasks, subjects and species. Differences chiefly involve the waveform frequency (higher in monkeys than in humans) and patterns of individual variation (more prominent in monkeys than in humans), and the waveform of the EMREO when factors due to horizontal and vertical eye displacements were controlled for. This article is part of the theme issue 'Decision and control processes in multisensory perception'. |
Matthew W. Lowder; Antonio Cardoso; Michael Pittman; Adrian Zhou Effects of syntactic structure on the processing of lexical repetition during sentence reading Journal Article In: Memory & Cognition, vol. 51, no. 5, pp. 1249–1263, 2023. @article{Lowder2023a, Previous research has demonstrated that the ease or difficulty of processing complex semantic expressions depends on sentence structure: Processing difficulty emerges when the constituents that create the complex meaning appear in the same clause, whereas difficulty is reduced when the constituents appear in separate clauses. The goal of the current eye-tracking-while-reading experiments was to determine how changes to sentence structure affect the processing of lexical repetition, as this manipulation enabled us to isolate processes involved in word recognition (repetition priming) from those involved in sentence interpretation (felicity of the repetition). When repetition of the target word was felicitous (Experiment 1), we observed robust effects of repetition priming with some evidence that these effects were weaker when repetition occurred within a clause versus across a clause boundary. In contrast, when repetition of the target word was infelicitous (Experiment 2), readers experienced an immediate repetition cost when repetition occurred within a clause, but this cost was eliminated entirely when repetition occurred across clause boundaries. The results have implications for word recognition during reading, processes of semantic integration, and the role of sentence structure in guiding these linguistic representations. |
Matthew W. Lowder; Adrian Zhou; Peter C. Gordon The lab discovered: Place-for-institution metonyms appearing in subject position are processed as agents Journal Article In: Journal of Experimental Psychology: Learning, Memory, and Cognition, pp. 1–16, 2023. @article{Lowder2023, “Hospital” can refer to a physical place or more figuratively to the people associated with it. Such place-for- institution metonyms are common in everyday language, but there remain several open questions in the literature regarding how they are processed. The goal of the current eyetracking experiments was to investigate how metonyms are interpreted when they appear as sentence subjects in structures that are temporarily syn- tactically ambiguous versus unambiguous (e.g., “The hospital [that was] requested by the doctor…”). If com- prehenders have a bias to interpret metonyms in subject position as agents (Fishbein & Harris, 2014), they should initially access the figurative (institutional) sense of the metonym. This interpretation is rendered incorrect at the disambiguating by-phrase, which should lead to reanalysis (i.e., garden-path effects). In Experiment 1, larger garden-path effects were observed for metonyms compared to inanimate control nouns that did not have a figurative sense. In Experiment 2, garden-path effects were equivalent for metonyms and animate sentence subjects. In addition, there was some evidence that readers exhibited initial difficulty at the verb (e.g., “requested”) when it immediately followed the metonym compared to the inanimate control nouns in Experiment 1. Overall, the results suggest that the subject-as-agent heuristic is a powerful cue during sentence processing, which can prompt the comprehender to access a figurative interpretation of a metonym. |
Cristina Lozano-Argüelles; Nuria Sagarra; Joseph V. Casillas Interpreting experience and working memory effects on L1 and L2 morphological prediction Journal Article In: Frontiers in Language Sciences, vol. 1, pp. 1–16, 2023. @article{LozanoArgueelles2023, The human brain tries to process information as efficiently as possible through mechanisms like prediction. Native speakers predict linguistic information extensively, but L2 learners show variability. Interpreters use prediction while working and research shows that interpreting experience mediates L2 prediction. However, it is unclear whether advantages related to interpreting are due to higher working memory (WM) capacity, a typical characteristic of professional interpreters. To better understand the role of WM during L1 and L2 prediction, English L2 learners of Spanish with and without interpreting experience and Spanish monolinguals completed a visual-world paradigm eye-tracking task and a number-letter sequencing working memory task. The eye-tracking task measured prediction of verbal morphology (present, past) based on suprasegmental information (lexical stress: paroxytone, oxytone) and segmental information (syllabic structure: CV, CVC). Results revealed that WM mediates L1 prediction, such that higher WM facilitates prediction of morphology in monolinguals. However, higher WM hinders prediction in L2 processing for non-interpreters. Interestingly, interpreters behaved similarly to monolinguals, with higher WM facilitating L2 prediction. This study provides further understanding of the variability in L2 prediction. |
Steven G. Luke; Tanner Jensen The effect of sudden-onset distractors on reading efficiency and comprehension Journal Article In: Quarterly Journal of Experimental Psychology, vol. 76, no. 5, pp. 1195 –1206, 2023. @article{Luke2023, Reading is an essential skill that requires focused attention. However, much reading is done in non-optimal environments. These days, reading is often done on digital devices or with a digital device nearby. These devices often introduce momentary distractions during reading, interrupting with alerts, notifications, and pop-ups. In two eye-tracking experiments, we investigated how such momentary distractions affect reading. Participants read paragraphs while their eye movements were monitored. During half of the paragraphs, distractions appeared periodically on the screen that required a response from the participants. In Experiment 1, the distractions were arrows that the participant had to respond to and then could immediately forget. In Experiment 2, the participants performed a 1-back task that required them to remember the identity of the last distractor. Compared with the no-distraction condition, the respond-and-forget distractors of Experiment 1 had minimal impact on reading behaviour and comprehension, but the working-memory-load distractors of Experiment 2 led to increased rereading and decreased reading comprehension. It seems a simple pop-up does not disrupt reading, but a message you must remember will. |
Steven G. Luke; Rachel Yu Liu; Kyle Nelson; Jared Denton; Michael W. Child An ex-Gaussian analysis of eye movements in L2 reading Journal Article In: Bilingualism: Language and Cognition, vol. 26, no. 2, pp. 330–344, 2023. @article{Luke2023a, Second language learners' reading is less efficient and more effortful than native reading. However, the source of their difficulty is unclear; L2 readers might struggle with reading in a different orthography, or they might have difficulty with later stages of linguistic interpretation of the input, or both. The present study explored the source of L2 reading difficulty by analyzing the distribution of fixation durations in reading. In three studies, we observed that L2 readers experience an increase in Mu, which we interpret as indicating early orthographic processing difficulty, when the L2 has a significantly different writing system than the L1 (e.g., Chinese and English) but not when the writing systems were similar (e.g., Portuguese and English). L2 readers also experienced an increase in Tau, indicating later-arising processing difficulty which likely reflects later-stage linguistic processes, when they read for comprehension. L2 readers of Chinese also experienced an additional increase in Tau. |
Changlin Luo; Mengyan Zhu; Xiangling Zhuang; Guojie Ma Food word processing in Chinese reading: A study of restrained eaters Journal Article In: British Journal of Psychology, vol. 114, no. 2, pp. 476–494, 2023. @article{Luo2023a, Food-related attentional bias refers that individuals typically prioritize rewarding food-related cues (e.g. food words and food images) compared with non-food stimuli; however, the findings are inconsistent for restrained eaters. Traditional paradigms used to test food-related attentional bias, such as visual probe tasks and visual search tasks, may not directly and accurately enough to reflect individuals' food-word processing at different cognitive stages. In this study, we introduced the boundary paradigm to investigate food-word attentional bias for both restrained and unrestrained eaters. Eye movements were recorded when they performed a naturalistic sentence-reading task. The results of later-stage analyses showed that food words were fixated on for less time than non-food words, which indicated a superiority of foveal food-word processing for both restrained and unrestrained eaters. The results of early-stage analyses showed that restrained eaters spent more time on pre-target regions in the food-word valid preview conditions, which indicated a parafoveal food-word processing superiority for restrained eaters (i.e. the parafoveal-on-foveal effect). The superiority of foveal food-word processing provides new insights into explaining food-related attentional bias in general groups. Additionally, the enhanced food-word attentional bias in parafoveal processing for restrained eaters illustrates the importance of individual characteristics in studying word recognition. |
Yingyi Luo; Dixiao Tan; Ming Yan Morphological structure influences saccade generation in Chinese reading Journal Article In: Reading and Writing, vol. 36, no. 5, pp. 1–17, 2023. @article{Luo2023d, Recent studies have demonstrated that saccadic programming in reading is not only determined by low-level visual factors. High-level morphological effects on saccade have been shown in two morphologically rich languages. In the present study, we examined the underlying mechanism of such morphological influences by comparing the processes of reading three-character Chinese compound words that differ in their structures in terms of morphological decomposition. Consistent with earlier reports, our results showed an effect of morphological structure on saccade. The readers' first-fixation location shifted further away from the beginning of the word, when the last two characters were more morphologically bounded and thus formed a [1 + 2] structure, than when the first two characters were more bounded (i.e., a [2 + 1] structure). The results are not accountable by a processing difficulty hypothesis, which proposes that saccade amplitude is determined by morphological complexity; rather, they suggest that Chinese readers parafoveally decompose a word and spontaneously target its longer stem, thus reflecting parafoveal access to words' stems. |
Yingyue Lv; Lei Zhang; Wanying Chen; Fang Xie; Kayleigh L. Warrington The influence of foveal load on parafoveal processing of N + 2 during Chinese reading Journal Article In: Visual Cognition, vol. 31, no. 2, pp. 97–106, 2023. @article{Lv2023, According to the foveal load hypothesis, parafoveal processing is influenced by the difficulty of current foveal processing. It remains unclear whether foveal load may affect the extent of parafoveal processing. This is an important consideration given the evidence that Chinese readers may frequently pre-process word N + 2 when N + 1 is one character. Accordingly, the current study manipulated word frequency to explore the influence of foveal load on parafoveal processing of N + 2 using a 2 (foveal load: high-frequency, low-frequency) × 2 (preview condition: identical preview, pseudo-character preview) within-subject design. Main effects of foveal load were found for the foveal word N, with longer fixations for low- than for high-frequency words and a main effect of preview was also found for N + 2, with longer fixations for pseudo-character preview compared to identical preview. Crucially, there was no interaction between foveal load and preview condition, indicating that parafoveal processing of word N + 2 is not influenced by foveal load during natural Chinese reading. |
Anqi Lyu; Larry Abel; Allen M. Y. Cheong Effect of habitual reading direction on saccadic eye movements: A pilot study Journal Article In: PLoS ONE, vol. 18, pp. 1–16, 2023. @article{Lyu2023, Cognitive processes can influence the characteristics of saccadic eye movements. Reading habits, including habitual reading direction, also affect cognitive and visuospatial processes, favouring attention to the side where reading begins. Few studies have investigated the effect of habitual reading direction on saccade directionality of low-cognitive-demand stimuli (such as dots). The current study examined horizontal prosaccade, antisaccade, and self-paced saccade in subjects with two primary habitual reading directions. We hypothesised that saccades responding to the stimuli in subject's habitual reading direction would show a longer prosaccade latency and lower antisaccade error rate (errors being a reflexive glance to a suddenappearing target, rather than a saccade away from it). Sixteen young Chinese participants with primary habitual reading direction from left to right and sixteen young Arabic and Persian participants with primary habitual reading direction from right to left were recruited. All subjects spoke/read English as their second language. Subjects needed to look towards a 5°/10° target in the prosaccade task or look towards the mirror image location of the target in the antisaccade task and look between two 10° targets in the self-paced saccade task. Only Arabic and Persian participants showed a shorter and directional prosaccade latency towards 5° stimuli against their habitual reading direction. No significant effect of reading direction on antisaccade latency towards the correct directions was found. Chinese readers were found to generate significantly shorter prosaccade latencies and higher antisaccade directional errors compared with Arabic and Persian readers for stimuli appearing at their habitual reading side. The present pilot study provides insights into the effect of reading habits on saccadic eye movements of low-cognitive-demand stimuli and offers a platform for future studies to investigate the relationship between reading habits and eye movement behaviours. |
Xiaochuan Ma; Yikang Liu; Roy Clariana; Chanyuan Gu; Ping Li From eye movements to scanpath networks: A method for studying individual differences in expository text reading Journal Article In: Behavior Research Methods, vol. 55, no. 2, pp. 730–750, 2023. @article{Ma2023b, Eye movements have been examined as an index of attention and comprehension during reading in the literature for over 30 years. Although eye-movement measurements are acknowledged as reliable indicators of readers' comprehension skill, few studies have analyzed eye-movement patterns using network science. In this study, we offer a new approach to analyze eye-movement data. Specifically, we recorded visual scanpaths when participants were reading expository science text, and used these to construct scanpath networks that reflect readers' processing of the text. Results showed that low ability and high ability readers' scanpath networks exhibited distinctive properties, which are reflected in different network metrics including density, centrality, small-worldness, transitivity, and global efficiency. Such patterns provide a new way to show how skilled readers, as compared with less skilled readers, process information more efficiently. Implications of our analyses are discussed in light of current theories of reading comprehension. |
Ye Ma; Brian Buccola; Zinan Wang; Shannon Cousins; Aline Godfroid; Alan Beretta Expressions with aspectual verbs elicit slower reading times than those with psychological verbs: An eye-tracking study in Mandarin Chinese Journal Article In: Journal of Psycholinguistic Research, vol. 52, no. 1, pp. 179–215, 2023. @article{Ma2023c, Research over the last 20 years has investigated the processing costs for sentences such as John began the book. Much of this work has conflated sentences with aspectual verbs, like start or finish, with psychological verbs, like enjoy or tolerate. However, recent studies have reported greater costs for aspectual verbs compared to psychological verbs (e.g., Katsika et al. in Ment Lex 7:58–76, 2012; Lai et al. in Compositionality and concepts in linguistics and psychology, 2017). The present paper reports an eye-tracking study that examined the costs of processing both verb types in Mandarin Chinese. The results revealed greater costs both for aspectual verbs compared to controls (John read the book) and for aspectual verbs compared to psychological verbs, reinforcing the claims of the Structured Individual Hypothesis (Piñango and Deo in J Semant 33:359–408, 2016). Strikingly, there was an early effect at the verb for aspectual verbs but not for psychological verbs. We argue that this result, together with previous findings and other conceptual issues, necessitates a conservative modification of the SIH: aspectual verbs are semantically more complex than psychological verbs. This modification retains the core analysis underlying the SIH, but reconciles the SIH with experimental findings by bringing it in line with the view that lexical semantic complexity has immediate consequences in processing (e.g., Brennan and Pylkkänen in Lang Cogn Process 25:777–807, 2010). |
Federica Magnabosco; Olaf Hauk An eye on semantics: A study on the influence of concreteness and predictability on early fixation durations Journal Article In: Language, Cognition and Neuroscience, pp. 1–15, 2023. @article{Magnabosco2023, We used eye-tracking during natural reading to study how semantic control and representation mechanisms interact for the successful comprehension of sentences, by manipulating sentence context and single-word meaning. Specifically, we examined whether a word's semantic characteristic (concreteness) affects first fixation and gaze durations (FFDs and GDs) and whether it interacts with the predictability of a word. We used a linear mixed effects model including several possible psycholinguistic covariates. We found a small but reliable main effect of concreteness and replicated a predictability effect on FFDs, but we found no interaction between the two. The results parallel previous findings of additive effects of predictability (context) and frequency (lexical level) in fixation times. Our findings suggest that the semantics of a word and the context created by the preceding words additively influence early stages of word processing in natural sentence reading. |
Marloes Mak; Myrthe Faber; Roel M. Willems Different kinds of simulation during literary reading: Insights from a combined fMRI and eye-tracking study Journal Article In: Cortex, vol. 162, pp. 115–135, 2023. @article{Mak2023, Mental simulation is an important aspect of narrative reading. In a previous study, we found that gaze durations are differentially impacted by different kinds of mental simulation. Motor simulation, perceptual simulation, and mentalizing as elicited by literary short stories influenced eye movements in distinguishable ways (Mak & Willems, 2019). In the current study, we investigated the existence of a common neural locus for these different kinds of simulation. We additionally investigated whether individual differences during reading, as indexed by the eye movements, are reflected in domain-specific activations in the brain. We found a variety of brain areas activated by simulation-eliciting content, both modality-specific brain areas and a general simulation area. Individual variation in percent signal change in activated areas was related to measures of story appreciation as well as personal characteristics (i.e., transportability, perspective taking). Taken together, these findings suggest that mental simulation is supported by both domain-specific processes grounded in previous experiences, and by the neural mechanisms that underlie higher-order language processing (e.g., situation model building, event indexing, integration). |
Marcello Maniglia; Kristina M. Visscher; Aaron R. Seitz Consistency of preferred retinal locus across tasks and participants trained with a simulated scotoma Journal Article In: Vision Research, vol. 203, pp. 1–9, 2023. @article{Maniglia2023, After loss of central vision following retinal pathologies such as macular degeneration (MD), patients often adopt compensatory strategies including developing a “preferred retinal locus” (PRL) to replace the fovea in tasks involving fixation. A key question is whether patients develop multi-purpose PRLs or whether their oculomotor strategies adapt to the demands of the task. While most MD patients develop a PRL, clinical evidence suggests that patients may develop multiple PRLs and switch between them according to the task at hand. To understand this, we examined a model of central vision loss in normally seeing individuals and tested whether they used the same or different PRLs across tasks after training. Nineteen participants trained for 10 sessions on contrast detection while in conditions of gaze-contingent, simulated central vision loss. Before and after training, peripheral looking strategies were evaluated during tasks measuring visual acuity, reading abilities and visual search. To quantify strategies in these disparate, naturalistic tasks, we measured and compared the amount of task-relevant information at each of 8 equally spaced, peripheral locations, while participants performed the tasks. Results showed that some participants used consistent viewing strategies across tasks whereas other participants' strategies differed depending on task. This novel method allows quantification of peripheral vision use even in relatively ecological tasks. These results represent one of the first examinations of peripheral viewing strategies across tasks in simulated vision loss. Results suggest that individual differences in peripheral looking strategies following simulated central vision loss may model those developed in pathological vision loss. |
Hannah S. Sarvasy; Adam Milton Morgan; Jenny Yu; Victor S. Ferreira; Shota Momma Cross-clause planning in Nungon (Papua New Guinea): Eye-tracking evidence Journal Article In: Memory & Cognition, vol. 51, no. 3, pp. 666–680, 2023. @article{Sarvasy2023, Hundreds of languages worldwide use a sentence structure known as the “clause chain,” in which 20 or more clauses can be stacked to form a sentence. The Papuan language Nungon is among a subset of clause chaining languages that require “switch-reference” suffixes on nonfinal verbs in chains. These suffixes announce whether the subject of each upcoming clause will differ from the subject of the previous clause. We examine two major issues in psycholinguistics: predictive processing in comprehension, and advance planning in production. Whereas previous work on other languages has demonstrated that sentence planning can be incremental, switch-reference marking would seem to prohibit strictly incremental planning, as it requires speakers to plan the next clause before they can finish producing the current one. This suggests an intriguing possibility: planning strategies may be fundamentally different in Nungon. We used a mobile eye-tracker and solar-powered laptops in a remote village in Papua, New Guinea, to track Nungon speakers' gaze in two experiments: comprehension and production. Curiously, during comprehension, fixation data failed to find evidence that switch-reference marking is used for predictive processing. However, during production, we found evidence for advance planning of switch-reference markers, and, by extension, the subjects they presage. We propose that this degree of advance syntactic planning pushes the boundaries of what is known about sentence planning, drawing on data from a novel morpheme type in an understudied language. |
Daniel Schmidtke; Sadaf Rahmanian; Anna L. Moro Tracking reading development in an English language university-level bridging program: evidence from eye-movements during passage reading Journal Article In: Bilingualism: Language and Cognition, vol. 26, pp. 356–370, 2023. @article{Schmidtke2023, Increasing numbers of international students enter university education via English language bridging programs. Much research has overlooked the nature of second language reading development during a bridging program, focusing instead on the development of literacy skills of international students who already meet the language requirement for undergraduate admission. We report a longitudinal eye-movement study assessing English passage reading efficiency and comprehension in 405 Chinese-speaking bridging program students. Incoming IELTS reading scores were used as an index of baseline reading ability. Linear mixed-effects regression models fitted to global eye-movement measures and reading comprehension indicated that despite initial between-subjects differences, within-subject change at each ability level progressed at the same rate, following parallel growth trajectories. Therefore, there was significant overall reading progress during the bridging program, but no evidence that the gap between low and high ability readers either closed or widened over time. |
Elizabeth R. Schotter; Sara Milligan; Victoria M. Estevez Event-related potentials show that parafoveal vision is insufficient for semantic integration Journal Article In: Psychophysiology, vol. 60, no. 7, pp. 1–25, 2023. @article{Schotter2023, Readers extract information from a word from parafoveal vision prior to looking at it. It has been argued that parafoveal perception allows readers to initiate linguistic processes, but it is unclear which stages of word processing are engaged: the process of extracting letter information to recognize words, or the process of extracting meaning to comprehend them. This study used the event-related brain potential (ERP) technique to investigate how word recognition (indexed by the N400 effect for unexpected or anomalous compared to expected words) and semantic integration (indexed by the Late-positive component; LPC effect for anomalous compared to expected words) are or are not elicited when the word is perceived only in parafoveal vision. Participants read a target word following a sentence that made it expected, unexpected, or anomalous, and read the sentences presented three words at a time in the Rapid Serial Visual Presentation (RSVP) with flankers paradigm so that words were perceived in parafoveal and foveal vision. We orthogonally manipulated whether the target word was masked in parafoveal and/or foveal vision to dissociate the processing associated with perception of the target word from either location. We found that the N400 effect was generated from parafoveally perceived words, and was reduced for foveally perceived words if they were previously perceived parafoveally. In contrast, the LPC effect was only elicited if the word was perceived foveally, suggesting that readers must attend to a word directly in foveal vision in order to attempt to integrate its meaning into the sentence context. |
Laura Schwalm; Ralph Radach Parafoveal syntactic processing from word N + 2 during reading: The case of gender-specific German articles Journal Article In: Psychological Research, vol. 87, no. 8, pp. 2511–2532, 2023. @article{Schwalm2023, Previous research has suggested that some syntactic information such as word class can be processed parafoveally during reading. However, it is still unclear to what extent early syntactic cueing within noun phrases can facilitate word processing during dynamic reading. Two experiments (total N = 72) were designed to address this question using a gaze-contingent boundary change paradigm to manipulate the syntactic fit within a nominal phrase. Either the article (Experiment 1) or the noun (Experiment 2) was manipulated in the parafovea, resulting in a syntactic mismatch, depending on the condition. Results indicated a substantial elevation of viewing times on both parts of the noun phrase when conflicting syntactic information had been present in the parafovea. In Experiment 1, the article was also fixated more often in the syntactic mismatch condition. These results provide direct evidence of parafoveal syntactic processing. Based on the early time-course of this effect, it can be concluded that grammatical gender is used to generate constraints for the processing of upcoming nouns. To our knowledge, these results also provide the first evidence that syntactic information can be extracted from a parafoveal word N + 2. |
Soroosh Shalileh; Dmitry Ignatov; Anastasiya Lopukhina; Olga Dragoy Identifying dyslexia in school pupils from eye movement and demographic data using artificial intelligence Journal Article In: PLoS ONE, vol. 18, pp. 1–26, 2023. @article{Shalileh2023, This paper represents our research results in the pursuit of the following objectives: (i) to introduce a novel multi-sources data set to tackle the shortcomings of the previous data sets, (ii) to propose a robust artificial intelligence-based solution to identify dyslexia in primary school pupils, (iii) to investigate our psycholinguistic knowledge by studying the importance of the features in identifying dyslexia by our best AI model. In order to achieve the first objective, we collected and annotated a new set of eye-movement-during-reading data. Furthermore, we collected demographic data, including the measure of non-verbal intelligence, to form our three data sources. Our data set is the largest eye-movement data set globally. Unlike the previously introduced binary-class data sets, it contains (A) three class labels and (B) reading speed. Concerning the second objective, we formulated the task of dyslexia prediction as regression and classification problems and scrutinized the performance of 12 classifications and eight regressions approaches. We exploited the Bayesian optimization method to fine-tune the hyperparameters of the models: and reported the average and the standard deviation of our evaluation metrics in a stratified ten-fold cross-validation. Our studies showed that multi-layer perceptron, random forest, gradient boosting, and k-nearest neighbor form the group having the most acceptable results. Moreover, we showed that although separately using each data source did not lead to accurate results, their combination led to a reliable solution. We also determined the importance of the features of our best classifier: our findings showed that the IQ, gender, and age are the top three important features; we also showed that fixation along the y-axis is more important than other fixation data. Dyslexia detection, eye fixation, eye movement, demographic, classification, regression, artificial intelligence. |