阅读和语言眼动追踪出版物
以下按年份列出了截至2024年(2025年初)的所有EyeLink眼动仪阅读和语言研究出版物。您可以使用视觉世界、理解、语音生成等关键字搜索眼动追踪出版物。您还可以搜索单个作者的姓名。如果我们错过了任何EyeLink阅读或语言研究文章,请给我们发电子邮件!
2025 |
Khaled H. A. Abdel-Latif; Thomas Koelewijn; Deniz Başkent; Hartmut Meister Assessment of speech processing and listening effort associated with speech-on-speech masking using the visual world paradigm and pupillometry Journal Article In: Trends in hearing, vol. 29, pp. 1–13, 2025. @article{AbdelLatif2025,Speech-on-speech masking is a common and challenging situation in everyday verbal communication. The ability to segregate competing auditory streams is a necessary requirement for focusing attention on the target speech. The Visual World Paradigm (VWP) provides insight into speech processing by capturing gaze fixations on visually presented icons that reflect the speech signal. This study aimed to propose a new VWP to examine the time course of speech segregation when competing sentences are presented and to collect pupil size data as a measure of listening effort. Twelve young normal-hearing participants were presented with competing matrix sentences (structure "name-verb-numeral-adjective-object") diotically via headphones at four target-to-masker ratios (TMRs), corresponding to intermediate to near perfect speech recognition. The VWP visually presented the number and object words from both the target and masker sentences. Participants were instructed to gaze at the corresponding words of the target sentence without providing verbal responses. The gaze fixations consistently reflected the different TMRs for both number and object words. The slopes of the fixation curves were steeper, and the proportion of target fixations increased with higher TMRs, suggesting more efficient segregation under more favorable conditions. Temporal analysis of pupil data using Bayesian paired sample t-tests showed a corresponding reduction in pupil dilation with increasing TMR, indicating reduced listening effort. The results support the conclusion that the proposed VWP and the captured eye movements and pupil dilation are suitable for objective assessment of sentence-based speech-on-speech segregation and the corresponding listening effort. |
Maryam A. Aljassmi; Kayleigh L. Warrington; Victoria A. Mcgowan; Fang Xie; Kevin B. Paterson Parafoveal preview benefit effects in vertical alphabetic reading Journal Article In: Language, Cognition and Neuroscience, pp. 1–10, 2025. @article{Aljassmi2025,The present study examines the extent to which the cognitive processes underlying reading can adapt to accommodate changes in text orientation. For readers of English, processing times are slowed substantially when reading text in the non-conventional vertical direction, but little is known about the processes underlying this slowdown. Accordingly, participants read English text presented in the conventional horizontal orientation, or rotated 90° clockwise to create a vertical orientation. Lexical processing was explored with word frequency effects and parafoveal processing was measured through parafoveal preview benefit. Reading times were longer, and word frequency effects were larger for vertical, compared with horizotonally presented text, in line with findings for reading in unfamiliar formats. Crucially, while clear preview benefit effects were observed for horizontal reading, these effects were entirely absent during vertical reading. These results provide novel insight into perceptual flexibility in foveal and parafoveal processing during reading. |
Dale J. Barr; Hanna Sirniö; Beáta Kovács; Kieran J. O'Shea; Shannon McNee; Alistair Beith; Heather Britain; Qintong Li Perspective conflict disrupts pragmatic inference in real-time language comprehension Journal Article In: Journal of Experimental Psychology: Learning, Memory, and Cognition, pp. 1–19, 2025. @article{Barr2025,In two visual-world eyetracking experiments, we investigated how effectively addressees use information about a speaker's perspective to resolve temporary ambiguities in spoken expressions containing prenominal scalar adjectives (e.g., the small candle). The experiments used a new “Display Change” task to create situations where an addressee's perspective conflicted with that of a speaker, allowing the point of disambiguation (early vs. late) to be specified independently from each perspective. Contrary to existing perspective-taking theories, the only situation in which addressees resolved references early was when both perspectives afforded early disambiguation. When perspectives conflicted, addressees exhibited a lower rate of preferential looks to the target and slower response times. This disruption to contrastive inference reflects either the suspension of pragmatic inferencing or cognitive limitations on the simultaneous representation and use of incompatible perspectives. |
Laurel Brehm; Nora Kennis; Christina Bergmann When is a ranana a banana? Disentangling the mechanisms of error repair and word learning Journal Article In: Language, Cognition and Neuroscience, pp. 1–21, 2025. @article{Brehm2025,When faced with an ambiguous novel word such as ‘ranana', how do listeners decide whether they heard a mispronunciation of a familiar target (‘banana') or a label for an unfamiliar novel item? We examined this question by combining visual-world eye-tracking with an offline forced-choice judgment paradigm. In two studies, we show evidence that participants entertain repair and novel label interpretations of novel words that were created by editing a familiar target word in multiple phonetic features (Experiment 1) or a single phonetic feature (Experiment 2). Repair (‘ranana' = a banana) and learning (‘ranana' = a novel referent) were both common interpretation strategies, and learning was strongly associated with visual attention to the novel image after it was referred to in a sentence. This indicates that repair and learning are both valid strategies for understanding novel words that depend upon a set of similar mechanisms, and suggests that attention during listening is causally related to whether one learns or repairs. |
Laurence Bruggeman; Evan Kidd; Rachel Nordlinger; Anne Cutler Incremental processing in a polysynthetic language (Murrinhpatha) Journal Article In: Cognition, vol. 257, pp. 1–7, 2025. @article{Bruggeman2025,Language processing is rapidly incremental, but evidence bearing upon this assumption comes from very few languages. In this paper we report on a study of incremental processing in Murrinhpatha, a polysynthetic Australian language, which expresses complex sentence-level meanings in a single verb, the full meaning of which is not clear until the final morph. Forty native Murrinhpatha speakers participated in a visual world eyetracking experiment in which they viewed two complex scenes as they heard a verb describing one of the scenes. The scenes were selected so that the verb describing the target scene had either no overlap with a possible description of the competitor image, or overlapped from the start (onset overlap) or at the end of the verb (rhyme overlap). The results showed that, despite meaning only being clear at the end of the verb, Murrinhpatha speakers made incremental predictions that differed across conditions. The findings demonstrate that processing in polysynthetic languages is rapid and incremental, yet unlike in commonly studied languages like English, speakers make parsing predictions based on information associated with bound morphs rather than discrete words. |
Andrew M Burleson; Pamela E Souza The time course of cognitive effort during disrupted speech Journal Article In: Quarterly Journal of Experimental Psychology, pp. 1–18, 2025. @article{Burleson2025,Listeners often find themselves in scenarios where speech is disrupted, misperceived, or otherwise difficult to recognise. In these situations, many individuals report exerting additional effort to understand speech, even when repairing speech may be difficult or impossible. This investigation aimed to characterise cognitive efforts across time during both sentence listening and a post-sentence retention interval by observing the pupillary response of participants with normal to borderline-normal hearing in response to two interrupted speech conditions: sentences interrupted by gaps of silence or bursts of noise. The pupillary response serves as a measure of the cumulative resources devoted to task completion. Both interruption conditions resulted in significantly greater levels of pupil dilation than the uninterrupted speech condition. Just prior to the end of a sentence, trials periodically interrupted by bursts of noise elicited greater pupil dilation than the silent-interrupted condition. Compared to the uninterrupted condition, both interruption conditions resulted in increased dilation after sentence end but before repetition, possibly reflecting sustained processing demands. Understanding pupil dilation as a marker of cognitive effort is important for clinicians and researchers when assessing the additional effort exerted by listeners with hearing loss who may use cochlear implants or hearing aids. Even when successful perceptual repair is unlikely, listeners may continue to exert increased effort when processing misperceived speech, which could cause them to miss upcoming speech or may contribute to heightened listening fatigue. |
Rita Cersosimo; Paul E. Engelhardt; Leigh Fernandez; Filippo Domaneschi Novel metaphor processing in dyslexia: A visual world eye-tracking study Journal Article In: Discourse Processes, pp. 1–21, 2025. @article{Cersosimo2025,Metaphor comprehension has been investigated in neurodevelopmental disorders, but studies devoted to adults with dyslexia are few and present inconsistent results. The present study sought to investigate how adults with dyslexia process novel metaphors. Individual differences in vocabulary, working memory, and Theory of Mind were also assessed. An online metaphor comprehension task based on the Visual World Paradigm was carried out with eye-tracking. Metaphors and corresponding literal sentences were aurally presented in isolation, and participants were asked to select a picture that best corresponded to the sentence they heard. Our results indicated that participants with dyslexia chose metaphor interpretations at a similar rate as did the control group. However, online processing data indicated generally slower response times, with a particular delay in processing metaphorical utterances. Eye movement analyses provided further insights into the underlying nature of the processing slowdowns, highlighting specific challenges encountered by individuals with dyslexia when interpreting figurative language. |
Jürgen Cholewa; Annika Kirschenkern; Frederike Steinke; Thomas Günther In: Journal of Speech, Language, and Hearing Research, pp. 1–19, 2025. @article{Cholewa2025,Purpose: Predictive language comprehension has become a major topic in psycholinguistic research. The study described in this article aims to investigate if German children with developmental language disorder (DLD) use grammatical gender agreement to predict the continuation of noun phrases in the same way as it has been observed for typically developing (TD) children. The study also seeks to differentiate between specific and general deficits in predictive processing by exploring the anticipatory use of semantic information. Additionally, the research examines whether the processing of gender and semantic information varies with the speed of stimulus presentation. Method: The study included 30 children with DLD (average age = 8.7 years) and 26 TD children (average age = 8.4 years) who participated in a visual-world eye- tracking study. Noun phrases, consisting of an article, an adjective, and a noun, were presented that matched with only one of two target pictures. The phrases contained a gender cue, a semantic cue, a combination of both, or none of these cues. The cues were provided by the article and/or adjective and could be used to identify the target picture before the noun itself was presented. Results: Both groups, TD children and those with DLD, utilized predictive processing strategies in response to gender agreement and semantic information when decoding noun phrases. However, children with DLD were only able to consider gender cues when noun phrases were presented at a slower speech rate, and even then, their predictive certainty remained below the typical level for their age. Conclusion: Based on these findings, the article discusses the potential relevance of the prediction framework for explaining comprehension deficits in chil- dren with DLD, as well as the clinical implications of the results. |
Andriana L. Christofalos; Nicole M. Arco; Madison Laks; Heather Sheridan The impact of interword spacing on inference processing during text reading: Evidence from eye movements Journal Article In: Discourse Processes, vol. 62, no. 1, pp. 1–15, 2025. @article{Christofalos2025,Removing interword spacing has been shown to disrupt lower-level oculomotor processes and word identification during text reading. However, the impact of these disruptions on higher-level processes remains unclear. To examine the influence of spacing on inferential processing, we monitored eye movements while participants read spaced and unspaced passages that were strongly or weakly constrained toward an inference. Removing spaces disrupted reading fluency, as evidenced by longer reading times, longer fixation durations, reduced skipping, and shorter saccades. We also observed the effects of inferential constraint for spaced passages as characterized by longer reading times, more regressions, and longer regression-path durations for weakly than strongly constrained passages. However, these constraint effects were absent for unspaced passages, suggesting that removing spaces disrupts inferential processing. Our results are consistent with models of reading and discourse processing that assume that higher-level reading processes depend on the quality of lexical representations developed at earlier, word-level reading stages. |
Sarah C. Creel Connecting the tots: Strong looking-pointing correlations in preschoolers' word learning and implications for continuity in language development Journal Article In: Child Development, vol. 96, pp. 87–103, 2025. @article{Creel2025,How does one assess developmental change when the measures themselves change with development? Most developmental studies of word learning use either looking (infants) or pointing (preschoolers and older). With little empirical evidence of the relationship between the two measures, developmental change is difficult to assess. This paper analyzes 914 pointing, looking children (451 female, varied ethnicities, 2.5–6.5 years, dates: 2009–2019) in 36 word- or sound-learning experiments with two-alternative test trials. Looking proportions and pointing accuracy correlated strongly (r =.7). Counter to the “looks first” hypothesis, looks were not sensitive to incipient knowledge that pointing missed: when pointing is at chance, looking proportions are also. Results suggest one possible path forward for assessing continuous developmental change. Methodological best practices are discussed. |
Jack Dempsey; Anna Tsiola; Nigel Bosch; Kiel Christianson; Mallory Stites Eye-movement indices of reading while debugging Python source code Journal Article In: Journal of Cognitive Psychology, vol. 37, no. 2, pp. 89–107, 2025. @article{Dempsey2025,Unlike text reading, the eye-movement behaviours associated with reading Python, a computer programming language, are largely understudied through a psycholinguistic lens. A general understanding of the eye movements involved in reading while troubleshooting Python, and how these behaviours compare to proofreading text, is critical for developing educational interventions and interactive tools for helping programmers debug their code. These data may also highlight to what extent humans use their underlying text reading ability when reading source code. The current work provides a profile of global reading behaviours associated with reading Python source code for debugging purposes. To this end, we recorded experienced programmers' eye movements while they determined whether 21 different Python functions would produce the desired output, an incorrect output, or an error message. Some reading behaviours seem to mirror those found in text reading (e.g. effects of stimulus complexity), while others may be specific to reading code. Results suggest that semantic errors that produce undesired outputs in programming source code may influence early stages of processing, likely due to the largely top-down strategy employed by experienced programmers when reading source code. The findings are framed to invigorate discussion and further exploration into psycholinguistic analysis of human source code reading. |
Leigh B. Fernandez; Muzna Shehzad; Lauren V. Hadley Younger adults may be faster at making semantic predictions, but older adults are more efficient Journal Article In: Psychology and Aging, pp. 1–8, 2025. @article{Fernandez2025,While there is strong evidence that younger adults use contextual information to generate semantic predictions, findings from older adults are less clear. Age affects cognition in a variety of different ways that may impact prediction mechanisms; while the efficiency of memory systems and processing speed decrease, life experience leads to complementary increases in vocabulary size, real-world knowledge, and even inhibitory control. Using the visual world paradigm, we tested prediction in younger (n = 30, between 18 and 35 years of age) and older adults (n = 30, between 53 and 78 years of age). Importantly, we differentiated early stage predictions based on simple spreading activation from the more resource-intensive tailoring of predictions when additional constraining information is provided. We found that older adults were slower than younger adults in generating early stage predictions but then quicker than younger adults to tailor those predictions given additional information. This suggests that while age may lead to delays in first activating relevant lexical items when listening to speech, increased linguistic experience nonetheless increases the efficiency with which contextual information is used. These findings are consistent with reports of age having positive as well as negative impacts on cognition and suggest conflation of different stages of prediction as a basis for the inconsistency in the aging-related literature to date. |
Zuzanna Fuchs; Olga Parshina; Irina A. Sekerina; Maria Polinsky Processing of verbal versus adjectival agreement: Implications for syntax and psycholinguistics Journal Article In: Glossa: a journal of general linguistics, vol. 10, no. 1, pp. 1–35, 2025. @article{Fuchs2025,Linguistic theories distinguish between external and internal agreement (e.g., noun-verb agreement vs.noun-modifier agreement, the latter also known as concord) and model them using different mechanisms.While this distinction has garnered considerable attention in syntactic theory, it remains largely unexplored in experimental work.In an effort to address this gap, we conducted two studies of external/internal agreement in Russian using self-paced reading and eye-tracking while reading.We measured the response to violations generated when native speakers encounter a noun that mismatches the features on an earlier element inflected for agreement (verb, modifying adjective, and predicative adjective).Both experimental studies found strong effects of ungrammaticality: participants were sensitive to agreement mismatches between the agreeing element and the trigger.However, there was no interaction observed between the effect of grammaticality and the type of agreeing element, suggesting that, while participants are sensitive to mismatches, the processing of the mismatches does not differ between external and internal agreement.Despite the cross-methodological replication of the null interaction effect, interpreting this result is necessarily tentative.We discuss possible implications, should the result be further replicated by future high-powered studies.We suggest that this outcome may indicate that differences in real-time processing of internal vs.external agreement may not be observable in time-course measures, or that the lack of such differences constitutes support for analyses of agreement as a two-step process, with one step in syntax, and the other, post-syntactic.We invite future work to test these hypotheses further. |
Helena Ghorbani; Gülcenur Özturan; Andrea Albonico; Jason J. S. Barton Reading words versus seeing font or handwriting style: A study of hemifield processing Journal Article In: Experimental Brain Research, vol. 243, no. 2, pp. 1–9, 2025. @article{Ghorbani2025,Tachistoscopic studies have established a right field advantage for the perception of visually presented words, which has been interpreted as reflecting a left hemispheric specialization. However, it is not clear whether this is driven by the linguistic task of word processing, or also occurs when processing properties such as the style and regularity of text. We had 23 subjects perform a tachistoscopic study while they viewed five-letter words in either computer font or handwriting. The task in one block was to respond if the word in the peripheral field matched a word just seen in the central field. In a second block with the same stimuli, the task was to respond if the style (handwriting or font) matched. We found a main effect of task: there was a right-field advantage for reading the word, but no field advantage for reporting the style of text. There was no effect of stimulus type and no interaction between task and stimulus type. We conclude that the field advantage for processing text is driven by the task, being specific for the processing the identity of the word and not the perception of the style of the text. We did not find evidence to support prior assertions that the type of text and its regularity influenced the field advantage during the word-reading task. |
Magdalena Gruner; Andreas Widmann; Stefan Wöhner; Erich Schröger; Jörg D. Jescheniak Semantic context effects in picture and sound naming: Evidence from event-related potentials and pupillometric data Journal Article In: Journal of cognitive neuroscience, vol. 37, no. 2, pp. 443–463, 2025. @article{Gruner2025,When a picture is repeatedly named in the context of semantically related pictures (homogeneous context), responses are slower than when the picture is repeatedly named in the context of unrelated pictures (heterogeneous context). This semantic interference effect in blocked-cyclic naming plays an important role in devising theories of word production. Wöhner, Mädebach, and Jescheniak [Wöhner, S., Mädebach, A., & Jescheniak, J. D. Naming pictures and sounds: Stimulus type affects semantic context effects. Journal of Experimental Psychology: Human Perception and Performance, 47, 716-730, 2021] have shown that the effect is substantially larger when participants name environmental sounds than when they name pictures. We investigated possible reasons for this difference, using EEG and pupillometry. The behavioral data replicated Wöhner and colleagues. ERPs were more positive in the homogeneous compared with the heterogeneous context over central electrode locations between 140-180 msec and 250-350 msec for picture naming and between 250 and 350 msec for sound naming, presumably reflecting semantic interference during semantic and lexical processing. The later component was of similar size for pictures and sounds. ERPs were more negative in the homogeneous compared with the heterogeneous context over frontal electrode locations between 400 and 600 msec only for sounds. The pupillometric data showed a stronger pupil dilation in the homogeneous compared with the heterogeneous context only for sounds. The amplitudes of the late ERP negativity and pupil dilation predicted naming latencies for sounds in the homogeneous context. The latency of the effects indicates that the difference in semantic interference between picture and sound naming arises at later, presumably postlexical processing stages closer to articulation. We suggest that the processing of the auditory stimuli interferes with phonological response preparation and self-monitoring, leading to enhanced semantic interference. |
Jinghua Huang; Mingyan Wang; Ting Zhang; Dongliang Zhang; Yi Zhou; Lujin Mao; Mengyao Qi Investigating the effect of emoji position on eye movements and subjective evaluations on Chinese sarcasm comprehension Journal Article In: Ergonomics, vol. 68, no. 2, pp. 251–266, 2025. @article{Huang2025,Evidence indicated that emojis could influence sarcasm comprehension and sentence processing in English. However, the effect of emojis on Chinese sarcasm comprehension remains unclear. Therefore, this study investigated the impact of the smiley emoji position and semantics on eye movements and subjective assessments during Chinese online communication. Our results showed that the presence of a smiley emoji improved participants' interpretation and perception of sarcasm. We also found shorter dwell times on sarcastic words compared to literal words under the comment-final emoji condition. Additionally, we clarified the time course of emojified sentence processing during Chinese reading: the presence of emoji initially decreased first fixation durations compared to the absence of emoji and then the comment-final emoji shortened dwell times on sarcastic words compared to literal words in the critical area of interest. Our findings suggested that the comment-final emoji was the preferable choice for avoiding semantic comprehension bias in China. |
Lingshan Huang The cognitive processing of nouns and verbs in second language reading: An eye-tracking study Journal Article In: Linguistics Vanguard, no. 288, pp. 1–11, 2025. @article{Huang2025a,This study explores the cognitive processing of nouns and verbs in second language (L2) reading, aiming to investigate the potential differences and their effects on comprehension performance. Twenty-five Chinese students read an English text while their eye movements were recorded. A reading comprehension test evaluated the participants' L2 reading comprehension performance. The results reveal a significant difference in total reading time between nouns and verbs. Additionally, total reading time, gaze duration, and the number of fixations on both nouns and verbs are negatively correlated with L2 reading comprehension performance. These findings suggest that while the initial processing mechanisms of nouns and verbs may be similar, they diverge in late stages of processing. |
Ivan Iotzov; Lucas C. Parra Effects of noise and reward on pupil size and electroencephalographic speech tracking in a word-detection task Journal Article In: European Journal of Neuroscience, vol. 61, pp. 1–12, 2025. @article{Iotzov2025,Speech is hard to understand when there is background noise. Speech intelligibility and listening effort both affect our ability to understand speech, but the relative contribution of these factors is hard to disentangle. Previous studies suggest that speech intelligibility could be assessed with EEG speech tracking and listening effort via pupil size. However, these measures may be confounded, because poor intelligibility may require a larger effort. To address this, we developed a novel word-detection paradigm that allows for a rapid behavioural assessment of speech processing. In this paradigm, words appear on the screen during continuous speech, similar to closed captioning. In two listening experiments with a total of 51 participants, we manipulated intelligibility by changing signal-to-noise ratios (SNRs) and modulated effort by varying monetary reward. Increasing SNR improved detection performance along with EEG speech tracking. Additionally, we find that pupil size increases with increased SNR. Surprisingly, when we modulated both reward and SNR, we found that reward modulated only pupil size, whereas SNR modulated only EEG speech tracking. We interpret this as the effects of arousal and listening effort on pupil size and of intelligibility on EEG speech tracking. The experimental paradigm |
Yu Cin Jian; Leo Yuk Ting Cheung Prediction of text-and-diagram reading comprehension by eye-movement indicators: A longitudinal study in elementary schools Journal Article In: European Journal of Psychology of Education, vol. 40, no. 1, pp. 1–25, 2025. @article{Jian2025,Eye-movement technology has been often used to examine reading processes, but research has seldom examined the relationship between the reading process and comprehension performance, and whether the relationships are similar or different across grades. To investigate this, we conducted a 3-year longitudinal study starting at grade 4, with 175 effect samples to track the development data of eye movements on text-and-diagram reading. A series of temporal and spatial eye-movement predictors were identified to predict reading comprehension in various grades. The result of a hierarchical regression model established that total fixation duration measures (reflects processing level) and mean fixation duration (reflects decoding efficiency) were relatively better predictors of the post-reading tests at grades 5 and 6. That is, the readers made more mental efforts and had better decoding ability, which predict better post-reading test scores. Meanwhile, in grades 5 and 6, rereading total fixation duration on both the main text and diagrams consistently predicted the post-reading tests, indicating that the readers' self-regulated study time on re-processing some specific information is important for reading comprehension. Besides, a longitudinal structural equation modeling (SEM) revealed that the readers' fixation durations and text-and-diagram regression count in the lower fourth grade could significantly predict the same indicators in the following 2 years. In summary, this study identified the critical eye-movement indicators for predicting reading-test performance, and these predictions were more effective for the readers in upper grades than for those in the lower grades. |
Marianna Kyriacou; Franziska Köder The cognitive underpinnings of irony comprehension: Fluid intelligence but not working memory modulates processing Journal Article In: Applied Psycholinguistics, vol. 45, pp. 1219–1250, 2025. @article{Kyriacou2025,The comprehension of irony involves a sophisticated inferential process requiring language users to go beyond the literal meaning of an utterance. Because of its complex nature, we hypothesized that working memory (WM) and fluid intelligence, the two main components of executive attention, would be involved in the understanding of irony: the former by maintaining focus and relevant information active during processing, the latter by disengaging irrelevant information and offering better problem-solving skills. In this eye-tracking reading experiment, we investigated how adults (N = 57) process verbal irony, based on their executive attention skills. The results indicated a null (or indirect) effect for WM, while fluid intelligence directly modulated the comprehension and processing of irony during reading. As fluid intelligence is an important individual-difference variable, the findings pave the way for future research on developmental and clinical populations who tend to struggle with nonliteral language. |
Melanie Labusch; Manuel Perea The CASE of brand names during sentence reading Journal Article In: Psychological Research, vol. 89, no. 1, pp. 1–10, 2025. @article{Labusch2025,Brand names typically maintain a distinctive letter case (e.g., IKEA, Google). This element is essential for theoretical (word recognition models) and practical (brand design) reasons. In abstractionist models, letter case is considered irrelevant, whereas instance-based models use surface information like letter case during lexical retrieval. Previous brand identification tasks reported faster responses to brands in their characteristic letter case (e.g., IKEA and Google faster than ikea and GOOGLE), favoring instance-based models. We examined whether this pattern can be generalized to normal sentence reading: Participants read sentences in which well-known brand names were presented intact (e.g., IKEA, Google) or with a modified letter case (e.g., Ikea, GOOGLE). Results showed a cost for brands written in uppercase, independently of their characteristic letter case, in early eye fixation measures (probability of first-fixation, first-fixation duration). However, for later measures (gaze duration and total times), fixation times were longer when the brand's letter case was modified, restricted to those brands typically written in lowercase (e.g., GOOGLE > Google, whereas Ikea ≲ IKEA). Thus, during sentence reading, both the actual letter case and the typical letter case of brand names interact dynamically, posing problems for abstractionist models of reading. |
Haiting Lan; Sixin Liao; Jan Louis Kruger Do advertisements disrupt reading? evidence from eye movements Journal Article In: Applied Cognitive Psychology, vol. 39, pp. 1–19, 2025. @article{Lan2025,Reading online texts is often accompanied by visual distractors such as advertisements. Although previous studies have found that visual distractors are attention-demanding, little is known about how they impact reading. Drawing on text-based and word-based eye-movement measures, the current study examines how three types of ads (static image, flashing text and video) influence readers' reading comprehension and reading process. Results show that increasingly animated ads were more distracting than static ones at the text level, as evidenced by more and longer fixations, and more regressions. Moreover, the word frequency effect was stronger when reading with ads with flashing text than without ads on gaze duration and total reading time, suggesting that linguistic-related animated ads interfere with word processing. Although visual distractors reduced their reading speed and word processing efficiency, readers managed to maintain sufficient comprehension by adopting a more mindful reading strategy, indicating how metacognition functions in complex reading situations. |
Zhiwei Liu; Yan Li; Jingxin Wang Flexible word position encoding in Chinese reading: Evidence from parafoveal preprocessing Journal Article In: Visual Cognition, pp. 1–9, 2025. @article{Liu2025b,Accurately encoding word positions plays a critical role in fluent reading, allowing readers to facilitate efficient comprehension. However, whether word position information can be encoded parafoveally remains unknown, particularly in unspaced languages like Chinese. This study investigated whether Chinese readers can extract word order information from parafoveal vision using the boundary paradigm and eye-tracking. Participants read sentences containing identical, transposed, or unrelated preview words, which were replaced by the target words upon the eyes crossing an invisible boundary. Results showed that reading times on the target words were longer for transposed compared to identical previews but shorter than unrelated previews. These findings suggest that word positional information can be encoded parafoveally during Chinese reading, but not in a strictly precise manner. The implications of the findings for the Chinese reading model are discussed. |
Belén López Assef; Tania Zamuner Task effects in children's word recall: Expanding the reverse production effect Journal Article In: Journal of Child Language, pp. 1–13, 2025. @article{LopezAssef2025,Words said aloud are typically recalled more than words studied under other techniques. In certain circumstances, production does not lead to this memory advantage. We investigated the nature of this effect by varying the task during learning. Children aged five to six years were trained on novel words which required no action (Heard) compared to Verbal-Speech (production), Non-Verbal-Speech (stick out tongue), and Non-Verbal-Non-Speech (touch nose). Eye-tracking showed successful learning of novel words in all training conditions, but no differences between conditions. Both non-verbal tasks disrupted recall, demonstrating that encoding can be disrupted when children perform different types of concurrent actions. |
Óscar Loureda Lamas; Mathis Teucher; Celia Hernández Pérez; Adriana Cruz Rubio; Carlos Gelormini-Lezama (Re)categorizing lexical encapsulation: An experimental approach Journal Article In: Journal of Pragmatics, vol. 239, pp. 4–15, 2025. @article{LouredaLamas2025,Anaphoric encapsulation is a discursive mechanism by which a noun phrase recovers an explicature. This eye tracking study addresses the question of whether categorizing versus recategorizing encapsulation lead to different processing patterns. Results show that (1) encapsulating noun phrases are cognitively prominent areas, (2) recategorization is never less effortful than categorization, (3) the prominence and instructional asymmetry of the encapsulating noun phrase with respect to the antecedent is greater in cases of recategorizing encapsulation. Overall, encapsulating noun phrases initiate a complex cognitive operation due to the nature of their antecedent, which includes both encoded and inferred information. A distinctive processing pattern emerges for recategorizing encapsulating noun phrases: greater local efforts, due to the introduction of new information, do not result in higher total reading times. Beyond the introductory section, the structure of this study is as follows: Section 2 discusses the properties of categorizing and recategorizing mechanisms. Section 3 reviews experimental research on nominal anaphoric encapsulation in Spanish. Section 4 outlines the key aspects of the experimental design and execution. Finally, sections 5 and 6 present the results of the experiment and offer a theoretical discussion of the findings. |
Margarethe Mcdonald; Tania S. Zamuner The relationship between language experience variables and the time course of spoken word recognition Journal Article In: Journal of Experimental Psychology: Learning, Memory, and Cognition, pp. 1–21, 2025. @article{Mcdonald2025,During spoken word recognition, words that are related phonologically (e.g., dog and dot) and words that are related semantically (e.g., dog and bear) are known to become active within the first second of word recognition. The time course of activation and resolution of these competing words changes as a function of linguistic knowledge. This preregistered study aimed to examine how a less commonly used linguistic predictor, percent lifetime language exposure, affects the time course of target and competitor activation in an eye-tracking visual world paradigm. Lifetime exposure was expected to capture variability in the representations and processes that contribute to individual differences in spoken word recognition. Results show that when putting lifetime exposure to French on a scale, more lifetime exposure was related to target fixations and slightly related to early phonological coactivation, but not related to semantic coactivation. These analyses demonstrate how generalized additive mixed models might help examine time course data with more continuous linguistic variables. Exploratory analyses looked at the amount of variance captured by three linguistic experience predictors (lifetime French exposure, recent French exposure, French vocabulary) on indices of target, phonological, and semantic fixations and identified vocabulary size as most frequently explaining significant variance, but the pattern of results did not differ from those of lifetime language exposure. These findings suggest that lifetime language exposure may not fully capture subtle differences in linguistic experience that affect lexical coactivation such as those brought upon by differences in exposure trajectories across the lifetime or differences in the setting of language exposure. |
Zhu Meng; Guoli Yan; John E. Marsh; Simon P. Liversedge Primary task demands modulate background speech disruption during reading of Chinese tongue twisters: An eye-tracking study Journal Article In: Journal of Cognitive Psychology, pp. 1–18, 2025. @article{Meng2025,This study investigated how the semantic and phonological properties of background speech affect reading, depending on primary task processing. Chinese participants were randomly assigned to two groups and read Chinese tongue twisters while exposed to meaningful, meaningless, spectrally-rotated speech (acoustically similar to normal speech but without linguistic information), or silence. One group engaged in a semantic task, comprehending sentences and responding to “yes-no” questions, while the other performed a phonological task, identifying the most frequent initial phoneme in sentences and selecting a corresponding character. Although background speech did not significantly influence accuracy for either task, it differentially impacted eye movements and reading rates. Semantic properties disrupted the semantic task without significantly affecting the phonological task, while phonological properties influenced both tasks, particularly the phonological one. These findings indicate that the nature of the reading task modulates the disruptive effects of background speech, supporting the interference-by-process account. |
Maria Eleonora Minissi; Alexia Antzaka; Simona Mancini; Marie Lallier Can playing video games enhance reading skills through more efficient serial visual search mechanisms? Insights from an eye tracking study Journal Article In: Language, Cognition and Neuroscience, vol. 40, no. 2, pp. 209–230, 2025. @article{Minissi2025,Reading disorders are associated with atypical top-down visual attention (VA) processes like reduced VA span and slower serial visual search (SVS). In contrast, expert action video game (AVG) players, known for their efficient top-down VA, exhibit improved reading abilities. It is unclear whether these benefits stem solely from AVGs or apply to other gaming experiences. To explore this, AVG players (AVGPs), players of genres excluding AVGs (VGPs), and non-players were evaluated on their VA span, and behavioural and oculomotor performance in SVS. VGPs, but not AVGPs, demonstrated enhanced performance and oculomotor behaviour in SVS compared to non-players, while both player groups showed a trend towards better VA span skills. Notably, reading-related skills were enhanced in the two player groups, but particularly more so in VGPs. These findings support the existence of potential benefits of playing video games different from classical AVGs for the development of top-down VA and reading-related abilities. |
Ryan M. O'Leary; Nicole M. Amichetti; Zoe Brown; Alexander J. Kinney; Arthur Wingfield Congruent prosody reduces cognitive effort in memory for spoken sentences: A pupillometric study with young and older adults Journal Article In: Experimental Aging Research, vol. 51, no. 1, pp. 35–58, 2025. @article{OLeary2025,Background: In spite of declines in working memory and other processes, older adults generally maintain good ability to understand and remember spoken sentences. In part this is due to preserved knowledge of linguistic rules and their implementation. Largely overlooked, however, is the support older adults may gain from the presence of sentence prosody (pitch contour, lexical stress, intra-and inter-word timing) as an aid to detecting the structure of a heard sentence. Methods: Twenty-four young and 24 older adults recalled recorded sentences in which the sentence prosody corresponded to the clausal structure of the sentence, when the prosody was in conflict with this structure, or when there was reduced prosody uninformative with regard to the clausal structure. Pupil size was concurrently recorded as a measure of processing effort. Results: Both young and older adults' recall accuracy was superior for sentences heard with supportive prosody than for sentences with uninformative prosody or for sentences in which the prosodic marking and causal structure were in conflict. The measurement of pupil dilation suggested that the task was generally more effortful for the older adults, but with both groups showing a similar pattern of effort-reducing effects of supportive prosody. Conclusions: Results demonstrate the influence of prosody on young and older adults' ability to recall accurately multi-clause sentences, and the significant role effective prosody may play in preserving processing effort. |
Wesley Orth; Shayne Sloggett; Masaya Yoshida Positive polarity items: An illusion of ungrammaticality Journal Article In: Language, Cognition and Neuroscience, pp. 1–25, 2025. @article{Orth2025,Negative Polarity Item (NPIs) produce an illusion of grammaticality in some contexts with negation. Many approaches to modelling the NPI illusion propose that it is driven by the processor's attempt to link an NPI to a negative element. We investigate an illusion effect observed with Positive Polarity Item (PPIs), another class of polarity sensitive element. While NPIs must be licensed by a negative element, PPIs are anti-licensed by negative elements. We find an illusion of ungrammaticality for PPIs in environments where an illusion of grammaticality is observed for NPIs. Thus, we argue there is a general polarity illusion. We find that several accounts of the NPI illusion either predict this PPI illusion or can capture this effect with a straightforward extension. The approaches which are able to predict this effect share a reliance on structural representation, highlighting the importance of both the licensing features of polarity items and the structural detail in sentence processing representations. |
Ascensión Pagán; Federica Degno; Sara V. Milledge; Richard D. Kirkden; Sarah J. White; Simon P. Liversedge; Kevin B. Paterson Aging and word predictability during reading: Evidence from eye movements and fixation-related potentials Journal Article In: Attention, Perception, & Psychophysics, pp. 1–26, 2025. @article{Pagan2025,The use of context to facilitate the processing of words is recognized as a hallmark of skilled reading. This capability is also hypothesized to change with older age because of cognitive changes across the lifespan. However, research investigating this issue using eye movements or event-related potentials (ERPs) has produced conflicting findings. Specifically, whereas eye-movement studies report larger context effects for older than younger adults, ERP findings suggest that context effects are diminished or delayed for older readers. Crucially, these contrary findings may reflect methodological differences, including use of unnatural sentence displays in ERP research. To address these limitations, we used a coregistration technique to record eye movements (EMs) and fixation-related potentials (FRPs) simultaneously while 44 young adults (18–30 years) and 30 older adults (65+ years) read sentences containing a target word that was strongly or weakly predicted by prior context. Eye-movement analyses were conducted over all data (full EM dataset) and only data matching FRPs. FRPs were analysed to capture early and later components 70–900 ms following fixation-onset on target words. Both eye-movement datasets and early FRPs showed main effects of age group and context, while the full EM dataset and later FRPs revealed larger context effects for older adults. We argue that, by using coregistration methods to address limitations of earlier ERP research, our experiment provides compelling complementary evidence from eye movements and FRPs that older adults rely more on context to integrate words during reading. |
Adam J. Parker; Timothy J. Slattery Frequency and predictability effects for line final words Journal Article In: Journal of Experimental Psychology: Human Perception and Performance, vol. 51, no. 1, pp. 92–112, 2025. @article{Parker2025,Computational models of eye movement control during reading have revolutionized the study of visual, perceptual, and linguistic processes underlying reading. However, these models can only simulate and test predictions about the reading of single lines of text. Here we report two studies that examined how input var- iables for lexical processing (frequency and predictability) in these models influence the processing of line- final words. The first study was a linear mixed-effects analysis of the Provo Corpus, which included data from 84 readers reading 55 multiline texts. The second study was a preregistered eye movement experiment, where 32 participants read 128 items where frequency, predictability, and position (intraline vs. line-final) were orthogonally manipulated. Both studies were consistent in showing that reading timeswere shorter on line-final words.While therewasmixed evidence for frequency and predictability effects in the ProvoCorpus, our exper- imental data confirmed additive effects of frequency and predictability for line-final words, which did not differ from those for intralinewords.We conclude that while models that make additive assumptions about the role of frequency and predictability may be better suited to modeling the current findings, additional assumptions are required if models are to be capable of modeling shorter reading times on line-final words. |
Olga Parshina; Anna Smirnova; Sofya Goldina; Emily Bainbridge The effect of the global language context on bilingual language control during L1 reading Journal Article In: Bilingualism: Language and Cognition, pp. 1–11, 2025. @article{Parshina2025,The proactive gain control hypothesis suggests that the global language context regulates lexical access to the bilinguals' languages during reading. Specifically, with increasing exposure to non-target language cues, bilinguals adjust the lexical activation to allow non-target language access from the earliest word recognition stages. Using the invisible boundary paradigm, we examined the flow of lexical activation in 50 proficient Russian-English bilinguals reading in their native Russian while the language context shifted from a monolingual to a bilingual environment. We gradually introduced non-target language cues (the language of experimenter and fillers) while also manipulating the type of word previews (identical, code-switches, unrelated code-switches, pseudowords). The results revealed the facilitatory reading effects of code-switches but only in the later lexical processing stages and these effects were independent of the global language context manipulation. The results are discussed from the perspective of limitations imposed by script differences on bilingual language control flexibility. |
Seema Prasad; Shivam Puri; Keerthana Kapiley; Riya Rafeekh Looking without knowing: Evidence for language-mediated eye movements to masked words in Hindi-English bilinguals Journal Article In: Languages, vol. 10, no. 2, pp. 1–15, 2025. @article{Prasad2025,Cross-linguistic activation has been frequently demonstrated in bilinguals through eye movements using the visual world paradigm. In this study, we explored if such activations could operate below thresholds of awareness, at least in the visual modality. Participants listened to a spoken word in Hindi or English and viewed a display containing masked printed words. One of the printed words was a phonological cohort of the translation equivalent of the spoken word (TE cohort). Previous studies using this paradigm with clearly visible words on a similar sample have demonstrated robust activation of TE cohorts. We tracked eye movements to a blank screen where the masked written words had appeared accompanied by spoken words. Analyses of fixation proportions and dwell times revealed that participants looked more often and for longer duration at quadrants that contained the TE cohorts compared to distractors. This is one of the few studies to show that cross-linguistic activation occurs even with masked visual information. We discuss the implications for bilingual parallel activation and unconscious processing of habitual visual information. |
Manuel F. Pulido; Marijana Macis; Suhad Sonbul The effects of adjacent and nonadjacent collocations on processing: Eye-tracking evidence from “nested” collocations Journal Article In: Journal of Experimental Psychology: Learning, Memory, and Cognition, pp. 1–19, 2025. @article{Pulido2025,There is now robust evidence of priming effects during sentence processing for adjacent words that form collocations (statistically associated combinations). However, there is very limited evidence regarding how nonadjacent collocations might facilitate processing. Furthermore, no previous research has examined how nonadjacent collocations interplay with other (non)collocational material in the surrounding context. We employed “nested” collocations for the first time, in which more than one contextual element (verb, adjective) is a potential collocate for a noun. For example, in a verb–adjective–noun (V-A-N) phrase, two collocations may be “nested” (“express concerns” + “valid concerns” = “express valid concerns”) or only the verb (nonadjacent) or adjective (adjacent) might be collocational. In an eye-tracking experiment with L1 English speakers, we manipulated the collocational status of adjectives adjacent to the noun, (V)-A-N, and verbs nonadjacent to the noun, V-(A)-N. Our results replicated the basic adjacent effect and produced evidence of facilitation for nonadjacent collocations. Additionally, we find preliminary evidence for a syntactic primacy effect, whereby collocational links involving the verb prove more impactful than adjective–noun collocations, despite nonadjacency. Importantly, the results reveal cumulative facilitation in “nested collocations,” with a boost resulting from the simultaneous effects observed in adjacent and nonadjacent collocations. Altogether, the results extend our understanding of collocational priming effects beyond single collocations. wibble99: |
Michela Redolfi; Chiara Melloni Processing adjectives in development: Evidence from eye-tracking Journal Article In: Journal of Child Language, vol. 52, pp. 270–293, 2025. @article{Redolfi2025,Combining adjective meaning with the modified noun is particularly challenging for children under three years. Previous research suggests that in processing noun-adjective phrases children may over-rely on noun information, delaying or omitting adjective interpretation. However, the question of whether this difficulty is modulated by semantic differences among (subsective) adjectives is underinvestigated. A visual-world experiment explores how Italian-learning children (N=38, 2;4-5;3) process noun-adjective phrases and whether their processing strategies adapt based on the adjective class. Our investigation substantiates the proficient integration of noun and adjective semantics by children. Nevertheless, alligning with previous research, a notable asymmetry is evident in the interpretation of nouns and adjectives, the latter being integrated more slowly. Remarkably, by testing toddlers across a wide age range, we observe a developmental trajectory in processing, supporting a continuity approach to children's development. Moreover, we reveal that children exhibit sensitivity to the distinct interpretations associated with each subsective adjective. |
Tracy E Reuter; Lauren L Emberson Relative contributions of predictive vs associative processes to infant looking behavior during language comprehension Journal Article In: Journal ofChild Language, pp. 1–24, 2025. @article{Reuter2025,Numerous developmental findings suggest that infants and toddlers engage predictive processing during language comprehension. However, a significant limitation of this research is that associative (bottom-up) and predictive (top-down) explanations are not readily differentiated. Following adult studies that varied predictiveness relative to semantic-relatedness to differentiate associative vs. predictive processes, the present study used eye-tracking to begin to disentangle the contributions of bottom-up and top-down mechanisms to infants' real-time language processing. Replicating prior results, infants (14-19 months old) use successive semantically-related words across sentences (e.g., eat, yum, mouth) to predict upcoming nouns (e.g., cookie). However, we also provide evidence that using successive semantically-related words to predict is distinct from the bottom-up activation of the word itself. In a second experiment, we investigate the potential effects of repetition on the findings. This work is the first to reveal that infant language comprehension is affected by both associative and predictive processes. |
Lilly Roth; Hans Christoph Nuerk; Felix Cramer; Gabriella Daroczy In: Psychological Research, vol. 89, no. 1, pp. 1–24, 2025. @article{Roth2025,Solving arithmetic word problems requires individuals to create a correct mental representation, and this involves both text processing and number processing. The latter comprises understanding the semantic meaning of numbers (i.e., their magnitudes) and potentially executing the appropriate mathematical operation. However, it is not yet clear whether number processing occurs after text processing or both take place simultaneously. We hypothesize that number processing occurs early and simultaneously with other problem-solving processes such as text processing. To test this hypothesis, we created non-solvable word problems that do not require any number processing and we manipulated the calculation difficulty using carry/borrow vs. non-carry/non-borrow within addition and subtraction problems. According to a strictly sequential model, this manipulation should not matter, because when problems are non-solvable, no calculation is required. In contrast, according to an interactive model, attention to numbers would be higher when word problems require a carry/borrow compared to a non-carry/non-borrow operation. Eye-tracking was used to measure attention to numbers and text in 63 adults, operationalized by static (duration and count of fixations and regressions) and dynamic measures (count of transitions). An interaction between difficulty and operation was found for all static and dynamic eye-tracking variables as well as for response times and error rates. The observed number processing in non-solvable word problems, which indicates that it occurs simultaneously with text processing, is inconsistent with strictly sequential models. |
Duygu F. Şafak; Holger Hopp Learning L2 grammar from prediction errors? Verb biases in structural priming in comprehension and production Journal Article In: Bilingualism: Language and Cognition, pp. 1–17, 2025. @article{Safak2025,This study tests whether prediction error underlies structural priming in a later-learnt L2 across two visual world eye-tracking priming experiments. Experiment 1 investigates priming when learners encounter verbs biased to double-object-datives (DO, “pay”) or prepositional-object- datives (PO, “send”) in the other structure in prime sentences. L1-German–L2-English learners read prime sentences crossing verb bias and structure (DO/PO). Subsequently, they heard target sentences – with unbiased verbs (“show”) – while viewing visual scenes. In line with implicit learning models, gaze data revealed priming and prediction-error effects, namely, more pre- dictive looks consistent with PO following PO primes with DO-bias verbs. Priming in compre- hension persisted into (unprimed) production, indicating that priming by prediction error leads to longer-term learning. Experiment 2 investigates the effects of target verb bias on error-based priming. Priming and prediction-error effects were reduced for targets with non-alternating verbs (“donate”) that only allow PO structures, suggesting learners' knowledge of the L2 grammar modulates prediction-error-based priming. Highlights |
Rosa Salmela; Minna Lehtonen; Seppo Vainio; Raymond Bertram Challenges in inflected word processing for L2 speakers The role of stem allomorphy Journal Article In: Studies in Second Language Acquisition, pp. 1–28, 2025. @article{Salmela2025,Morphological knowledge refers to the ability to recognize and use morphemes correctly in syntactic contexts and word formation. This is crucial for learning a morphologically rich language like Finnish, which features both agglutinative and fusional morphology. In Finnish, agglutination occurs in forms like aamu: aamu+lla (‘morning: in the morning'), where a suffix is transparently added. Fusional features, as seen in ilta: illa+lla (‘evening: in the evening'), involve allomorphic stemchanges that reduce transparency. We investigated the challenges posed by stem allomorphy for word recognition in isolation and in context for L2 learners and L1 speakers ofFinnish. In a lexical decision task, L2 speakers had longer response times and higher error rates for semitransparent inflections, while L1 speakers showed longer response times for both transparent and semitransparent inflection types. In sentence reading, L2 speakers exhibited longer fixation times for semitransparent forms, whereas L1 speakers showed no significant effects. The results suggest that the challenges in L2 inflectional processing are more related to fusional than agglutinative features of the Finnish language. |
Daniel Schmidtke; Julie A. Van Dyke; Victor Kuperman DerLex: An eye‑movement database of derived word reading in English Journal Article In: Behavior Research Methods, vol. 57, no. 1, pp. 1–15, 2025. @article{Schmidtke2025,This paper introduces a new database of eye-tracking data on English derived words, DerLex. A total of 598 unique derived suffixed words were embedded in sentences and read by 357 participants representing both university convenience pools and community pools of non-college-bound adults. Besides the eye-movement record of reading derived suffixed words, the DerLex database provides the author recognition test (ART) scores for each participant, tapping into their reading proficiency, as well as multiple lexical variables reflecting distributional, orthographic, phonological, and semantic features of the words, their constituent morphemes, and morphological families. The paper additionally reports the main effects of select lexical variables and their interactions with the ART scores. It also produces estimates of statistical power and sample sizes required to reliably detect those lexical effects. While some effects are robust and can be readily detected even in a small-scale typi- cal experiment, the over-powered DerLex database does not offer sufficient power to detect many other effects—including those of theoretical importance for existing accounts of morphological processing. We believe that both the availability of the new data resource and the limitations it provides for the planning and design of upcoming experiments are useful for future research on morphological complexity. |
Jens Schmidtke; Dana Bsharat-Maalouf; Tamar Degani; Hanin Karawani How lexical frequency, language dominance and noise affect listening effort–insights from pupillometry insights from pupillometry Journal Article In: Language, Cognition and Neuroscience, vol. 40, no. 2, pp. 195–208, 2025. @article{Schmidtke2025a,Acoustic, listener, and stimulus-related factors modulate speech-in-noise processes. This study examined how noise, listening experience, manipulated at two levels, native [L1] vs. second language [L2], and lexical frequency impact listening effort. Forty-seven participants, tested in their L1 Hebrew and L2 English, completed a word recognition test in quiet and noisy conditions while pupil size was recorded to assess listening effort. Results showed that listening in L2 was overall more effortful than in L1, with frequency effects modulated by language and noise. In L1, pupil responses to high and low frequency words were similar in both conditions. In L2, low frequency words elicited a larger pupil response, indicating greater effort, but this effect vanished in noise. A time-course analysis of the pupil response suggests that L1–L2 processing differences occur during lexical selection, indicating that L2 listeners may struggle to match acoustic-phonetic signals to long-term memory representations. |
Sarah Schuster; Kim Lara Weiss; Florian Hutzler; Martin Kronbichler; Stefan Hawelka Interactive and additive effects of word frequency and predictability: A fixation-related fMRI study Journal Article In: Brain and Language, vol. 260, pp. 1–7, 2025. @article{Schuster2025,The effects of word frequency and predictability are informative with respect to bottom-up and top-down mechanisms during reading. Word frequency is assumed to index bottom-up, whereas word predictability top-down information. Findings regarding potential interactive effects, however, are inconclusive. An interactive effect would suggest an early lexical impact of contextual top-down mechanisms where both variables are processed concurrently in early stages of word recognition. An additive effect, to the contrary, would suggest that contextual top-down processing only occurs post-lexically. We evaluated potential interactions between word frequency and predictability during silent reading by means of functional magnetic resonance imaging and simultaneous eye-tracking (i.e., fixation-related fMRI). Our data revealed exclusively additive effects. Specifically, we observed effects of word frequency and word predictability in left inferior frontal regions, whereas word frequency additionally exhibited an effect in the left occipito-temporal cortex. We interpret our findings in terms of contextual top-down processing facilitation. |
Irina A. Sekerina; Olga Parshina; Vladislava Staroverova; Natalia Gagarina Attention–language interface in Multilingual Assessment Instrument for Narratives Journal Article In: Journal of Experimental Child Psychology, vol. 249, pp. 1–19, 2025. @article{Sekerina2025,The current study employed the Multilingual Assessment Instrument for Narratives (MAIN) to test comprehension of narrative macrostructure in Russian in a visual world eye-tracking paradigm. The four MAIN visual narratives are structurally similar and question referents' goals and internal states (IS). Previous research revealed that children's MAIN comprehension differed among the four narratives in German, Swedish, Russian, and Turkish, but it is not clear why. We tested whether the difference in comprehension was (a) present, (b) caused by complicated inferences in understanding IS compared with goals, and (c) ameliorated by orienting visual attention to the referents whose IS was critical for accurate comprehension. Our findings confirmed (a) and (b) but found no effect of attentional cues on accuracy for (c). The multidimensional theory of narrative organization of children's knowledge of macrostructure needs to consider the type of inferences necessary for IS that are influenced by subjective interpretation and reasoning. |
Lauren N. Slivka; Kenna R. H. Clayton; Greg D. Reynolds Mask-wearing affects infants' selective attention to familiar and unfamiliar audiovisual speech Journal Article In: Frontiers in Developmental Psychology, vol. 3, pp. 1–8, 2025. @article{Slivka2025,This study examined the immediate effects of mask-wearing on infant selective visual attention to audiovisual speech in familiar and unfamiliar languages. Infants distribute their selective attention to regions of a speaker's face differentially based on their age and language experience. However, the potential impact wearing a face mask may have on infants' selective attention to audiovisual speech has not been systematically studied. We utilized eye tracking to examine the proportion of infant looking time to the eyes and mouth of a masked or unmasked actress speaking in a familiar or unfamiliar language. Six-month-old and 12-month-old infants (n = 42, 55% female, 91%White Non-Hispanic/Latino) were shown videos of an actress speaking in a familiar language (English) with and without a mask on, as well as videos of the same actress speaking in an unfamiliar language (German) with and without a mask. Overall, infants spent more time looking at the unmasked presentations compared to the masked presentations. Regardless of language familiarity or age, infants spent more time looking at the mouth area of an unmasked speaker and they spent more time looking at the eyes of a masked speaker. These findings indicate mask-wearing has immediate effects on the distribution of infant selective attention to different areas of the face of a speaker during audiovisual speech. |
Lukas Suveg; Tanvi Thakkar; Emily Burg; Shelly P. Godar; Daniel Lee; Ruth Y. Litovsky The relationship between spatial release from masking and listening effort among cochlear implant users with single-sided deafness Journal Article In: Ear & Hearing, pp. 1–16, 2025. @article{Suveg2025,Objectives: To examine speech intelligibility and listening effort in a group of patients with single-sided deafness (SSD) who received a cochlear implant (CI). There is limited knowledge on how effectively SSD-CI users can integrate electric and acoustic inputs to obtain spatial hearing benefits that are important for navigating everyday noisy environments. The present study examined speech intelligibility in quiet and noise simultaneously with measuring listening effort using pupillometry in individuals with SSD before, and 1 year after, CI activation. The study was designed to examine whether spatial separation between target and interfering speech leads to improved speech understanding (spatial release from masking [SRM]), and is associated with a decreased effort (spatial release from listening effort [SRE]) measured with pupil dilation (PPD). Design: Eight listeners with adult-onset SSD participated in two visits: (1) pre-CI and (2) post-CI (1 year after activation). Target speech consisted of Electrical and Electronics Engineers sentences and masker speech consisted of AzBio sentences. Outcomes were measured in three target-masker configurations with the target fixed at 0° azimuth: (1) quiet, (2) co-located target/maskers, and (3) spatially separated (±90° azimuth) target/maskers. Listening effort was quantified as change in peak proportional PPD on the task relative to baseline dilation. Participants were tested in three listening modes: acoustic-only, CI-only, and SSD-CI (both ears). At visit 1, the acoustic-only mode was tested in all three target-masker configurations. At visit 2, the acoustic-only and CI-only modes were tested in quiet, and the SSD-CI listening mode was tested in all three target-masker configurations. Results: Speech intelligibility scores in quiet were at the ceiling for the acoustic-only mode at both visits, and in the SSD-CI listening mode at visit 2. In quiet, at visit 2, speech intelligibility scores were significantly worse in the CI-only listening modes than in all other listening modes. Comparing SSD-CI listening at visit 2 with pre-CI acoustic-only listening at visit 1, speech intelligibility scores for co-located and spatially separated configurations showed a trend toward improvement (higher scores) that was not significant. However, speech intelligibility was significantly higher in the separated compared with the co-located configuration in acoustic-only and SSD-CI listening modes, indicating SRM. PPD evoked by speech presented in quiet was significantly higher with CI-only listening at visit 2 compared with acoustic-only listening at visit 1. However, there were no significant differences between co-located and spatially separated configurations on PPD, likely due to the variability among this small group of participants. There was a negative correlation between SRM and SRE, indicating that improved speech intelligibility with spatial separation of target and masker is associated with a greater decrease in listening effort on those conditions. Conclusions: The small group of patients with SSD-CI in the present study demonstrated improved speech intelligibility from spatial separation of target and masking speech, but PPD measures did not reveal the effects of spatial separation on listening effort. However, there was an association between the improvement in speech intelligibility (SRM) and the reduction in listening effort (SRE) from spatial separation of target and masking speech. |
Zohre Soleymani Tekbudak; Mehdi Purmohammad; Ayşegül Özkan; Cengiz Acartürk The PSR corpus: A Persian sentence reading corpus of eye movements Journal Article In: Behavior Research Methods, vol. 57, no. 1, pp. 1–16, 2025. @article{Tekbudak2025,The present study introduces the Persian Sentence Reading (PSR) Corpus, aiming to expand empirical data for Persian, an under-investigated language in research on oculomotor control in reading. Reading research has largely focused on Latin script languages with a left-to-right reading direction. However, languages with different reading directions, such as right-to-left and top-to-bottom, and particularly Persian script-based languages like Farsi and Dari, have remained understudied. This study pioneers in providing an eye movement dataset for reading Persian sentences, enabling further exploration of the influences of unique Persian characteristics on eye movement patterns during sentence reading. The core objective of the study is to provide data about how word characteristics impact eye movement patterns. The research also investigates the characteristics of the interplay between neighboring words and eye movements on them. By broadening the scope of reading research beyond commonly studied languages, the study aims to contribute to an interdisciplinary approach to reading research, exemplifying investigations through various theoretical and methodological perspectives. |
Kathryn A. Tremblay; Katja Mcbane; Katherine S. Binder The role of morphology and sentence context in word processing for adults with low literacy Journal Article In: Journal of Learning Disabilities, pp. 1–15, 2025. @article{Tremblay2025,Both vocabulary skill and morphological complexity, or whether words can be broken down into root words and affixes, have a significant impact on word processing for adults with low literacy. We investigated the influence of word-level variables of morphological complexity and root word frequency, and the sentence-level variable of context strength on word processing in adults with low literacy, who differed on levels of vocabulary depth skills, which was a participant- level variable. Our findings demonstrate that morphological complexity, root word frequency, and context strength are all related to how adult learners process words while reading, but their effects are dependent on participants' vocabulary depth. Participants with higher levels of vocabulary depth were able to more quickly process morphologically complex words and make better use of supportive sentence context as compared to individuals with lower levels of vocabulary depth. These findings suggest that both morphological complexity and vocabulary depth are important for word processing and reading comprehension in adults with low literacy. |
Fang Xie; Wanying Chen; Lei Zhang; Xiaohua Cao; Kayleigh L. Warrington Exploring the role of word segmentation on parafoveal processing during Chinese reading Journal Article In: Journal of Cognitive Psychology, vol. 37, no. 1, pp. 1–14, 2025. @article{Xie2025,The importance of the word as a unit of meaning is well-established for readers of both alphabetic languages and Chinese. However, the unspaced nature of written Chinese raises questions about how readers use upcoming information to guide word segmentation and to adjust the parafoveal processing of subsequent characters. Using an eye-tracking experiment, we investigated whether Chinese readers pre-process character C2 more when it forms a word with C1 than when they belong to separate words. The boundary paradigm was used to manipulate the preview of C2, such that readers saw either an identity (normal) or pseudo-character preview. Linear mixed-effects models revealed reduced preview benefit when C1 and C2 were separate words. These results suggest that despite the absence of visual segmentation cues, Chinese readers are able to utilise the parafoveal preview to support the identification of word boundaries and modulate the extent of their parafoveal processing to prioritise the processing of word units. |
Xiaodong Xu; Cailing Ji; Taohui Li; Martin J. Pickering The prediction of segmental and tonal information in Mandarin Chinese: An eye-tracking investigation Journal Article In: Language, Cognition and Neuroscience, vol. 40, no. 1, pp. 56–70, 2025. @article{Xu2025a,There is controversy about the extent to which people predict phonology during comprehension. In three visual-world experiments, we ask whether it occurs in Mandarin, a tonal language. Participants heard sentences containing a target word that was highly predictable (Cloze 80.2%, Experiment 1) or very highly predictable (Cloze 93.9%, Experiments 2–3) and saw an array of objects containing one whose name matched the target word (Experiments 1–2), was unrelated to the target word (Experiments 1–3), or matched the target word in segment and tone (Experiments 1–3), in segment only (Experiments 1–3), or tone only (Experiment 3). In comparison to the unrelated object, participants looked more at the segment + tone object (Experiments 1–3), and sometimes at the segment object (Experiments 1 and 3), but not at the tone object. We conclude that participants predict segmental information independently of tone. |
Ming Yan; Jinger Pan; Reinhold Kliegl The Beijing Sentence Corpus II: A cross-script comparison between traditional and simplified Chinese sentence reading Journal Article In: Behavior Research Methodsl, vol. 57, no. 2, pp. 1–16, 2025. @article{Yan2025a,We introduce a sentence corpus with eye-movement data in traditional Chinese (TC), based on the original Beijing Sentence Corpus (BSC) in simplified Chinese (SC). The most noticeable difference between TC and SC character sets is their visual complexity. There are reaction time corpora in isolated TC character/word lexical decision and naming tasks. However, up to now natural TC sentence reading corpus with recorded eye movements has not been available for general public. We report effects of word frequency, visual complexity, and predictability on eye movements on fixation location and duration based on 60 native TC readers. In addition, because the current BSC-II sentences are nearly identical to the original BSC sentences, we report similarities and differences of the linguistic influences on eye movements for the two varieties of written Chinese. The results shed light on how visual complexity affects eye movements. Together, the two sentence corpora comprise a useful tool to establish cross-script similarities and differences in TC and SC. |
Zheng Yang; Bing Han; Xinbo Gao; Zhi Hui Zhan Eye-movement-prompted large image captioning model Journal Article In: Pattern Recognition, vol. 159, pp. 1–13, 2025. @article{Yang2025a,Pretrained large vision-language models have shown outstanding performance on the task of image captioning. However, owing to the insufficient decoding of image features, existing large models sometimes lose important information, such as objects, scenes, and their relationships. In addition, the complex “black-box” nature of these models makes their mechanisms difficult to explain. Research shows that humans learn richer representations than machines do, which inspires us to improve the accuracy and interpretability of large image captioning models by combining human observation patterns. We built a new dataset, called saliency in image captioning (SIC), to explore relationships between human vision and language representation. One thousand images with rich context information were selected as image data of SIC. Each image was annotated with five caption labels and five eye-movement labels. Through analysis of the eye-movement data, we found that humans efficiently captured comprehensive information for image captioning during their observations. Therefore, we propose an eye-movement-prompted large image captioning model, which is embedded with two carefully designed modules: the eye-movement simulation module (EMS) and the eye-movement analyzing module (EMA). EMS combines the human observation pattern to simulate eye-movement features, including the positions and scan paths of eye fixations. EMA is a graph neural network (GNN) based module, which decodes graphical eye-movement data and abstracts image features as a directed graph. More accurate descriptions can be predicted by decoding the generated graph. Extensive experiments were conducted on the MS-COCO and NoCaps datasets to validate our model. The experimental results showed that our network was interpretable, and could achieve superior results compared with state-of-the-art methods, i.e., 84.2% BLEU-4 and 145.1% CIDEr-D on MS-COCO Karpathy test split, indicating its strong potential for use in image captioning. |
Masataka Yano; Keiyu Niikuni; Ruri Shimura; Natsumi Funasaki; Masatoshi Koizumi Producing non-basic word orders in (in)felicitous contexts: Evidence from pupillometry and functional near-infrared spectroscopy (fNIRS) Journal Article In: Language, Cognition and Neuroscience, vol. 40, no. 1, pp. 1–22, 2025. @article{Yano2025,The present study examined why speakers of languages with flexible word orders are more likely to use syntactically complex non-basic word orders when they provide discourse-given information earlier in sentences. This may be because they are more efficient for speakers to produce (the Speaker Economy Hypothesis). Alternatively, speakers may produce them to help listeners understand sentences more efficiently (the Listener Economy Hypothesis), given that previous studies showed that the processing of non-basic word orders was facilitated when the felicitous context was provided (i.e. a displaced object refers to discourse-given information). We addressed this issue by conducting a picture-description experiment, in which participants uttered sentences with syntactically basic Subject-Object-Verb (SOV) or non-basic Object-Subject-Verb (OSV) in felicitous or infelicitous contexts while cognitive load was tracked using pupillometry and functional near-infrared spectroscopy. The results showed that the felicitous context facilitated the filler-gap dependency formation of OSVs in production, supporting the Speaker Economy Hypothesis. |
Panpan Yao; Xin Jiang; Xinwei Chen; Xingshan Li Explore the processing unit of L2 Chinese learners in on-line Chinese reading Journal Article In: Second Language Research, vol. 41, no. 1, pp. 3 –19, 2025. @article{Yao2025,The present study explored the processing units of high-proficiency second language (L2) Chinese learners in on-line reading in an eye-tracking experiment. The critical aim was to investigate how learners segment continuous characters into words without the aid of word boundary demarcations. Based on previous studies, the embedded words of 2- and 3-character incremental words were manipulated to be either plausible or implausible with the preceding verbs, while the incremental words themselves were always plausible. The results revealed an effect of the plausibility manipulation, which suggested that L2 Chinese learners activated embedded words first and integrated embedded words with previous sentence context as soon as they read them. |
Taishen Zeng; Longxia Lou; Zhi-Fang Liu; Chaoyang Chen; Zhijun Zhang Coregistration of eye movements and EEG reveals frequency effects of words and their constituent characters in natural silent Chinese reading Journal Article In: Scientific Reports, vol. 15, no. 1, pp. 1–14, 2025. @article{Zeng2025,We conducted two experiments to examine the lexical and sub-lexical processing of Chinese two-character words in reading. We used a co-registration electroencephalogram (EEG) for the first fixation on target words. In Experiment 1, whole-word occurrence frequency and initial constituent character frequency were orthogonally manipulated, while in Experiment 2, whole-word occurrence frequency and end constituent character frequency were orthogonally manipulated. Results showed that word frequency facilitated eye-tracking measures, while initial and end character frequencies inhibited them. Classical word frequency effects on N170 and N400 in the posterior region and reversed word frequency effects over the anterior region were consistently observed in both experiments. Experiment 1 revealed an inhibiting effect of initial character frequency on anterior N170. In Experiment 2, interaction between end-character frequency and word frequency showed reliable effects on anterior N170 and N400. These results demonstrate both facilitating and inhibiting word frequency effects, along with inhibiting effects of character frequency and that word frequency moderates the inhibiting effects of end constituent character frequency during natural silent Chinese reading. |
Taishen Zeng; Longxia Lou; Zhifang Liu; Zhijun Zhang Age-related depreciation in predictive processing during Chinese reading: Insights from fixation-related potentials Journal Article In: Current Psychology, no. 2004, pp. 1–11, 2025. @article{Zeng2025a,To overcome methodological deficiencies in previous eye-tracking and event-related potentials (ERP) studies, the fixa- tion-related potential (FRP) approach was used to investigate how aging affects predictive processing in silent Chinese free-view reading. Forty older and 42 young adults participated in the experiment. All of them reported good reading abilities and none suffered from physical, mental, or cognitive diseases. The older participants were over 60 years of age (62.670 ± 3.018), and they did not differ from the younger group in the schooling years (11.43 vs. 12.10 |
Zhenghua Zhang; Qingfang Zhang Linear incrementality in focus and accentuation processing during sentence production: Evidence from eye movements Journal Article In: Frontiers in Human Neuroscience, pp. 1–19, 2025. @article{Zhang2025d,Introduction: While considerable research in language production has focused on incremental processing during conceptual and grammatical encoding, prosodic encoding remains less investigated. This study examines whether focus and accentuation processing in speech production follows linear or hierarchical incrementality. Methods: We employed visual world eye-tracking to investigate how focus and accentuation are processed during sentence production. Participants were asked to complete a scenario description task where they were prompted to use a predetermined sentence structure to accurately convey the scenario, thereby spontaneously accentuate the corresponding entity. We manipulated the positions of focus with accentuation (initial vs. medial) by changing the scenarios. The initial and medial positions correspond to the first and second nouns in sentences like "N1 is above N2, not N3." Results: Our findings revealed that speech latencies were significantly shorter in the sentences with initial focus accentuation than those with medial focus accentuation. Furthermore, eye-tracking data demonstrated that speakers quickly displayed a preference for fixating on initial information after scenarios onset. Crucially, the time-course analysis revealed that the onset of the initial focus accentuation effect (around 460 ms) preceded that of the medial focus accentuation effect (around 920 ms). Discussion: These results support that focus and accentuation processing during speech production prior to articulation follows linear incrementality rather than hierarchical incrementality. |
Zhenghua Zhanga; Qingfang Zhang Accentuation affects the planning scope and focus – accentuation consistency modulates sentence production: Evidence from eye movements Journal Article In: Journal of Speech, Language, and Hearing Research, pp. 1–27, 2025. @article{Zhanga2025,Purpose: Previous studies have shown that the planning scope of sentence production is flexible and influenced by a range of linguistic and extralinguistic factors. However, one important aspect that remains underexplored is the role of prosody, a key component of language, in shaping the planning scope. While it has been established that both conceptual and grammatical information influence sentence production and conceptual information is closely linked with prosodic cues, it remains unclear whether and how prosody, particularly accentuation, affects the planning process. Additionally, there is limited understanding of how conceptual (focus) and prosodic (accentuation) information interact to influence sentence production. Therefore, this study aims to investigate whether prosody (specifically, sentence accentuation) influences the planning scope and how the interaction between conceptual focus and prosodic accentuation jointly shapes sentence production. Method: Question-answer pairs were used to create focus, and a red dot was added in scenarios as a cue for accentuation. Participants were asked to complete a picture description task and accent the entity with a red dot. We manipulated the accentuation position (initial vs. medial) and focus-accentuation consistency (consistent vs. inconsistent). Results: Speech latencies with initial accentuation were shorter than with medial accentuation. Eye-tracking data indicated that speakers preferred to fixate on accented pictures before articulation in initial accentuation, whereas in medial accentuation, speakers first preferred to fixate on deaccented pictures before shifting to accented ones. Both speech and first fixation latencies on accented pictures were shorter in the consistent condition. In the initial accentuation, accented-deaccented advantage scores were higher in the consistent condition from scenario onset to speech onset, while in the medial accentuation, this difference emerged after 220 ms. In addition, a focus inconsistent with the accentuation position slightly increases the acoustic prominence of deaccented information. Conclusions: Accentuation positions affect planning scope, with a larger scope for medial accentuation. Additionally, the consistency between focus and accentuation influences sentence production, broadly affecting the processing of accented information and impacting external acoustic prominence. This influence on accented information processing occurs during the conceptualization and linguistic encoding phases, with processing starting more quickly and taking priority when focus and accentuation are consistent. This study provides a more comprehensive understanding of how various linguistic components interact to shape sentence production. |
2024 |
Rana Abu-Zhaya; Inbal Arnon Does early unit size impact the formation of linguistic predictions? Grammatical gender as a case study Journal Article In: Language Learning, vol. 74, no. 4, pp. 814–852, 2024. @article{AbuZhaya2024,Making adults learn from larger linguistic units can facilitate learning article–noun agreement. Here we ask whether initial exposure to larger units improves learning by increasing the predictive associations between the article and noun. Using an artificial language learning paradigm, we taught 106 Hebrew-speaking participants novel article–noun associations with either segmented input first or unsegmented input first, and tested their learning of the article–noun association and their ability to use articles to predict nouns. Our results showed that participants exposed to unsegmented input first were more likely to treat the article–noun unit as one word and were more accurate at learning the correct article–noun associations. However, participants in the unsegmented-first condition did not show increased gaze to the target compared to those in the segmented-first condition. We discuss how these findings inform our understanding of the challenges that adults face when learning a second language. |
Cengiz Acartürk; Ayşegül Özkan; Tuğçe Nur Pekçetin; Zuhal Ormanoğlu; Bilal Kırkıcı TURead: An eye movement dataset of Turkish reading Journal Article In: Behavior Research Methods, vol. 56, no. 3, pp. 1793–1816, 2024. @article{Acartuerk2024,In this study, we present TURead, an eye movement dataset of silent and oral sentence reading in Turkish, an agglutinative language with a shallow orthography understudied in reading research. TURead provides empirical data to investigate the relationship between morphology and oculomotor control. We employ a target-word approach in which target words are manipulated by word length and by the addition of two commonly used suffixes in Turkish. The dataset contains well-established eye movement variables; prelexical characteristics such as vowel harmony and bigram-trigram frequencies and word features, such as word length, predictability, frequency, eye voice span measures, Cloze test scores of the root word and suffix predictabilities, as well as the scores obtained from two working memory tests. Our findings on fixation parameters and word characteristics are in line with the patterns reported in the relevant literature. |
Victoria I. Adedeji; Julie A. Kirkby; Martin R. Vasilev; Timothy J. Slattery Children's reading of sublexical units in years three to five: A combined analysis of eye-movements and voice recording Journal Article In: Scientific Studies of Reading, vol. 28, no. 2, pp. 214–233, 2024. @article{Adedeji2024,Purpose: Children progress from making grapheme–phoneme connections to making grapho-syllabic connections before whole-word connections during reading development (Ehri, 2005a). More is known about the development of grapheme–phoneme connections than is known about grapho-syllabic connections. Therefore, we explored the trajectory of syllable use in English developing readers during oral reading. Method: Fifty-one English-speaking children (mean age: 8.9 years, 55% females, 88% monolinguals) in year groups three, four, and five read aloud sentences with an embedded target word, while their eye movements and voices were recorded. The targets contained six letters and were either one or two syllables. Result: Children in grade five had shorter gaze duration, shorter articulation duration, and larger spatial eye-voice span (EVS) than children in grade four. Children in grades three and four did not significantly differ on these measures. A syllable number effect was found for gaze duration but not for articulation duration and spatial EVS. Interestingly, one-syllable words took longer to process compared to two-syllable words, suggesting that more syllables may not always signify greater processing difficulty. Conclusion: Overall, children are sensitive to sublexical reading units; however, due to sample and stimuli limitations, these findings should be interpreted with caution and further research conducted. |
Svetlana Alexeeva Parafoveal letter identification in Russian: Confusion matrices based on error rates Journal Article In: Behavior Research Methods, vol. 56, no. 8, pp. 8567–8587, 2024. @article{Alexeeva2024,In the present study, we introduce parafoveal letter confusion matrices for the Russian language, which uses the Cyrillic script. To ensure that our confusion rates reflect parafoveal processing and no other effects, we employed an adapted boundary paradigm (Rayner, 1975) that prevented the participants from directly fixating the letter stimuli. Additionally, we assessed confusability under isolated and word-like (crowded) conditions using two modern fonts, since previous research showed that letter recognition depended on crowding and font (Coates, 2015; Pelli et al., 2006). Our additional goal was to gain insight into what letter features or configurational patterns might be essential for letter recognition in Russian; thus, we conducted exploratory clustering analysis on visual confusion scores to identify groups of similar letters. To support this analysis, we conducted a comprehensive review of over 20 studies that proposed crucial properties of Latin letters relevant to character perception. The summary of this review is valuable not only for our current study but also for future research in the field. |
Na An; Clare Wright; Jun Wang How does background knowledge affect second language reading? An eye movement study Journal Article In: International Journal of Applied Linguistics, pp. 1767–1789, 2024. @article{An2024,There is broad consensus that a reader's background knowledge on a reading topic affects both their reading processes and comprehension in their first language and also in a second language. However, it is unclear whether a reader's background knowledge specifically affects reading comprehension accuracy and reading rate. The extent to which background knowledge facilitates second language reading when compared to a reader's L2 linguistic knowledge is also unclear. Moreover, the mental process accounting for the interaction between general background knowledge, type of linguistic knowledge such as vocabulary or writing system, and L2 reading abilities also need to be identified. Using texts in Mandarin Chinese, this paper investigates these problems with an eye-movement study administered to 40 L2 Chinese learners with Indo-European L1s. Results illustrate that an L2 reader's background knowledge about the text can positively impact both their reading comprehension and reading rate; however, the influence on the latter could be topic-dependent. In more challenging topics, the contribution of background knowledge to reading comprehension could outweigh any single type of linguistic knowledge, even if the target language uses a more cognitively demanding writing system. The connectionist account proposed by the construction–integration theory is suggested to be currently the best theoretical explanation for the mental process behind developing second-language reading abilities. Pedagogical implications are also considered based on these findings. |
Bernhard Angele; Ismael Gutiérrez-Cordero; Manuel Perea; Ana Marcet Reading(,) with and without commas Journal Article In: Quarterly Journal of Experimental Psychology, vol. 77, no. 6, pp. 1190 –1200, 2024. @article{Angele2024,All major writing systems mandate the use of commas to separate clauses and list items. However, casual writers often omit mandatory commas. Little empirical or theoretical research has been done on the effect that omitting mandatory commas has on eye movement control during reading. We present an eye-tracking experiment in Spanish, a language with a clear standard as to mandatory comma use. Sentences were presented with or without mandatory commas while readers' eye movements were recorded. There was a local increase in the go-past time for the pre-comma region when commas were presented, which was balanced out by shorter first-pass and second-pass times on the subsequent regions. In global sentence reading time, there was no evidence for an advantage of presenting commas. These findings suggest that, even when commas are mandatory, their effect is primarily to shift when processing takes place rather than to facilitate processing overall. |
Eléonore Arbona; Kilian G. Seeber; Marianne Gullberg The role of semantically related gestures in the language comprehension of simultaneous interpreters in noise Journal Article In: Language, Cognition and Neuroscience, vol. 39, no. 5, pp. 584–608, 2024. @article{Arbona2024,Manual co-speech gestures can facilitate language comprehension, especially in adverse listening conditions. However, we do not know whether gestures influence simultaneous interpreters' language comprehension in adverse listening conditions, and if so, whether this influence is modulated by interpreting experience, or by active simultaneous interpreting (SI). We exposed 24 interpreters and 24 bilinguals without interpreting experience to utterances with semantically related gestures, semantically unrelated gestures, or without gestures while engaging in comprehension (interpreters and bilinguals) or in SI (interpreters only). Tasks were administered in clear and noisy speech. Accuracy and reaction time were measured, and participants' gaze was tracked. During comprehension, semantically related gestures facilitated both groups' processing in noise. Facilitation was not modulated by interpreting experience. However, when interpreting noisy speech, interpreters did not benefit from gestures. This suggests that the comprehension component, and specifically crossmodal information processing, in SI differs from that of other language comprehension. |
Scott P. Ardoin; Katherine S. Binder; Paulina A. Kulesz; Eloise Nimocks; Joshua A. Mellott Examining the influence of passage and student characteristics on test-taking strategies: An eye-tracking study Journal Article In: Learning and Individual Differences, vol. 109, pp. 1–12, 2024. @article{Ardoin2024,Understanding test-taking strategies (TTSs) and the variables that influence TTSs is crucial to understanding what reading comprehension tests measure. We examined how passage and student characteristics were associated with TTSs and their impact on response accuracy. Third (n = 78), fifth (n = 86), and eighth (n = 86) graders read and answered questions associated with six passages. Eye-movement records were used to code TTSs. Results indicated that TTS choice was related to passage and student characteristics. Passage characteristics that make comprehension more difficult resulted in more students choosing a TTS that did not involve reading passages in their entirety before answering questions. TTSs encompassing reading passages in their entirety before answering questions resulted in higher accuracy for 5th and 8th graders. Understanding TTS choices can aid our understanding of the processes measured by reading comprehension tests, what TTS should be encouraged, and what contributes to tests producing different outcomes. Educational relevance statement Schools spend considerable time and money collecting and interpreting the outcomes of reading comprehension tests. To truly understand what these test results mean, we must understand what students are doing when taking reading comprehension tests. Furthermore, we need to know to what extent certain tests and student characteristics might be associated with test-taking strategies that avoid reading passages for comprehension. Finally, teachers need to know whether certain test-taking strategies might positively or negatively impact response accuracy to know what strategies to teach and not to teach. The current study was designed to provide answers relevant to these important educational matters. |
Scott P. Ardoin; Katherine S. Binder; Christina Novelli; Peter L. Robertson The common element of test taking: Reading and responding to questions Journal Article In: School Psychology, pp. 1–7, 2024. @article{Ardoin2024a,Taking a reading comprehension (RC) test is a goal-oriented task, with the goal of answering questions correctly. We assume the number of questions students correctly answer represents their ability to engage successfully in the RC processes necessary to understand texts. Students, however, use various test-taking strategies, some of which negatively impact passage comprehension. The present study used eye-tracking procedures to measure what students do when reading the one part of the tests that all students must read to perform well on an RC test, the questions. Participants included 248 third-, fifth-, and eighth-grade students who read six texts and responded to associated questions while researchers recorded their eye movements. Eye-movement records were used to code students' test-taking strategy and measure the time students spent reading multiple-choice questions and each response option. Students were also administered a measure of reading achievement. Analyses suggest eye movements on multiple-choice questions were associated with reading achievement, and the challenges less-skilled readers experience with texts are also present when reading in the question region. Differences in strategies and processes do not only occur in the text region. Therefore, researchers and practitioners should pay increased attention to the strategies that are taught and used by students when reading and responding to RC questions. |
Wenfu Bao; Anja Arnhold; Juhani Järvikivi Phonology, homophony, and eyes-closed rest in Mandarin novel word learning: An eye-tracking study in adult native and non-native speakers Journal Article In: Applied Psycholinguistics, vol. 45, pp. 213–242, 2024. @article{Bao2024,This study used the visual world paradigm to investigate novel word learning in adults from different language backgrounds and the effects of phonology, homophony, and rest on the outcome. We created Mandarin novel words varied by types of phonological contrasts and homophone status. During the experiment, native (n = 34) and non-native speakers (English; n = 30) learned pairs of novel words and were tested twice with a 15-minute break in between, which was spent either resting or gaming. In the post-break test of novel word recognition, an interaction appeared between language backgrounds, phonology, and homophony: non-native speakers performed less accurately than native speakers only on non-homophones learned in pairs with tone contrasts. Eye movement data indicated that non-native speakers' processing of tones may be more effortful than their processing of segments while learning homophones, as demonstrated by the time course. Interestingly, no significant effects of rest were observed across language groups; yet after gaming, native speakers achieved higher accuracy than non-native speakers. Overall, this study suggests that Mandarin novel word learning can be affected by participants' language backgrounds and phonological and homophonous features of words. However, the role of short periods of rest in novel word learning requires further investigation. |
Alisa Baron; Katrina Connell; Daniel Kleinman; Lisa M. Bedore; Zenzi M. Griffin Grammatical gender in spoken word recognition in school-age Spanish monolingual and Spanish–English bilingual children Journal Article In: Frontiers in Psychology, vol. 15, pp. 1–13, 2024. @article{Baron2024,This study examined grammatical gender processing in school-aged children with varying levels of cumulative English exposure. Children participated in a visual world paradigm with a four-picture display where they heard a gendered article followed by a target noun and were in the context where all images were the same gender (same gender), where all of the distractor images were the opposite gender than the target noun (different gender), and where all of the distractor images were the opposite gender, but there was a mismatch in the gendered article and target noun pair. We investigated 51 children (aged 5;0–10;0) who were exposed to Spanish since infancy but varied in their amount of cumulative English exposure. In addition to the visual word paradigm, all children completed an article–noun naming task, a grammaticality judgment task, and standardized vocabulary tests. Parents reported on their child's cumulative English language exposure and current English language use. To investigate the time course of lexical facilitation effects, looks to the target were analyzed with a cluster-based permutation test. The results revealed that all children used gender in a facilitatory way (during the noun region), and comprehension was significantly inhibited when the article–noun pairing was ungrammatical rather than grammatical. Compared to children with less cumulative English exposure, children with more cumulative English exposure looked at the target noun significantly less often overall, and compared to younger children, older children looked at the target noun significantly more often overall. Additionally, children with lower cumulative English exposure looked at target nouns more in the different-gender condition than the same-gender condition for masculine items more than feminine items. |
Lauren S. Baron; Anna M. Ehrhorn; Peter Shlanta; Jane Ashby; Bethany A. Bell; Suzanne M. Adlof Orthographic influences on phonological processing in children with and without reading difficulties: An eye-tracking study Journal Article In: Reading and Writing, pp. 1–24, 2024. @article{Baron2024a,Phonological processing is an important contributor to decoding and spelling difficulties, but it does not fully explain word reading outcomes for all children. As orthographic knowledge is acquired, it influences phonological processing in typical readers. In the present study, we examined whether orthography affects phonological processing differently for children with current reading difficulties (RD), children with a history of reading difficulties who are currently presenting with typical word reading skills (Hx), and children with typical development and no history of reading difficulties (TD). School-aged children completed a phonological awareness task containing spoken words and pictures while eye movements were recorded. In this task, children had to pair a spoken stimulus word with one of four pictures that ended with the same sound. Within the task, stimulus-target picture pairs varied in the congruency and consistency of the orthographic and phonological mappings of their final consonant sounds. Eye movements revealed that children with typical word reading (the Hx and TD groups) showed better discrimination of the target from the foils compared to peers with underdeveloped word reading skills. All children were more accurate when stimulus-target pairs were congruent and consistent than when they were incongruent or inconsistent. Orthography plays an important role in the completion of phonological awareness tasks, even in the absence of written words and for children with a wide range of reading abilities. Results highlight the importance of considering orthography during interventions for phonological awareness and word reading. |
Patrice Speeter Beddor; Andries W. Coetzee; Ian Calloway; Stephen Tobin; Ruaridh Purse The relation between perceptual retuning and articulatory restructuring: Individual differences in accommodating a novel phonetic variant Journal Article In: Journal of Phonetics, vol. 107, pp. 1–23, 2024. @article{Beddor2024,When language users accommodate a novel phonetic variant, they adjust their perceptual and articulatory spaces in listener- and speaker-specific ways. Motivated by the centrality of accommodation and the perception-production relation to theories of phonetics and sound change, this study tests the hypothesis that individuals who are adept at perceptually retuning for a novel variant will be more accurate imitators of that form. In perceptual eye-tracking and spontaneous imitation ultrasound-imaging tasks, 37 American English participants were exposed to a talker's novel raised /æ/ before /ɡ/ (bag), and to their familiar unraised /æk/ (back) and /eɪk/ (bake). Consistent with the hypothesis, results showed that the more participants showed perceptual facilitation (i.e., used raised /æ(ɡ)/ to disambiguate back-bag trials), the more they imitated raised /æ(ɡ)/. Perceptual retuning, though, did not predict articulatory restructuring: imitators produced not context-dependent raising, but more general “imitative” raising. For theories of sound change, the findings provide circumscribed support for especially adept perceptual adapters to an innovation having the potential to be strong disseminators of that variant. For theories of accommodation, findings point toward the importance of studying imitation of a targeted variant in the broader context of how talkers and imitators situate that variant in relation to phonetically similar forms. |
Ali Behzadnia; Signy Wegener; Audrey Bürki; Elisabeth Beyersmann The role of oral vocabulary when L2 speakers read novel words: A complex word training study Journal Article In: Bilingualism: Language and Cognition, vol. 27, no. 3, pp. 388–399, 2024. @article{Behzadnia2024,The present study asked whether oral vocabulary training can facilitate reading in a second language (L2). Fifty L2 speakers of English received oral training over three days on complex novel words, with predictable and unpredictable spellings, composed of novel stems and existing suffixes (i.e., vishing, vishes, vished). After training, participants read the novel word stems for the first time (i.e., trained and untrained), embedded in sentences, and their eye movements were monitored. The eye-tracking data revealed shorter looking times for trained than untrained stems, and for stems with predictable than unpredictable spellings. In contrast to monolingual speakers of English, the interaction between training and spelling predictability was not significant, suggesting that L2 speakers did not generate orthographic skeletons that were robust enough to affect their eye-movement behaviour when seeing the trained novel words for the first time in print. |
Robyn Berghoff; Emanuel Bylund L2 activation during L1 processing is increased by exposure but decreased by proficiency Journal Article In: International Journal of Bilingualism, vol. 28, no. 3, pp. 555–569, 2024. @article{Berghoff2024,Aims: The study investigates the effects of L2 proficiency and L2 exposure on L2-to-L1 cross-language activation (CLA) in L1-dominant bilinguals. In so doing, it tests the predictions made by prominent models of the bilingual lexicon regarding how language experience modulates CLA. Design: The participants (27 L1-dominant L1 English–L2 Afrikaans speakers) completed a visual world eye-tracking task, conducted entirely in English, in which they saw four objects on a screen: a target object, which they were instructed to click on; a competitor object, whose Afrikaans label overlapped phonetically at onset with the English target object label; and two unrelated distractors. Language background data were collected using the Language History Questionnaire 3.0. Analysis: A growth curve analysis was performed to investigate the extent to which the background variables modulated looks to the Afrikaans competitor item versus to the two unrelated distractor items. Findings: Increased L2 exposure was associated with greater CLA, which is consistent with models suggesting that exposure modulates the likelihood and speed with which a linguistic item becomes activated. Moreover, CLA was reduced at higher levels of L2 proficiency, which aligns with accounts of the bilingual lexicon positing that parasitism of the L2 on the L1 is reduced at higher proficiency levels, leading to reduced CLA. Originality: L2 activation during L1 processing and the variables that modulate it are not well documented, particularly among L1 speakers with limited proficiency in and exposure to the L2. Significance: The findings contribute to the evaluation of competing accounts of bilingual lexical organization. |
Alexandra Berlin Khenis; Maksim Markevich; Anastasiia Streltsova; Elena L. Grigorenko Eye movement patterns in Russian-speaking adolescents with differing reading comprehension proficiency: Exploratory scanpath analysis Journal Article In: Journal of Intelligence, vol. 12, no. 11, pp. 1–19, 2024. @article{BerlinKhenis2024,Previous research has indicated that individuals with varying levels of reading comprehension (often used as a proxy for general cognitive ability) employ distinct reading eye movement patterns. This exploratory eye-tracking study aimed to investigate the text-reading process in adolescents with differing reading comprehension, specifically examining how these differences manifest at the global eye movement level through scanpath analysis. Our findings revealed two distinct groups of scanpaths characterized by statistically significant differences in eye movement parameters. These groups were identified as “fast readers” and “slow readers”. Both groups exhibited similar oculomotor performance during the initial reading. However, significant differences emerged when they reread and revisited the text. Notably, these findings align with prior research conducted with different samples and languages, although discrepancies emerged in saccade amplitude and first-pass reading behavior. This study contributes to the understanding of how reading comprehension levels are reflected in global eye movement strategies among adolescents. However, limitations inherent in the experimental design, particularly the potential influence of the task on reading patterns, warrant further investigation. Future research should aim to explore these phenomena in more naturalistic reading settings, employing a design specifically tailored to capture the nuances of spontaneous reading behavior. |
Borogjoon Borjigin; Guangyao Zhang; You Hou; Xingshan Li Perceptual span in Mongolian text reading Journal Article In: Current Psychology, vol. 43, no. 29, pp. 24287–24294, 2024. @article{Borjigin2024,In this study, an eye-tracking experiment was conducted to investigate the perceptual span during traditional Mongolian reading, a script uniquely written vertically. We adopted a gaze-contingent moving-window paradigm to measure the size of the perceptual span when reading traditional Mongolian sentences. The results showed that the perceptual span was asymmetric downward, extending one syllable above the fixation and three syllables below the fixation. These findings are important for understanding how reading direction affects the underlying cognitive mechanisms during reading and will help to understand the universal mechanisms of reading. |
Ethan S. Bromberg-Martin; Yang-Yang Feng; Takaya Ogasawara; J. Kael White; Kaining Zhang; Ilya E. Monosov A neural mechanism for conserved value computations integrating information and rewards Journal Article In: Nature Neuroscience, vol. 27, pp. 1–17, 2024. @article{BrombergMartin2024,Behavioral and economic theory dictate that we decide between options based on their values. However, humans and animals eagerly seek information about uncertain future rewards, even when this does not provide any objective value. This implies that decisions are made by endowing information with subjective value and integrating it with the value of extrinsic rewards, but the mechanism is unknown. Here, we show that human and monkey value judgements obey strikingly conserved computational principles during multi-attribute decisions trading off information and extrinsic reward. We then identify a neural substrate in a highly conserved ancient structure, the lateral habenula (LHb). LHb neurons signal subjective value, integrating information's value with extrinsic rewards, and the LHb predicts and causally influences ongoing decisions. Neurons in key input areas to the LHb largely signal components of these computations, not integrated value signals. Thus, our data uncover neural mechanisms of conserved computations underlying decisions to seek information about the future. |
Laurence Bruggeman; Anne Cutler Lexical recognition processes in L2-dominant bilingualism Journal Article In: Frontiers in Language Sciences, vol. 3, pp. 1–11, 2024. @article{Bruggeman2024,To comprehend speech, listeners must resolve competition between potential candidate words. In second-language (L2) listening such competition may be inflated by spurious activation; the onsets of “reggae” and “legacy” may both activate “leg” for Japanese listeners, or the rhymes of “adapt” and “adept” may activate “apt” for Dutch listeners, while only one in each pair triggers competition for L1 listeners. Using eyetracking with L2-dominant bilingual emigrants, we directly compared within-language L1 and L2 lexical activation and competition in the same individuals. For these listeners, activation patterns did not differ across languages. Unexpectedly, however, we observed onset competition in both languages but rhyme competition in the L2 only (although the same stimuli elicited rhyme competition for control listeners in both languages). This suggests that L1 rhyme competition may disappear after long-time immersion in an L2 environment. |
Dana Bsharat-Maalouf; Jens Schmidtke; Tamar Degani; Hanin Karawani Through the pupils' lens: Multilingual effort in first and second language listening Journal Article In: Ear & Hearing, vol. 46, no. 2, pp. 494–511, 2024. @article{BsharatMaalouf2024,Objectives: The present study aimed to examine the involvement of listening effort among multilinguals in their first (L1) and second (L2) languages in quiet and noisy listening conditions and investigate how the presence of a constraining context within sentences influences listening effort. Design: A group of 46 young adult Arabic (L1)–Hebrew (L2) multilinguals participated in a listening task. This task aimed to assess participants' perceptual performance and the effort they exert (as measured through pupillometry) while listening to single words and sentences presented in their L1 and L2, in quiet and noisy environments (signal to noise ratio = 0 dB). Results: Listening in quiet was easier than in noise, supported by both perceptual and pupillometry results. Perceptually, multilinguals performed similarly and reached ceiling levels in both languages in quiet. However, under noisy conditions, perceptual accuracy was significantly lower in L2, especially when processing sentences. Critically, pupil dilation was larger and more prolonged when listening to L2 than L1 stimuli. This difference was observed even in the quiet condition. Contextual support resulted in better perceptual performance of high-predictability sentences compared with low-predictability sentences, but only in L1 under noisy conditions. In L2, pupillometry showed increased effort when listening to high-predictability sentences compared with low-predictability sentences, but this increased effort did not lead to better understanding. In fact, in noise, speech perception was lower in high-predictability L2 sentences compared with low-predictability ones. Conclusions: The findings underscore the importance of examining listening effort in multilingual speech processing and suggest that increased effort may be present in multilingual's L2 within clinical and educational settings. |
Maya Campbell; Nicole Oppenheimer; Alex L. White Severe processing capacity limits for sub-lexical features of letter strings Journal Article In: Attention, Perception, & Psychophysics, vol. 86, no. 2, pp. 643–652, 2024. @article{Campbell2024,When reading, the visual system is confronted with many words simultaneously. How much of that information can a reader process at once? Previous studies demonstrated that low-level visual features of multiple words are processed in parallel, but lexical attributes are processed serially, for one word at a time. This implies that an internal bottleneck lies somewhere between early visual and lexical analysis. We used a dual-task behavioral paradigm to investigate whether this bottleneck lies at the stage of letter recognition or phonological decoding. On each trial, two letter strings were flashed briefly, one above and one below fixation, and then masked. In the letter identification experiment, participants indicated whether a vowel was present in a particular letter string. In the phonological decoding experiment, participants indicated whether the letter string was pronounceable. We compared accuracy in a focused attention condition, in which participants judged only one of the two strings, with accuracy in a divided attention condition, in which participants judged both strings independently. In both experiments, the cost of dividing attention was so large that it supported a serial model: participants were able to process only one letter string per trial. Furthermore, we found a stimulus processing trade-off that is characteristic of serial processing: When participants judged one string correctly, they were less likely to judge the other string correctly. Therefore, the bottleneck that constrains word recognition under these conditions arises at a sub-lexical level, perhaps due to a limit on the efficiency of letter recognition. |
Jon W. Carr; Monica Fantini; Lorena Perrotti; Davide Crepaldi Readers target words where they expect to minimize uncertainty Journal Article In: Journal of Memory and Language, vol. 138, pp. 1–15, 2024. @article{Carr2024,Skilled readers use multiple heuristics to guide their eye movements during reading. One possible cue that readers may rely on is the way in which information about word identity is typically spread across words. In many (but not all) languages, words are, on average, more informative on the left, predicting that readers should have a preference for left-of-center fixation when targeting words. Any such effect will, however, be modulated by important perceptual constraints and may be masked by various confounding factors. In three experiments with artificially constructed lexicons, we provide causal evidence that the way in which a language distributes information affects how readers land on words. We further support our analyses with a Bayesian cognitive model of visual word recognition that predicts where readers ought to fixate in order to minimize uncertainty about word identity. Taken together, our findings suggest that global properties of the lexicon may play a role in isolated word targeting, and may therefore make a contribution to eye movement behavior in more natural reading settings. |
Gareth Carrol; Katrien Segaert As easy as cake or a piece of pie? Processing idiom variation and the contribution of individual cognitive differences Journal Article In: Memory & Cognition, vol. 52, no. 2, pp. 334–351, 2024. @article{Carrol2024,Language users routinely use canonical, familiar idioms in everyday communication without difficulty. However, creativity in idiom use is more widespread than sometimes assumed, and little is known about how we process creative uses of idioms, and how individual differences in cognitive skills contribute to this. We used eye-tracking while reading and cross-modal priming to investigate the processing of idioms (e.g., play with fire) compared with creative variants (play with acid) and literal controls (play with toys), amongst a group of 47 university-level native speakers of English. We also conducted a series of tests to measure cognitive abilities (working memory capacity, inhibitory control, and processing speed). Eye-tracking results showed that in early reading behaviour, variants were read no differently to literal phrases or idioms but showed significantly longer overall reading times, with more rereading required compared with other conditions. Idiom variables (familiarity, decomposability, literal plausibility) and individual cognitive variables had limited effects throughout, although more decomposable phrases of all kinds required less overall reading time. Cross-modal priming—which has often shown a robust idiom advantage in past studies—demonstrated no difference between conditions, but decomposability again led to faster processing. Overall, results suggest that variants were treated more like literal phrases than novel metaphors, with subsequent effort required to make sense of these in the way that was consistent with the context provided. |
Min Chang; Zhenying Pu; Jingxin Wang Oral reading promotes predictive processing in Chinese sentence reading: Eye movement evidence Journal Article In: PeerJ, vol. 12, no. 10, pp. 1–19, 2024. @article{Chang2024,Background. Fluent sentence reading is widely acknowledged to depend on top-down contextual prediction, wherein sentential and contextual cues guide the pre-activation of linguistic representations before encountering stimuli, facilitating subsequent comprehension. The Prediction-by-Production hypothesis posits an explanation for predictive processes in language comprehension, suggesting that prediction during comprehension involves processes associated with language production. However, there is a lack of eye movement evidence supporting this hypothesis within sentence reading contexts. Thus, we manipulated reading mode and word predictability to examine the influence of language production on predictive processing. Methods. Participants engaged in silent or oral reading of sentences containing either high or low-predictable target words. Eye movements were recorded using the Eyelink1000 eye tracker. Results. The findings revealed a higher skipping rate and shorter fixation times for high-predictable words compared to low-predictable ones, and for silent compared to oral reading. Notably, interactive effects were observed in the time measures (FFD, SFD, GD) during first-pass reading, indicating that word predictability effects were more pronounced during oral reading than silent reading. Discussion. The observed pattern of results suggests that the activation of the production system enhances predictive processing during the early lexical access, providing empirical support for the Prediction-by-Production hypothesis in eye movement sentence reading situations, extending the current understanding of the timing and nature of predictions in reading comprehension. |
Vassiki S. Chauhan; Krystal C. McCook; Alex L. White Reading reshapes stimulus selectivity in the visual word form area Journal Article In: eNeuro, vol. 11, no. 7, pp. 1–20, 2024. @article{Chauhan2024,Reading depends on a brain region known as the “visual word form area” (VWFA) in the left ventral occipitotemporal cortex. This region's function is debated because its stimulus selectivity is not absolute, it is modulated by a variety of task demands, and it is inconsistently localized. We used fMRI to characterize the combination of sensory and cognitive factors that activate word-responsive regions that we precisely localized in 16 adult humans (4 male). We then presented three types of character strings: English words, pseudowords, and unfamiliar characters with matched visual features. Participants performed three different tasks while viewing those stimuli: detecting real words, detecting color in the characters, and detecting color in the fixation mark. There were three primary findings about the VWFA's response: (1) It preferred letter strings over unfamiliar characters even when the stimuli were ignored during the fixation task. (2) Compared with those baseline responses, engaging in the word reading task enhanced the response to words but suppressed the response to unfamiliar characters. (3) Attending to the stimuli to judge their color had little effect on the response magnitudes. Thus, the VWFA is uniquely modulated by a cognitive signal that is specific to voluntary linguistic processing and is not additive. Functional connectivity analyses revealed that communication between the VWFA and a left frontal language area increased when the participant engaged in the linguistic task. We conclude that the VWFA is inherently selective for familiar orthography, but it falls under control of the language network when the task demands it. |
Shuyuan Chen; Jinzuan Chen; Yanping Liu Are there binocular advantages in Chinese reading? Evidence from eye movements Journal Article In: Scientific Studies of Reading, vol. 28, no. 3, pp. 270–283, 2024. @article{Chen2024k,Purpose: This study aims to examine whether binocular vision plays a facilitating or impeding role in lexical processing during sentence reading in Chinese. Method: Adopting the revised boundary paradigm, we orthogonally manipulated the parafoveal and foveal viewing conditions (monocular vs. binocular) of target words (high- vs. low-frequency) within sentences. Forty participants (30 females, mean age = 19.9 years) were recruited to read these sentences and their eye movements were monitored. Results: Through directly comparing the eye movement measures in different viewing conditions, the results indicated that compared with monocular viewing, binocular viewing resulted in shorter fixation durations, thereby facilitating lexical processing. Critically, in addition to the higher information encoding speed toward the currently fixated word in the fovea, the more efficient preprocessing of the upcoming text to the right of fixation in the parafovea may also contribute to the superiority of binocular vision over monocular. Conclusion: Our findings provide the first evidence to support the binocular advantages in Chinese reading, which reveals that high-quality visual input from binocular vision plays a vital role in fluent and efficient written text reading. |
Shuyuan Chen; Erik D. Reichle; Yanping Liu Direct lexical control of eye movements in Chinese reading: Evidence from the co-registration of EEG and eye tracking Journal Article In: Cognitive Psychology, vol. 153, no. 135, pp. 1–21, 2024. @article{Chen2024f,The direct-lexical-control hypothesis stipulates that some aspect of a word's processing determines the duration of the fixation on that word and/or the next. Although the direct lexical control is incorporated into most current models of eye-movement control in reading, the precise implementation varies and the assumptions of the hypothesis may not be feasible given that lexical processing must occur rapidly enough to influence fixation durations. Conclusive empirical evidence supporting this hypothesis is therefore lacking. In this article, we report the results of an eye-tracking experiment using the boundary paradigm in which native speakers of Chinese read sentences in which target words were either high- or low-frequency and preceded by a valid or invalid preview. Eye movements were co-registered with electroencephalography, allowing standard analyses of eye-movement measures, divergence point analyses of fixation-duration distributions, and fixated-related potentials on the target words. These analyses collectively provide strong behavioral and neural evidence of early lexical processing and thus strong support for the direct-lexical-control hypothesis. We discuss the implications of the findings for our understanding of how the hypothesis might be implemented, the neural systems that support skilled reading, and the nature of eye-movement control in the reading of Chinese versus alphabetic scripts. |
Sijia Chen; Jan-Louis Kruger Visual processing during computer-assisted consecutive interpreting Journal Article In: Interpreting, vol. 26, no. 2, pp. 231–252, 2024. @article{Chen2024g,This study investigates the visual processing patterns during computer-assisted consecutive interpreting (CACI). In phase I of the proposed CACI workflow, the interpreter listens to the source speech and respeaks it into speech recognition (SR) software. In phase II, the interpreter produces target speech supported by the SR text and its machine translation (MT) output. A group of students performed CACI with their eye movements tracked. In phase I, the participants devoted the majority of their attention to listening and respeaking, with very limited attention distributed to the SR text. However, a positive correlation was found between the percentage of dwell time on the SR text and the quality of respeaking, which suggests that active monitoring could be important. In phase II, the participants devoted more visual attention to the MT text than to the SR text and engaged in deeper and more effortful processing when reading the MT text. We identified a positive correlation between the percentage of dwell time on the MT text and interpreting quality in the L2–L1 direction but not in the L1–L2 direction. These results contribute to our understanding of computer-assisted interpreting and can provide insights for future research and training in this area. |
Xianglan Chen; Weiqian Liu; Yuming Ma; Zhongyang Sun How pupils of different ages perceive menus denoting metaphorical and metonymic expressions: Insights from eye-tracking Journal Article In: Acta Psychologica, vol. 249, pp. 1–7, 2024. @article{Chen2024i,The “embodied” position on language comprehension proposes that metaphor or metonymy understanding can be presented in a distributed network based on previous sensorimotor experience. The current study attempted to investigate how children understood metaphor and metonymy.in the context of daily diet that provides rich sensory experience for children. We implemented an eye-tracking experiment where a 2 × 2 × 2 mixed design was employed. Thirty Chinese pupils aging from 6 to 12 were instructed to appreciate Chinese menus denoting metaphoric or metonymic expressions. Results of eye-tracking indicated that the dish image captioned with metaphorical names held the greatest attention of pupils, which held especially true for junior pupils. Moreover, the inclusion of Chinese pinyin in the menu served as a distractor that reduced pupils' attention to other menu elements. This study adds to the state of the art on embodied account of language by inspecting how the under-explored children perceived metaphorical and metonymic expressions. The context of everyday diet abundant in sensory experience managed to provide a more vivid scenario on this topic. It also provides practical insight into how to design menus to invoke particular sensory experience of infants who are undergoing both physical and mental development. |
Anna Chrabaszcz; Anna Laurinavichyute; Nina Ladinskaya; Liubov Baladzhaeva; Anat Prior; Andriy Myachykov; Olga Dragoy Writing direction influences the spatial representations of past- and future-tense forms: Evidence from eye tracking Journal Article In: Memory & Cognition, pp. 1–16, 2024. @article{Chrabaszcz2024,The present study tests the hypothesis that the directionality of reading habits (left-to-right or right-to-left) impacts individuals' representation of nonspatial events. Using the blank screen paradigm, we examine whether eye movements reflect culture-specific spatial biases in processing temporal information, specifically, grammatical tense in Russian and Hebrew. Sixty-two native speakers of Russian (a language with a left-to-right reading and writing system) and 62 native speakers of Hebrew (a language with a right-to-left reading and writing system) listened to verbs in the past or future tense while their spontaneous gaze positions were recorded. Following the verb, a visual spatial probe appeared in one of the five locations of the screen, and participants responded manually to indicate its position. While participants' response latencies to the spatial probe revealed no significant effects, their gaze positions along the horizontal axis for past- and future-tensed verbs aligned with the reading and writing direction in their language. These results provide novel evidence that eye movements during auditory processing of grammatical tense are influenced by culturally specific reading and writing conventions, shifting leftward or rightward on the horizontal plane depending on the stimuli's time reference (past or future) and the participants' language (Russian or Hebrew). This spatial bias indicates a common underlying cognitive mechanism that uses spatial dimensions to represent temporal constructs. |
Kiel Christianson; Jack Dempsey; Anna Tsiola; Sarah Elizabeth M. Deshaies; Nayoung Kim Retracing the garden-path: Nonselective rereading and no reanalysis Journal Article In: Journal of Memory and Language, vol. 137, pp. 1–17, 2024. @article{Christianson2024,When people read temporarily ambiguous (“garden-path”) sentences, the forward movement of their eyes is often interrupted by regressions. These regressions are usually followed by rereading some portion of the previously read text. Frazier and Rayner (1982) proposed the Selective Reanalysis Hypothesis (SRH), which proposed that readers regress to critical choice points in the syntactic phrase marker of garden-paths where misparses had occurred, and furthermore, then reanalyzed the syntactic structure to arrive at a correct parse in most cases. A considerable amount of more recent work, however, suggests that readers often do not derive a correct parse or interpretation from such sentences. If these more recent observations are accurate, perhaps rereading is not necessarily strategic, controlled, or predictable. The current study consists of two large-scale eye-tracking experiments designed specifically to examine where and how much people reread garden-path sentences, and whether rereading influences comprehension accuracy. A variable text-masking paradigm was employed to restrict access to portions of garden-paths and non-garden-paths during rereading. Scanpath analyses were used to determine whether some or all participants targeted syntactically critical parts of previously read text. Comprehension questions probed final interpretations. In short, readers often misinterpreted the garden-paths, and no rereading measures predicted better comprehension. Furthermore, scanpath analyses revealed considerable variation across and within readers; only small percentages of trials conformed to structurally-based predictions. Taken together, we fail to find support for structurally strategic rereading. We therefore propose that rereading of these sentences is more often “confirmatory” than “revisionary” in nature. |
Andriana L. Christofalos; Madison Laks; Stephanie Wolfer; Elisa C. Dias; Daniel C. Javitt; Heather Sheridan Lower-level oculomotor deficits in schizophrenia during multi-line reading: Evidence from return-sweeps Journal Article In: Quarterly Journal of Experimental Psychology, vol. 77, no. 7, pp. 1533–1543, 2024. @article{Christofalos2024,Reading fluency deficits in schizophrenia (Sz) have been attributed to dysfunction in both lower-level, oculomotor processing and higher-level, lexical processing, according to the two-hit deficit model. Given that prior work examining reading deficits in individuals with Sz has primarily focused on single-line and single-word reading tasks, eye movements that are unique to passage reading, such as return-sweep saccades, have not yet been examined in Sz. Return-sweep saccades are large eye movements that are made when readers move from the end of one line to the beginning of the next line during natural passage reading. Examining return-sweeps provides an opportunity to examine lower-level, oculomotor deficits during reading under circumstances when upcoming higher-level, lexical information is not available for visual processing because visual acuity constraints do not permit detailed lexical processing of line-initial words when return-sweeps are programmed. To examine the source of reading deficits in Sz, we analysed an existing data set in which participants read multi-line passages with manipulations to line spacing. Readers with Sz made significantly more return-sweep targeting errors followed by corrective saccades compared with healthy controls. Both groups showed similar effects of line spacing on return-sweep targeting accuracy, suggesting similar sensitivities to visual crowding during reading. Furthermore, the patterns of fixation durations in readers with Sz corroborate prior work indicating reduced parafoveal processing of upcoming words. Together, these findings suggest that lower-level visual and oculomotor dysfunction contribute to reading deficits in Sz, providing support for the two-hit deficit model. |
Clara Cohen Predicting this rock: Listeners use redundant phonetic information in online morphosyntactic processing Journal Article In: Glossa Psycholinguistics, vol. 3, pp. 1–52, 2024. @article{Cohen2024,Pronunciation variation is systematic, and provides listeners with cues to what the speaker is about to say. Shortened stems, for example, can indicate an upcoming suffix, while lengthened ones can indicate a word boundary follows. Previous work has shown that listeners draw on these cues to distinguish polysyllabic words, like rocket, from monosyllabic words, like rock. This strategy is useful in morphological processing, as additional morphological structure often adds additional syllables. The current study asks (i) whether listeners use these cues to distinguish words that differ only in morphological structure with no change in syllable count (e.g., rock/rocks); and (ii) how surrounding morphosyntactic context affects listeners' ability to use these cues. Ideal observer models predict that listeners should be attentive to phonetic detail in all contexts regardless of how much new information it offers, while the strategic listener account allows listeners to dynamically adjust their attentiveness to phonetic detail based on its information value in context. In a visual-world eye-tracking study, English-speaking listeners were presented with utterances containing target nouns whose stem durations were manipulated to provide cues to the presence or absence of (a) a plural suffix (rock vs. rocks) or (b) a second, non-morphological syllable (rock vs. rocket). These words were embedded in two contexts: (i) preceded by agreeing determiners, which rendered stem duration cues redundant for predicting the presence or absence of a suffix (this rock/these rocks), and (ii) preceded by non-agreeing determiners (the rock(s)), where stem duration cues carried more information. The results are consistent with ideal observer models: listeners are highly attentive to all acoustic detail, and especially so when it is predictable (and hence redundant), as long as they have the cognitive resources to handle it. |
Derya Çokal; Klaus Heusinger The role of alternatives in the cognitive processing of German demonstratives: Insights from online and offline processing Journal Article In: Frontiers in Language Sciences, vol. 3, no. 1, pp. 1–9, 2024. @article{Cokal2024,This study, employing eye-tracking reading and sentence completion experiments, explores the impact of competing antecedents on the German demonstratives der and dieser . It challenges prior assumptions, revealing that in competitive alternative antecedent contexts, processing dieser initially posed challenges, indicating sensitivity to alternatives. Dieser exhibited less processing difficulties than der , potentially influenced by a register effect. Consistent with previous findings, in the offline task, references to the non-prominent entity were similar for both demonstratives, but our online experiment shows functional differences in cognitive processes between the two in reading. Our results suggest that Thematic Role accounts better explain antecedent preferences for der and dieser than Centering Theory . |
Sarah E. Colby; Francis X. Smith; Bob McMurray The role of inhibitory control in spoken word recognition: Evidence from cochlear implant users Journal Article In: Language, Cognition and Neuroscience, vol. 39, no. 8, pp. 1059–1071, 2024. @article{Colby2024,During spoken word recognition, listeners must quickly map sounds to meaning while suppressing competitors. It remains unclear whether domain-general inhibitory control is recruited for resolving lexical competition. Cochlear implant (CI) users present a unique population for addressing this question because they are consistently confronted with degraded auditory input, and may need to rely on domain-general mechanisms to compensate. We examined word recognition in adult CI users who were prelingually deaf (lost their hearing in childhood |
Carmen Julia Coloma; Ernesto Guerra; Zulema De Barbieri; Andrea Helo; Zulema De Barbieri; Andrea Helo; Carmen Julia; Ernesto Guerra; Zulema De Barbieri; Andrea Helo Article comprehension in monolingual Spanish-speaking children with developmental language disorder: A longitudinal eye tracking study Journal Article In: International Journal of Speech-Language Pathology, vol. 26, no. 1, pp. 105–117, 2024. @article{Coloma2024,Purpose: Article-noun disagreement in spoken language is a marker of children with developmental language disorder (DLD). However, the evidence is less clear regarding article comprehension. This study investigates article comprehension in monolingual Spanish-speaking children with and without DLD. Method: Eye tracking methodology used in a longitudinal experimental design enabled the examination of real time article comprehension. The children at the time 1 were 40 monolingual Spanish-speaking preschoolers (20 with DLD and 20 with typical language development [TLD]). A year later (time 2), 27 of these children (15 with DLD and 12 with TLD) were evaluated. Children listened to simple phrases while inspecting a four object visual context. The article in the phrase agreed in number and gender with only one of the objects. Result: At the time 1, children with DLD did not use articles to identify the correct image, while children with TLD anticipated the correct picture. At the time 2, both groups used the articles' morphological markers, but children with DLD showed a slower and weaker preference for the correct referent compared to their age-matched peers. Conclusion: These findings suggest a later emergence, but a similar developmental trajectory, of article comprehension in children with DLD compared to their peers with TLD. |
Sarah C. Creel; Conor I. Frye Minimal gains for minimal pairs: Difficulty in learning similar-sounding words continues into preschool Journal Article In: Journal of Experimental Child Psychology, vol. 240, pp. 1–27, 2024. @article{Creel2024,A critical indicator of spoken language knowledge is the ability to discern the finest possible distinctions that exist between words in a language—minimal pairs, for example, the distinction between the novel words beesh and peesh. Infants differentiate similar-sounding novel labels like “bih” and “dih” by 17 months of age or earlier in the context of word learning. Adult word learners readily distinguish similar-sounding words. What is unclear is the shape of learning between infancy and adulthood: Is there a nonlinear increase early in development, or is there protracted improvement as experience with spoken language amasses? Three experiments tested monolingual English-speaking children aged 3 to 6 years and young adults. Children underperformed when learning minimal-pair words compared with adults (Experiment 1), compared with learning dissimilar words even when speech materials were optimized for young children (Experiment 2), and when the number of word instances during learning was quadrupled (Experiment 3). Nonetheless, the youngest group readily recognized familiar minimal pairs (Experiment 3). Results are consistent with a lengthy trajectory for detailed sound pattern learning in one's native language(s), although other interpretations are possible. Suggestions for research on developmental trajectories across various age ranges are made. |
Nannan Cui; Yang Wang; Jiefei Luo; Yan Wu The role of executive functions in 9- to 12-year-old children's sentence processing: An eye-movement study Journal Article In: Journal of Research in Reading, vol. 47, no. 2, pp. 201–219, 2024. @article{Cui2024,Background: Executive function (EF) plays a crucial role in children's reading. However, previous studies were based on offline products of reading comprehension. Online research is needed to reveal the core mechanisms underlying children's reading processing. By measuring children's working memory (WM) and cognitive flexibility (CF), we investigated whether individual differences in EF could modulate sentence processing and, if so, how they exert their roles. Methods: The present study manipulated semantic congruency and the association between crucial words in a sentence. We recruited 89 Chinese children aged 9–12 years and monitored their eye movement. Results: The study revealed distinct associations between reader- and text-related characteristics, as evidenced by eye-movement patterns during reading. A significant incongruency effect was observed in reading, underscoring the children's capacity to discern incongruent information. Children's WM and CF were found to modulate this process. Specifically, high-WM children showed more effective integration of incongruent information when the textual context was closely related during the later-stage processing. In contrast, low-WM children faced more challenges with incongruent words. Additionally, CF was influential during the early processing period. High-CF children exhibited longer early-stage reading times for incongruent words in associated contexts. Conclusions: Individual differences in EF can modulate children's online sentence processing. However, different EF components may play different roles. |
Michael G. Cutter; Kevin B. Paterson; Ruth Filik Eye-movements during reading and noisy-channel inference making Journal Article In: Journal of Memory and Language, vol. 137, pp. 1–16, 2024. @article{Cutter2024,This novel experiment investigates the relationship between readers' eye movements and their use of “noisy channel” inferences when reading implausible sentences, and how this might be affected by cognitive aging. Young (18–26 years) and older (65–87 years) adult participants read sentences which were either plausible or implausible. Crucially, readers could assign a plausible interpretation to the implausible sentences by inferring that a preposition (i.e., to) had been unintentionally omitted or included. Our results reveal that readers' fixation locations within such sentences are associated with the likelihood of them inferring the presence or absence of this critical preposition to reach a plausible interpretation. Moreover, our older adults were more likely to make these noisy-channel inferences than the younger adults, potentially because their poorer visual processing and greater linguistic experience promote such inference-making. We propose that the present findings provide novel experimental evidence for a perceptual contribution to noisy-channel inference-making during reading. |
Megan M. Dailey; Camille Straboni; Sharon Peperkamp Using allophonic variation in L2 word recognition: French listeners' processing of English vowel nasalization Journal Article In: Second Language Research, vol. 40, no. 4, pp. 865 –886, 2024. @article{Dailey2024,During spoken word processing, native (L1) listeners use allophonic variation to predictively rule out word competitors and speed up word recognition. There is some evidence that second language (L2) learners develop an awareness of allophonic distributions in their L2, but whether they use their knowledge to facilitate word recognition online, like native listeners do, is largely unknown. In an offline gating experiment and an online eye-tracking experiment in the visual world paradigm, we compare advanced French learners of English and a control group of L1 English listeners on their processing of English vowel nasalization during spoken word recognition. In the gating task, the French listeners' performance did not differ from that of the English ones. The eye-tracking results show that French listeners used the allophonic distribution in the same way as English listeners, although they were not as fast. Together, these results reveal that L2 learners can develop novel processing strategies using sounds in allophonic distribution to facilitate spoken word recognition. |
Claudia Damiano; Maarten Leemans; Johan Wagemans Exploring the semantic-inconsistency effect in scenes using a continuous measure of linguistic-semantic similarity Journal Article In: Psychological Science, vol. 35, no. 6, pp. 623–634, 2024. @article{Damiano2024,Viewers use contextual information to visually explore complex scenes. Object recognition is facilitated by exploiting object–scene relations (which objects are expected in a given scene) and object–object relations (which objects are expected because of the occurrence of other objects). Semantically inconsistent objects deviate from these expectations, so they tend to capture viewers' attention (the semantic-inconsistency effect). Some objects fit the identity of a scene more or less than others, yet semantic inconsistencies have hitherto been operationalized as binary (consistent vs. inconsistent). In an eye-tracking experiment (N = 21 adults), we study the semantic-inconsistency effect in a continuous manner by using the linguistic-semantic similarity of an object to the scene category and to other objects in the scene. We found that both highly consistent and highly inconsistent objects are viewed more than other objects (U-shaped relationship), revealing that the (in)consistency effect is more than a simple binary classification. |
Roberto G. Almeida; Jordan Gallant; Caitlyn Antal; Gary Libben In: Journal of Experimental Psychology: Learning, Memory, and Cognition, pp. 1–25, 2024. @article{Almeida2024,How does the language comprehension system identify and interpret word constituents—or morphemes— during sentence reading? We investigated this question by employing words containing semantically ambiguous roots (e.g., bark, with meanings related to both “dog” and “tree”) which are disambiguated when affixed by -ing (e.g., barking; related to “dog” only). We aimed to understand whether higher-level access to the meaning of the root bark would be constrained by lower-level morphological affixation. In Experiment 1, using eye-tracking, participants read sentences containing words with semantically ambiguous roots, such as barking (a prime), combined with targets that were either related to two meanings of the root (dog, tree) or they were cloze and unrelated controls. All five eye-tracking measures we employed (first fixation duration, gaze duration, go-past time, total reading time, and regressions to target) showed no difference between the two root-related targets, which were slower than cloze, but faster than unrelated. Results show that even in cases where a meaning is inconsistent with the full word form (barking-tree), both meanings of the ambiguous root are activated. These results were supported by Experiment 2, employing a maze task in which the time to select the cloze (night) continuation for the sentence He heard loud barking during the… was disrupted by the presence of distractors related to both meanings of bark. We discuss the implications of these findings for the nature ofmorphological parsing and lexical ambiguity resolution in sentence contexts. We suggest that word recognition and lexical access processes involve separating roots from affixes, yielding independent and exhaustive access to root meanings—even when they are ruled out by affixation and context. |
