Non-Human Primate Eye-Tracking Publications
All EyeLink eye tracker non-human primate research publications up until 2024 (with some early 2025s) are listed below by year. You can search the eye-tracking publications using keywords such as Temporal Cortex, Macaque, Antisaccade, etc. You can also search for individual author names. If we missed any EyeLink non-human primate articles, please email us!
2023 |
Diane C. Mézière; Lili Yu; Erik D. Reichle; Titus Malsburg; Genevieve McArthur Using eye-tracking measures to predict reading comprehension Journal Article In: Reading Research Quarterly, vol. 58, no. 3, pp. 425–449, 2023. @article{Meziere2023,This study examined the potential of eye-tracking as a tool for assessing reading comprehension. We administered three widely used reading comprehension tests with varying task demands to 79 typical adult readers while monitoring their eye movements. In the York Assessment of Reading for Comprehension (YARC), participants were given passages of text to read silently, followed by comprehension questions. In the Gray Oral Reading Test (GORT-5), participants were given passages of text to read aloud, followed by comprehension questions. In the sentence comprehension subtest of the Wide Range Achievement Test (WRAT-4), participants were asked to provide a missing word in sentences that they read silently (i.e., a cloze task). Linear models predicting comprehension scores from eye-tracking measures yielded different results for the three tests. Eye-tracking measures explained significantly more variance than reading-speed data for the YARC (four times better), GORT (three times better), and the WRAT (1.3 time better). Importantly, there was no common strong predictor for all three tests. These results support growing recognition that reading comprehension tests do not measure the same cognitive processes, and that participants adapt their reading strategies to the tests' varying task demands. This study also suggests that eye-tracking may provide a useful alternative for measuring reading comprehension. |
Evelyn Milburn; Michael Walsh Dickey; Tessa Warren; Rebecca Hayes Increased reliance on world knowledge during language comprehension in healthy aging: evidence from verb-argument prediction Journal Article In: Aging, Neuropsychology, and Cognition, vol. 30, no. 1, pp. 1–33, 2023. @article{Milburn2023,Cognitive aging negatively impacts language comprehension performance. However, there is evidence that older adults skillfully use linguistic context and their crystallized world knowledge to offset age-related changes that negatively impact comprehension. Two visual-world paradigm experiments examined how aging changes verb-argument prediction, a comprehension process that relies on world knowledge but has rarely been examined in the cognitive-aging literature. Older adults did not differ from younger adults in their activation of an upcoming likely verb argument, particularly when cued by a semantically-rich agent+verb combination (Experiment 1). However, older adults showed elevated activation of previously-mentioned agents (Experiment 1) and of unlikely but verb-congruent referents (Experiment 2). This is novel evidence that older adults exploit semantic context and world knowledge during comprehension to successfully activate upcoming referents. However, older adults also show elevated activation of irrelevant information, consistent with previous findings demonstrating that older adults may experience greater proactive interference and competition from task-irrelevant information. |
Sara Milligan; Brian Nestor; Martín Antúnez; Elizabeth R. Schotter Out of sight, out of mind: Foveal processing is necessary for semantic integration of words into sentence context Journal Article In: Journal of Experimental Psychology: Human Perception and Performance, vol. 49, no. 5, pp. 687–708, 2023. @article{Milligan2023,Word recognition begins before a reader looks directly at a word, as demonstrated by the parafoveal preview benefit and word skipping. Both low-level form and high-level semantic features can be accessed in parafoveal vision and used to promote reading efficiency. However, words are not recognized in isolation during reading; once a semantic representation is retrieved, it must be integrated with the broader sentence context. One open question about parafoveal processing is whether it is limited to shallow stages of lexico-semantic activation or extends to semantic integration. In the present two-experiment study, we recorded event-related brain potentials in response to a sentence-final word that was presented in foveal or parafoveal vision and was either expected, unexpected, or anomalous in the sentence context.We found thatword recognition, indexed by the N400, ensued regardless of perception location whereas identification of the semantic fit of a word in its sentence context, indexed by the late positive component, was only observed for foveally perceived but not parafoveally perceived words. This pattern was not sensitive to task differences that promote different levels of orthographic scrutiny, as manipulated between the two experiments. These findings demonstrate separate roles for parafoveal and foveal processing in reading. |
Serge Minor; Natalia Mitrofanova; Gustavo Guajardo; Myrte Vos; Gillian Ramchand Aspect processing across languages: A visual world eye-tracking study Journal Article In: Frontiers in Language Sciences, vol. 1, pp. 1–14, 2023. @article{Minor2023a,The study employed a combination of a picture selection task and Visual World eye-tracking to investigate the processing of grammatical aspect (perfective vs. imperfective) in three languages: Russian, Spanish and English. In order to probe into the cognitive representations triggered by the aspectual forms we contrasted visual representations of different temporal portions of telic events—a snapshot of the process stage (ongoing event) and a snapshot of the immediate aftermath of the event/the result state (completed event). In all three languages, the gaze patterns and offline responses revealed a strong preference for representations of ongoing events in the imperfective condition. This confirms that the imperfective forms in all the three languages draw attention to the in-progress portion of a telic event. In the perfective condition, however, we found robust differences. Russian uses verbal prefixes to mark perfective aspect, and our results suggest that perfective telic verbs in Russian strongly highlight the result state of an event. In Spanish, the perfective past tense form (Preterite) also highlights event completion, but to a lesser extent than in Russian—in line with its less restrictive semantics in not requiring an inherent boundary. In contrast to Russian and Spanish, English speakers did not show a preference for representations of completed events in the perfective (Simple Past) condition. This suggests that the English Simple Past form does not encode a preferential cognitive salience for either the activity portion of an event or its result state, and lends support to the analysis of the English Simple Past as a non-aspectual tense form. |
Padraic Monaghan; Seamus Donnelly; Katie Alcock; Amy Bidgood; Kate Cain; Samantha Durrant; Rebecca L. A. Frost; Lana S. Jago; Michelle S. Peter; Julian M. Pine; Heather Turnbull; Caroline F. Rowland Learning to generalise but not segment an artificial language at 17 months predicts children's language skills 3 years later Journal Article In: Cognitive Psychology, vol. 147, pp. 1–13, 2023. @article{Monaghan2023,We investigated whether learning an artificial language at 17 months was predictive of children's natural language vocabulary and grammar skills at 54 months. Children at 17 months listened to an artificial language containing non-adjacent dependencies, and were then tested on their learning to segment and to generalise the structure of the language. At 54 months, children were then tested on a range of standardised natural language tasks that assessed receptive and expressive vocabulary and grammar. A structural equation model demonstrated that learning the artificial language generalisation at 17 months predicted language abilities – a composite of vocabulary and grammar skills – at 54 months, whereas artificial language segmentation at 17 months did not predict language abilities at this age. Artificial language learning tasks – especially those that probe grammar learning – provide a valuable tool for uncovering the mechanisms driving children's early language development. |
Yoichi Mukai; Juhani Järvikivi; Benjamin V. Tucker The role of phonology-to-orthography consistency in predicting the degree of pupil dilation induced in processing reduced and unreduced speech Journal Article In: Applied Psycholinguistics, vol. 44, no. 5, pp. 784–815, 2023. @article{Mukai2023,The relationship between the ways in which words are pronounced and spelled has been shown to affect spoken word processing, and a consistent relationship between pronunciation and spelling has been reported as a possible cause of unreduced pronunciations being easier to process than reduced counterparts although reduced pronunciations occur more frequently. In the present study, we investigate the effect of pronunciation-to-spelling consistency for reduced and unreduced pronunciations in L1 and L2 listeners of a logographic language. More precisely, we compare L1 and L2 Japanese listeners to probe whether they use orthographic information differently when processing reduced and unreduced speech. Using pupillometry, the current study provides evidence that extends the hypothesis about the role of orthography in the processing of reduced speech. Orthographic realization matters in processing for L1 and L2 advanced listeners. More specifically, how consistent the orthographic realization is with its phonological form (phonology-to-orthography consistency) modulates the extent to which reduced pronunciation induces additional processing costs. The results are further discussed in terms of their implications for how listeners process reduced speech and the role of the orthographic form in speech processing. |
Shingo Nahatame Predicting processing effort during L1 and L2 reading: The relationship between text linguistic features and eye movements Journal Article In: Bilingualism: Language and Cognition, pp. 1–14, 2023. @article{Nahatame2023,Researchers have taken great interest in the assessment of text readability. This study expands on this research by developing readability models that predict the processing effort involved during first language (L1) and second language (L2) text reading. Employing natural language processing tools, the study focused on assessing complex linguistic features of texts, and these features were used to explain the variance in processing effort, as evidenced by eye movement data for L1 or L2 readers of English that were extracted from an open eye-tracking corpus. Results indicated that regression models using the indices of complex linguistic features provided better performance in predicting processing effort for both L1 and L2 reading than the models using simple linguistic features (word and sentence length). Furthermore, many of the predictive variables were lexical features for both L1 and L2 reading, emphasizing the importance of decoding for fluent reading regardless of the language used. |
Mihaela Beatrice Neagu; Abigail A. Kressner; Helia Relaño-Iborra; Per Bækgaard; Torsten Dau; Dorothea Wendt Investigating the reliability of pupillometry as a measure of individualized listening effort Journal Article In: Trends in Hearing, vol. 27, pp. 1–20, 2023. @article{Neagu2023,Recordings of the pupillary response have been used in numerous studies to assess listening effort during a speech-in-noise task. Most studies focused on averaged responses across listeners, whereas less is known about pupil dilation as an indicator of the individuals' listening effort. The present study investigated the reliability of several pupil features as potential indicators of individual listening effort and the impact of different normalization procedures on the reliability. The pupil diameters of 31 normal-hearing listeners were recorded during multiple visits while performing a speech-in-noise task. The signal-to-noise ratios (SNRs) of the stimuli ranged from (Formula presented.) 12 dB to (Formula presented.) 4 dB. All listeners were measured twice at separate visits, and 11 were re-tested at a third visit. To examine the reliability of the pupil responses across visits, the intraclass correlation coefficient was applied to the peak and mean pupil dilation and to the temporal features of the pupil response, extracted using growth curve analysis. The reliability of the pupillary response was assessed in relation to SNR and different normalization procedures over multiple visits. The most reliable pupil features were the traditional mean and peak pupil dilation. The highest reliability results were obtained when the data were baseline-corrected and normalized to the individual pupil response range across all visits. Moreover, the present study results showed only a minor impact of the SNR and the number of visits on the reliability of the pupil response. Overall, the results may provide an important basis for developing a standardized test for pupillometry in the clinic. |
Ulrike Nederstigt; Béryl Hilberink-Schulpen Attention to multilingual job ads: An eye-tracking study on the use of English in German job ads Journal Article In: Folia Linguistica, vol. 57, no. 2, pp. 313–343, 2023. @article{Nederstigt2023,In many non-English-speaking countries, English loanwords in job ads seem to be very common. The question is whether this linguistic choice is advantageous, especially when the job advertised does not involve working in an international environment. Previous research of English loanwords in job ads has revealed that their effect in terms of the evaluation of the company, the job and the ad is limited if effects can be shown at all. Suggestions that English loanwords draw readers' attention because this language choice deviates from what readers expect and, in addition, take more processing time (because they are foreign) lack empirical evidence. The eye-tracking and behavioural data of our experiment did not provide any empirical evidence for the attention-drawing function of English loanwords nor an influence on their effectiveness in job ads geared to graduate students in Germany. We suggest that loanwords need a certain amount of processing to be identified as foreign. This means they are different from other salient cues that were shown to draw readers' attention because they are not subject to automatic processes. In addition, our participants were sufficiently proficient in English so that differences in processing time were not reflected in their eye-movement data. |
M. J. Nelson; S. Moeller; M. Seckin; E. J. Rogalski; M. M. Mesulam; R. S. Hurley The eyes speak when the mouth cannot: Using eye movements to interpret omissions in primary progressive aphasia Journal Article In: Neuropsychologia, vol. 184, pp. 1–9, 2023. @article{Nelson2023,Though it may seem simple, object naming is a complex multistage process that can be impaired by lesions at various sites of the language network. Individuals with neurodegenerative disorders of language, known as primary progressive aphasias (PPA), have difficulty with naming objects, and instead frequently say “I don't know” or fail to give a vocal response at all, known as an omission. Whereas other types of naming errors (paraphasias) give clues as to which aspects of the language network have been compromised, the mechanisms underlying omissions remain largely unknown. In this study, we used a novel eye tracking approach to probe the cognitive mechanisms of omissions in the logopenic and semantic variants of PPA (PPA-L and PPA-S). For each participant, we identified pictures of common objects (e.g., animals, tools) that they could name aloud correctly, as well as pictures that elicited an omission. In a separate word-to-picture matching task, those pictures appeared as targets embedded among an array with 15 foils. Participants were given a verbal cue and tasked with pointing to the target, while eye movements were monitored. On trials with correctly-named targets, controls and both PPA groups ceased visual search soon after foveating the target. On omission trials, however, the PPA-S group failed to stop searching, and went on to view many foils “post-target”. As further indication of impaired word knowledge, gaze of the PPA-S group was subject to excessive “taxonomic capture”, such that they spent less time viewing the target and more time viewing related foils on omission trials. In contrast, viewing behavior of the PPA-L group was similar to controls on both correctly-named and omission trials. These results indicate that the mechanisms of omission in PPA differ by variant. In PPA-S, anterior temporal lobe degeneration causes taxonomic blurring, such that words from the same category can no longer be reliably distinguished. In PPA-L, word knowledge remains relatively intact, and omissions instead appear to be caused by downstream factors (e.g., lexical access, phonological encoding). These findings demonstrate that when words fail, eye movements can be particularly informative. |
Ariel N. James; Colleen J. Minnihan; Duane G. Watson Language experience predicts eye movements during online auditory comprehension Journal Article In: Journal of Cognition, vol. 6, no. 1, pp. 1–29, 2023. @article{James2023,Experience-based theories of language processing suggest that listeners use the properties of their previous linguistic input to constrain comprehension in real time (e.g. MacDonald & Christiansen, 2002; Smith & Levy, 2013; Stanovich & West, 1989; Mishra, Pandey, Singh, & Huettig, 2012). This project investigates the prediction that individual differences in experience will predict differences in sentence comprehension. Participants completed a visual world eye-tracking task following Altmann and Kamide (1999) which manipulates whether the verb licenses the anticipation of a specific referent in the scene (e.g. The boy will eat/move the cake). Within this paradigm, we ask (1) are there reliable individual differences in language-mediated eye movements during this task? If so, (2) do individual differences in language experience correlate with these differences, and (3) can this relationship be explained by other, more general cognitive abilities? Study 1 finds evidence that language experience predicts an overall facilitation in fixating the target, and Study 2 replicates this effect and finds that it remains when controlling for working memory, inhibitory control, phonological ability, and perceptual speed. |
Juan Jia; Ziyu Wei; Heben Cheng; Xiaolu Wang Translation directionality and translator anxiety: Evidence from eye movements in L1-L2 translation Journal Article In: Frontiers in Psychology, vol. 14, pp. 1–12, 2023. @article{Jia2023,While considerable research on the impact of anxiety on second language learning has been carried out in international contexts, the impact of anxiety on the translator's undertaking L2 translation, a sort of anxiety arising from the translation directionality, as well as the structure of cognitive mechanism for translational anxiety, remain under-explored. Adopting the eye-tracking and key-logging approach to data collection, this study implemented an eye-tracking experiment with EFL learners at a Chinese university to probe into how the participants responded to L1 and L2 translation-tasks and the mechanism involved in these processes. It is found that translation directionality does have a great impact on the processing of translation, which causes the change of cognitive load and then leads to the change of levels in translator anxiety. The finding further confirms the key premises of the Processing Proficiency Model and the Revised Hierarchical Model with attendant implications for translation processes. |
Yanfang Jia; Sanjun Sun Man or machine? Comparing the difficulty of human translation versus neural machine translation post-editing Journal Article In: Perspectives: Studies in Translation Theory and Practice, vol. 31, no. 5, pp. 950–968, 2023. @article{Jia2023a,This study aims to compare neural machine translation (NMT) post-editing and human translation in terms of task difficulty while considering source text (ST) complexity and machine translation (MT) quality levels, two factors that have been rarely examined in previous comparison studies. Data were obtained from 60 trainee translators concerning the perceived and objective difficulties of post-editing and human translation tasks and the participants' performance. It was found that (1) the difficulty of the NMT post-editing task, compared to human translation, was significantly influenced by both NMT quality and ST complexity; the difficulty of the post-editing task was significantly lower than that of the human translation task only in the case of high-quality NMT paired with complex ST, while the results were mixed for other interactions between NMT quality and ST complexity levels; (2) no strong correlations were found between the participants' perceived difficulty and the measurements of objective difficulty and task performance for both post-editing and human translation tasks. Practical and research implications were discussed. |
Yu-Cin Cin Jian Reading behavior in science comics and its relations with comprehension performance and reading attitudes: An eye-tracker study Journal Article In: Research in Science Education, vol. 53, no. 129, pp. 689–706, 2023. @article{Jian2023,One of the ways to acquire scientific knowledge is by reading science comics. This study aims to investigate the attitudes (e.g., reading habits, interest, motivation) of university students toward reading science comics, and how they read science comics for acquiring scientific knowledge reflected by an eye tracker. Sixty-five undergraduates were invited to complete an attitudes and habits questionnaire of reading comics, after which they read a science comic where their reading processes were recorded by an eye tracker; finally, they completed a reading comprehension test. The results showed that most undergraduates had a positive attitude for reading comics, and were more likely to learn science by reading comics rather than texts. In addition, the analysis results of the linear mixed-effect models indicated that fixation with regard to re-reading durations could promote post-reading comprehension. The readers who particularly re-read the important information in relation to the boxed-in texts and graphics for a longer period scored higher in the post-test (e.g., the cause and variation processes of cancer). The analysis of variance also indicated that readers who exhibited a good test performance allocated more re-reading time on informational texts and diagrams. This meant they were more intentional and selective in re-reading the core and concept-intensive information; however, concerning the reader who performed poorly in their test, this reading pattern was unapparent. Therefore, those who exhibited a better grasp of the knowledge in the science comics were likely to fully process the areas that presented relevant information concerning important science concepts. |
Shang Jiang; Anna Siyanova-Chanturia The processing of multiword expressions in L1 and L2 Chinese: Evidence from reaction times and eye movements Journal Article In: Modern Language Journal, vol. 107, no. 2, pp. 565–605, 2023. @article{Jiang2023a,Frequency and proficiency have been found to play an important role in second language (L2) phrasal processing. However, existing research has largely focused on English and other European languages, with other commonly used languages, such as Chinese, being largely disregarded. To fill this gap, we carried out two experiments to investigate how frequency—operationalized as a dichotomy (collocation vs. control) and a continuum (log-transformed corpus frequency)—and language proficiency affect phrasal processing in first language (L1) and L2 speakers of Chinese. The results of a grammaticality judgment task (Experiment 1) and an eye-tracking experiment (Experiment 2) largely converged to show that not only L1 speakers but also L2 learners are sensitive to phrase frequency manipulations, with collocations and higher frequency phrases being processed faster than controls and lower frequency phrases, respectively. Additionally, the analysis of eye movements—but not reaction times—showed a relationship between proficiency and phrase frequency. Finally, the use of the eye-tracking methodology allowed us to tap into the mechanisms associated with earlier and later stages of phrasal processing, and to analyze multiple interest areas. |
Jia Jin; Chenchen Lin; Fenghua Wang; Ting Xu; Wuke Zhang A study of cognitive effort involved in the framing effect of summary descriptions of online product reviews for search vs. experience products Journal Article In: Electronic Commerce Research, vol. 23, no. 2, pp. 785–806, 2023. @article{Jin2023b,Few studies have focused on summary descriptions of online product reviews regarding purchase decisions, and there is a gap between individual product reviews and summary descriptions of online product reviews. The current study applied eye-tracking to explore how the product type moderates the framing effect of summary descriptions of product reviews on e-consumers' purchase decisions. The results showed that product type moderated the framing effect of summary reviews on e-consumers' purchase intention. Specifically, for search products, compared with a negative frame, a positive frame increased e-consumers' attention to function attributes and led to higher purchase intention. However, with experience products, e-consumers' attention and purchase intention did not vary across framing messages. Referring to information asymmetry theory and signal theory, we posit that the cognitive effort involved in summary review information is high for search products and low for experience products since summary reviews are a more useful signal in reducing information asymmetry for search products than for experience products. The theoretical and practical implications are also discussed. |
Jia Jin; Ailian Wang; Cuicui Wang; Qingguo Ma How do consumers perceive and process online overall vs. individual text-based reviews? Behavioral and eye-tracking evidence Journal Article In: Information and Management, vol. 60, no. 5, pp. 1–13, 2023. @article{Jin2023a,Building on the Heuristic-Systematic model, we use a survey and two eye-tracking experiments to investigate consumers' perceived usefulness of overall and individual text-based reviews (OTRs vs. ITRs) for search vs. experience products, and the information processing features. Results indicate that OTRs show higher usefulness than ITRs, regardless of product type. ITRs are perceived to be more useful for experience products than for search products. Furthermore, two eye-tracking studies confirm these results from a physiological standpoint and reveal the attentional allocation during information processing. OTRs affect subjects' processing of ITRs information differently in purchase search and experience products. |
Miranda Johnson; John Palmer; Cathleen M. Moore; Geoffrey M. Boynton Evidence from partially valid cueing that words are processed serially Journal Article In: Psychonomic Bulletin & Review, vol. 30, no. 4, pp. 1–10, 2023. @article{Johnson2023c,There has been a long-standing debate about whether lexical and semantic processing of words is serial or parallel. We addressed this debate using partially valid cueing, where one of two words is cued. The cue was valid on 80% and invalid on the other 20% of the trials. The task was semantic categorization, and performance was measured by accuracy. The new feature was to use a postmask to limit attentional switching. We found a large effect of cueing while performance for the uncued word was at chance. This chance performance was consistent with serial processing and not with typical parallel processing. This result adds to the evidence from other recent studies that the lexical and semantic processing of words is serial. |
Rebecca L. Johnson; Megan Wootten; Abigail I. Spear; Ashley Smolensky The relationship between personality traits and the processing of emotion words: Evidence from eye-movements in sentence reading Journal Article In: Journal of Psycholinguistic Research, vol. 52, no. 5, pp. 1497–1523, 2023. @article{Johnson2023a,Previous research shows that processing times on emotion words (both negative and positive) are faster than on non-emotional neutral words. In the current study, we explored how personality traits (the Big Five and the trait emotional intelligence factors) may further influence the processing of emotion versus non-emotion words by conducting two experiments where participants silently read sentences while their eye movements were recorded. The results replicated the facilitative emotion effect and showed that those with higher agreeableness scores had stronger emotion effects on positive words and those with higher extraversion scores, higher openness scores, higher agreeableness scores, lower sociability scores, and higher emotionality scores had stronger emotion effects on negative words. Furthermore, some personality traits also led to different ways that readers approach text, for example, through more risky reading strategies. |
Olessia Jouravlev; Mark McPhedran; Vegas Hodgins; Debra Jared Cross-language semantic parafoveal preview benefits in bilinguals Journal Article In: Journal of Experimental Psychology: Learning, Memory, and Cognition, vol. 49, no. 10, pp. 1683–1697, 2023. @article{Jouravlev2023,The aim of this project was to identify factors contributing to cross-language semantic preview benefits. In Experiment 1, Russian–English bilinguals read English sentences with Russian words presented as parafoveal previews. The gaze-contingent boundary paradigm was used to present sentences. Critical previews were cognate translations of the target word (CTAPT—START), noncognate translations (CPOK— TERM), or interlingual homograph translations (MOPE—SEA).A semantic preview benefit (i.e., shorter fixation durations for related than unrelated previews) was observed for cognate and interlingual homograph translations, but not for noncognate translations. In Experiment 2, English–French bilinguals read English sentences with French words used as parafoveal previews. Critical previews were interlingual homograph translations of the target word (PAIN—BREAD) or interlingual homograph translations with a diacritic added (PÁIN—BREAD). A robust semantic preview benefit was found only for interlingual homographs without diacritics, although both preview types produced a semantic preview benefit in the total fixation duration. Our findings suggest that semantically related previews need to have substantial orthographic overlap with words in the target language to produce cross-language semantic preview benefits in early eye fixation measures. In terms of the Bilingual Interactive Activation+ model, the preview word may need to activate the language node for the target language before its meaning is integrated with that of the target word. |
Crystal Lee; Andrew Jessop; Amy Bidgood; Michelle S. Peter; Julian M. Pine; Caroline F. Rowland; Samantha Durrant How executive functioning, sentence processing, and vocabulary are related at 3 years of age Journal Article In: Journal of Experimental Child Psychology, vol. 233, pp. 1–21, 2023. @article{Lee2023,There is a wealth of evidence demonstrating that executive function (EF) abilities are positively associated with language development during the preschool years, such that children with good executive functions also have larger vocabularies. However, why this is the case remains to be discovered. In this study, we focused on the hypothesis that sentence processing abilities mediate the association between EF skills and receptive vocabulary knowledge, in that the speed of language acquisition is at least partially dependent on a child's processing ability, which is itself dependent on executive control. We tested this hypothesis in longitudinal data from a cohort of 3- and 4-year-old children at three age points (37, 43, and 49 months). We found evidence, consistent with previous research, for a significant association between three EF skills (cognitive flexibility, working memory [as measured by the Backward Digit Span], and inhibition) and receptive vocabulary knowledge across this age range. However, only one of the tested sentence processing abilities (the ability to maintain multiple possible referents in mind) significantly mediated this relationship and only for one of the tested EFs (inhibition). The results suggest that children who are better able to inhibit incorrect responses are also better able to maintain multiple possible referents in mind while a sentence unfolds, a sophisticated sentence processing ability that may facilitate vocabulary learning from complex input. |
Sungyoon Lee The role of spatial ability and attention shifting in reading of illustrated scientific texts: An eye tracking study Journal Article In: Reading Psychology, vol. 44, no. 8, pp. 915–935, 2023. @article{Lee2023b,The purpose of the study is to examine the role of spatial ability and attention shifting in reading of illustrated science texts. Thirty-five fourth/fifth elementary students read two science texts. Prior knowledge and retention/transfer learning outcomes were measured using researcher-developed measures. While reading, students' eye movements were monitored with an eye-tracker. Several eye movement indices were used to reflect reading processes. Fixation count on text/picture was used to represent students' attentional focus on text or picture. Text to text saccades and picture to picture saccades were used to reflect students' information organization. Students' integrative reading behavior was measured by eye movement transitions between text and picture. Wisconsin Card Sorting Test and Visual Perception Skill Test were used to assess attention shifting and visuospatial working memory, respectively. Multiple regressions were conducted to examine whether students' spatial ability and attention shifting predict text processing, picture processing, or integrative processing of text and picture. Hierarchical regressions were conducted to examine whether students' integrative reading make unique and direct contributions to their learning outcomes. The study found that 1) both spatial ability and attention shifting are significant predictors for integrative reading behavior while they are not for other processing behaviors (i.e., text processing and picture processing) and 2) integrative reading behaviors in illustrated text reading account for significant amounts of variance in the transfer outcomes while not in the retention outcomes. This study gives practical implications on the development of visual literacy interventions and on how teachers design their instruction about science text reading. |
Yen-Lin Lee; Hsuan-Chih Chen; Yu-Chen Chan The attentional bias of gelotophobes towards emotion words containing the Chinese character for ‘laugh': An eye-tracking approach Journal Article In: Current Psychology, vol. 42, no. 19, pp. 16330–16343, 2023. @article{Lee2023c,Gelotophobes are typically characterized by the fear of laughter, social withdrawal, and humorlessness, possibly related to negative experiences of being laughed at in the past. The present study seeks to expand our understanding of gelotophobia through a relatively novel approach: using eye-tracking to investigate the attentional bias of gelotophobes and non-gelotophobes towards negative emotion words that do and do not contain the Chinese character for “laugh,” by comparing responses to negative ridicule words (RID), negative contempt words (CONT), positive pleasure words (PLE) and neutral words (NEU). Results of the start time of the first run of fixations showed that gelotophobes and non-gelotophobes both focused on negative words before other words. Gelotophobes' attentional bias towards RID and CONT was greater than that of non-gelotophobes in first gaze duration, percentage of total viewing duration, total fixation count, and run count, suggesting that gelotophobes had greater difficulty in disengaging their attention from negative to neutral words. Non-gelotophobes' attentional bias, however, towards negative ridicule neutral words (RID-NEU) and negative contempt neutral words (CONT-NEU) was greater than that of gelotophobes, suggesting that non-gelotophobes were more able to shift attention from negative to neutral words. Moreover, gelotophobes paid significantly more attention to RID than CONT, suggesting that gelotophobes displayed a longer and stronger attentional bias towards RID (containing the “laugh” character). Interestingly, there was no difference for PLE between gelotophobes and non-gelotophobes. The present study contributes to our understanding of the attentional bias of gelotophobes and non-gelotophobes towards emotion words. |
Rony Lemel; Lilach Shalev; Gal Nitsan; Boaz M. Ben-David Listen up! ADHD slows spoken-word processing in adverse listening conditions: Evidence from eye movements Journal Article In: Research in Developmental Disabilities, vol. 133, pp. 1–15, 2023. @article{Lemel2023,Background: Cognitive skills such as sustained attention, inhibition and working memory are essential for speech processing, yet are often impaired in people with ADHD. Offline measures have indicated difficulties in speech recognition on multi-talker babble (MTB) background for young adults with ADHD (yaADHD). However, to-date no study has directly tested online speech processing in adverse conditions for yaADHD. Aims: Gauging the effects of ADHD on segregating the spoken target-word from its sound-sharing competitor, in MTB and working-memory (WM) load. Methods and procedures: Twenty-four yaADHD and 22 matched controls that differ in sustained attention (SA) but not in WM were asked to follow spoken instructions presented on MTB to touch a named object, while retaining one (low-load) or four (high-load) digit/s for later recall. Their eye fixations were tracked. Outcomes and results: In the high-load condition, speech processing was less accurate and slowed by 140ms for yaADHD. In the low-load condition, the processing advantage shifted from early perceptual to later cognitive stages. Fixation transitions (hesitations) were inflated for yaADHD. Conclusions and implications: ADHD slows speech processing in adverse listening conditions and increases hesitation, as speech unfolds in time. These effects, detected only by online eyetracking, relate to attentional difficulties. We suggest online speech processing as a novel purview on ADHD. What this paper adds?: We suggest speech processing in adverse listening conditions as a novel vantage point on ADHD. Successful speech recognition in noise is essential for performance across daily settings: academic, employment and social interactions. It involves several executive functions, such as inhibition and sustained attention. Impaired performance in these functions is characteristic of ADHD. However, to date there is only scant research on speech processing in ADHD. The current study is the first to investigate online speech processing as the word unfolds in time using eyetracking for young adults with ADHD (yaADHD). This method uncovered slower speech processing in multi-talker babble noise for yaADHD compared to matched controls. The performance of yaADHD indicated increased hesitation between the spoken word and sound-sharing alternatives (e.g., CANdle-CANdy). These delays and hesitations, on the single word level, could accumulate in continuous speech to significantly impair communication in ADHD, with severe implications on their quality of life and academic success. Interestingly, whereas yaADHD and controls were matched on WM standardized tests, WM load appears to affect speech processing for yaADHD more than for controls. This suggests that ADHD may lead to inefficient deployment of WM resources that may not be detected when WM is tested alone. Note that these intricate differences could not be detected using traditional offline accuracy measures, further supporting the use of eyetracking in speech tasks. Finally, communication is vital for active living and wellbeing. We suggest paying attention to speech processing in ADHD in treatment and when considering accessibility and inclusion. |
Hui Li; Xiaolu Wang; Kevin B. Paterson; Hua Zhang; Degao Li Is there a processing advantage for verb-noun collocations in Chinese reading? Evidence from eye movements during reading Journal Article In: Frontiers in Psychology, vol. 14, pp. 1–12, 2023. @article{Li2023e,A growing number of studies show a processing advantage for collocations, which are commonly-used juxtapositions of words, such as “joint effort” or “shake hands,” suggesting that skilled readers are keenly perceptive to the occurrence of two words in phrases. With the current research, we report two experiments that used eye movement measures during sentence reading to explore the processing of four-character verb-noun collocations in Chinese, such as 修改文章 (“revise the article”). Experiment 1 compared the processing of these collocations relative to similar four-character expressions that are not collocations (e.g., 修改结尾, “revise the ending”) in neutral contexts and contexts in which the collocation was predictable from the preceding sentence context. Experiment 2 further examined the processing of these four-character collocations, by comparing eye movements for commonly-used “strong” collocations, such as 保护环境 (“protect the environment”), as compared to less commonly-used “weak” collocations, such as 保护自然 (“protect nature”), again in neutral contexts and contexts in which the collocations were highly predictable. The results reveal a processing advantage for both collocations relative to novel expressions, and for “strong” collocations relative to “weak” collocations, which was independent of effects of contextual predictability. We interpret these findings as providing further evidence that readers are highly sensitive to the frequency that words co-occur as a phrase in written language, and that a processing advantage for collocations occurs independently of contextual expectations. |
Nan Li; Dongxia Sun; Suiping Wang Semantic preview effect of relatedness and plausibility in reading Chinese: Evidence from high constraint sentences Journal Article In: Reading and Writing, vol. 36, no. 5, pp. 1319–1338, 2023. @article{Li2023n,In natural reading, the processing of words in fixation is influenced by semantic information obtained through preview (i.e., the semantic preview effect). Previous studies have confirmed that two types of semantic information exhibit the semantic preview effect: semantic association, which is reflected by the semantic relationship between preview words and target words, and semantic integration, which is reflected by the plausibility of preview words in sentences. This study examined whether and how these two types of semantic preview information interact to influence readers' processing of words in the fovea. We referenced high constraint sentences, in which contextual information strongly limits the possible meanings, and the meaning of the target word can be activated before the target word becomes fixated. Thus, the meaning of the target word can be obtained at least as early as when the pretarget word becomes fixated. Therefore, by creating a high constraint context, the reader can obtain the meaning of the upcoming word both through preview and through preactivation within the same preview time window. We tested the preview effect of semantic relatedness when preview words were implausible (Experiment 1) and plausible (Experiment 2). Readers' eye movements were measured. The results showed that the preview effect (shortened fixation duration) of semantic relatedness appeared only when the preview word was plausible. This finding suggests that readers can use semantic information from different sources within the same preview time window and that message-level representations play an immediate and pivotal role in this process. |
Qian Li A preliminary study on the online processing of anticipatory tonal coarticulation – Evidence from eye movements Journal Article In: Frontiers in Psychology, vol. 14, pp. 1–8, 2023. @article{Li2023g,While the f0 realization of lexical tones vary extensively in contexts, little has been known on how listeners process the variation in lexical tones due to contextual effects such as tonal coarticulation in spoken word recognition. This study thus aims to fill the knowledge gap in tone perception with evidence from two types of anticipatory tonal coarticulation effects in Tianjin Mandarin, i.e., the slope raising effect due to a following low-falling tone and the overall-height raising effect due to a following low-dipping tone. An eye-tracking experiment with the Visual World Paradigm was carried out to compare participants' eye movements when they heard targets in three types of anticipatory raising conditions, i.e., the Slope Raising condition, the Overall-height Raising condition, as well as the No Raising condition (the baseline). The eye movement results showed significant differences in the proportion of looks to target between the Slope Raising condition versus the other two conditions, whereas the Overall-height Raising condition did not differ significantly from the No Raising condition. The findings thus suggest the facilitatory effect of tonal coarticulation cues in the anticipation of the upcoming tones, but listeners in this study seemed to be only sensitive to the raising in the f0 slope rather than the overall raising in the f0 height. |
Shuang Li; Xiuhong Tong; Wei Shena Influence of lexical tone similarity on spoken word recognition in Mandarin Chinese: Evidence from eye tracking Journal Article In: Journal of Speech, Language, and Hearing Research, vol. 66, no. 9, pp. 3453–3472, 2023. @article{Li2023h,Purpose: Using the visual world paradigm with the eye-tracking technique, this study examined the extent to which lexical tone similarity influences spoken word recognition. Method: In two experiments, participants were audibly presented with a target word and visually presented with the same target word, a tonal competitor, and two distractors, and they were required to identify the target word. In Experiment 1, the two tonal competitors shared either acoustically highly similar tones (e.g., target word: /yang2tai2/, “balcony” vs. competitor: /yang3zi3/, “adopted son”) or acoustically lowly similar tones (e.g., target word: /yang2tai2/, “balcony” vs. competitor:/yang4ben3/, “sample”). In Experiment 2, the acoustic similarity of the target words and the tonal competitors shared either acoustically highly similar tones or acoustically lowly similar tones or identical tones (e.g., target word: /yang2tai2/, “balcony” vs. competitor: /yang2mao2/, “wool”). Results: The results of the two experiments consistently demonstrated a graded tonal competitor effect, in which acoustically highly similar tonal competitors attracted more visual attention than acoustically lowly similar tonal competitors. Conclusion: Tonal similarity plays a graded constraining role in spoken word recognition in Mandarin Chinese. |
Yutong Li; Hanwen Shi; Shan Li; Lei Gao; Xiaolei Gao The adjustment of complexity on sarcasm processing in Chinese: Evidence from reading time indicators Journal Article In: Brain Sciences, vol. 13, no. 2, pp. 1–13, 2023. @article{Li2023m,It is controversial whether sarcasm processing should go through literal meaning processing. There is also a lack of eye movement evidence for Chinese sarcasm processing. In this study, we used eye movement experiments to explore the processing differences between sarcastic and literal meaning in Chinese text and whether this was regulated by sentence complexity. We manipulated the variables of complexity and literality. We recorded 33 participants' eye movements when they were reading Chinese text and the results were analyzed by a linear mixed model. We found that, in the early stage of processing, there was no difference between the processing time of the sarcastic meaning and the literal meaning of simple remarks, whereas for complex remarks, the time needed to process the sarcastic meaning was longer than that needed to process the literal meaning. In the later stage of processing, regardless of complexity, the processing time of the sarcastic meaning was longer than that of the literal meaning. These results suggest that sarcastic speech processing in Chinese is influenced by literal meaning, and the effect of literal meaning on sarcastic remarks is regulated by complexity. Sarcastic meaning was expressed differently in different stages of processing. These results support the hierarchical salience hypothesis of the serial modular model. |
Feifei Liang; Qi Gao; Xin Li; Yongsheng Wang; Xuejun Bai; Simon P. Liversedge In: Journal of Experimental Psychology: Learning, Memory, and Cognition, vol. 49, no. 1, pp. 98–115, 2023. @article{Liang2023b,Word spacing is important in guiding eye movements during spaced alphabetic reading. Chinese is unspaced and it remains unclear as to how Chinese readers segment and identify words in reading. We conducted two parallel experiments to investigate whether the positional probabilities of the initial and the final characters of a multicharacter word affected word segmentation and identification in Chinese reading. Two-character words were selected as targets. In Experiment 1, the initial character's positional probability was manipulated as being either high or low, and the final character was kept identical across the two conditions. In Experiment 2, an analogous manipulation was made for the final character of the target word. We recorded adults' and children's eye movements when they read sentences containing these words. In Experiment 1, reading times on targets did not differ in the two conditions for both children and adults, providing no evidence that a word initial character's positional probability contributes to word segmentation. In Experiment 2, adults had shorter reading times and made fewer refixations on targets that comprised final characters with high relative to low positional probabilities; a similar effect was observed in children, but this effect had a slower time course. The results demonstrate that the positional probability of the final (but not the initial) character of a word influences segmentation commitments in reading. It suggests that Chinese readers identify where a currently fixated word ends, and via this commitment, by default, they identify where the subsequent word begins |
Agnieszka Lijewska The influence of semantic bias on triple non-identical cognates during reading: Evidence from trilinguals' eye movements Journal Article In: Second Language Research, vol. 39, no. 4, pp. 1235 –1263, 2023. @article{Lijewska2023,The current study investigated how the processing of triple cognates (words sharing form and meaning across three languages) is modulated by the semantic bias of sentence context in a reading task. In the study, Polish–German–English trilinguals read English sentences while their eye movements were monitored. The sentences were either semantically biased (high-context) or neutral (low-context) towards target words. The targets were either Polish–German–English cognates whose cross-language form overlap was incomplete (e.g. DIAMENT–DIAMANT–DIAMOND) or English-only controls (e.g. KURCZAK–HÄHNCHEN–CHICKEN). The results revealed a significant effect of context in gaze durations and in total reading time. Importantly, no cognate facilitation effect was identified in any reading measure. The gaze duration data additionally revealed that English-only controls were read slower in low-context sentences than in high-context sentences but gaze durations for cognates were not affected by the sentence context. Thus, prior bilingual findings were only partially replicated in the current study with trilinguals. This suggests that bilingual models of language processing should be carefully adapted to trilinguals. The current data may also mean that non-identical cognates (even those shared across three languages) induce relatively small effects and large samples of participants and items may be needed to detect such effects across reading measures. |
Chia-Yu Liu; Chao-Jung Wu Effects of working memory and relevant knowledge on reading texts and infographics Journal Article In: Reading and Writing, vol. 36, no. 162, pp. 2319–2343, 2023. @article{Liu2023i,Infographics are a new type of reading material comprising textual and visual information that has been used worldwide. Nonetheless, there has been limited research investigating people's infographic-reading performance and the characteristics of superior readers. This study adopted Chinese texts and infographics as materials and employed eye-tracking technology to assess how working memory and relevant knowledge affected 137 college students' reading comprehension, as indicated by reading accuracy (ACC), and reading efficiency, which in turn was indicated by reading time (RT) and total fixation duration (TFD). For texts, verbal working memory (VWM) exhibited no effects on individuals' reading performance; visuospatial working memory (VSWM) exerted positive effects on both ACC and TFD, and participants with higher knowledge demonstrated better ACC. For infographics, higher-VWM participants showed greater ACC, and higher-VSWM participants displayed a longer RT and TFD, though the effect of knowledge was limited. Moreover, a significant interaction effect of VWM and relevant knowledge on the TFD of infographics was observed, indicating that individuals' prior knowledge or experience might structure schemas in an infographic and then act with VWM to accelerate reading speed. This study improves our understanding of how working memory and relevant knowledge impact the processing of materials with different synthesized levels, and its implications for instruction and research are discussed. |
Stephanie N. Lovich; Cynthia D. King; David L. K. Murphy; Hossein Abbasi; Patrick Bruns; Christopher A. Shera; Jennifer M. Groh Conserved features of eye movement related eardrum oscillations (EMREOs) across humans and monkeys Journal Article In: Philosophical Transactions of the Royal Society B: Biological Sciences, vol. 378, no. 1886, pp. 1–10, 2023. @article{Lovich2023,Auditory and visual information involve different coordinate systems, with auditory spatial cues anchored to the head and visual spatial cues anchored to the eyes. Information about eye movements is therefore critical for reconciling visual and auditory spatial signals. The recent discovery of eye movement-related eardrum oscillations (EMREOs) suggests that this process could begin as early as the auditory periphery. How this reconciliation might happen remains poorly understood. Because humans and monkeys both have mobile eyes and therefore both must perform this shift of reference frames, comparison of the EMREO across species can provide insights to shared and therefore important parameters of the signal. Here we show that rhesus monkeys, like humans, have a consistent, significant EMREO signal that carries parametric information about eye displacement as well as onset times of eye movements. The dependence of the EMREO on the horizontal displacement of the eye is its most consistent feature, and is shared across behavioural tasks, subjects and species. Differences chiefly involve the waveform frequency (higher in monkeys than in humans) and patterns of individual variation (more prominent in monkeys than in humans), and the waveform of the EMREO when factors due to horizontal and vertical eye displacements were controlled for. This article is part of the theme issue 'Decision and control processes in multisensory perception'. |
Matthew W. Lowder; Antonio Cardoso; Michael Pittman; Adrian Zhou Effects of syntactic structure on the processing of lexical repetition during sentence reading Journal Article In: Memory & Cognition, vol. 51, no. 5, pp. 1249–1263, 2023. @article{Lowder2023a,Previous research has demonstrated that the ease or difficulty of processing complex semantic expressions depends on sentence structure: Processing difficulty emerges when the constituents that create the complex meaning appear in the same clause, whereas difficulty is reduced when the constituents appear in separate clauses. The goal of the current eye-tracking-while-reading experiments was to determine how changes to sentence structure affect the processing of lexical repetition, as this manipulation enabled us to isolate processes involved in word recognition (repetition priming) from those involved in sentence interpretation (felicity of the repetition). When repetition of the target word was felicitous (Experiment 1), we observed robust effects of repetition priming with some evidence that these effects were weaker when repetition occurred within a clause versus across a clause boundary. In contrast, when repetition of the target word was infelicitous (Experiment 2), readers experienced an immediate repetition cost when repetition occurred within a clause, but this cost was eliminated entirely when repetition occurred across clause boundaries. The results have implications for word recognition during reading, processes of semantic integration, and the role of sentence structure in guiding these linguistic representations. |
Cristina Lozano-Argüelles; Nuria Sagarra; Joseph V. Casillas Interpreting experience and working memory effects on L1 and L2 morphological prediction Journal Article In: Frontiers in Language Sciences, vol. 1, pp. 1–16, 2023. @article{LozanoArgueelles2023,The human brain tries to process information as efficiently as possible through mechanisms like prediction. Native speakers predict linguistic information extensively, but L2 learners show variability. Interpreters use prediction while working and research shows that interpreting experience mediates L2 prediction. However, it is unclear whether advantages related to interpreting are due to higher working memory (WM) capacity, a typical characteristic of professional interpreters. To better understand the role of WM during L1 and L2 prediction, English L2 learners of Spanish with and without interpreting experience and Spanish monolinguals completed a visual-world paradigm eye-tracking task and a number-letter sequencing working memory task. The eye-tracking task measured prediction of verbal morphology (present, past) based on suprasegmental information (lexical stress: paroxytone, oxytone) and segmental information (syllabic structure: CV, CVC). Results revealed that WM mediates L1 prediction, such that higher WM facilitates prediction of morphology in monolinguals. However, higher WM hinders prediction in L2 processing for non-interpreters. Interestingly, interpreters behaved similarly to monolinguals, with higher WM facilitating L2 prediction. This study provides further understanding of the variability in L2 prediction. |
Steven G. Luke; Tanner Jensen The effect of sudden-onset distractors on reading efficiency and comprehension Journal Article In: Quarterly Journal of Experimental Psychology, vol. 76, no. 5, pp. 1195 –1206, 2023. @article{Luke2023,Reading is an essential skill that requires focused attention. However, much reading is done in non-optimal environments. These days, reading is often done on digital devices or with a digital device nearby. These devices often introduce momentary distractions during reading, interrupting with alerts, notifications, and pop-ups. In two eye-tracking experiments, we investigated how such momentary distractions affect reading. Participants read paragraphs while their eye movements were monitored. During half of the paragraphs, distractions appeared periodically on the screen that required a response from the participants. In Experiment 1, the distractions were arrows that the participant had to respond to and then could immediately forget. In Experiment 2, the participants performed a 1-back task that required them to remember the identity of the last distractor. Compared with the no-distraction condition, the respond-and-forget distractors of Experiment 1 had minimal impact on reading behaviour and comprehension, but the working-memory-load distractors of Experiment 2 led to increased rereading and decreased reading comprehension. It seems a simple pop-up does not disrupt reading, but a message you must remember will. |
Steven G. Luke; Rachel Yu Liu; Kyle Nelson; Jared Denton; Michael W. Child An ex-Gaussian analysis of eye movements in L2 reading Journal Article In: Bilingualism: Language and Cognition, vol. 26, no. 2, pp. 330–344, 2023. @article{Luke2023a,Second language learners' reading is less efficient and more effortful than native reading. However, the source of their difficulty is unclear; L2 readers might struggle with reading in a different orthography, or they might have difficulty with later stages of linguistic interpretation of the input, or both. The present study explored the source of L2 reading difficulty by analyzing the distribution of fixation durations in reading. In three studies, we observed that L2 readers experience an increase in Mu, which we interpret as indicating early orthographic processing difficulty, when the L2 has a significantly different writing system than the L1 (e.g., Chinese and English) but not when the writing systems were similar (e.g., Portuguese and English). L2 readers also experienced an increase in Tau, indicating later-arising processing difficulty which likely reflects later-stage linguistic processes, when they read for comprehension. L2 readers of Chinese also experienced an additional increase in Tau. |
Changlin Luo; Mengyan Zhu; Xiangling Zhuang; Guojie Ma Food word processing in Chinese reading: A study of restrained eaters Journal Article In: British Journal of Psychology, vol. 114, no. 2, pp. 476–494, 2023. @article{Luo2023a,Food-related attentional bias refers that individuals typically prioritize rewarding food-related cues (e.g. food words and food images) compared with non-food stimuli; however, the findings are inconsistent for restrained eaters. Traditional paradigms used to test food-related attentional bias, such as visual probe tasks and visual search tasks, may not directly and accurately enough to reflect individuals' food-word processing at different cognitive stages. In this study, we introduced the boundary paradigm to investigate food-word attentional bias for both restrained and unrestrained eaters. Eye movements were recorded when they performed a naturalistic sentence-reading task. The results of later-stage analyses showed that food words were fixated on for less time than non-food words, which indicated a superiority of foveal food-word processing for both restrained and unrestrained eaters. The results of early-stage analyses showed that restrained eaters spent more time on pre-target regions in the food-word valid preview conditions, which indicated a parafoveal food-word processing superiority for restrained eaters (i.e. the parafoveal-on-foveal effect). The superiority of foveal food-word processing provides new insights into explaining food-related attentional bias in general groups. Additionally, the enhanced food-word attentional bias in parafoveal processing for restrained eaters illustrates the importance of individual characteristics in studying word recognition. |
Yingyi Luo; Dixiao Tan; Ming Yan Morphological structure influences saccade generation in Chinese reading Journal Article In: Reading and Writing, vol. 36, no. 5, pp. 1–17, 2023. @article{Luo2023c,Recent studies have demonstrated that saccadic programming in reading is not only determined by low-level visual factors. High-level morphological effects on saccade have been shown in two morphologically rich languages. In the present study, we examined the underlying mechanism of such morphological influences by comparing the processes of reading three-character Chinese compound words that differ in their structures in terms of morphological decomposition. Consistent with earlier reports, our results showed an effect of morphological structure on saccade. The readers' first-fixation location shifted further away from the beginning of the word, when the last two characters were more morphologically bounded and thus formed a [1 + 2] structure, than when the first two characters were more bounded (i.e., a [2 + 1] structure). The results are not accountable by a processing difficulty hypothesis, which proposes that saccade amplitude is determined by morphological complexity; rather, they suggest that Chinese readers parafoveally decompose a word and spontaneously target its longer stem, thus reflecting parafoveal access to words' stems. |
Yingyue Lv; Lei Zhang; Wanying Chen; Fang Xie; Kayleigh L. Warrington The influence of foveal load on parafoveal processing of N + 2 during Chinese reading Journal Article In: Visual Cognition, vol. 31, no. 2, pp. 97–106, 2023. @article{Lv2023,According to the foveal load hypothesis, parafoveal processing is influenced by the difficulty of current foveal processing. It remains unclear whether foveal load may affect the extent of parafoveal processing. This is an important consideration given the evidence that Chinese readers may frequently pre-process word N + 2 when N + 1 is one character. Accordingly, the current study manipulated word frequency to explore the influence of foveal load on parafoveal processing of N + 2 using a 2 (foveal load: high-frequency, low-frequency) × 2 (preview condition: identical preview, pseudo-character preview) within-subject design. Main effects of foveal load were found for the foveal word N, with longer fixations for low- than for high-frequency words and a main effect of preview was also found for N + 2, with longer fixations for pseudo-character preview compared to identical preview. Crucially, there was no interaction between foveal load and preview condition, indicating that parafoveal processing of word N + 2 is not influenced by foveal load during natural Chinese reading. |
Anqi Lyu; Larry Abel; Allen M. Y. Cheong Effect of habitual reading direction on saccadic eye movements: A pilot study Journal Article In: PLoS ONE, vol. 18, pp. 1–16, 2023. @article{Lyu2023,Cognitive processes can influence the characteristics of saccadic eye movements. Reading habits, including habitual reading direction, also affect cognitive and visuospatial processes, favouring attention to the side where reading begins. Few studies have investigated the effect of habitual reading direction on saccade directionality of low-cognitive-demand stimuli (such as dots). The current study examined horizontal prosaccade, antisaccade, and self-paced saccade in subjects with two primary habitual reading directions. We hypothesised that saccades responding to the stimuli in subject's habitual reading direction would show a longer prosaccade latency and lower antisaccade error rate (errors being a reflexive glance to a suddenappearing target, rather than a saccade away from it). Sixteen young Chinese participants with primary habitual reading direction from left to right and sixteen young Arabic and Persian participants with primary habitual reading direction from right to left were recruited. All subjects spoke/read English as their second language. Subjects needed to look towards a 5°/10° target in the prosaccade task or look towards the mirror image location of the target in the antisaccade task and look between two 10° targets in the self-paced saccade task. Only Arabic and Persian participants showed a shorter and directional prosaccade latency towards 5° stimuli against their habitual reading direction. No significant effect of reading direction on antisaccade latency towards the correct directions was found. Chinese readers were found to generate significantly shorter prosaccade latencies and higher antisaccade directional errors compared with Arabic and Persian readers for stimuli appearing at their habitual reading side. The present pilot study provides insights into the effect of reading habits on saccadic eye movements of low-cognitive-demand stimuli and offers a platform for future studies to investigate the relationship between reading habits and eye movement behaviours. |
Xiaochuan Ma; Yikang Liu; Roy Clariana; Chanyuan Gu; Ping Li From eye movements to scanpath networks: A method for studying individual differences in expository text reading Journal Article In: Behavior Research Methods, vol. 55, no. 2, pp. 730–750, 2023. @article{Ma2023b,Eye movements have been examined as an index of attention and comprehension during reading in the literature for over 30 years. Although eye-movement measurements are acknowledged as reliable indicators of readers' comprehension skill, few studies have analyzed eye-movement patterns using network science. In this study, we offer a new approach to analyze eye-movement data. Specifically, we recorded visual scanpaths when participants were reading expository science text, and used these to construct scanpath networks that reflect readers' processing of the text. Results showed that low ability and high ability readers' scanpath networks exhibited distinctive properties, which are reflected in different network metrics including density, centrality, small-worldness, transitivity, and global efficiency. Such patterns provide a new way to show how skilled readers, as compared with less skilled readers, process information more efficiently. Implications of our analyses are discussed in light of current theories of reading comprehension. |
Ye Ma; Brian Buccola; Zinan Wang; Shannon Cousins; Aline Godfroid; Alan Beretta Expressions with aspectual verbs elicit slower reading times than those with psychological verbs: An eye-tracking study in Mandarin Chinese Journal Article In: Journal of Psycholinguistic Research, vol. 52, no. 1, pp. 179–215, 2023. @article{Ma2023c,Research over the last 20 years has investigated the processing costs for sentences such as John began the book. Much of this work has conflated sentences with aspectual verbs, like start or finish, with psychological verbs, like enjoy or tolerate. However, recent studies have reported greater costs for aspectual verbs compared to psychological verbs (e.g., Katsika et al. in Ment Lex 7:58–76, 2012; Lai et al. in Compositionality and concepts in linguistics and psychology, 2017). The present paper reports an eye-tracking study that examined the costs of processing both verb types in Mandarin Chinese. The results revealed greater costs both for aspectual verbs compared to controls (John read the book) and for aspectual verbs compared to psychological verbs, reinforcing the claims of the Structured Individual Hypothesis (Piñango and Deo in J Semant 33:359–408, 2016). Strikingly, there was an early effect at the verb for aspectual verbs but not for psychological verbs. We argue that this result, together with previous findings and other conceptual issues, necessitates a conservative modification of the SIH: aspectual verbs are semantically more complex than psychological verbs. This modification retains the core analysis underlying the SIH, but reconciles the SIH with experimental findings by bringing it in line with the view that lexical semantic complexity has immediate consequences in processing (e.g., Brennan and Pylkkänen in Lang Cogn Process 25:777–807, 2010). |
Marloes Mak; Myrthe Faber; Roel M. Willems Different kinds of simulation during literary reading: Insights from a combined fMRI and eye-tracking study Journal Article In: Cortex, vol. 162, pp. 115–135, 2023. @article{Mak2023,Mental simulation is an important aspect of narrative reading. In a previous study, we found that gaze durations are differentially impacted by different kinds of mental simulation. Motor simulation, perceptual simulation, and mentalizing as elicited by literary short stories influenced eye movements in distinguishable ways (Mak & Willems, 2019). In the current study, we investigated the existence of a common neural locus for these different kinds of simulation. We additionally investigated whether individual differences during reading, as indexed by the eye movements, are reflected in domain-specific activations in the brain. We found a variety of brain areas activated by simulation-eliciting content, both modality-specific brain areas and a general simulation area. Individual variation in percent signal change in activated areas was related to measures of story appreciation as well as personal characteristics (i.e., transportability, perspective taking). Taken together, these findings suggest that mental simulation is supported by both domain-specific processes grounded in previous experiences, and by the neural mechanisms that underlie higher-order language processing (e.g., situation model building, event indexing, integration). |
Marcello Maniglia; Kristina M. Visscher; Aaron R. Seitz Consistency of preferred retinal locus across tasks and participants trained with a simulated scotoma Journal Article In: Vision Research, vol. 203, pp. 1–9, 2023. @article{Maniglia2023,After loss of central vision following retinal pathologies such as macular degeneration (MD), patients often adopt compensatory strategies including developing a “preferred retinal locus” (PRL) to replace the fovea in tasks involving fixation. A key question is whether patients develop multi-purpose PRLs or whether their oculomotor strategies adapt to the demands of the task. While most MD patients develop a PRL, clinical evidence suggests that patients may develop multiple PRLs and switch between them according to the task at hand. To understand this, we examined a model of central vision loss in normally seeing individuals and tested whether they used the same or different PRLs across tasks after training. Nineteen participants trained for 10 sessions on contrast detection while in conditions of gaze-contingent, simulated central vision loss. Before and after training, peripheral looking strategies were evaluated during tasks measuring visual acuity, reading abilities and visual search. To quantify strategies in these disparate, naturalistic tasks, we measured and compared the amount of task-relevant information at each of 8 equally spaced, peripheral locations, while participants performed the tasks. Results showed that some participants used consistent viewing strategies across tasks whereas other participants' strategies differed depending on task. This novel method allows quantification of peripheral vision use even in relatively ecological tasks. These results represent one of the first examinations of peripheral viewing strategies across tasks in simulated vision loss. Results suggest that individual differences in peripheral looking strategies following simulated central vision loss may model those developed in pathological vision loss. |
Marju Kaps Information structural effects in processing contrastive ellipsis: Eye-tracking evidence from a flexible word order language Journal Article In: Journal of Linguistics, vol. 59, no. 2, pp. 427–457, 2023. @article{Kaps2023,Previous experimental work on the processing of clausal ellipsis with contrastive remnants shows a Locality preference - DP remnants are preferentially paired with the most recently encountered DP correlate in the antecedent clause, even in the presence of contrastive prosody or semantic bias favouring a non-local correlate. The Locality effect has been argued to arise from the language processor consulting (default) information-structural representations when pairing remnants and correlates, yet direct evidence for the information structure hypothesis for Locality has been difficult to obtain. Estonian is a flexible word order language that optionally marks Contrastive Topics (CTs) syntactically, while allowing for the linear distance between a CT subject correlate and remnant to be held constant, in order to rule out a Recency explanation for the Locality effect. In an eye-tracking during reading experiment with case-disambiguated subject and object remnants in Estonian, we see asymmetries in the Locality preference (i.e. object advantage) following canonical Verb-second antecedent clauses and subject CT-marking Verb-third clauses. This provides novel evidence for fine-grained information-structural representations guiding the processing of contrastive ellipsis. |
Natalia Kartushina; Julien Mayor Coping with dialects from birth: Role of variability on infants' early language development. Insights from Norwegian dialects Journal Article In: Developmental Science, vol. 26, no. 1, pp. 1–19, 2023. @article{Kartushina2023,Previous research suggests that exposure to accent variability can affect toddlers' familiar word recognition and word comprehension. The current preregistered study addressed the gap in knowledge on early language development in infants exposed to two dialects from birth and assessed the role of dialect similarity in infants' word recognition and comprehension. A 12-month-old Norwegian-learning infants, exposed to native Norwegian parents speaking the same or two Norwegian dialects, took part in two eye-tracking tasks, assessing familiar word form recognition and word comprehension. Their parents' speech was assessed for similarity by native Norwegian speakers. First, in contrast to previous research, our results revealed no listening preference for words over nonwords in both monodialectal and bidialectal infants, suggesting potential language-specific differences in the onset of word recognition. Second, the results showed evidence for word comprehension in monodialectal infants, but not in bidialectal infants, suggesting that exposure to dialectal variability impacts early word acquisition. Third, perceptual similarity between parental dialects tendentially facilitated bidialectal infants' word recognition and comprehension. Forth, the results revealed a strong correlation between the raters and parents' assessment of similarity between dialects, indicating that parental estimations can be reliably used to assess infants' speech variability at home. Finally, our results revealed a strong relationship between word recognition and comprehension in monodialectal infants and the absence of such a relationship in bidialectal infants, suggesting that either these two skills do not necessarily align in infants exposed to more variable input, or that the alignment might occur at a later stage. |
I. M. Dushyanthi Karunathilake; Jason L. Dunlap; Janani Perera; Alessandro Presacco; Lien Decruy; Samira Anderson; Stefanie E. Kuchinsky; Jonathan Z. Simon Effects of aging on cortical representations of continuous speech Journal Article In: Journal of Neurophysiology, vol. 129, no. 6, pp. 1359–1377, 2023. @article{Karunathilake2023,Understanding speech in a noisy environment is crucial in day-to-day interactions and yet becomes more challenging with age, even for healthy aging. Age-related changes in the neural mechanisms that enable speech-in-noise listening have been investigated previously; however, the extent to which age affects the timing and fidelity of encoding of target and interfering speech streams is not well understood. Using magnetoencephalography (MEG), we investigated how continuous speech is represented in auditory cortex in the presence of interfering speech in younger and older adults. Cortical representations were obtained from neural responses that time-locked to the speech envelopes with speech envelope reconstruction and temporal response functions (TRFs). TRFs showed three prominent peaks corresponding to auditory cortical processing stages: early (∼50 ms), middle (∼100 ms), and late (∼200 ms). Older adults showed exaggerated speech envelope representations compared with younger adults. Temporal analysis revealed both that the age-related exaggeration starts as early as ∼50 ms and that older adults needed a substantially longer integration time window to achieve their better reconstruction of the speech envelope. As expected, with increased speech masking envelope reconstruction for the attended talker decreased and all three TRF peaks were delayed, with aging contributing additionally to the reduction. Interestingly, for older adults the late peak was delayed, suggesting that this late peak may receive contributions from multiple sources. Together these results suggest that there are several mechanisms at play compensating for age-related temporal processing deficits at several stages but which are not able to fully reestablish unimpaired speech perception. |
Laura Keller; Malte C. Viebahn; Alexis Hervais-Adelman; Kilian G. Seeber Unpacking the multilingualism continuum: An investigation of language variety co-activation in simultaneous interpreters Journal Article In: PLoS ONE, vol. 18, pp. 1–27, 2023. @article{Keller2023,This study examines the phonological co-activation of a task-irrelevant language variety in mono- and bivarietal speakers of German with and without simultaneous interpreting (SI) experience during German comprehension and production. Assuming that language varieties in bivarietal speakers are co-activated analogously to the co-activation observed in bilinguals, the hypothesis was tested in the Visual World paradigm. Bivarietalism and SI experience were expected to affect co-activation, as bivarietalism requires communication-context based language-variety selection, while SI hinges on concurrent comprehension and production in two languages; task type was not expected to affect co-activation as previous evidence suggests the phenomenon occurs during comprehension and production. Sixty-four native speakers of German participated in an eye-tracking study and completed a comprehension and a production task. Half of the participants were trained interpreters and half of each sub-group were also speakers of Swiss German (i.e., bivarietal speakers). For comprehension, a growth-curve analysis of fixation proportions on phonological competitors revealed cross-variety co-activation, corroborating the hypothesis that co-activation in bivar-ietals' minds bears similar traits to language co-activation in multilingual minds. Conversely, co-activation differences were not attributable to SI experience, but rather to differences in language-variety use. Contrary to expectations, no evidence for phonological competition was found for either same- nor cross-variety competitors in either production task (interpreting- and word-naming variety). While phonological co-activation during production cannot be excluded based on our data, exploring the effects of additional demands involved in a production task hinging on a language-transfer component (oral translation from English to Standard German) merit further exploration in the light of a more nuanced understanding of the complexity of the SI task. |
Clare Kirtley; Christopher Murray; Phillip B. Vaughan; Benjamin W. Tatler Navigating the narrative: An eye-tracking study of readers' strategies when reading comic page layouts Journal Article In: Applied Cognitive Psychology, vol. 37, no. 1, pp. 52–70, 2023. @article{Kirtley2023,In multimedia stimuli (e.g., comics), the reader must follow a narrative in which text and image both contribute information, and artists may use more irregular layouts which must still be followed correctly. While previous work has found that the external structure (outlines) of panels is a major contributor to navigation decisions in comics, other studies have shown that panel content can affect reading order. The present studies use eye-tracking to investigate these contributions further. In Experiment 1, the reading behaviors on six layout variations were compared. The influence of the external structure was replicated, but an effect of text location was also found for one layout type. Experiment 2 focused on variations of this particular layout, manipulating the location of text within critical panels. Panel content was a consistent effect for all variations. While most navigation decisions are made using the external structure, content becomes key when resolving ambiguous layouts. |
Kelsey E. Klein; Elizabeth A. Walker; Bob McMurray In: Ear & Hearing, vol. 44, no. 2, pp. 338–357, 2023. @article{Klein2023a,Objective: The objective of this study was to characterize the dynamics of real-time lexical access, including lexical competition among phonologically similar words, and spreading semantic activation in school-age children with hearing aids (HAs) and children with cochlear implants (CIs). We hypothesized that developing spoken language via degraded auditory input would lead children with HAs or CIs to adapt their approach to spoken word recognition, especially by slowing down lexical access. Design: Participants were children ages 9- to 12-years old with normal hearing (NH), HAs, or CIs. Participants completed a Visual World Paradigm task in which they heard a spoken word and selected the matching picture from four options. Competitor items were either phonologically similar, semantically similar, or unrelated to the target word. As the target word unfolded, children's fixations to the target word, cohort competitor, rhyme competitor, semantically related item, and unrelated item were recorded as indices of ongoing lexical access and spreading semantic activation. Results: Children with HAs and children with CIs showed slower fixations to the target, reduced fixations to the cohort competitor, and increased fixations to the rhyme competitor, relative to children with NH. This wait-and-see profile was more pronounced in the children with CIs than the children with HAs. Children with HAs and children with CIs also showed delayed fixations to the semantically related item, although this delay was attributable to their delay in activating words in general, not to a distinct semantic source. Conclusions: Children with HAs and children with CIs showed qualitatively similar patterns of real-time spoken word recognition. Findings suggest that developing spoken language via degraded auditory input causes long-term cognitive adaptations to how listeners recognize spoken words, regardless of the type of hearing device used. Delayed lexical access directly led to delays in spreading semantic activation in children with HAs and CIs. This delay in semantic processing may impact these children's ability to understand connected speech in everyday life. |
Marina Klimovich; Simon P. Tiffin-Richards; Tobias Richter In: Journal of Research in Reading, vol. 46, no. 2, pp. 123–142, 2023. @article{Klimovich2023,Background: Commercial speed-reading training programs are typically marketed with the promise to dramatically increase reading speed without impairing comprehension. From the perspective of reading psychology, it seems quite unlikely that speed-reading training can indeed have such effects. However, research on the effectiveness of modern speed-reading training programs on reading performance in typical readers is sparse. The present study had two goals. First, we sought to extend prior research on speed-reading by assessing the effects of a speed-reading application on reading performance in a pre-training and post-training design with a control group. Second, we aimed to identify the mechanism underlying speed-reading training programs. Methods: We assessed reading speed, comprehension and eye movements of 30 German-speaking undergraduates (Mage = 22.77 years |
Eva Marie Koch; Bram Bulté; Alex Housen; Aline Godfroid The predictive processing of number information in subregular verb morphology in a first and second language Journal Article In: Applied Psycholinguistics, vol. 44, no. 5, pp. 750–783, 2023. @article{Koch2023,We investigated the predictive processing of grammatical number information through stem-vowel alternations in German strong verbs by adult first language (L1) speakers and Dutch-speaking advanced second language (L2) learners of German, and the influence of working memory and awareness (i.e., whether participants consciously registered the predictive cue) thereon. While changed stem vowels indicate a singular referent (e.g., /ϵ/ in fällt3SG, falls), unchanged vowels indicate plural (e.g., /a/ in fallt2PL, fall). This target structure presents a challenge for L2 learners of German due to its subregularity and low salience. With their eye movements being tracked, participants matched German auditory sentences (VSO order) with one of two pictures, displaying identical action scenes but varying in agent number. The number cue provided by the strong verbs allowed participants to predict whether the upcoming subject would be singular or plural. The analyses revealed significant prediction, measured as predictive eye movements toward the target picture and faster button-press responses. Prediction in the L2 group was weaker than in the L1 group and present in the eye movement data only. Higher working memory scores were linked to faster predictive presses. Approximately half of the participants had become aware of the predictive cue, and being aware facilitated prediction to a limited extent. |
Deran Kong; Yu-Yin Hsu Processing covert dependency: An eye-tracking study of scope interpretations of embedded Wh-questions in Mandarin Journal Article In: PLoS ONE, vol. 18, pp. 1–15, 2023. @article{Kong2023,Non-local dependency in Mandarin wh-questions has been extensively researched in theoretical linguistics, but it remains an under-studied topic in the field of language processing. Unlike languages that require wh-movement to form wh-questions, Mandarin is a wh-in-situ language, and hence is generally assumed to require a covert dependency between a whphrase and its scope-bearing position. Mandarin therefore provides an ideal linguistic environment in which to study not only cognitive-processing mechanisms, but also how different types of non-local dependency, especially covert dependency, can be handled by readers. This paper investigates the processing of such covert non-local dependency in multiple embedded clauses, that is, multiple complementizer phrases (CPs). In wh-in-situ sentences with multiple CPs, the wh-phrases' scope varies according to the types of verbs and their embedded clauses. Based on the subcategorization of clausal verbs, we designed four experimental conditions: double-embedded low scope, double-embedded high scope, double-embedded ambiguous scope, and long distance in pivotal construction. According to memory-based and distance-based language processing theories, the low-scope condition should be easier to process than the high-scope one, because the former has a shorter linear distance than the latter when forming dependencies; and pivotal construction should be easier to process than high-scope embedded clauses, because the former has a shorter structural distance. In cases where both low- and high-scope interpretations are possible, we aim to determine whether readers exhaust every potential interpretation during comprehension, or adopt a ‘good-enough' approach to obtaining an interpretation via an easier and less costly process. To this end, we will adopt the eye-tracking technique that allows us to obtain fine-grained reading-time data, which can be used to compare processing across conditions. The results will contribute to understanding human readers' mechanisms for processing covert dependency and resolving scope ambiguity in wh-in-situ languages. |
Anastasiia Konovalova Pun processing in advertising posters: Evidence from eye tracking Journal Article In: Journal of Eye Movement Research, pp. 1–17, 2023. @article{Konovalova2023,This study examines the process of reading polycode advertising posters, focusing in particular on the effect of a pun in the headline. The pun, or a sequence of lexical items that can be perceived as ambiguous, is contained in the headline and different meanings of this sequence are supported by the picture and text. The results of the preliminary experiment showed that advertisements with puns are rated as more attractive, original, effective and positive compared to advertisements without puns. We hypothesized that puns in the headlines increase cognitive effort in processing posters, leading to higher evaluations. The main experiment tested this and examined differences in eye movement when reading posters with and without puns. Fifty-five Russian participants viewed advertisements while their eye movements were recorded. Our results showed no fundamental differences in the general pattern of viewing advertisement posters with and without puns. We found that readers start to perceive polycode advertisements from the text and spend more time reading the text than looking at an image. These findings shed light on how attention is distributed between verbal and non-verbal components of polycode texts, and which type of poster is more effective for information retrieval at different processing levels. |
Arnout Koornneef On the readability of texts presented in sentence-by-sentence segments to beginner readers: Evidence from self-paced reading and eye tracking Journal Article In: Reading and Writing, vol. 37, no. 1, pp. 69–87, 2023. @article{Koornneef2023,Many digital reading applications have built-in features to control the presentation flow of texts by segmenting those texts into smaller linguistic units. Whether and how these segmentation techniques affect the readability of texts is largely unknown. With this background, the current study examined a recent proposal that a sentence-by-sentence presentation mode of texts improves reading comprehension of beginning readers because this presentation mode encourages them to engage in more effortful sentence wrap-up processing. In a series of self-paced reading and eye-tracking experiments with primary school pupils as participants (6–9 years old; n = 134), reading speed and text comprehension were assessed in a full-page control condition—i.e., texts were presented in their entirety—and in an experimental condition in which texts were presented in sentence-by-sentence segments. The results showed that text comprehension scores were higher for segmented texts than for full-page texts. Furthermore, in the final word-regions of the sentences in the texts, the segmented layout induced longer reading times than the full-page layout did. However, mediation analyses revealed that these inflated reading times had no, or even a disruptive influence on text comprehension. This indicates that the observed comprehension advantage for segmented texts cannot be attributed to more effortful sentence wrap-up. A more general implication of these findings is that the segmentation features of reading applications should be used with caution (e.g., in educational or professional settings) because it is unclear how they affect the perceptual and cognitive mechanisms that underlie reading. |
Svetlana Kovalenko; Anton Mamonov; Vladislav Kuznetsov; Alexandr Bulygin; Irina Shoshina; Ivan Brak; Alexey Kashevnik OperatorEYEVP: Operator dataset for fatigue detection based on eye movements, heart rate data, and video information Journal Article In: Sensors, vol. 23, no. 13, pp. 1–35, 2023. @article{Kovalenko2023,Detection of fatigue is extremely important in the development of different kinds of preventive systems (such as driver monitoring or operator monitoring for accident prevention). The presence of fatigue for this task should be determined with physiological and objective behavioral indicators. To develop an effective model of fatigue detection, it is important to record a dataset with people in a state of fatigue as well as in a normal state. We carried out data collection using an eye tracker, a video camera, a stage camera, and a heart rate monitor to record a different kind of signal to analyze them. In our proposed dataset, 10 participants took part in the experiment and recorded data 3 times a day for 8 days. They performed different types of activity (choice reaction time, reading, correction test Landolt rings, playing Tetris), imitating everyday tasks. Our dataset is useful for studying fatigue and finding indicators of its manifestation. We have analyzed datasets that have public access to find the best for this task. Each of them contains data of eye movements and other types of data. We evaluated each of them to determine their suitability for fatigue studies, but none of them fully fit the fatigue detection task. We evaluated the recorded dataset by calculating the correspondences between eye-tracking data and CRT (choice reaction time) that show the presence of fatigue. |
Emmanouil Ktistakis; Panagiotis Simos; Miltiadis K. Tsilimbaris; Sotiris Plainis Efficacy οf wet age-related macular degeneration treatment οn reading: A pilot study using eye-movement analysis Journal Article In: Optometry and Vision Science, vol. 100, no. 10, pp. 670–678, 2023. @article{Ktistakis2023,SIGNIFICANCE Functional vision, as evaluated with silent passage reading speed, improves after anti-vascular endothelial growth factor (anti-VEGF) treatment in patients with wet age-related macular antidegeneration (wAMD), reflecting primarily a concomitant reduction in the number of fixations. Implementing eye movement analysis when reading may better characterize the effectiveness of therapeutic approaches in wAMD. PURPOSE This study aimed to evaluate silent reading performance by means of eye fixation analysis before and after anti-VEGF treatment in wAMD patients. METHODS Sixteen wAMD patients who underwent anti-VEGF treatment in one eye and visual acuity (VA) better than 0.5 logMAR served as the AMD group. Twenty adults without ocular pathology served as the control group. Central retinal thickness and near VA were assessed at baseline and 3 to 4 months after their first visit. Reading performance was evaluated using short passages of 0.4-logMAR print size. Eye movements were recorded using EyeLink II video eye tracker. Data analysis included computation of reading speed, fixation duration, number of fixations, and percentage of regressions. Frequency distributions of fixation durations were analyzed with ex-Gaussian fittings. RESULTS In the AMD group, silent reading speed in the treated eye correlated well with central retinal thickness reduction and improved significantly by an average of 15.9 ± 28.5 words per minute (P =.04). This improvement was accompanied by an average reduction of 0.24 ± 0.38 in fixations per word (P =.03). The corresponding improvement in monocular VA was not statistically significant. Other eye fixation parameters did not change significantly after treatment. No statistically significant differences were found in the control group. CONCLUSIONS Visual acuity tests may underestimate the potential therapeutic effects after anti-VEGF treatment in patients with relatively good acuity who are being treated for wAMD. Evaluating silent reading performance and eye fixation parameters may better characterize the effectiveness of therapeutic approaches in wAMD patients. |
Justin B. Kueser; Ryan Peters; Arielle Borovsky The role of semantic similarity in verb learning events: Vocabulary-related changes across early development Journal Article In: Journal of Experimental Child Psychology, vol. 226, pp. 1–19, 2023. @article{Kueser2023,Verb meaning is challenging for children to learn across varied events. This study examined how the taxonomic semantic similarity of the nouns in novel verb learning events in a progressive alignment learning condition differed from the taxonomic dissimilarity of nouns in a dissimilar learning condition in supporting near (similar) and far (dissimilar) verb generalization to novel objects in an eye-tracking task. A total of 48 children in two age groups (23 girls; younger: 21–24 months |
Victor Kuperman; Noam Siegelman; Sascha Schroeder; Cengiz Acartürk; Svetlana Alexeeva; Simona Amenta; Raymond Bertram; Rolando Bonandrini; Marc Brysbaert; Daria Chernova; Sara Maria Da Fonseca; Nicolas Dirix; Wouter Duyck; Argyro Fella; Ram Frost; Carolina A. Gattei; Areti Kalaitzi; Kaidi Lõo; Marco Marelli; Kelly Nisbet; Timothy C. Papadopoulos; Athanassios Protopapas; Satu Savo; Diego E. Shalom; Natalia Slioussar; Roni Stein; Longjiao Sui; Analí Taboh; Veronica Tønnesen; Kerem Alp Usal; Veronica Tonnesen; Kerem Alp Usal Text reading in English as a second language: Evidence from the Multilingual Eye-Movements Corpus Journal Article In: Studies in Second Language Acquisition, vol. 45, no. 1, pp. 3–37, 2023. @article{Kuperman2023,Research into second language (L2) reading is an exponentially growing field. Yet, it still has a relatively short supply of comparable, ecologically valid data from readers representing a variety of first languages (L1). This article addresses this need by presenting a new data resource called MECO L2 (Multilingual Eye Movements Corpus), a rich behavioral eye-tracking record of text reading in English as an L2 among 543 university student speakers of 12 different L1s. MECO L2 includes a test battery of component skills of reading and allows for a comparison of the participants' reading performance in their L1 and L2. This data resource enables innovative large-scale cross-sample analyses of predictors of L2 reading fluency and comprehension. We first introduce the design and structure of the MECO L2 resource, along with reliability estimates and basic descriptive analyses. Then, we illustrate the utility of MECO L2 by quantifying contributions of four sources to variability in L2 reading proficiency proposed in prior literature: reading fluency and comprehension in L1, proficiency in L2 component skills of reading, extralinguistic factors, and the L1 of the readers. Major findings included (a) a fundamental contrast between the determinants of L2 reading fluency versus comprehension accuracy, and (b) high within-participant consistency in the real-time strategy of reading in L1 and L2. We conclude by reviewing the implications of these findings to theories of L2 acquisition and outline further directions in which the new data resource may support L2 reading research. |
Didem Kurt; Nazik Dinçtopal Deniz Processing focus in Turkish Journal Article In: Languages, vol. 8, no. 1, pp. 1–22, 2023. @article{Kurt2023,The immediately preverbal position has been argued to be the default focus position in Turkish. In absence of any overt focus markers, the constituent in this position is considered to carry sentential stress and neutral information for canonical word-order sentences and focus is projected to the whole sentence in the form of broad focus. In non-canonical word-order sentences, the immediately preverbal constituent is presumed to carry focal stress and the focused constituent would receive narrow focus. This paper tested this claim experimentally. The paper also investigated if there were any differences in the cognitive operations associated with processing and revising focus in canonical and non-canonical sentences. There were a sentence completion task and an eye-tracking experiment. The sentence completion data and the eye-tracking data supported the theoretical predictions: the immediately preverbal position was associated with default focus in Turkish when no pitch accentuation or other focus markers were available. The eye-tracking data further showed that changes to word-order were perceived as cues for broad versus narrow focus marking. The participants' processing of and revision from narrow focus were costlier than processing broad focus and assigning narrow focus for the first time. We argue, in line with previous research, that this may be due to deeper encoding of focused information in memory or heavier memory load resulting from keeping a set of alternatives of the focused constituent when it has contrastive meaning. |
Marianna Kyriacou; Kathy Conklin; Dominic Thompson Ambiguity resolution in passivized idioms: Is there a shift in the most likely interpretation? Journal Article In: Canadian Journal of Experimental Psychology, vol. 77, no. 3, pp. 212–226, 2023. @article{Kyriacou2023,Ambiguous but canonical idioms (kick the bucket) are processed fast in both their figurative (“die”) and literal (“boot the pail”) senses, although processing costs associated with meaning integration may emerge in postidiom regions. Modified versions (the bucket was kicked) are processed more slowly than canonical configurations when intended figuratively. We hypothesized that modifications delay idiom recognition and prioritize the literal meaning, yielding processing costs when the context warrants a figurative interpretation. To test this, we designed an eye-tracking study, where passivized idioms were followed by “wibble99” relating to their literal (bucket—water) or figurative (dead—body) meaning, or were incongruent (time). The remaining context was identical. The findings showed a facilitation for the literal meaning: wibble99 and passivized idioms in the literal condition were read significantly faster in go-past and total reading time, respectively, compared to both the figurative and control conditions. However, both literal and figurative wibble99 were processed equally fast (and significantly faster than controls) in total reading time. In support of our hypothesis, the literal meaning of passivized idioms appears to be more highly activated and easier to integrate, although the figurative meaning receives some activation that facilitates its (full) retrieval if necessary. |
Sol Lago; Kate Stone; Elise Oltrogge; João Veríssimo Possessive processing in bilingual comprehension Journal Article In: Language Learning, vol. 73, no. 3, pp. 904–941, 2023. @article{Lago2023,Second language (L2) learners make gender errors with possessive pronouns. In production, these errors are modulated by the gender match between the possessor and possessee noun. We examined whether this so-called match effect extends to L2 comprehension by attempting to replicate a recent study on gender predictions in first language (L1) German speakers (Stone, Veríssimo, et al., 2021). By comparing Spanish and English learners of L2 German whose languages have different possessive constraints, we were able to examine whether the match effect was modulated by the participants' L1. A first experiment suggested that predictions and match effects were absent in setups with complex visual displays. A second experiment with simpler displays successfully elicited predictions and match effects, but their size was comparable in Spanish and English speakers, inconsistent with crosslinguistic influence. We interpret our results as evidence that processing difficulties with possessives result from memory interference that impacts both L1 and L2 comprehenders. |
Hend Lahoud; David L. Share; Adi Shechter A developmental study of eye movements in Hebrew word reading: The effects of word familiarity, word length, and reading proficiency Journal Article In: Frontiers in Psychology, vol. 14, pp. 1–11, 2023. @article{Lahoud2023,Previous studies examining the link between visual word recognition and eye movements have shown that eye movements reflect the time-course of cognitive processes involved in reading. Whereas most studies have been undertaken in Western European languages written in the Roman alphabet, the present developmental study investigates a non-European language—Hebrew, which is written in a non-alphabetic (abjadic) script. We compared the eye-movements of children in Grades 4 to 6 (N = 30) and university students (N = 30) reading familiar real words and unfamiliar (pseudo)words of 3 letters and 5 letters in length. Using linear mixed models, we focused on the effects of word familiarity, word length, and age group. Our results highlight both universal aspects of word reading (developmental and familiarity (lexicality) effects) as well as language-specific word length effect which appears to be related to the unique morphological and orthographic features of the Semitic abjad. |
Cheng-Ji Lai; Li-You Chang In: Social Sciences and Humanities Open, vol. 8, no. 1, pp. 1–8, 2023. @article{Lai2023,This study investigated how undergraduate students with different levels of translation proficiency employed translation principles and techniques in English-Chinese sight translation tasks, and how this affected their cognitive processing and performance. Participants were grouped into high-, intermediate-, and low-levels based on placement tests, and completed pre- and post-tests after a translation course. Their use of three translation principles (fidelity, fluency, and elegance) and techniques (segmentation, conversion, and addition) was measured using EyeLink eye tracking, and participants were interviewed to evaluate their metacognitive reflections on their translations. The results show that the high- and intermediate-level groups completed the sight translation post-test faster than the pre-test. The use of segmentation, restructuring, and conversion techniques was found to benefit students the most in sight translation tasks, and the intermediate-level group outperformed the other groups by making a greater cognitive effort in restructuring and refining their translations to achieve a higher level of competence in the elegance principle. The study provides pedagogical implications and scholarly significance for the application of translation principles and techniques in sight translation between Chinese and English. |
Yao-Ying Lai; David Braze; Maria Mercedes Piñango The time-course of contextual modulation for underspecified meaning Journal Article In: The Mental Lexicon, vol. 18, no. 1, pp. 41–93, 2023. @article{Lai2023a,Sentences like (1) “ The singer began the album” are ambiguous between an agentive reading (The singer began recording/playing/etc. the album) and a constitutive reading (The singer's song was the first track). The ambiguity is rooted in the meaning specification of the aspectual-verb class, which demands its complement be construed as a structured individual along a dimension (e.g., spatial, informational, eventive). In (1), the complement can be construed as a set of eventualities (eventive) or musical content (informational). Processing aspectual-verb sentences is shown to involve (a) exhaustive lexical-function retrieval and (b) construal of multiple dimension-specific structured individuals, leading to multiple compositions with agentive and constitutive readings. The ultimate interpretation depends on the biased dimensions in context. Our eye-tracking study comparing sentences in different contexts (agentive vs. constitutive-biasing) shows not only the aspectual-verb composition effect, previously reported for the agentive readings, but also a comparable processing profile for the constitutive readings, a novel finding supporting the unified linguistic analysis and processing implementation of the two readings. Regardless of reading, the composition effect is observable even after the complement has been retrieved, indicating that the fundamental lexico-semantic compositional processes must take place before context can serve as a constraining force. |
Carina Frondén; Johanna K Kaakinen Reading Easy Language texts written by public authorities: Evidence from eye tracking Journal Article In: Finnish Journal of Linguistics, vol. 36, no. 2023, pp. 7–36, 2023. @article{Fronden2023,Previous research has shown that word length, frequency and word repetition influence word reading times (Rayner 1998; 2009). Guidelines for Easy Language advise writers to use frequent and short words, and to repeat words instead of using synonyms. However, some of these guidelines are based on research that has been misinterpreted, simplified, or is outdated (Wengelin 2015), and studies focusing on effects of word length, frequency and word repetition among adult readers in the Easy Swedish target group are lacking. This eyetracking study investigated the reading of Easy Language texts written by public authorities, as well as the effects of word length, frequency, and word repetition on readers in a day centre for people with intellectual disabilities. The results showed significant effects for word length and frequency in all readers. In addition, the effects were significantly greater in the target group than in the control group. The effects for word repetition were not as clear, affecting only one of the reading measures. Furthermore, the study revealed poor comprehension rates in the target group, i. e., when asked, they were not able to reproduce the main contents of the texts. The significantly greater effects of word length and frequency suggest that the related Easy Language guidelines are valid for this group of readers. The poor comprehension rates indicate that the texts were too difficult for these readers. |
Tao Gong; Lan Shuai Segmented relations between online reading behaviors, text properties, and reader–text interactions: An eye-movement experiment Journal Article In: Frontiers in Psychology, vol. 13, pp. 1–20, 2023. @article{Gong2023,Purpose: To investigate relations between abilities of readers and properties of words during online sentence reading, we conducted a sentence reading eye-movements study on young adults of English monolinguals from the US, who exhibited a wide scope of individual differences in standard measures of language and literacy skills. Method: We adopted mixed-effects regression models of gaze measures of early and late print processing stages from sentence onset to investigate possible associations between gaze measures, text properties, and skill measures. We also applied segmented linear regressions to detect the dynamics of identified associations. Results: Our study reported significant associations between (a) gaze measures (first-pass reading time, total reading times, and first-pass regression probability) and (b) interactions of lexical properties (word length or position) and skill measures (vocabulary, oral reading fluency, decoding, and verbal working memory), and confirmed a segmented linear dynamics between gaze measures and lexical properties, which was influenced by skill measures. Conclusion: This study extends the previous work on predictive effects of individual language and literacy skills on online reading behavior, enriches the existing methodology exploring the dynamics of associations between lexical properties and eye-movement measures, and stimulates future work investigating factors that shape such dynamics. |
Alexa S. Gonzalez; Kathryn A. Tremblay; Katherine S. Binder Context facilitates the decoding of lexically ambiguous words for adult literacy learners Journal Article In: Reading and Writing, vol. 36, no. 3, pp. 699–722, 2023. @article{Gonzalez2023,An estimated one-fifth of adults in the United States possess low literacy skills, which includes minimal proficiency in reading and difficulty processing contextual information. One way to study reading behavior of adults with low literacy is through eye movement studies; however, these investigations have been generally limited. Thus, the present study collected eye movement data (e.g., gaze duration, total time, regressions) from adult literacy learners while they read sentences to investigate online reading behavior. We manipulated the lexical ambiguity of the target words, context strength, and context location in the sentences. The role of vocabulary depth, which refers to the deeper understanding of a word in one's vocabulary, was also examined. Results show that adult literacy learners spent more total time reading ambiguous words compared to control words and vocabulary depth was significantly correlated with processing of lexically ambiguous words. Participants with higher depth scores were more sensitive to the complexity of ambiguous words and more effective at utilizing context compared to those with lower depth scores, which is reflected by more total time reading ambiguous words when more informative context was available and more regressions made to the target word by participants with higher depth scores. Overall, there is evidence to demonstrate the benefits of context use in lexical processing, as well as adult learners' sensitivity to changes in lexical ambiguity. |
Julie Gregg; Albrecht W. Inhoff; Xingshan Li Lexical competition influences correct and incorrect visual word recognition Journal Article In: Quarterly Journal of Experimental Psychology, vol. 76, no. 5, pp. 1011 –1025, 2023. @article{Gregg2023,A growing body of research suggests that visual word recognition is error-prone, and that errors may contribute to inhibitory neighbour frequency effects in word identification and reading. The present study used the neighbourhood frequency effect to examine the relationship between lexical competition and error making during visual word recognition. A novel adaptation of the visual world paradigm (VWP) was used, in which participants selected a briefly presented printed target word from an array containing the target, its higher- or lower-frequency neighbour, an orthographic onset competitor, and an orthographically unrelated distractor word. Analyses of the visual inspection of the arrays suggested that lexical competition occurred when words were correctly identified, as competitors were preferentially viewed as a function of their orthographic similarity with the target, and higher-frequency neighbours were preferentially viewed over lower-frequency neighbours. Orthographic similarity and neighbour frequency also influenced error making. Targets were often mistaken for their neighbours, and these errors were more common for targets with higher-frequency neighbours. The time course of target and neighbour viewing for error trials also provided preliminary evidence for two kinds of errors: early-occurring, perceptual errors and later-occurring selection errors that resulted from unsuccessfully resolved lexical competition. Together, these findings suggest that neighbour frequency effects reflect the contribution of both general lexical competition and occasional errors. |
Junjuan Gu; Junyi Zhou; Yaqian Bao; Jiayu Liu; Manuel Perea; Xingshan Li The effect of transposed-character distance in Chinese reading Journal Article In: Journal of Experimental Psychology: Learning, Memory, and Cognition, vol. 49, no. 3, pp. 464–476, 2023. @article{Gu2023a,Previous research in alphabetic languages has shown that both position (external, internal) and distance (adjacent, nonadjacent) modulate letter position encoding during reading. To examine the generality of this pattern for a comprehensive model of word recognition and reading, we examined these effects during Chinese reading (i.e., an unspaced logographic language). Participants in two experiments read intact sentences and sentences containing transposed-character nonwords while their eye movements were monitored. Experiment 1 manipulated the distance between the transposed characters (adjacent vs. nonadjacent) within three-character words. Reading times were longer when nonadjacent characters were transposed compared with adjacent characters. Also, for adjacent character transpositions, a wordbeginning character transposition led to longer reading times than a word-ending character transposition. Experiment 2 manipulated orthogonally character transposition distance (adjacent vs. nonadjacent) and position within four-character words, including the beginning versus the last character. Reading times were longer when the transposition involves the first character than when involves the ending character. Fixation durations on the target regions in the nonadjacent character transposition condition were longer than those in the adjacent character transposition condition. Taken together, these results reveal robust effects of both the initial character position and transposed-character distance in Chinese reading. Thus, the privileged status of the initial character is intrinsically related to how we access lexical information. |
Thomas Günther; Annika Kirschenkern; Axel Mayer; Frederike Steinke; Jürgen Cholewa In: Journal of Speech, Language, and Hearing Research, vol. 66, no. 10, pp. 3907–3924, 2023. @article{Guenther2023,Purpose: Many models of language comprehension assume that listeners predict the continuation of an incoming linguistic stimulus immediately after itonset, based on only partial linguistic and contextual information. Their related developmental models try to determine which cues (e.g., semantic or morpho-syntactic) trigger such prediction, and to which extent, during different period of language acquisition. One morphosyntactic cue utilized predictively in many languages, inter alia German, is grammatical gender. However, studies of the developmental trajectories of the acquisition of predictive gender processing in German remain a few. Method: This study attempts to shed light on such processing strategies usein noun phrase decoding among children acquiring German as their first language by examining their eye movements during a language–picture matching task (N = 78, 5–10 years old). Its aim was to confirm whether the eye moments indicated the presence of age-specific differences in the processing of gender cue, provided either in isolation or in combination with a semantic cue. Results: The results revealed that German children made use of predictive gender processing strategies from the age of 5 years onward; however, the pace online gender processing, as well as confidence in the predicted continuation increased up to the age of 10 years. Conclusion: Predictive processing of gender cues plays a role in German language comprehension even in children younger than 8 years. |
Michael Hahn; Frank Keller Modeling task effects in human reading with neural network-based attention Journal Article In: Cognition, vol. 230, pp. 1–25, 2023. @article{Hahn2023,Research on human reading has long documented that reading behavior shows task-specific effects, but it has been challenging to build general models predicting what reading behavior humans will show in a given task. We introduce NEAT, a computational model of the allocation of attention in human reading, based on the hypothesis that human reading optimizes a tradeoff between economy of attention and success at a task. Our model is implemented using contemporary neural network modeling techniques, and makes explicit and testable predictions about how the allocation of attention varies across different tasks. We test this in an eyetracking study comparing two versions of a reading comprehension task, finding that our model successfully accounts for reading behavior across the tasks. Our work thus provides evidence that task effects can be modeled as optimal adaptation to task demands. |
Tami Harel-Arbeli; Yuval Palgi; Boaz M. Ben-David Sow in tears and reap in joy: Eye tracking reveals age-related differences in the cognitive cost of spoken context processing Journal Article In: Psychology and Aging, vol. 38, no. 6, pp. 534–547, 2023. @article{HarelArbeli2023,Older adults have been found to use context to facilitate word recognition at least as efficiently as young adults. This may pose a conundrum, as context use is based on cognitive resources that are considered to decrease with aging. The goal of this study was to shed light on this question by testing age-related differences in context use and the cognitive demands associated with it. The eye movements of 30 young (21–27 years old) and 30 older adults (61–79 years old) were examined as they listened to spoken instructions to touch an image on a monitor. The predictability of the target word was manipulated between trials: nonpredictive (baseline), predictive (context), or predictive of two images (competition). In tandem, listeners were asked to retain one or four spoken digits (low or high cognitive load) for later recall. Separate analyses were conducted for the preceding sentence and the (final) target word. Sentence processing: Older adults were slower than young adults to accumulate evidence for target-word prediction (context condition), and they were more negatively affected by the increase in cognitive load (context and competition). Targetword recognition: No age-related differences were found in word recognition rate or the effect of cognitive load following predictive context (context and competition). Although older adults have greater difficulty processing context, they can use context to facilitate word recognition as efficiently as young adults. These results provide a better understanding of how cognitive processing changes with aging. They may help develop interventions aimed at improving communication in older adults. |
Juan Haro; Natalia López-Cortés; Pilar Ferré Pupillometric and behavioural evidence shows no differences between polyseme and homonym processing Journal Article In: Acta Psychologica, vol. 238, pp. 1–13, 2023. @article{Haro2023,Ambiguous words can have related meanings (polysemes, e.g., newspaper) or unrelated meanings (homonyms, e.g., bat). Here we examined the processing of both types of ambiguous words (as well as unambiguous words) in tasks of increasing level of semantic engagement. Four experiments were conducted in which the degree of semantic engagement of the task was manipulated: lexical decision task (Experiments 1 and 2), semantic categorization task (Experiment 3) and number-of-meanings task (Experiment 4). RTs and pupillary response were recorded. To our knowledge, pupillary response had never been used before to study ambiguous words processing in isolation. Results showed faster RTs for ambiguous words with respect to unambiguous words in LDT, and larger pupil dilation was observed for ambiguous words in comparison to unambiguous ones in number-of-meanings task. However, differences between polysemes and homonyms were not observed in any task. These results provide no evidence that polysemes and homonyms are processed differently. |
Kara Hawthorne; Susan J. Loveall In: Journal of Speech, Language, and Hearing Research, vol. 66, no. 9, pp. 3606–3621, 2023. @article{Hawthorne2023,Purpose: Pronouns are referentially ambiguous: For example, “she” could refer to any female. Nonetheless, errors in pronoun interpretation rarely occur for adults with typical development (TD) due to several strategies implicitly shared between the talker and listener. The purpose of this study was to test the impacts of syntactic, semantic, and prosodic prominence on pronoun interpre-tation for adults with intellectual and developmental disabilities (IDD) and TD. Method: Adults with IDD (n =28) andTD (n = 27) listened to ministories involving a pronoun with two potential antecedents that varied in syntactic, semantic, and prag-matic prominence. Subject/first-mentioned antecedents are more syntactically prominent than object antecedents. Semantic prominence was manipulated via verb transitivity: Subjects are more semantically prominent when the verb is highly transitive (e.g., “hit” vs. “see,” a low-transitivity verb for which the subject is merely experiencing the action). Pragmatic prominence was manipulated by placing pro-sodic focus on one of the two potential antecedents. Eye gaze to images represent-ing the potential antecedents was tracked as a measure of online processing. Responses to a follow-up pronoun interpretation question were also recorded. Results: Adults with TD used syntactic, semantic, and—in early processing— pragmatic prominence when interpreting ambiguous pronouns. Adults with IDD were sensitive to syntactic prominence but to a significantly lesser extent than their peers with TD. Conclusions: Pronouns are an integral part of everyday conversation, and when the conversational partners do not share common strategies to link ambiguous pronouns with their antecedents, misunderstandings will occur. Results show that adults with IDD only weakly share pronoun interpretation strategies with adults with TD, suggesting that pronouns may be an important focus for inter-vention for this population. |
Lena Henke; Ashley G. Lewis; Lars Meyer Fast and slow rhythms of naturalistic reading revealed by combined eye-tracking and electroencephalography Journal Article In: Journal of Neuroscience, vol. 43, no. 24, pp. 4461–4469, 2023. @article{Henke2023,Neural oscillations are thought to support speech and language processing. They may not only inherit acoustic rhythms, but might also impose endogenous rhythms onto processing. In support of this, we here report that human (both male and female) eye movements during naturalistic reading exhibit rhythmic patterns that show frequency-selective coherence with the EEG, in the absence of any stimulation rhythm. Periodicity was observed in two distinct frequency bands: First, word-locked saccades at 4-5 Hz display coherence with whole-head theta-band activity. Second, fixation durations fluctuate rhythmically at;1 Hz, in coherence with occipital delta-band activity. This latter effect was additionally phase-locked to sentence endings, suggesting a relationship with the formation of multi-word chunks. Together, eye movements during reading contain rhythmic patterns that occur in synchrony with oscillatory brain activity. This suggests that linguistic processing imposes preferred processing time scales onto reading, largely independent of actual physical rhythms in the stimulus. |
Florian Hintz; Cesko C. Voeten; Odette Scharenborg Recognizing non-native spoken words in background noise increases interference from the native language Journal Article In: Psychonomic Bulletin & Review, vol. 30, no. 4, pp. 1549–1563, 2023. @article{Hintz2023,Listeners frequently recognize spoken words in the presence of background noise. Previous research has shown that noise reduces phoneme intelligibility and hampers spoken-word recognition – especially for non-native listeners. In the present study, we investigated how noise influences lexical competition in both the non-native and the native language, reflecting the degree to which both languages are co-activated. We recorded the eye movements of native Dutch participants as they listened to English sentences containing a target word while looking at displays containing four objects. On target-present trials, the visual referent depicting the target word was present, along with three unrelated distractors. On target-absent trials, the target object (e.g., wizard) was absent. Instead, the display contained an English competitor, overlapping with the English target in phonological onset (e.g., window), a Dutch competitor, overlapping with the English target in phonological onset (e.g., wimpel, pennant), and two unrelated distractors. Half of the sentences was masked by speech-shaped noise; the other half was presented in quiet. Compared to speech in quiet, noise delayed fixations to the target objects on target-present trials. For target-absent trials, we observed that the likelihood for fixation biases towards the English and Dutch onset competitors (over the unrelated distractors) was larger in noise than in quiet. Our data thus show that the presence of background noise increases lexical competition in the task-relevant non-native (English) and in the task-irrelevant native (Dutch) language. The latter reflects stronger interference of one's native language during non-native spoken-word recognition under adverse conditions. |
Nora Hollenstein; Marius Tröndle; Martyna Plomecka; Samuel Kiegeland; Yilmazcan Özyurt; Lena A. Jäger; Nicolas Langer The ZuCo benchmark on cross-subject reading task classification with EEG and eye-tracking data Journal Article In: Frontiers in Psychology, vol. 13, pp. 1–20, 2023. @article{Hollenstein2023,We present a new machine learning benchmark for reading task classification with the goal of advancing EEG and eye-tracking research at the intersection between computational language processing and cognitive neuroscience. The benchmark task consists of a cross-subject classification to distinguish between two reading paradigms: normal reading and task-specific reading. The data for the benchmark is based on the Zurich Cognitive Language Processing Corpus (ZuCo 2.0), which provides simultaneous eye-tracking and EEG signals from natural reading of English sentences. The training dataset is publicly available, and we present a newly recorded hidden testset. We provide multiple solid baseline methods for this task and discuss future improvements. We release our code and provide an easy-to-use interface to evaluate new approaches with an accompanying public leaderboard: www.zuco-benchmark.com. |
Jannat Hossain; Alex L. White The transposed word effect is consistent with serial word recognition and varies with reading speed Journal Article In: Cognition, vol. 238, pp. 1–11, 2023. @article{Hossain2023,The scientific study of reading has long been animated by questions of parallel vs. serial processing. Do readers recognize words serially, adding each one sequentially to a representation of the sentence structure? One fascinating phenomenon to emerge from this research is the transposed word effect: when asked to judge whether sentences are grammatical, readers often fail to notice grammatical errors caused by transposing two words. This effect could be evidence that readers recognize multiple words in parallel. Here we provide converging evidence that the transposed word effect is also consistent with serial processing because it occurs robustly when the words in each sentence are presented serially. We further investigated how the effect relates to individual differences in reading speed, to gaze fixation patterns, and to differences in difficulty across sentences. In a pretest, we first measured the natural English reading rate of 37 participants, which varied widely. In a subsequent grammatical decision task, we presented grammatical and ungrammatical sentences in two modes: one with all words presented simultaneously, and the other with single words presented sequentially at each participant's natural rate. Unlike prior studies that used a fixed sequential presentation rate, we found that the magnitude of the transposed word effect was at least as strong in the sequential presentation mode as in the simultaneous mode, for both error rates and response times. Moreover, faster readers were more likely to miss transpositions of words presented sequentially. We argue that these data favor a “noisy channel” model of comprehension in which skilled readers rely on prior knowledge to rapidly infer the meaning of sentences, allowing for apparent errors in spatial or temporal order, even when the individual words are recognized one at a time. |
Liv J. Hoversten; Clara D. Martin Parafoveal processing in bilingual readers: Semantic access within but not across languages Journal Article In: Journal of Experimental Psychology: Human Perception and Performance, vol. 49, no. 12, pp. 1564–1578, 2023. @article{Hoversten2023,Prior research has investigated the quality of information a reader can extract from upcoming parafoveal words. However, very few studies have considered parafoveal processing in bilingual readers, who may differ from monolinguals due to slower lexical access and susceptibility to cross-language activation. This eye-tracking experiment, therefore, investigated how bilingual readers process parafoveal semantic information within and across languages. We used the boundary technique to replace a preview word in a sentence with a different target word during the first rightward saccade from the pretarget region. We manipulated both preview language (nonswitch vs. code-switch) and semantic relatedness (synonym/translation vs. unrelated) between previews and targets. Upon fixation, target words always appeared in the same language as the rest of the sentence to create an essentially monolingual language context. Semantic preview benefits emerged for nonswitched synonym previews but not for code-switched translation previews. Furthermore, participants skipped code-switched previews less often than nonswitched previews and no more often than previews that were unfamiliar to them. These data suggest that bilinguals can extract within-language semantic information from the parafovea in both native and nonnative languages, but that cross-language words are not accessible while reading in a monolingual language mode, as per the partial selectivity hypothesis of bilingual language control. |
Pei Hsuan Hsieh; Po I. Hsu Displaying software installation agreements to motivate users' reading Journal Article In: International Journal of Human-Computer Interaction, vol. 39, no. 20, pp. 4006–4023, 2023. @article{Hsieh2023a,The purpose of this study is to identify an effective display mode that best motivates software users to read the software installation agreements before downloading, thereby enhancing their understanding of intellectual property rights and preventing potential legal issues. This study randomly assigned the participants to enter either an eye-tracking or a computer-based experiment in which one of three display modes was presented. A computer-based pre-test and post-test related to intellectual property rights were given to the participants. The final results showed that the “keyword mode” was the most effective in keeping their attention on the key content. The results of a survey about software installation experiences and attitudes toward reading software installation agreements and the follow-up interviews confirmed the experimental findings. The study's contribution lies in revealing to software providers the most effective reading mode that best enhances the software users' understanding of the moral and legal concepts. |
Scott S. Hsieh; David A. Cook; Akitoshi Inoue; Hao Gong; Parvathy Sudhir Pillai; Matthew P. Johnson; Shuai Leng; Lifeng Yu; Jeff L. Fidler; David R. Holmes Iii; Rickey E. Carter; Cynthia H. Mccollough; Joel G. Fletcher Understanding reader variability: A 25-radiologist study on liver metastasis detection at CT Journal Article In: Radiology, vol. 306, no. 2, pp. 1–10, 2023. @article{Hsieh2023,Background: Substantial interreader variability exists for common tasks in CT imaging, such as detection of hepatic metastases. This variability can undermine patient care by leading to misdiagnosis. Purpose: To determine the impact of interreader variability associated with (a) reader experience, (b) image navigation patterns (eg, eye movements, workstation interactions), and (c) eye gaze time at missed liver metastases on contrast-enhanced abdominal CT images. Materials and Methods: In a single-center prospective observational trial at an academic institution between December 2020 and February 2021, readers were recruited to examine 40 contrast-enhanced abdominal CT studies (eight normal, 32 containing 91 liver metastases). Readers circumscribed hepatic metastases and reported confidence. The workstation tracked image navigation and eye movements. Performance was quantified by using the area under the jackknife alternative free-response receiver operator charac- teristic (JAFROC-1) curve and per-metastasis sensitivity and was associated with reader experience and image navigation variables. Differences in area under JAFROC curve were assessed with the Kruskal-Wallis test followed by the Dunn test, and effects of image navigation were assessed by using the Wilcoxon signed-rank test. Results: Twenty-five readers (median age, 38 years; IQR, 31–45 years; 19 men) were recruited and included nine subspecialized abdominal radiologists, five nonabdominal staff radiologists, and 11 senior residents or fellows. Reader experience explained differences in area under the JAFROC curve, with abdominal radiologists demonstrating greater area under the JAFROC curve (mean, 0.77; 95% CI: 0.75, 0.79) than trainees (mean, 0.71; 95% CI: 0.69, 0.73) (P = .02) or nonabdominal subspecialists (mean, 0.69; 95% CI: 0.60, 0.78) (P = .03). Sensitivity was similar within the reader experience groups (P = .96). Image navigation variables that were associated with higher sensitivity included longer interpretation time (P = .003) and greater use of coronal images (P < .001). The eye gaze time was at least 0.5 and 2.0 seconds for 71% (266 of 377) and 40% (149 of 377) of missed metastases, respectively. Conclusion: Abdominal radiologists demonstrated better discrimination for the detection of liver metastases on abdominal contrast-enhanced CT images. Missed metastases frequently received at least a brief eye gaze. Higher sensitivity was associated with longer interpretation time and greater use of liver display windows and coronal images. |
Jinfeng Huang; Gaoyan Zhang; Jianwu Dang; Yu Chen; Shoko Miyamoto Semantic processing during continuous speech production: An analysis from eye movements and EEG Journal Article In: Frontiers in Human Neuroscience, vol. 17, pp. 1–13, 2023. @article{Huang2023c,Introduction: Speech production involves neurological planning and articulatory execution. How speakers prepare for articulation is a significant aspect of speech production research. Previous studies have focused on isolated words or short phrases to explore speech planning mechanisms linked to articulatory behaviors, including investigating the eye-voice span (EVS) during text reading. However, these experimental paradigms lack real-world speech process replication. Additionally, our understanding of the neurological dimension of speech planning remains limited. Methods: This study examines speech planning mechanisms during continuous speech production by analyzing behavioral (eye movement and speech) and neurophysiological (EEG) data within a continuous speech production task. The study specifically investigates the influence of semantic consistency on speech planning and the occurrence of “look ahead” behavior. Results: The outcomes reveal the pivotal role of semantic coherence in facilitating fluent speech production. Speakers access lexical representations and phonological information before initiating speech, emphasizing the significance of semantic processing in speech planning. Behaviorally, the EVS decreases progressively during continuous reading of regular sentences, with a slight increase for non-regular sentences. Moreover, eye movement pattern analysis identifies two distinct speech production modes, highlighting the importance of semantic comprehension and prediction in higher-level lexical processing. Neurologically, the dual pathway model of speech production is supported, indicating a dorsal information flow and frontal lobe involvement. The brain network linked to semantic understanding exhibits a negative correlation with semantic coherence, with significant activation during semantic incoherence and suppression in regular sentences. Discussion: The study's findings enhance comprehension of speech planning mechanisms and offer insights into the role of semantic coherence in continuous speech production. Furthermore, the research methodology establishes a valuable framework for future investigations in this domain. |
Falk Huettig; Cesko C. Voeten; Esther Pascual; Junying Liang; Florian Hintz Do autistic children differ in language-mediated prediction? Journal Article In: Cognition, vol. 239, pp. 1–7, 2023. @article{Huettig2023,Prediction appears to be an important characteristic of the human mind. It has also been suggested that prediction is a core difference of autistic1 children. Past research exploring language-mediated anticipatory eye movements in autistic children, however, has been somewhat contradictory, with some studies finding normal anticipatory processing in autistic children with low levels of autistic traits but others observing weaker prediction effects in autistic children with less receptive language skills. Here we investigated language-mediated anticipatory eye movements in young children who differed in the severity of their level of autistic traits and were in professional institutional care in Hangzhou, China. We chose the same spoken sentences (translated into Mandarin Chinese) and visual stimuli as a previous study which observed robust prediction effects in young children (Mani & Huettig, 2012) and included a control group of typically-developing children. Typically developing but not autistic children showed robust prediction effects. Most interestingly, autistic children with lower communication, motor, and (adaptive) behavior scores exhibited both less predictive and non-predictive visual attention behavior. Our results raise the possibility that differences in language-mediated anticipatory eye movements in autistic children with higher levels of autistic traits may be differences in visual attention in disguise, a hypothesis that needs further investigation. |
Kacie Dunham-Carr; Jacob I. Feldman; David M. Simon; Sarah R. Edmunds; Alexander Tu; Wayne Kuang; Julie G. Conrad; Pooja Santapuram; Mark T. Wallace; Tiffany G. Woynaroski The processing of audiovisual speech is linked with vocabulary in autistic and monautistic children: An ERP study Journal Article In: Brain Sciences, vol. 13, no. 7, pp. 1–15, 2023. @article{DunhamCarr2023,Explaining individual differences in vocabulary in autism is critical, as understanding and using words to communicate are key predictors of long-term outcomes for autistic individuals. Differences in audiovisual speech processing may explain variability in vocabulary in autism. The efficiency of audiovisual speech processing can be indexed via amplitude suppression, wherein the amplitude of the event-related potential (ERP) is reduced at the P2 component in response to audiovisual speech compared to auditory-only speech. This study used electroencephalography (EEG) to measure P2 amplitudes in response to auditory-only and audiovisual speech and norm-referenced, standardized assessments to measure vocabulary in 25 autistic and 25 nonautistic children to determine whether amplitude suppression (a) differs or (b) explains variability in vocabulary in autistic and nonautistic children. A series of regression analyses evaluated associations between amplitude suppression and vocabulary scores. Both groups demonstrated P2 amplitude suppression, on average, in response to audiovisual speech relative to auditory-only speech. Between-group differences in mean amplitude suppression were nonsignificant. Individual differences in amplitude suppression were positively associated with expressive vocabulary through receptive vocabulary, as evidenced by a significant indirect effect observed across groups. The results suggest that efficiency of audiovisual speech processing may explain variance in vocabulary in autism. |
Ciara Egan; Joshua S. Payne; Manon W. Jones In: Neuropsychologia, vol. 184, pp. 1–8, 2023. @article{Egan2023,Readers with developmental dyslexia are known to be impaired in representing and accessing phonology, but their ability to process meaning is generally considered to be intact. However, neurocognitive studies show evidence of a subtle semantic processing deficit in dyslexic readers, relative to their typically-developing peers. Here, we compared dyslexic and typical adult readers on their ability to judge semantic congruency (congruent vs. inconcongruent) in short, two-word phrases, which were further manipulated for phonological relatedness (alliterating vs. non-alliterating); “dazzling-diamond”; “sparkling-diamond”; “dangerous-diamond”; and “creepy-diamond”. At the level of behavioural judgement, all readers were less accurate when evaluating incongruent alliterating items compared with incongruent non-aliterating, suggesting that phonological patterning creates the illusion of semantic congruency (as per Egan et al., 2020). Dyslexic readers showed a similar propensity for this form-meaning relationship despite a phonological processing impairment as evidenced in the cognitive and literacy indicative assessments. Dyslexic readers also showed an overall reduction in the ability to accurately judge semantic congruency, suggestive of a subtle semantic impairment. Whilst no group differences emerged in the electrophysiological measures, our pupil dilation measurements revealed a global tendency for dyslexic readers to manifest a reduced attentional response to these word stimuli, compared with typical readers. Our results show a broad manifestation of neurocognitive differences in adult dyslexic and typical readers' processing of print, at the level of autonomic arousal as well as in higher level semantic judgements. |
Ciara Egan; Anna Siyanova-Chanturia; Paul Warren; Manon W. Jones As clear as glass: How figurativeness and familiarity impact simile processing in readers with and without dyslexia Journal Article In: Quarterly Journal of Experimental Psychology, vol. 76, no. 2, pp. 231–247, 2023. @article{Egan2023a,For skilled readers, idiomatic language confers faster access to overall meaning compared with non-idiomatic language, with a processing advantage for figurative over literal interpretation. However, currently very little research exists to elucidate whether atypical readers—such as those with developmental dyslexia—show such a processing advantage for figurative interpretations of idioms, or whether their reading impairment implicates subtle differences in semantic access. We wanted to know whether an initial figurative interpretation of similes, for both typical and dyslexic readers, is dependent on familiarity. Here, we tracked typical and dyslexic readers' eye movements as they read sentences containing similes (e.g., as cold as ice), orthogonally manipulated for novelty (e.g., familiar: as cold as ice, novel: as cold as snow) and figurativeness (e.g., literal: as cold as ice [low temperature], figurative: as cold as ice [emotionally distant]), with figurativeness being defined by the sentence context. Both participant groups exhibited a processing advantage for familiar and figurative similes over novel and literal similes. However, compared with typical readers, participants with dyslexia had greater difficulty processing similes both when they were unfamiliar and when the context biased the simile meaning towards a literal rather than a figurative interpretation. Our findings suggest a semantic processing anomaly in dyslexic readers, which we discuss in light of recent literature on sentence-level semantic processing. |
Dina Abdel Salam El-Dakhs; Suhad Sonbul; Jeanette Altarriba How do foreign language learners process L2 emotion words in silent reading? An eye-tracking study Journal Article In: Languages, vol. 8, no. 2, pp. 1–28, 2023. @article{ElDakhs2023,The current study aimed to examine the processing of emotion words in L2 silent reading. We conducted two experiments in which Arab learners of English as a foreign language (EFL) read short English sentences in which target words were embedded. The participants' eye movements were recorded and analyzed. The results of Experiment 1, which compared the processing of emotionally positive versus neutral words by 44 participants, did not reveal any significant effect for word type. The results only showed a few instances of significant interactions between word type and word frequency (i.e., positive words were read faster than neutral words only in the case of high-frequency words) and arousal (i.e., positive words were recognized faster than neutral words only when the target words were low in arousal). The results of Experiment 2, which compared the processing of emotionally negative versus neutral words by 43 participants, only established one effect of word type on the skipping rate which was also modulated by length (i.e., negative words were less likely to be skipped, particularly shorter ones). Moreover, arousal interacted with word type (i.e., only the negative words with low arousal were read faster than neutral words in two eye-movement measures). |
Irina Elgort; Aaron Veldre Word processing before explicit attention: Using the gaze-contingent boundary paradigm in L2 reading research Journal Article In: Research Methods in Applied Linguistics, vol. 2, no. 3, pp. 1–18, 2023. @article{Elgort2023,Eye-movement studies investigating second language (L2) word processing during reading are growing exponentially. However, what information L2 readers are able to process parafoveally is a less researched topic. The gaze-contingent boundary paradigm (Rayner, 1975) allows researchers to manipulate visual information in an upcoming word during reading, tapping into real-time word processing without awareness. This article provides an overview of experimental studies of parafoveal word processing in reading, followed by a methodological review of the use of the boundary paradigm in L2 and bilingual research. We synthesize key methodological details (including preview type, eye-movement measures) and findings of 15 experiments that met our search criteria, concluding that the parafoveal preview effect observed when reading in the first language is also present in L2 reading. We propose how the gaze-contingent boundary paradigm can be used to study L2 lexical knowledge and factors that affect its development. Finally, we provide advice and instructions for designing and conducting boundary paradigm experiments. |
Juan Escalante; Grant Eckstein; Troy L. Cox; Steven Luke Multiple-choice reading behaviors of ESL students: An eye-tracking study Journal Article In: TESOL Communications, vol. 2, no. 1, pp. 1973–1974, 2023. @article{Escalante2023,Only recently has eye-tracking been used to investigate test-taker reading behavior, and results have been primarily used to confirm a range of cognitive tasks elicited by test items. This study explores test taker reading behavior for its own sake by describing how ESL readers of different proficiency levels behaviorally view multiple-choice passages and test items at different difficulty levels. Data were gathered from 51 students at three proficiency levels attending a university-sponsored intensive English program (IEP). Participants read eight validated reading comprehension items at varying difficulty levels while their eye movements were recorded on the passage, multiple-choice stem, correct answer, and distractors. Reading behavior demonstrated that language proficiency had a limited effect while passage difficulty had a stronger effect on reading behavior: participants gave less visual attention to the reading passage and correct answers within easier items and when they had higher language proficiency. The interaction of proficiency and item difficult on reading behavior is important in understanding how learners experience tests. |
Nikki G. Fackler; Peter C. Gordon Mask-related costs in measuring preview benefit: Evidence from a distributional analysis based on target word reading times Journal Article In: Attention, Perception, & Psychophysics, vol. 85, no. 7, pp. 2475–2487, 2023. @article{Fackler2023,Skilled reading involves processing the upcoming word in parafoveal vision before it is fixated, leading to shorter fixations on that word. This phenomenon, parafoveal preview benefit, is a key component of theoretical models of reading; it is measured using the invisible boundary paradigm, in which reading times on a target word are compared for instances when preview is accurate and when the target word is masked while in the parafovea. However, parafoveal masks have been shown to induce unintentional processing costs, thereby inflating measures of preview benefit. The degraded mask has been explored as a potential solution to this problem, leading to mixed results. While previous work has analyzed the preview effect by comparing mean reading times on the target word, the present study provides a more comprehensive analysis by examining the distribution of the preview effect across target word fixation times for unrelated and degraded masks. Participants read sentences containing target words whose preview was either identical, unrelated, or degraded, and their eye movements were recorded. Analyses revealed that although there were no mean differences between reading times for the unrelated and degraded conditions, the pattern of the effects varied as a function of target word fixation times. Unrelated masks resulted in positively sloped generally linear delta plots, while degraded masks resulted in relatively flat delta plots for fixations longer than 200 ms. These differences suggest that different cognitive mechanisms are involved in the processing of the two mask types. Implications for understanding and measuring preview benefit are discussed. |
Mojgan Farahani; Vijay Parsa; Philip C. Doyle Auditory-perceptual and pupillometric evaluation of vocal roughness and listening effort in tracheoesophageal speech Journal Article In: Journal of Voice, pp. 1–16, 2023. @article{Farahani2023,Objectives: This study evaluated auditory-perceptual judgments of perceived vocal roughness (VR) and listening effort (LE) along with pupillometric responses in response to speech samples produced by tracheoesophageal (TE) talkers. Methods: Twenty normal-hearing, naive young adults (eight men and twelve women) served as listeners. Listeners were divided into two groups: (1) a with-anchor (WA) group (four men and six women) and (2) a no-anchor (NA) group (four men and six women). All were presented with speech samples produced by twenty TE talkers; listeners evaluated two auditory-perceptual dimensions—VR and LE—using visual analog scales. Anchors were provided to the WA group as an external referent for their ratings. In addition, during the auditory-perceptual task, each listener's pupil reactions also were recorded with peak pupil dilation (PPD) measures extracted as a physiologic indicator associated with the listening task. Results: High interrater reliability was obtained for both the WA and NA groups. High correlations also were observed between auditory-perceptual ratings of roughness and LE, and between PPD values and ratings of both dimensions for the WA group. The inclusion of an anchor during the auditory-perceptual task improved interrater reliability ratings, but it also imposed an increased demand on listeners. Conclusions: Data obtained offer insights into the relationship between subjective indices of voice quality (ie, auditory-perceptual evaluation) and physiologic responses (PPD) to the abnormal voice quality that characterizes TE talkers. Furthermore, these data provide information on the inclusion/exclusion of audio anchors and potential increases in listener demand in response to abnormal voice quality. |
Argyro Fella; Maria Loizou; Christoforos Christoforou; Timothy C. Papadopoulos Eye movement evidence for simultaneous cognitive processing in reading Journal Article In: Children, vol. 10, no. 12, pp. 1–17, 2023. @article{Fella2023,Measuring simultaneous processing, a reliable predictor of reading development and reading difficulties (RDs), has traditionally involved cognitive tasks that test reaction or response time, which only capture the efficiency at the output processing stage and neglect the internal stages of information processing. However, with eye-tracking methodology, we can reveal the underlying temporal and spatial processes involved in simultaneous processing and investigate whether these processes are equivalent across chronological or reading age groups. This study used eye-tracking to investigate the simultaneous processing abilities of 15 Grade 6 and 15 Grade 3 children with RDs and their chronological-age controls (15 in each Grade). The Grade 3 typical readers were used as reading-level (RL) controls for the Grade 6 RD group. Participants were required to listen to a question and then point to a picture among four competing illustrations demonstrating the spatial relationship raised in the question. Two eye movements (fixations and saccades) were recorded using the EyeLink 1000 Plus eye-tracking system. The results showed that the Grade 3 RD group produced more and longer fixations than their CA controls, indicating that the pattern of eye movements of young children with RD is typically deficient compared to that of their typically developing counterparts when processing verbal and spatial stimuli simultaneously. However, no differences were observed between the Grade 6 groups in eye movement measures. Notably, the Grade 6 RD group outperformed the RL-matched Grade 3 group, yielding significantly fewer and shorter fixations. The discussion centers on the role of the eye-tracking method as a reliable means of deciphering the simultaneous cognitive processing involved in learning. |
Leigh B. Fernandez; Ricarda Bothe; Shanley E. M. Allen The role of L1 reading direction on L2 perceptual span: An eye-tracking study investigating Hindi and Urdu speakers Journal Article In: Second Language Research, vol. 39, no. 2, pp. 1–23, 2023. @article{Fernandez2023b,In the current study we used the gaze-contingent moving window paradigm to directly compare the second language (L2) English perceptual span of two groups that speak languages with essentially the same lexicon and grammar but crucially with different writing directions (and scripts): Hindi (read left to right) and Urdu (read right to left). This is the first study to directly compare first language (L1) speakers of languages that differ primarily in reading direction in a common L2, English. While Urdu speakers had a slightly faster reading rate, we found no additional differences between Hindi and Urdu speakers when reading L2 English; both groups showed a perceptual span between 9 and 11 characters to the right of the fixation based on saccade length. This suggests little to no influence of L1 reading direction on L2 perceptual span, but rather that L2 perceptual span is influenced by allocation of attention during reading. Our data are in line with research by Leung et al. (2014) finding that L2 speakers have a smaller perceptual span than native speakers (L1 perceptual span is approximately 15 characters to the right of the fixation). This most likely stems from the increased demands associated with reading in a second language, which led to a reduction in the amount of attention that can be allocated outside of the current fixation. |
Leigh B. Fernandez; Agnesa Xheladini; Shanley E. M. Allen Proficient L2 readers do not have a risky reading strategy Journal Article In: Linguistic Approaches to Bilingualism, vol. 13, no. 6, pp. 854–872, 2023. @article{Fernandez2023,Proficient first-language (L1) readers of alphabetic languages that are read left-to-right typically have a perceptual span of 3–4 characters to the left and 14–15 characters to the right of the foveal fixation. Given that second-language (L2) processing requires more cognitive resources, we hypothesize that L2ers will have a smaller perceptual span than L1ers, and may rely on a compensatory risky reading strategy with a more symmetrical perceptual span similar to that seen in older L1 adults. Here, we test the size and symmetry of the perceptual span in German L1/English L2ers reading in English. We manipulate the amount of information available (3,6,9 characters-left/3,9,15 characters-right) during reading, and also account for the influence of English skills. Results show that L2ers benefit from an increase of window size from 3 to 6 characters to the left, and from 3 to 9 characters to the right, with higher-skilled L2ers further benefiting from an increase to 15 characters to the right. Contrary to our hypothesis, proficient L2ers exhibit an asymmetric perceptual span similar to college-aged L1ers and do not employ a compensatory risky reading strategy. This suggests that L1 and L2 language processing are not qualitatively different, but are rather modulated by individual differences. |
Laura Fernández-Arroyo; Nuria Sagarra; Kaylee Fernández Differential effects of language proficiency and use on L2 lexical prediction Journal Article In: The Mental Lexicon, pp. 1–26, 2023. @article{FernandezArroyo2023,Language experience is essential for SLA. Yet, studies comparing the role of L2 proficiency and L2 use on L2 processing are scant, and there are no studies examining how these variables modulate learners' ability to generalize grammatical associations to new instances. This study investigates whether L2 proficiency and L2 use affect L2 stress-tense suffix associations (a stressed syllable cuing a present suffix, and an unstressed syllable cuing a preterit suffix) using eye-tracking. Spanish monolinguals and English learners of Spanish varying in L2 proficiency and L2 use saw two verbs (e.g., firma-firmó ‘(s)he signs/signed'), heard a sentence containing one of the verbs, and chose the verb they had heard. Both groups looked at target verbs above chance before hearing the suffix, but the monolinguals did so more accurately and earlier than the learners. The learners recognized past verbs faster than present verbs, were faster with higher than lower L2 proficiency, and later with higher than lower L2 use. Finally, higher L2 proficiency yielded earlier morphological activation but higher L2 use produced later morphological activation, indicating that L2 proficiency and L2 use affect L2 word processing differently. We discuss the contribution of these findings to language acquisition and processing models, as well as models of general cognition. |
Francesca Foppolo; Greta Mazzaggio; Ludovico Franco; Maria Rita Manzini A group of researchers are testing pseudopartitives in Italian: Notional number is not the key to the facts Journal Article In: Glossa Psycholinguistics, vol. 2, no. 1, pp. 1–34, 2023. @article{Foppolo2023,The present paper focuses on pseudopartitive constructions headed by quantifier, collective, or container nouns (like a lot of senators, a group of students, a bottle of pills) followed by a singular or a plural verb. We compared these structures with superficially similar adnominal structures of the form NP1[−PL] prep NP2[PL] (e.g., the level of the lakes is/are) in Italian in an acceptability judgment study (Experiment 1), a forced-choice task (Experiment 2), and an eye tracking reading study (Experiment 3). Two major findings were consistent across all studies. First, verb agreement in pseudopartitives always patterned differently from controls. Second, albeit an overall preference for singular verbs was observed, a gradient difference emerged between adnominal controls and pseudopartitives, and among pseudopartitives headed by different nouns. We explain such variability in terms of the availability of a measure interpretation (e.g., pills in the measure of a bottle vs. a bottle containing pills) which is linked to the type of the pseudopartitive's head noun. While in non-pseudopartitive adnominal structures only one parse is allowed by the grammar, in pseudopartitives a given head noun may admit or block a structural configuration in which the plural feature of the embedded constituent (e.g., of students, modifying a group) can determine the plurality of the subsequent verb. We conclude that verb agreement in pseudopartitives is a grammatical phenomenon and, as such, it refers to speakers' grammatical competence and cannot be reduced to agreement attraction of the plural intervener. |
Johanna Abendroth; Tobias Richter Reading perspectives moderate text-belief consistency effects in eye movements and comprehension Journal Article In: Discourse Processes, vol. 60, no. 2, pp. 119–140, 2023. @article{Abendroth2023,Readers often prioritize processing and comprehension of information perceived as relevant to a particular intention. Using a repeated-measurement study, we investigated how readers' prior beliefs and external reading perspectives influence processing and comprehension of belief-relevant texts on two socioscientific controversies. University students read belief-relevant texts from a belief-consistent perspective in one experimental session and from a belief-inconsistent reading perspective in another. Eye tracking was used to measure immediate and delayed processing and a sentence verification task was used to measure comprehension. Results revealed longer first-pass reading times for belief-inconsistent claims compared to belief-consistent claims, especially in the belief-inconsistent reading perspective. Longer lookbacks on belief-consistent claims were found in the belief-consistent reading perspective but similar lookback times for both types of claims in the belief-inconsistent reading perspective. We further found better comprehension for belief-consistent information in the belief-consistent reading perspective but balanced comprehension levels in the belief-inconsistent reading perspective. |
Rania Al-aqarbeh Transfer of L1 strategies in L2 processing of long-distance dependencies Journal Article In: Italian Journal of Linguistics, vol. 35, no. 1, pp. 3–42, 2023. @article{Alaqarbeh2023,This study investigated the online processing of the relative clause dependency. The participants were native speakers of southern Jordanian Arabic, a grammatical resumption language, and were advanced learners of English as a second language, an intrusive resumption language. Another relevant difference between these two languages is that resumption in southern Jordanian Arabic ameliorates the relative clause island effect, while it does not in English. Two offline acceptability judgment tasks and two online eyetracking reading tasks were conducted in Jordanian Arabic (L1) and English (L2). The results revealed that the L2 learners had the pre-requisite grammatical knowledge to process the relative clause dependency in English. They seemed to posit a resumptive pronoun to resolve the dependency inside a relative clause island in their L1 and L2 alike. This result demonstrated that the L2 learners in the current study exhibited detailed syntactic processing. By doing so, they diverged from the processing behavior native speakers of English exhibited in processing similar stimuli in previous studies (Traxler & Pickering 1996; Omaki & Schulz 2011). In conclusion, the different processing behavior the L2 learners in this study manifested can be attributed to L1 transfer rather than to shallower, less detailed syntactic processing as proposed by the Shallow Structure Hypothesis. |