EyeLink 临床和动眼神经眼球追踪出版物
EyeLink临床和oculomotor研究出版物至2023年(一些早于2024年)列在以下年份。您可以使用Saccadic Adaptation、Schizophrenia、Nystagmus等关键词搜索出版物。您还可以按年份搜索个人作者姓名和有限搜索(选择年份,然后单击搜索按钮)。如果我们错过了任何EyeLink临床或oculomotor文章,请给我们发电子邮件!
2021 |
Hui Li; Kayleigh L. Warrington; Ascensión Pagán; Kevin B. Paterson; Xialou Wang Independent effects of collocation strength and contextual predictability on eye movements in reading Journal Article In: Language, Cognition and Neuroscience, vol. 36, no. 8, pp. 1001–1009, 2021. @article{Li2021d, Collocations are commonly co-occurring word pairs, such as “black coffee”. Previous research has demonstrated a processing advantage for collocations compared to novel phrases, suggesting that readers are sensitive to the frequency that words co-occur in phrases. However, a further question concerns whether this processing advantage for collocations occurs independently from effects of contextual predictability. We examined this issue in an eye movement experiment using adjective–noun pairs that are strong collocations (e.g. “black coffee”) or weak collocations (e.g. “bitter coffee”), based on co-occurrence statistics. These were presented in sentences where the shared concept they expressed (e.g. coffee) was predictable or unpredictable from the prior sentence context. We observed clear effects of collocation strength, with shorter reading times for strong compared to weak collocations. Moreover, these effects occurred independently of effects of contextual predictability. The findings therefore provide novel evidence that a processing advantage for collocations is not driven by contextual expectations. |
Xiuhong Li; Weidong Li; Buyun Liu; Jinxin Zhang; Jingwen Ma; Chuanbo Xie; Jing Wu; Jin Jing The influence of articulatory suppression on reading among chinese children with developmental dyslexia: An eye-movement study Journal Article In: Frontiers in Pediatrics, vol. 9, pp. 758615, 2021. @article{Li2021i, Objective: The study aimed to examine how the phonological loop influences reading ability and processing in Chinese children with developmental dyslexia (DD). Methods: This study included 30 children with DD and 37 children without DD. Two types of articles (i.e., scenery prose and narrative story) and two conditions (under the conditions of articulatory-suppression and silent reading) were applied. An eye-link II High-Speed Eye Tracker was used to track a series of eye-movement parameters. The data were analyzed by the linear Mixed-Effects model. Results: Compared with children without DD, Children with DD had lower reading achievement (RA), frequency of saccades (FS) and frequency of fixations (FF), longer reading time (RT) and average fixation duration (AFD), slower reading speed (RS), shorter average saccade amplitude (ASA) and fixation distance (FD), more number of fixations (NF), and number of saccades (NS). There were significant interactions between participant group and articulatory suppression on RT and FD. We also observed interaction effects between article types and articulatory suppression on RA, AFD, ASA, and FS. Conclusion: Children DD exhibit abnormal phonological loop and eye movements while reading. The role of articulatory suppression on reading varies with the presentation of DD and the article type. |
Kunyu Lian; Jie Ma; Feifei Liang; Ling Wei; Shuwei Zhang; Yingying Wu; Xuejun Bai; Rong Lian The role of character positional frequency in oral reading: A developmental study Journal Article In: Social Behavior and Personality, vol. 49, no. 1, pp. 1–13, 2021. @article{Lian2021, How frequently a character appears in a word (positional character frequency) is used as a cue in word segmentation when reading aloud in the Chinese language. In this study we created 176 sentences with a target word in the center of each. Participants were 76 college students (mature readers) and 76 third-grade students (beginner readers). Results show an interaction effect of age and positional frequency of the initial character in the word on gaze duration. Further analysis shows that the third-grade students gaze duration was significantly longer in high, relative to low, positional character frequency of the target words. This trend was consistent with refixation duration, and there was a marginally significant interaction between age and total fixation time. Overall, positional character frequency was an important cue for word segmentation in oral reading in the Chinese language, and third-grade students relied more heavily on this cue than did college students. |
Feifei Liang; Jie Ma; Xuejun Bai; Simon P. Liversedge Initial landing position effects on Chinese word learning in children and adults Journal Article In: Journal of Memory and Language, vol. 116, pp. 104183, 2021. @article{Liang2021, We adopted a word learning paradigm to examine whether children and adults differ in their saccade targeting strategies when learning novel words in Chinese reading. Adopting a developmental perspective, we extrapolated hypotheses pertaining to saccadic targeting and its development from the Chinese Reading Model (Li & Pollatsek, 2020). In our experiment, we embedded novel words into eight sentences, each of which provided a context for readers to form a new lexical representation. A group of children and a group of adults were required to read these sentences as their eye movements were recorded. At a basic level, we showed that decisions of initial saccadic targeting, and mechanisms responsible for computation of initial landing sites relative to launch sites are in place early in children, however, such targeting was less optimal in children than adults. Furthermore, for adults as lexical familiarity increased saccadic targeting behavior became more optimized, however, no such effects occurred in children. Mechanisms controlling initial saccadic targeting in relation to launch sites and in respect of lexical familiarity appear to operate with functional efficacy that is developmentally delayed. At a broad theoretical level, we consider our results in relation to issues associated with visually and linguistically, mediated saccadic control. More specifically, our novel findings fit neatly with our theoretical extrapolations from the CRM and suggest that its framework may be valuable for future investigations of the development of eye movement control in Chinese reading. |
Sixin Liao; Lili Yu; Erik D. Reichle; Jan-Louis Kruger Using eye movements to study the reading of subtitles in video Journal Article In: Scientific Studies of Reading, vol. 25, no. 5, pp. 417–435, 2021. @article{Liao2021, This article reports the first eye-movement experiment to examine how the presence versus absence of concurrent video content and presentation speed affect the reading of subtitles. Results indicated that participants adapted their visual routines to examine video content while simultaneously prioritizing the reading of subtitles, especially when the latter was displayed only briefly. Although decisions about when and where to move the eyes largely remained under local (cognitive) control, this control was also modulated by global task demands, suggesting an integration of local and global eye-movement control. The theoretical and pedagogical implications of these findings are discussed, and we also briefly describe a new theoretical framework for understanding all forms of multimodal reading, including the reading of subtitles in video. |
Michael A. Johns; Paola E. Dussias Of revistas and magacínes: Lexical competition in the online processing of established loanwords Journal Article In: Journal of Second Language Studies, vol. 4, no. 2, pp. 375–411, 2021. @article{Johns2021, The transfer of words from one language to another is ubiquitous in many of the world's languages. While loanwords have a rich literature in the fields of historical linguistics, language contact, and sociolinguistics, little work has been done examining how loanwords are processed by bilinguals with knowledge of both the source and recipient languages. The present study uses pupillometry to compare the online processing of established loanwords in Puerto Rican Spanish to native Spanish words by highly proficient Puerto Rican Spanish-English bilinguals. Established loanwords elicited a significantly larger pupillary response than native Spanish words, with the pupillary response modulated by both the frequency of the loanword itself and of the native Spanish counterpart. These findings suggest that established loanwords are processed differently than native Spanish words and compete with their native equivalents, potentially due to both intra- and inter-lingual effects of saliency. |
Michael A. Johns; Laura Rodrigo; Rosa E. Guzzardo Tamargo; Aliza Winneg; Paola E. Dussias Priming and persistence in bilinguals: What codeswitching tells us about lexical priming in sentential contexts Journal Article In: Bilingualism: Language and Cognition, vol. 24, no. 4, pp. 681–693, 2021. @article{Johns2021a, Most studies on lexical priming have examined single words presented in isolation, despite language users rarely encountering words in such cases. The present study builds upon this by examining both within-language identity priming and across-language translation priming in sentential contexts. Highly proficient Spanish-English bilinguals read sentence-question pairs, where the sentence contained the prime and the question contained the target. At earlier stages of processing, we find evidence only of within-language identity priming; at later stages of processing, however, across-language translation priming surfaces, and becomes as strong as within-language identity priming. Increasing the time between the prime sentence and target question results in strengthened priming at the latest stages of processing. These results replicate previous findings at the single-word level but do so within sentential contexts, which has implications both for accounts of priming via automatic spreading activation as well as for accounts of persistence attested in spontaneous speech corpora. |
Holly Joseph; Elizabeth Wonnacott; Kate Nation Online inference making and comprehension monitoring in children during reading: Evidence from eye movements Journal Article In: Quarterly Journal of Experimental Psychology, vol. 74, no. 7, pp. 1202–1224, 2021. @article{Joseph2021, Inference generation and comprehension monitoring are essential elements of successful reading comprehension. While both improve with age and reading development, little is known about when and how children make inferences and monitor their comprehension during the reading process itself. Over two experiments, we monitored the eye movements of two groups of children (age 8–13 years) as they read short passages and answered questions that tapped local (Experiment 1) and global (Experiment 2) inferences. To tap comprehension monitoring, the passages contained target words which were consistent or inconsistent with the context. Comprehension question location was also manipulated with the question appearing before or after the passage. Children made local inferences during reading, but the evidence was less clear for global inferences. Children were sensitive to inconsistencies that relied on the generation of an inference, consistent with successful comprehension monitoring, although this was seen only very late in the eye movement record. Although question location had a large effect on reading times, it had no effect on global comprehension in one experiment and reading the question first had a detrimental effect in the other. We conclude that children appear to prioritise efficiency over completeness when reading, generating inferences spontaneously only when they are necessary for establishing a coherent representation of the text. |
Tamás Káldi; Anna Babarczy Linguistic focus guides attention during the encoding and refreshing of working memory content Journal Article In: Journal of Memory and Language, vol. 116, pp. 104187, 2021. @article{Kaldi2021, Focus is a linguistic device that marks a piece of information within an utterance as most relevant, as when emphasis is placed by the speaker on a word using phonological stress, special intonation, or prosodic prominence. The question addressed in the present study is whether the use of linguistic focus is best seen as a means of directing the listener's attention. We investigated attention allocation on the part of the listener to linguistically focused elements in working memory in a series of eye-tracking experiments. We concentrated on two processes: the encoding of the focused element and its retention. Attentional load during encoding was measured by pupil dilation, and attention allocation during retention was estimated from fixations to locations of previously present visual stimuli on a blank screen. It was found that i) more attention was allocated during the processing of sentences with linguistic focus and ii) linguistically focused elements received more attention during memory retention. However, when the task demanded the sharing of attention, the advantage of the focused element during retention disappeared. Further experiments showed that when verbal stimuli whose prominence was not linguistically marked were presented, the patterns of attention allocation associated with linguistic focus during retention replicated. These results lend further support to the claim that linguistic focus is a grammaticalized means of expressing prominence, and as such, functions as an attention capturing device. |
Tinghu Kang; Ping Wang; Hui Zhang Cognitive style differences in attention distribution regarding calligraphic perception Journal Article In: Psychology Research and Behavior Management, vol. 14, pp. 251–260, 2021. @article{Kang2021a, Purpose: Calligraphy is the most unique form of artistic expression in Chinese culture. However, most studies that used calligraphy as a research object only explored its artistivalue from an artistic perspective. Thus, we know little about the information processing and influencing factors of calligraphic perception. Thus, we aimed to determine whether there ardifferences in attention distribution due to cognitive style in the process of calligraphiperception. Methods: The calligraphy of Lan Ting Ji Xu, which is known as the first running script in the history of Chinese calligraphy, was selected as the experimental material. The study used eye movement experiments to explore the differences in cognitive styles of attention distribution when perceiving calligraphy, through the analysis of eye movement data oparticipants. Results: The results showed that field-independent participants had more fixation durationnumber of fixations, and saccade angle when they perceived calligraphic works than thoswho were field-dependent. In other words, field-independent individuals spend more attention resources in the perceptual process. In addition, through data analysis, it was found thafixation duration, number of fixations, and saccade angle in the middle position of calligraphy are larger than the data on both sides of the calligraphy. In other words, when individualperceive calligraphy, the content in the middle position can attract more attention resourcethan those on both sides. Conclusion: We found that individuals with different cognitive styles have differences in attention distribution in the process of perceiving calligraphy. |
Elif Canseza Kaplan; Anita E. Wagner; Paolo Toffanin; Deniz Başkent Do musicians and non-musicians differ in speech-on-speech processing? Journal Article In: Frontiers in Psychology, vol. 12, pp. 623787, 2021. @article{Kaplan2021, Earlier studies have shown that musically trained individuals may have a benefit in adverse listening situations when compared to non-musicians, especially in speech-on-speech perception. However, the literature provides mostly conflicting results. In the current study, by employing different measures of spoken language processing, we aimed to test whether we could capture potential differences between musicians and non-musicians in speech-on-speech processing. We used an offline measure of speech perception (sentence recall task), which reveals a post-task response, and online measures of real time spoken language processing: gaze-tracking and pupillometry. We used stimuli of comparable complexity across both paradigms and tested the same groups of participants. In the sentence recall task, musicians recalled more words correctly than non-musicians. In the eye-tracking experiment, both groups showed reduced fixations to the target and competitor words' images as the level of speech maskers increased. The time course of gaze fixations to the competitor did not differ between groups in the speech-in-quiet condition, while the time course dynamics did differ between groups as the two-talker masker was added to the target signal. As the level of two-talker masker increased, musicians showed reduced lexical competition as indicated by the gaze fixations to the competitor. The pupil dilation data showed differences mainly in one target-to-masker ratio. This does not allow to draw conclusions regarding potential differences in the use of cognitive resources between groups. Overall, the eye-tracking measure enabled us to observe that musicians may be using a different strategy than non-musicians to attain spoken word recognition as the noise level increased. However, further investigation with more fine-grained alignment between the processes captured by online and offline measures is necessary to establish whether musicians differ due to better cognitive control or sound processing. |
Efthymia C. Kapnoula; Bob McMurray In: Brain and Language, vol. 223, pp. 105031, 2021. @article{Kapnoula2021, Listeners generally categorize speech sounds in a gradient manner. However, recent work, using a visual analogue scaling (VAS) task, suggests that some listeners show more categorical performance, leading to less flexible cue integration and poorer recovery from misperceptions (Kapnoula et al., 2017, 2021). We asked how individual differences in speech gradiency can be reconciled with the well-established gradiency in the modal listener, showing how VAS performance relates to both Visual World Paradigm and EEG measures of gradiency. We also investigated three potential sources of these individual differences: inhibitory control; lexical inhibition; and early cue encoding. We used the N1 ERP component to track pre-categorical encoding of Voice Onset Time (VOT). The N1 linearly tracked VOT, reflecting a fundamentally gradient speech perception; however, for less gradient listeners, this linearity was disrupted near the boundary. Thus, while all listeners are gradient, they may show idiosyncratic encoding of specific cues, affecting downstream processing. |
Young-Suk Grace Kim; Yaacov Petscher; Christopher Vorstius The relations of online reading processes (eye movements) with working memory, emergent literacy skills, and reading proficiency Journal Article In: Scientific Studies of Reading, vol. 25, no. 4, pp. 351–369, 2021. @article{Kim2021e, We examined the relations between working memory, emergent literacy skills (e.g., phonological awareness, orthographic awareness, rapid-automatized naming), word reading, and listening comprehension to online reading processes (eye movements), and their relations to reading comprehension. A total of 292 students were assessed on working memory and emergent literacy skills in Grade 1, and eye movements, language, and reading skills in Grade 3. Structural equation model results showed that word reading was related to gaze duration and rereading duration, but listening comprehension was not. Working memory and emergent literacy skills were related to eye movements, but their relations to eye movements were largely mediated by word reading. Eye movements were related to reading comprehension, but not after accounting for word reading and listening comprehension. These results expand our understanding of reading development by revealing the nature of relations of emergent literacy skills, reading, and listening comprehension to online processes. |
Suzanne Kleijn; Willem M. Mak; Ted J. M. Sanders Causality, subjectivity and mental spaces: Insights from on-line discourse processing Journal Article In: Cognitive Linguistics, vol. 32, no. 1, pp. 35–65, 2021. @article{Kleijn2021, Research has shown that it requires less time to process information that is part of an objective causal relation describing states of affairs in the world (She was out of breath because she was running), than information that is part of a subjective relation (She must have been in a hurry because she was running) expressing a claim or conclusion and a supporting argument. Representing subjectivity seems to require extra cognitive operations. In Mental Spaces Theory (MST; Fauconnier, Gilles. 1994. Mental spaces: Aspects of meaning construction in natural language. Cambridge: MIT Press) the difference between these two relation types can be described in terms of an extra mental space in the discourse representation of subjective relations: representing the Subject of Consciousness (SoC). In processing terms, this might imply that the processing difference is not present if this SoC has already been established in the discourse. We tested this prediction in two eye tracking experiments. The results of Experiment 1 showed that signaling the subjectivity of the relation by introducing a subject of consciousness beforehand did not diminish the processing asymmetry compared to a neutral context. However, the relative complexity of subjective relations was diminished in the context of Free Indirect Speech (No! He was absolutely sure. There was no doubt about it. She was running so she was in hurry; Experiment 2). In terms of MST and the representation of subjectivity in general, this implies that not only creating a representation of a thinking subject, but also assigning a claim to this thinking subject requires extra processing effort. |
Judith Köhne-Fuetterer; Heiner Drenhaus; Francesca Delogu; Vera Demberg The online processing of causal and concessive discourse connectives Journal Article In: Linguistics, vol. 59, no. 2, pp. 417–448, 2021. @article{KoehneFuetterer2021, While there is a substantial amount of evidence for language processing being a highly incremental and predictive process, we still know relatively little about how top-down discourse based expectations are combined with bottom-up information such as discourse connectives. The present article reports on three experiments investigating this question using different methodologies (visual world paradigm and ERPs) in two languages (German and English). We find support for highly incremental processing of causal and concessive discourse connectives, causing anticipation of upcoming material. Our visual world study shows that anticipatory looks depend on the discourse connective; furthermore, the German ERP study revealed an N400 effect on a gender-marked adjective preceding the target noun, when the target noun was inconsistent with the expectations elicited by the combination of context and discourse connective. Moreover, our experiments reveal that the facilitation of downstream material based on earlier connectives comes at the cost of reversing original expectations, as evidenced by a P600 effect on the concessive relative to the causal connective. |
Letícia Kolberg; Alex Carvalho; Mireille Babineau; Naomi Havron; Anne-Caroline Fiévét; Bernadete Abaurre; Anne Christophe “The tiger is hitting! the duck too!” 3-year-olds can use prosodic information to constrain their interpretation of ellipsis Journal Article In: Cognition, vol. 213, pp. 104626, 2021. @article{Kolberg2021, This work aims to investigate French children's ability to use phrasal boundaries for disambiguation of a type of ambiguity not yet studied, namely stripping sentences versus simple transitive sentences. We used stripping sentences such as “[Le tigre tape]! [Le canard aussi]!” (“[The tiger is hitting]! [The duck too]!”, in which both the tiger and the duck are hitting), which, without the prosodic information, would be ambiguous with a transitive sentence such as “[Le tigre] [tape le canard aussi]!” (“[The tiger] [is hitting the duck too]!”, in which the tiger is hitting the duck). We presented 3-to-4-year-olds and 28-month-olds with one of the two types of sentence above, while they watched two videos side-by-side on a screen: one depicting the transitive interpretation of the sentences, and another depicting the stripping interpretation. The stripping interpretation video showed the two characters as agents of the named action (e.g. a duck and a tiger hitting a bunny), and the transitive interpretation video showed only the first character as an agent, and the second character as a patient of the action (e.g. the tiger hitting the duck and the bunny). The results showed that 3-to-4-year-olds use prosodic information to correctly distinguish stripping sentences from transitive sentences, as they looked significantly more at the appropriate video, while 28-month-olds show only a trend in the same direction. While recent studies demonstrated that from 18 months of age, infants are able to use phrasal prosody to guide the syntactic analysis of ambiguous sentences, our results show that only 3-to-4-year-olds were able to reliably use phrasal prosody to constrain the parsing of stripping sentences. We discuss several factors that can explain this delay, such as differences in the frequency of these structures in child-directed speech, as well as in the complexity of the sentences and of the experimental task. Our findings add to the growing body of evidence on the role of prosody in constraining parsing in young children. |
Arnout Koornneef The processing signature of anticipatory reading: An eye-tracking study on lexical predictions Journal Article In: Linguistics, vol. 59, no. 2, pp. 449–479, 2021. @article{Koornneef2021, Current approaches to the human language faculty emphasize that during real-time processing anticipatory mechanisms play a vital role for people to parse and comprehend linguistic input at a sufficient pace. Consistent with this view, several Event-Related Potential (ERP) and behavioral self-paced reading (SPR) studies revealed a processing disadvantage for pre-nominal linguistic elements that (grammatically) mismatched with an expected upcoming noun. More recently, however, these findings have been challenged because the results are difficult to replicate. In the current study, I continue this line of replication research with a complementary method: eye tracking. I conducted two experiments aimed at reproducing prior findings of a SPR study of van Berkum, Jos J. A., Colin M. Brown, Pienie Zwitserlood, Valesca Kooijman & Hagoort Peter. 2005. Anticipating upcoming words in discourse: Evidence from ERPs and reading times. Journal of Experimental Psychology: Learning, Memory, and Cognition 31(3). 443-467. The participants read two-sentence stories constructed to elicit a strong lexical prediction about an upcoming noun. To assess whether readers were activating the lexical prediction, the noun was preceded by two gender-inflected adjectives carrying an inflectional suffix that either matched or mismatched with the syntactic gender of the predicted noun. Overall, I did not obtain evidence for strong lexical prediction as the eye-tracking metrics revealed no processing disadvantage for mismatching adjectives (i.e., contrary to the findings of van Berkum et al.). In fact, in some cases readers allocated more processing resources to pre-nominal adjectives that morphologically matched with the gender of the predicted noun. These intriguing findings will be discussed in the context of the time course, the processing costs, and the validation processes of lexical predictions. |
Ronan McGarrigle; Sarah Knight; Lyndon Rakusen; Jason Geller; Sven Mattys Older adults show a more sustained pattern of effortful listening than young adults Journal Article In: Psychology and Aging, vol. 36, no. 4, pp. 504–519, 2021. @article{McGarrigle2021, Listening to speech in adverse conditions can be challenging and effortful, especially for older adults. This study examined age-related differences in effortful listening by recording changes in the task-evoked pupil response (TEPR; a physiological marker of listening effort) both at the level of sentence processing and over the entire course of a listening task. A total of 65 (32 young adults, 33 older adults) participants performed a speech recognition task in the presence of a competing talker, while moment-to-moment changes in pupil size were continuously monitored. Participants were also administered the Vanderbilt Fatigue Scale, a questionnaire assessing daily life listening-related fatigue within four domains (social, cognitive, emotional, physical). Normalized TEPRs were overall larger and more steeply rising and falling around the peak in the older versus the young adult group during sentence processing. Additionally, mean TEPRs over the course of the listening task were more stable in the older versus the young adult group, consistent with a more sustained recruitment of compensatory attentional resources to maintain task performance. No age-related differences were found in terms of total daily life listening-related fatigue; however, older adults reported higher scores than young adults within the social domain. Overall, this study provides evidence for qualitatively distinct patterns of physiological arousal between young and older adults consistent with age-related upregulation in resource allocation during listening. A more detailed understanding of age-related changes in the subjective and physiological mechanisms that underlie effortful listening will ultimately help to address complex communication needs in aging listeners. (PsycInfo Database Record (c) 2021 APA, all rights reserved) |
Ronan McGarrigle; Lyndon Rakusen; Sven Mattys In: Psychophysiology, vol. 58, no. 1, pp. e13703, 2021. @article{McGarrigle2021a, Effort during listening is commonly measured using the task-evoked pupil response (TEPR); a pupillometric marker of physiological arousal. However, studies to date report no association between TEPR and perceived effort. One possible reason for this is the way in which self-report effort measures are typically administered, namely as a single data point collected at the end of a testing session. Another possible reason is that TEPR might relate more closely to the experience of tiredness from listening than to effort per se. To examine these possibilities, we conducted two preregistered experiments that recorded subjective ratings of effort and tiredness from listening at multiple time points and examined their covariance with TEPR over the course of listening tasks varying in levels of acoustic and attentional demand. In both experiments, we showed a within-subject association between TEPR and tiredness from listening, but no association between TEPR and effort. The data also suggest that the effect of task difficulty on the experience of tiredness from listening may go undetected using the traditional approach of collecting a single data point at the end of a listening block. Finally, this study demonstrates the utility of a novel correlation analysis technique (“rmcorr”), which can be used to overcome statistical power constraints commonly found in the literature. Teasing apart the subjective and physiological mechanisms that underpin effortful listening is a crucial step toward addressing these difficulties in older and/or hearing-impaired individuals. |
Rita Mendonça; Margarida V. Garrido; Gün R. Semin The effect of simultaneously presented words and auditory tones on visuomotor performance Journal Article In: Multisensory Research, vol. 34, no. 7, pp. 715–742, 2021. @article{Mendonca2021, The experiment reported here used a variation of the spatial cueing task to examine the effects of unimodal and bimodal attention-orienting primes on target identification latencies and eye gaze movements. The primes were a nonspatial auditory tone and words known to drive attention consistent with the dominant writing and reading direction, as well as introducing a semantic, temporal bias (past-future) on the horizontal dimension. As expected, past-related (visual) word primes gave rise to shorter response latencies on the left hemifield and future-related words on the right. This congruency effect was differentiated by an asymmetric performance on the right space following future words and driven by the left-to-right trajectory of scanning habits that facilitated search times and eye gaze movements to lateralized targets. Auditory tone prime alone acted as an alarm signal, boosting visual search and reducing response latencies. Bimodal priming, i.e., temporal visual words paired with the auditory tone, impaired performance by delaying visual attention and response times relative to the unimodal visual word condition. We conclude that bimodal primes were no more effective in capturing participants' spatial attention than the unimodal auditory and visual primes. Their contribution to the literature on multisensory integration is discussed. |
Ayşegül Özkan; Figen Beken Fikri; Bilal Kırkıcı; Reinhold Kliegl; Cengiz Acartürk Eye movement control in Turkish sentence reading Journal Article In: Quarterly Journal of Experimental Psychology, vol. 74, no. 2, pp. 377–397, 2021. @article{Oezkan2021, Reading requires the assembly of cognitive processes across a wide spectrum from low-level visual perception to high-level discourse comprehension. One approach of unravelling the dynamics associated with these processes is to determine how eye movements are influenced by the characteristics of the text, in particular which features of the words within the perceptual span maximise the information intake due to foveal, spillover, parafoveal, and predictive processing. One way to test the generalisability of current proposals of such distributed processing is to examine them across different languages. For Turkish, an agglutinative language with a shallow orthography–phonology mapping, we replicate the well-known canonical main effects of frequency and predictability of the fixated word as well as effects of incoming saccade amplitude and fixation location within the word on single-fixation durations with data from 35 adults reading 120 nine-word sentences. Evidence for previously reported effects of the characteristics of neighbouring words and interactions was mixed. There was no evidence for the expected Turkish-specific morphological effect of the number of inflectional suffixes on single-fixation durations. To control for word-selection bias associated with single-fixation durations, we also tested effects on word skipping, single-fixation, and multiple-fixation cases with a base-line category logit model, assuming an increase of difficulty for an increase in the number of fixations. With this model, significant effects of word characteristics and number of inflectional suffixes of foveal word on probabilities of the number of fixations were observed, while the effects of the characteristics of neighbouring words and interactions were mixed. |
Dario Paape; Shravan Vasishth; Ralf Engbert Does local coherence lead to targeted regressions and illusions of grammaticality? Journal Article In: Open Mind: Discoveries in Cognitive Science, vol. 5, pp. 42–58, 2021. @article{Paape2021, Local coherence effects arise when the human sentence processor is temporarily misled by a locally grammatical but globally ungrammatical analysis (The coach smiled at the player tossed a frisbee by the opposing team). It has been suggested that such effects occur either because sentence processing occurs in a bottom-up, self-organized manner rather than under constant grammatical supervision, or because local coherence can disrupt processing due to readers maintaining uncertainty about previous input. We report the results of an eye-tracking study in which subjects read German grammatical and ungrammatical sentences that either contained a locally coherent substring or not and gave binary grammaticality judgments. In our data, local coherence affected on-line processing immediately at the point of the manipulation. There was, however, no indication that local coherence led to illusions of grammaticality (a prediction of self-organization), and only weak, inconclusive support for local coherence leading to targeted regressions to critical context words (a prediction of the uncertain-input approach). We discuss implications for self-organized and noisy-channel models of local coherence. |
Ascensión Pagán; Hazel I. Blythe; Simon P. Liversedge The influence of children's reading ability on initial letter position encoding during a reading-like task Journal Article In: Journal of Experimental Psychology: Learning, Memory, and Cognition, vol. 47, no. 7, pp. 1186–1203, 2021. @article{Pagan2021, Previous studies exploring the cost of reading sentences with words that have two transposed letters in adults showed that initial letter transpositions caused the most disruption to reading, indicating the important role that initial letters play in lexical identification (e.g., Rayner et al., 2006). Regarding children, it is not clear whether differences in reading ability would affect how they encode letter position information as they attempt to identify misspelled words in a reading-like task. The aim of this experiment was to explore how initial-letter position information is encoded by children compared to adults when reading misspelled words, containing transpositions, during a reading-like task. Four different conditions were used: control (words were correctly spelled), TL12 (letters in first and second positions were transposed), TL13 (letters in first and third positions were transposed), and TL23 (letters in second and third positions were transposed). Results showed that TL13 condition caused the most disruption, whereas TL23 caused the least disruption to reading of misspelled words. Although disruption for the TL13 condition was quite rapid in adults, the immediacy of disruption was less so for the TL23 and TL12 conditions. For children, effects of transposition also occurred quite rapidly but were longer lasting. The time course was particularly extended for the less skilled relative to the more skilled child readers. This pattern of effects suggests that both adults and children with higher, relative to lower,reading ability encode internal letter position information more flexibly to identify misspelled words,with transposed letters, during a reading-like task. |
Jinger Pan; Miaomiao Liu; Hong Li; Ming Yan Chinese children benefit from alternating-color words in sentence reading Journal Article In: Reading and Writing, vol. 34, no. 2, pp. 355–369, 2021. @article{Pan2021c, Word boundary information is not marked explicitly in Chinese sentences and word ambiguity happens in Chinese texts. This introduces difficulty to parse characters into words when reading Chinese sentences, especially for beginning readers. In an eye-tracking study, we tested whether explicit word boundary information as provided by alternating text-colors affects reading performance of Chinese children and how such an effect is influenced by individual differences in word segmentation ability. Results showed that across a number of eye-movement measures, grade three children overall benefited from explicit marking of word boundary. Additionally, children with highest word segmentation ability showed the largest benefits in reading speed. We discuss possible implications for education. |
Jinger Pan; Ming Yan; Eike M. Richter; Hua Shu; Reinhold Kliegl The Beijing Sentence Corpus: A Chinese sentence corpus with eye movement data and predictability norms Journal Article In: Behavior Research Methods, vol. 54, no. 4, pp. 1989–2000, 2021. @article{Pan2021, This report introduces the Beijing Sentence Corpus (BSC). This is a Chinese sentence corpus of eye-tracking data with relatively clear word boundaries. In addition, we report predictability norms for each word in the corpus. Eye movement corpora are available in alphabetic scripts such as English, German, and French. However, there is no publicly available corpus for Chinese. Thus, to study predictive processes during reading in Chinese, it is necessary to establish such a corpus. Also, given the clear word boundaries in the sentences, BSC is especially useful to provide evidence relevant to the theoretical debate of saccade target selection in Chinese. With the large-scale predictability norms, we conducted new analyses based on 60 BSC readers, testing the influences of launch word and target word properties while controlling for visual and oculomotor constraints, as well as sentence and subject-level individual differences. We discuss implications for guidance of eye movements in Chinese reading. |
Jinger Pan; Caicai Zhang; Xunan Huang; Ming Yan Sandhi-tone words prolong fixation duration during silent sentence reading in Chinese Journal Article In: Reading and Writing, vol. 34, no. 4, pp. 841–857, 2021. @article{Pan2021d, The current study examined whether or not lexical access is influenced by detailed phonological features during the silent reading of Chinese sentences. We used two types of two-character target words (Mandarin sandhi-tone and base-tone). The first characters of the words in the sandhi-tone condition had a tonal alternation, but no tonal alternation was involved in the base-tone condition. Recordings of eye movements revealed that native Mandarin Chinese readers viewed the base-tone target words more briefly than the sandhi-tone target words when they were infrequent. Such articulation-specific effects on visual word processing, however, diminished for frequent words. We suggest that a conflict in tonal representation at a character/morpheme level and at a word level induces prolongation in fixation duration on infrequent sandhi-tone words, and conclude that these tonal effects appear to reflect articulation simulation of words during the silent reading of Chinese sentences. |
Yali Pan; Steven Frisson; Ole Jensen Neural evidence for lexical parafoveal processing Journal Article In: Nature Communications, vol. 12, pp. 5234, 2021. @article{Pan2021a, In spite of the reduced visual acuity, parafoveal information plays an important role in natural reading. However, competing models on reading disagree on whether words are previewed parafoveally at the lexical level. We find neural evidence for lexical parafoveal processing by combining a rapid invisible frequency tagging (RIFT) approach with magnetoencephalography (MEG) and eye-tracking. In a silent reading task, target words are tagged (flickered) subliminally at 60 Hz. The tagging responses measured when fixating on the pre-target word reflect parafoveal processing of the target word. We observe stronger tagging responses during pre-target fixations when followed by low compared with high lexical frequency targets. Moreover, this lexical parafoveal processing is associated with individual reading speed. Our findings suggest that reading unfolds in the fovea and parafovea simultaneously to support fluent reading. |
Nadia Paraskevoudi; John S. Pezaris Full gaze contingency provides better reading performance than head steering alone in a simulation of prosthetic vision Journal Article In: Scientific Reports, vol. 11, pp. 11121, 2021. @article{Paraskevoudi2021, The visual pathway is retinotopically organized and sensitive to gaze position, leading us to hypothesize that subjects using visual prostheses incorporating eye position would perform better on perceptual tasks than with devices that are merely head-steered. We had sighted subjects read sentences from the MNREAD corpus through a simulation of artificial vision under conditions of full gaze compensation, and head-steered viewing. With 2000 simulated phosphenes, subjects (n = 23) were immediately able to read under full gaze compensation and were assessed at an equivalent visual acuity of 1.0 logMAR, but were nearly unable to perform the task under head-steered viewing. At the largest font size tested, 1.4 logMAR, subjects read at 59 WPM (50% of normal speed) with 100% accuracy under the full-gaze condition, but at 0.7 WPM (under 1% of normal) with below 15% accuracy under head-steering. We conclude that gaze-compensated prostheses are likely to produce considerably better patient outcomes than those not incorporating eye movements. |
Fabio Parente; Kathy Conklin; Josephine M. Guy; Rebekah Scott The role of empirical methods in investigating readers' constructions of authorial creativity in literary reading Journal Article In: Language and Literature, vol. 30, no. 1, pp. 21–36, 2021. @article{Parente2021, The popularity of literary biographies and the importance publishers place on author publicity materials suggest the concept of an author's creative intentions is important to readers' appreciation of literary works. However, the question of how this kind of contextual information informs literary interpretation is contentious. One area of dispute concerns the extent to which readers' constructions of an author's creative intentions are text-centred and therefore can adequately be understood by linguistic evidence alone. The current study shows how the relationship between linguistic and contextual factors in readers' constructions of an author's creative intentions may be investigated empirically. We use eye-tracking to determine whether readers' responses to textual features (changes to lexis and punctuation) are affected by prior, extra-textual prompts concerning information about an author's creative intentions. We showed participants pairs of sentences from Oscar Wilde and Henry James while monitoring their eye movements. The first sentence was followed by a prompt denoting a different attribution (Authorial, Editorial/Publisher and Typographic) for the change that, if present, would appear in the second sentence. After reading the second sentence, participants were asked whether they had detected a change and, if so, to describe it. If the concept of an author's creative intentions is implicated in literary reading this should influence participants' reading behaviour and ability to accurately report a change based on the prompt. The findings showed that readers' noticing of textual variants was sensitive to the prior prompt about its authorship, in the sense of producing an effect on attention and re-reading times. But they also showed that these effects did not follow the pattern predicted of them, based on prior assumptions about readers' cultures. This last finding points to the importance, as well as the challenges, of further investigating the role of contextual information in readers' constructions of an author's creative intentions. |
Ji-hyun Park L2 learners' processing of English articles: An eye-tracking study Journal Article In: Linguistic Research, vol. 38, no. 3, pp. 567–592, 2021. @article{Park2021a, Adult language learners' difficulties with second language (L2) articles are well attested in the literature. Ionin et al. (2004, 2009) argued that L2 learners whose native language lacks articles have access to both possible semantic universals of the article system, namely, definiteness and specificity. The fluctuation between the two options may result in learners' misuse of the articles. This study investigates their claim using both online and offline measures of learners' linguistic knowledge. Twenty-two Korean learners and 22 native speakers of English read pairs of sentences that included (un)grammatical articles twice, first with a focus on meaning while their eye movements were recorded, and then to make grammaticality judgments. The learners' performances are discussed in terms of the grammaticality of the article use and the semantic contexts in which the target articles were used in comparison to native English speakers' performance on the same tasks. The online task produced mixed results for the L2 learners, while the offline task relied on the right option for English. (Gyeongin |
Adam J. Parker; Timothy J. Slattery Spelling ability influences early letter encoding during reading: Evidence from return-sweep eye movements Journal Article In: Quarterly Journal of Experimental Psychology, vol. 74, no. 1, pp. 135–149, 2021. @article{Parker2021, In recent years, there has been an increase in research concerning individual differences in readers' eye movements. However, this body of work is almost exclusively concerned with the reading of single-line texts. While spelling and reading ability have been reported to influence saccade targeting and fixation times during intra-line reading, where upcoming words are available for parafoveal processing, it is unclear how these variables affect fixations adjacent to return-sweeps. We, therefore, examined the influence of spelling and reading ability on return-sweep and corrective saccade parameters for 120 participants engaged in multiline text reading. Less-skilled readers and spellers tended to launch their return-sweeps closer to the end of the line, prefer a viewing location closer to the start of the next, and made more return-sweep undershoot errors. We additionally report several skill-related differences in readers' fixation durations across multiline texts. Reading ability influenced all fixations except those resulting from return-sweep error. In contrast, spelling ability influenced only those fixations following accurate return-sweeps—where parafoveal processing was not possible prior to fixation. This stands in contrasts to an established body of work where fixation durations are related to reading but not spelling ability. These results indicate that lexical quality shapes the rate at which readers access meaning from the text by enhancing early letter encoding, and influences saccade targeting even in the absence of parafoveal target information. |
Olga Parshina; Anna K. Laurinavichyute; Irina A. Sekerina Eye-movement benchmarks in Heritage Language reading Journal Article In: Bilingualism: Language and Cognition, vol. 24, no. 1, pp. 69–82, 2021. @article{Parshina2021, This eye-tracking study establishes basic benchmarks of eye movements during reading in heritage language (HL) by Russian-speaking adults and adolescents of high (n = 21) and low proficiency (n = 27). Heritage speakers (HSs) read sentences in Cyrillic, and their eye movements were compared to those of Russian monolingual skilled adult readers, 8-year-old children and L2 learners. Reading patterns of HSs revealed longer mean fixation durations, lower skipping probabilities, and higher regressive saccade rates than in monolingual adults. High-proficient HSs were more similar to monolingual children, while low-proficient HSs performed on par with L2 learners. Low-proficient HSs differed from high-proficient HSs in exhibiting lower skipping probabilities, higher fixation counts, and larger frequency effects. Taken together, our findings are consistent with the weaker links account of bilingual language processing as well as the divergent attainment theory of HL. |
Ana Pellicer–Sánchez; Kathy Conklin; Michael P. H. Rodgers; Fabio Parente The effect of auditory input on multimodal reading comprehension: An examination of adult readers' eye movements Journal Article In: The Modern Language Journal, pp. 1–21, 2021. @article{Pellicer–Sanchez2021, Comprehension of many types of texts involves constructing meaning from text and pictures. However, research examining how second language (L2) learners process text and pictures and the relationship with comprehension is scarce. Thus, while verbal input is often presented in written and auditory modes simultaneously (i.e., audio of text with simultaneous reading of it), we do not know how the auditory input affects L2 adult learners' processing of text and pictures and its relation to comprehension. In the current study, L2 adult learners and native (L1) adults read and read while listening to an illustrated story while their eye movements were recorded. Immediately after reading, they completed a comprehension test. Results showed that the presence of auditory input allowed learners to spend more time looking at pictures and supported a better integration of text and pictures. No differences were observed between L2 and L1 readers' allocation of attention to text and pictures. Both reading conditions led to similar levels of comprehension. Processing time on the text was positively related to comprehension for L2 readers, while it was associated to lower comprehension for L1 readers. Processing time on images was positively related to comprehension only for L1 readers. |
Ryan E. Peters; Justin B. Kueser; Arielle Borovsky Perceptual connectivity influences toddlers' attention to known objects and subsequent label processing Journal Article In: Brain Sciences, vol. 11, no. 2, pp. 163, 2021. @article{Peters2021, While recent research suggests that toddlers tend to learn word meanings with many “perceptual” features that are accessible to the toddler's sensory perception, it is not clear whether and how building a lexicon with perceptual connectivity supports attention to and recognition of word meanings. We explore this question in 24–30-month-olds (N = 60) in relation to other individual differences, including age, vocabulary size, and tendencies to maintain focused attention. Participants' looking to item pairs with high vs. low perceptual connectivity—defined as the number of words in a child's lexicon sharing perceptual features with the item—was measured before and after target item labeling. Results revealed pre-labeling attention to known items is biased to both high-and low-connectivity items: first to high, and second, but more robustly, to low-connectivity items. Subsequent object–label processing was also facilitated for high-connectivity items, particularly for children with temperamental tendencies to maintain focused attention. This work provides the first empirical evidence that patterns of shared perceptual features within children's known vocabularies influence both visual and lexical processing, highlighting the potential for a newfound set of developmental dependencies based on the perceptual/sensory structure of early vocabularies. |
Aurélie Pistono; Robert J. Hartsuiker Eye-movements can help disentangle mechanisms underlying disfluency Journal Article In: Language, Cognition and Neuroscience, vol. 36, no. 8, pp. 1038–1055, 2021. @article{Pistono2021, To reveal the underlying cause of disfluency, several authors related the pattern of disfluencies to difficulties at specific levels of production, using a Network Task. Given that disfluencies are multifactorial, we combined this paradigm with eye-tracking to disentangle disfluency related to word preparation difficulties from others (e.g. stalling strategies). We manipulated lexical and grammatical selection difficulty. In Experiment 1, lines connecting the pictures varied in length, which led participants to use a strategy and inspect other areas than the upcoming picture when pictures were preceded by long lines. Experiment 2 only used short lines. In both experiments, lexical selection difficulty promoted self-corrections, pauses and longer fixation latency prior to naming. Multivariate Pattern Analyses demonstrated that disfluency and eye-movement data patterns can predict lexical selection difficulty. Eye-tracking could provide complementary information about network tasks, by disentangling disfluencies related to picture naming from disfluencies related to self-monitoring or stalling strategies. |
Seema Prasad; Ramesh Kumar Mishra In: Bilingualism: Language and Cognition, vol. 24, no. 2, pp. 241–270, 2021. @article{Prasad2021, Does a concurrent verbal working memory (WM) load constrain cross-linguistic activation? In a visual world study, participants listened to Hindi (L1) or English (L2) spoken words and viewed a display containing the phonological cohort of the translation equivalent (TE cohort) of the spoken word and 3 distractors. Experiment 1 was administered without a load. Participants then maintained two or four letters (Experiment 2) or two, six or eight letters (Experiment 3) in WM and were tested on backward sequence recognition after the visual world display. Greater looks towards TE cohorts were observed in both the language directions in Experiment 1. With a load, TE cohort activation was inhibited in the L2 - L1 direction and observed only in the early stages after word onset in the L1 - L2 direction suggesting a critical role of language direction. These results indicate that cross-linguistic activation as seen through eye movements depends on cognitive resources such as WM. |
Raheleh Saryazdi; Daniel DeSantis; Elizabeth K. Johnson; Craig G. Chambers The use of disfluency cues in spoken language processing: Insights from aging Journal Article In: Psychology and Aging, vol. 36, no. 8, pp. 928–942, 2021. @article{Saryazdi2021a, Past research suggests listeners treat disfluencies as informative cues during spoken language processing. For example, studies have shown that child and younger adult listeners use filled pauses to rapidly anticipate discourse-new objects. The present study explores whether older adults show a similar pattern, or if this ability is reduced in light of age-related declines in language and cognitive abilities. The study also examines whether the processing of disfluencies differs depending on the talker's age. Stereotyped ideas about older adults' speech could lead listeners to treat disfluencies as uninformative, similar to the way in which listeners react to disfluencies produced by non-native speakers or individuals with a cognitive disorder. Experiment 1 tracking to capture younger and older listeners' real-time reactions to filled pauses produced by younger and older talkers. On critical trials, participants followed fluent or disfluent instructions referring to by both younger and older talkers as cues for reference to discourse-new objects despite holding stereotypes regarding older adults' speech. Experiment 2 further explored listeners' biased judgments of talkers' fluency, using auditory materials from Experiment 1. Speech produced by an older talker was rated as more slower than a younger talker even though these features were matched across recordings. Together, the findings demonstrate (a) older listeners' effective use of disfluency cues in real-time listeners treat both older and younger talkers' disfluencies as informative despite regarding older talkers' speech. |
Gaston Saux; Nicolas Vibert; Julien Dampuré; Debora I. Burin; M. Anne Britt; Jean François Rouet From simple agents to information sources: Readers' differential processing of story characters as a function of story consistency Journal Article In: Acta Psychologica, vol. 212, pp. 103191, 2021. @article{Saux2021, The study examined how readers integrate information from and about multiple information sources into a memory representation. In two experiments, college students read brief news reports containing two critical statements, each attributed to a source character. In half of the texts, the statements were consistent with each other, in the other half they were discrepant. Each story also featured a non-source character (who made no statement). The hypothesis was that discrepant statements, as compared to consistent statements, would promote distinct attention and memory only for the source characters. Experiment 1 used short interviews to assess participants' ability to recognize the source of one of the statements after reading. Experiment 2 used eye-tracking to collect data during reading and during a source-content recognition task after reading. As predicted, discrepancies only enhanced memory of, and attention to source-related segments of the texts. Discrepancies also enhanced the link between the two source characters in memory as opposed to the non-source character, as indicated by the participants' justifications (Experiment 1) and their visual inspection of the recognition items (Experiment 2). The results are interpreted within current theories of text comprehension and document literacy. |
Daniel Schmidtke; Anna L. Moro Determinants of word-reading development in English learner university students: A longitudinal eye movement study Journal Article In: Reading Research Quarterly, vol. 56, no. 4, pp. 819–854, 2021. @article{Schmidtke2021, We investigated the word-reading development of adult second-language learners of English. A sample of 70 (Mandarin or Cantonese) Chinese-speaking students enrolled in a university-level English bridging program at a Canadian university silently read passages of text at the beginning and end of the program while their eye movements were recorded. At each timepoint, we also administered a battery of tests that measure key component skills of second-language reading (phonological processing, vocabulary knowledge, and listening comprehension). We found longitudinal changes in lexical processing for long words in early (refixation probability and gaze duration) and late (go-past time and total reading time) eye movement measures, indicating a shift from a sublexical to a holistic word-processing strategy. We found the largest gains in sublexical processing among students with stronger phonological awareness upon entry to the program and students who acquired more vocabulary than their peers during the program. We interpret the results of this study as evidence of a transition from a lexical processing strategy that is heavily reliant on phonological decoding to word-reading behavior that is more actively engaged in higher order cognitive processes, such as meaning integration. This research offers novel insights into predictors of reading skill in postsecondary English-language bridging programs. |
Daniel Schmidtke; Julie A. Van Dyke; Victor Kuperman CompLex: an eye-movement database of compound word reading in English Journal Article In: Behavior Research Methods, vol. 53, no. 1, pp. 59–77, 2021. @article{Schmidtke2021a, The CompLex database presents a large-scale collection of eye-movement studies on English compound-word processing. A combined total of 440 participants completed eye-tracking experiments in which they silently read unspaced English compound words (e.g., goalpost) embedded in sentence contexts (e.g., Dylan hit the goalpost when he was aiming for the net.). Three studies were conducted using participants representing the non-college-bound population (300 participants), and four studies included participants recruited from the student population (140 participants). The database comprises trial-level eye-movement data (47,763 trials), participant data (including a measure of reading experience estimated via the Author Recognition Test), and lexical characteristics for the set of 931 English compound words used as critical stimuli in the studies. One contribution of the present paper is a set of regression analyses conducted on the full database and individual experiments. We report that the most reliable and consistent main effects were those elicited by compound word length, left constituent frequency, right constituent frequency, compound frequency and semantic transparency. Separately, we also found that the effect of left frequency and compound word length is weaker among more frequent compounds. Another contribution is a power analysis, in which we determined the sample sizes required to reliably detect effect sizes that are comparable to those observed in our regression models. These sample size estimates serve as a recommendation for researchers wishing to either collect eye-movement data for compound word reading, or use the current database as a resource for the study of English compound word processing. |
Lea-Maria Schmitt; Julia Erb; Sarah Tune; Anna U. Rysop; Gesa Hartwigsen; Jonas Obleser Predicting speech from a cortical hierarchy of event-based time scales Journal Article In: Science Advances, vol. 7, no. 49, pp. eabi6070, 2021. @article{Schmitt2021a, How do predictions in the brain incorporate the temporal unfolding of context in our natural environment? We here provide evidence for a neural coding scheme that sparsely updates contextual representations at the boundary of events. This yields a hierarchical, multilayered organization of predictive language comprehension. Training artificial neural networks to predict the next word in a story at five stacked time scales and then using model-based functional magnetic resonance imaging, we observe an event-based “surprisal hierarchy” evolving along a temporoparietal pathway. Along this hierarchy, surprisal at any given time scale gated bottom-up and top-down connectivity to neighboring time scales. In contrast, surprisal derived from continuously updated context influenced temporoparietal activity only at short time scales. Representing context in the form of increasingly coarse events constitutes a network architecture for making predictions that is both computationally efficient and contextually diverse. |
Sarah Schuster; Nicole Alexandra; Florian Hutzler; Fabio Richlan; Martin Kronbichler; Stefan Hawelka Cloze enough? Hemodynamic effects of predictive processing during natural reading Journal Article In: NeuroImage, vol. 228, pp. 117687, 2021. @article{Schuster2021, Evidence accrues that readers form multiple hypotheses about upcoming words. The present study investigated the hemodynamic effects of predictive processing during natural reading by means of combining fMRI and eye movement recordings. In particular, we investigated the neural and behavioral correlates of precision-weighted prediction errors, which are thought to be indicative of subsequent belief updating. Participants silently read sentences in which we manipulated the cloze probability and the semantic congruency of the final word that served as an index for precision and prediction error respectively. With respect to the neural correlates, our findings indicate an enhanced activation within the left inferior frontal and middle temporal gyrus suggesting an effect of precision on prediction update in higher (lexico-)semantic levels. Despite being evident at the neural level, we did not observe any evidence that this mechanism resulted in disproportionate reading times on participants' eye movements. The results speak against discrete predictions, but favor the notion that multiple words are activated in parallel during reading. 1. |
Ana I. Schwartz; Karla S. Tarin The impact of a discourse context on bilingual cross-language lexical activation Journal Article In: Bilingualism: Language and Cognition, vol. 24, no. 5, pp. 879–890, 2021. @article{Schwartz2021, Four hypotheses regarding the impact of discourse context on cross-language lexical activation were tested. Highly-proficient, Spanish-English bilinguals read all-English paragraphs containing non-identical and identical cognates or noncognate controls while their eye-movements were tracked. There were four paragraph conditions based on a full crossing of semantic bias from the topic sentence and sentence containing the critical word. In analyses in which cognate status was treated categorically there was an interaction between global bias and cognates status such that the observed inhibitory effects of cognate status were attenuated in global-neutral contexts. Follow-up analyses on the non-identical cognates in which orthographic overlap was treated continuously revealed a U-shaped function between orthographic overlap and processing time, which was more pronounced in global-neutral contexts. The overall pattern of findings is consistent with a combined operation of resonant-based and feature-restriction mechanisms of context effects. |
Adi Shechter; David L. Share Keeping an eye on effort: A pupillometric investigation of effort and effortlessness in visual word recognition Journal Article In: Psychological Science, vol. 32, no. 1, pp. 80–95, 2021. @article{Shechter2021a, Rapid and seemingly effortless word recognition is a virtually unquestioned characteristic of skilled reading, yet the definition and operationalization of the concept of cognitive effort have proven elusive. We investigated the cognitive effort involved in oral and silent word reading using pupillometry among adults (Experiment 1 |
Jing Shen Pupillary response to dynamic pitch alteration during speech perception in noise Journal Article In: JASA Express Letters, vol. 1, no. 11, pp. 115202, 2021. @article{Shen2021, Dynamic pitch, also known as intonation, conveys both semantic and pragmatic meaning in speech communica- tion. While alteration of this cue is detrimental to speech intelligibility in noise, the mechanism involved is poorly understood. Using the psychophysiological measure of task-evoked pupillary response, this study examined the perceptual effect of altered dynamic pitch cues on speech perception in noise. The data showed that pupil dilation increased with dynamic pitch strength in a sentence recognition in noise task. Taken together with recognition accuracy data, the results suggest the involvement of perceptual arousal in speech perception with dynamic pitch alteration |
Wei Shen; Jukka Hyönä; Youxi Wang; Meiling Hou; Jing Zhao The role of tonal information during spoken-word recognition in Chinese: Evidence from a printed-word eye-tracking study Journal Article In: Memory & Cognition, vol. 49, no. 1, pp. 181–192, 2021. @article{Shen2021a, Two experiments were conducted to investigate the extent to which the lexical tone can affect spoken-word recognition in Chinese using a printed-word paradigm. Participants were presented with a visual display of four words—namely, a target word (e.g., 象限, xiang4xian4, “quadrant”), a tone-consistent phonological competitor (e.g., 相册, xiang4ce4, “photo album”), or a tone-inconsistent phonological competitor (e.g., 香菜, xiang1cai4, “coriander”), and two unrelated distractors. Simultaneously, they were asked to listen to a spoken target word presented in isolation (Experiment 1) or embedded in neutral/predictive sentence contexts (Experiment 2), and then click on the target word on the screen. Results showed significant phonological competitor effects (i.e., the fixation proportion on the phonological competitor was higher than that on the distractors) under both tone conditions. Specifically, a larger phonological competitor effect was observed in the tone-consistent condition than in the tone-inconsistent condition when the spoken word was presented in isolation and the neutral sentence contexts. This finding suggests a partial role of lexical tone in constraining spoken-word recognition. However, when embedded in a predictive sentence context, the phonological competitor effect was only observed in the tone-consistent condition and absent in the tone-inconsistent condition. This result indicates that the predictive sentence context can strengthen the role of lexical tone. |
Timothy G. Shepard; Zhong-Lin Lu; Deyue Yu Test-retest reliability of the qReading method in normally sighted young adults Journal Article In: Optometry and Vision Science, vol. 98, no. 8, pp. 936–946, 2021. @article{Shepard2021, SIGNIFICANCE We recently developed a novel Bayesian adaptive method, qReading, to measure reading function. The qReading method has both the efficiency and excellent test-retest reliability in normally sighted young adults to make it an excellent candidate for future studies of its value in diagnosis and longitudinal evaluation of treatment and/or rehabilitation outcomes. PURPOSE A novel Bayesian adaptive method, qReading, was recently developed to measure reading function. Here we performed a systematic assessment of the test-retest reliability of the qReading method. METHODS The variability of five repeated measurements of the reading curve was examined in two settings: within session and between sessions. For the within-session design, we considered two subpopulations: naive observers and experienced observers. All observers were normally sighted young adults. For each set of data, in addition to examining the intrinsic precision of the qReading method (the half width of the credible interval of the posterior distribution of the estimated performance), we computed four metrics to assess repeatability: standard deviation, Bland-Altman coefficient of repeatability, correlation coefficient, and Fractional Rank Precision. RESULTS Extrinsic factors such as observer, time interval between repeated measures, and observer experience all contribute to the variation across measurements. Nevertheless, the four metrics consistently show that the variability across five repeated measurements is small for each set of data. This is true even without taking learning effects into account (standard deviations, ≤0.092 log10 units; Bland-Altman coefficient of repeatability, ≤0.15 (log10)2 units; correlation coefficient, ≥0.91; and Fractional Rank Precision, ≥0.81). CONCLUSIONS The qReading method has excellent test-retest reliability in normally sighted young adults. |
Les Sikos; Katharina Stein; Maria Staudte A rose by any other verb: The effect of expectations and word category on processing effort in situated sentence comprehension Journal Article In: Frontiers in Psychology, vol. 12, pp. 661898, 2021. @article{Sikos2021, Recent work has shown that linguistic and visual contexts jointly modulate linguistic expectancy and, thus, the processing effort for a (more or less) expected critical word. According to these findings, uncertainty about the upcoming referent in a visually-situated sentence can be reduced by exploiting the selectional restrictions of a preceding word (e.g., a verb or an adjective), which then reduces processing effort on the critical word (e.g., a referential noun). Interestingly, however, no such modulation was observed in these studies on the expectation-generating word itself. The goal of the current study is to investigate whether the reduction of uncertainty (i.e., the generation of expectations) simply does not modulate processing effort-or whether the particular subject-verb-object (SVO) sentence structure used in these studies (which emphasizes the referential nature of the noun as direct pointer to visually co-present objects) accounts for the observed pattern. To test these questions, the current design reverses the functional roles of nouns and verbs by using sentence constructions in which the noun reduces uncertainty about upcoming verbs, and the verb provides the disambiguating and reference-resolving piece of information. Experiment 1 (a Visual World Paradigm study) and Experiment 2 (a Grammaticality Maze study) both replicate the effect found in previous work (i.e., the effect of visually-situated context on the word which uniquely identifies the referent), albeit on the verb in the current study. Results on the noun, where uncertainty is reduced and expectations are generated in the current design, were mixed and were most likely influenced by design decisions specific to each experiment. These results show that processing of the reference-resolving word—whether it be a noun or a verb—reliably benefits from the prior linguistic and visual information that lead to the generation of concrete expectations. |
Jack W. Silcox; Brennan R. Payne The costs (and benefits) of effortful listening on context processing: A simultaneous electrophysiology, pupillometry, and behavioral study Journal Article In: Cortex, vol. 142, pp. 296–316, 2021. @article{Silcox2021, There is an apparent disparity between the fields of cognitive audiology and cognitive electrophysiology as to how linguistic context is used when listening to perceptually challenging speech. To gain a clearer picture of how listening effort impacts context use, we conducted a pre-registered study to simultaneously examine electrophysiological, pupillometric, and behavioral responses when listening to sentences varying in contextual constraint and acoustic challenge in the same sample. Participants (N = 44) listened to sentences that were highly constraining and completed with expected or unexpected sentence-final words (“The prisoners were planning their escape/party”) or were low-constraint sentences with unexpected sentence-final words (“All day she thought about the party”). Sentences were presented either in quiet or with +3 dB SNR background noise. Pupillometry and EEG were simultaneously recorded and subsequent sentence recognition and word recall were measured. While the N400 expectancy effect was diminished by noise, suggesting impaired real-time context use, we simultaneously observed a beneficial effect of constraint on subsequent recognition memory for degraded speech. Importantly, analyses of trial-to-trial coupling between pupil dilation and N400 amplitude showed that when participants' showed increased listening effort (i.e., greater pupil dilation), there was a subsequent recovery of the N400 effect, but at the same time, higher effort was related to poorer subsequent sentence recognition and word recall. Collectively, these findings suggest divergent effects of acoustic challenge and listening effort on context use: while noise impairs the rapid use of context to facilitate lexical semantic processing in general, this negative effect is attenuated when listeners show increased effort in response to noise. However, this effort-induced reliance on context for online word processing comes at the cost of poorer subsequent memory. |
Ziming Song; Xiaowei Liang; Yongsheng Wang; Guoli Yan Effect of alternating-color words on oral reading in grades 2–5 Chinese children: Evidence from eye movements Journal Article In: Reading and Writing, vol. 34, no. 10, pp. 2627–2643, 2021. @article{Song2021b, There is no obvious boundary information in Chinese reading. It has been shown that the introduction of word boundary information presented with alternating colors without changing the text distribution could significantly improve the reading speed of Chinese children in grade 2 (Perea and Wang in Mem Cognit 45(7):1160−1170, 2017. https://doi.org/10.3758/s13421-017-0717-0). However, few studies have examined how the effect of word boundary information on children's oral reading develops and changes as children's grade increases. The present study asked Chinese children in grades 2–5 to read alternating-color and mono-color text orally and used eye-tracking technology to explore the developmental trajectory of the influence of word boundary information on oral reading. The results indicated that children in grade 2 and grade 3 showed faster reading speeds in the alternating-color condition than in the mono-color condition. In contrast, there was no difference between the two conditions in children in grade 4 and grade 5. We discuss the mechanisms of the findings and the implications for education. |
Thomas St. Pierre; Elizabeth K. Johnson Looking for wugs in all the right places: Children's use of prepositions in word learning Journal Article In: Cognitive Science, vol. 45, no. 8, pp. e13028, 2021. @article{St.Pierre2021, To help infer the meanings of novel words, children frequently capitalize on their current linguistic knowledge to constrain the hypothesis space. Children's syntactic knowledge of function words has been shown to be especially useful in helping to infer the meanings of novel words, with most previous research focusing on how children use preceding determiners and pronouns/auxiliary to infer whether a novel word refers to an entity or an action, respectively. In the current visual world experiment, we examined whether 28- to 32-month-olds could exploit their lexical semantic knowledge of an additional class of function words—prepositions—to learn novel nouns. During the experiment, children were tested on their ability to use the prepositions in, on, under, and next to to identify novel creatures displayed on a screen (e.g., The wug is on the table), as well as their ability to later identify the creature without accompanying prepositions (e.g., Look at the wug). Children overall demonstrated understanding of all the prepositions but next to and were able to use their knowledge of prepositions to learn the associations between novel words and their intended referents, as shown by greater-than chance looks to the target referent when no prepositional phrase was provided. |
Manuel F. Pulido Individual chunking ability predicts efficient or shallow L2 processing: Eye-tracking evidence from multiword units in relative clauses Journal Article In: Frontiers in Psychology, vol. 11, pp. 607621, 2021. @article{Pulido2021, Behavioral studies on language processing rely on the eye-mind assumption, which states that the time spent looking at text is an index of the time spent processing it. In most cases, relatively shorter reading times are interpreted as evidence of greater processing efficiency. However, previous evidence from L2 research indicates that non-native participants who present fast reading times are not always more efficient readers, but rather shallow parsers. Because earlier studies did not identify a reliable predictor of variability in L2 processing, such uncertainty around the interpretation of reading times introduces a potential confound that undermines the credibility and the conclusions of online measures of processing. The present study proposes that a recently developed modulator of online processing efficiency, namely, chunking ability, may account for the observed variability in L2 online reading performance. L1 English – L2 Spanish learners' eye movements were analyzed during natural reading. Chunking ability was predictive of overall reading speed. Target relative clauses contained L2 Verb-Noun multiword units, which were manipulated with regards to their L1-L2 congruency. The results indicated that processing of the L1-L2 incongruent units was modulated by an interaction of L2 chunking ability and level of knowledge of multiword units. Critically, the data revealed an inverse U-shaped pattern, with faster reading times in both learners with the highest and the lowest chunking ability scores, suggesting fast integration in the former, and lack of integration in the latter. Additionally, the presence of significant differences between conditions was correlated with individual chunking ability. The findings point at chunking ability as a significant modulator of general L2 processing efficiency, and of cross-language differences in particular, and add clarity to the interpretation of variability in the online reading performance of non-native speakers. |
Christina Ralph-Nearman; Madison A. Hooper; Ruth Filik In: Cognition and Emotion, vol. 35, no. 8, pp. 1543–1558, 2021. @article{RalphNearman2021, Eating disorder prevalence is increasing in males, perhaps more rapidly than in females. Theorists have proposed that cognitive biases are important factors underpinning disordered eating, especially those related to food, body, and perfectionism. We investigated these factors in relation to males' eating disorder symptomatology in the general population by using eye-tracking during reading as a novel and implicit measure. 180 males' eye movements were monitored while they read scenarios (third-person in Experiment 1 (n = 90, 18-38(Mage = 21.50 |
Theresa Redl; Stefan L. Frank; Peter Swart; Helen Hoop The male bias of a generically-intended masculine pronoun: Evidence from eye-tracking and sentence evaluation Journal Article In: PLoS ONE, vol. 16, no. 4, pp. e0249309, 2021. @article{Redl2021, Two experiments tested whether the Dutch possessive pronoun zijn ‘his' gives rise to a gender inference and thus causes a male bias when used generically in sentences such as Everyone was putting on his shoes. Experiment 1 (N = 120, 48 male) was a conceptual replication of a previous eye-tracking study that had not found evidence of a male bias. The results of the current eye-tracking experiment showed the generically-intended masculine pronoun to trigger a gender inference and cause a male bias, but for male participants and in stereotypically neutral stereotype contexts only. No evidence for a male bias was thus found in stereotypically female and male context nor for female participants altogether. Experiment 2 (N = 80, 40 male) used the same stimuli as Experiment 1, but employed the sentence evaluation paradigm. No evidence of a male bias was found in Experiment 2. Taken together, the results suggest that the generically-intended masculine pronoun zijn ‘his' can cause a male bias for male participants even when the referents are previously introduced by inclusive and grammatically gender-unmarked iedereen ‘everyone'. This male bias surfaces with eye-tracking, which taps directly into early language processing, but not in offline sentence evaluations. Furthermore, the results suggest that the intended generic reading of the masculine possessive pronoun zijn ‘his' is more readily available for women than for men. |
Gwendolyn Rehrig; Reese A. Cullimore; John M. Henderson; Fernanda Ferreira When more is more: Redundant modifiers can facilitate visual search Journal Article In: Cognitive Research: Principles and Implications, vol. 6, no. 10, pp. 1–20, 2021. @article{Rehrig2021, Abstract: According to the Gricean Maxim of Quantity, speakers provide the amount of information listeners require to correctly interpret an utterance, and no more (Grice in Logic and conversation, 1975). However, speakers do tend to violate the Maxim of Quantity often, especially when the redundant information improves reference precision (Degen et al. in Psychol Rev 127(4):591–621, 2020). Redundant (non-contrastive) information may facilitate real-world search if it narrows the spatial scope under consideration, or improves target template specificity. The current study investigated whether non-contrastive modifiers that improve reference precision facilitate visual search in real-world scenes. In two visual search experiments, we compared search performance when perceptually relevant, but non-contrastive modifiers were included in the search instruction. Participants (NExp. 1 = 48, NExp. 2 = 48) searched for a unique target object following a search instruction that contained either no modifier, a location modifier (Experiment 1: on the top left, Experiment 2: on the shelf), or a color modifier (the black lamp). In Experiment 1 only, the target was located faster when the verbal instruction included either modifier, and there was an overall benefit of color modifiers in a combined analysis for scenes and conditions common to both experiments. The results suggest that violations of the Maxim of Quantity can facilitate search when the violations include task-relevant information that either augments the target template or constrains the search space, and when at least one modifier provides a highly reliable cue. Consistent with Degen et al. (2020), we conclude that listeners benefit from non-contrastive information that improves reference precision, and engage in rational reference comprehension. Significance statement: This study investigated whether providing more information than someone needs to find an object in a photograph helps them to find that object more easily, even though it means they need to interpret a more complicated sentence. Before searching a scene, participants were either given information about where the object would be located in the scene, what color the object was, or were only told what object to search for. The results showed that providing additional information helped participants locate an object in an image more easily only when at least one piece of information communicated what part of the scene the object was in, which suggests that more information can be beneficial as long as that information is specific and helps the recipient achieve a goal. We conclude that people will pay attention to redundant information when it supports their task. In practice, our results suggest that instructions in other contexts (e.g., real-world navigation, using a smartphone app, prescription instructions, etc.) can benefit from the inclusion of what appears to be redundant information. |
Tracy Reuter; Kavindya Dalawella; Casey Lew-williams Adults and children predict in complex and variable referential contexts Journal Article In: Language, Cognition and Neuroscience, vol. 36, no. 4, pp. 474–490, 2021. @article{Reuter2021a, Prior research suggests that prediction supports language processing and learning. However, the ecological validity of such findings is unclear because experiments usually include constrained stimuli. While theoretically suggestive, previous conclusions will be largely irrelevant if listeners cannot generate predictions in response to complex and variable perceptual input. Taking a step toward addressing this limitation, three eye-tracking experiments evaluated how adults (N = 72) and 4- and 5-year-old children (N = 72) generated predictions in contexts with complex visual stimuli (Experiment 1), variable speech stimuli (Experiment 2), and both concurrently (Experiment 3). Results indicated that listeners generated predictions in contexts with complex visual stimuli or variable speech stimuli. When both were more naturalistic, listeners used informative verbs to generate predictions, but not adjectives or number markings. This investigation provides a test for theories claiming that prediction is a central learning mechanism, and calls for further evaluations of prediction in naturalistic settings. |
Samy Rima; Michael C. Schmid Reading specific small saccades predict individual phonemic awareness and reading speed Journal Article In: Frontiers in Neuroscience, vol. 15, pp. 663242, 2021. @article{Rima2021, Small fixational eye-movements are a fundamental aspect of vision and thought to reflect fine shifts in covert attention during active viewing. While the perceptual benefits of these small eye movements have been demonstrated during a wide range of experimental tasks including during free viewing, their function during reading remains surprisingly unclear. Previous research demonstrated that readers with increased microsaccade rates displayed longer reading speeds. To what extent increased fixational eye movements are, however, specific to reading and might be indicative of reading skill deficits remains, however, unknown. To address this topic, we compared the eye movement scan paths of 13 neurotypical individuals and 13 subjects diagnosed with developmental dyslexia during short story reading and free viewing of natural scenes. We found that during reading only, dyslexics tended to display small eye movements more frequently compared to neurotypicals, though this effect was not significant at the population level, as it could also occur in slow readers not diagnosed as dyslexics. In line with previous research, neurotypical readers had twice as many regressive compared to progressive microsaccades, which did not occur during free viewing. In contrast, dyslexics showed similar amounts of regressive and progressive small fixational eye movements during both reading and free viewing. We also found that participants with smaller fixational saccades from both neurotypical and dyslexic samples displayed reduced reading speeds and lower scores during independent tests of reading skill. Slower readers also displayed greater variability in the landing points and temporal occurrence of their fixational saccades. Both the rate and spatio-temporal variability of fixational saccades were associated with lower phonemic awareness scores. As none of the observed differences between dyslexics and neurotypical readers occurred during control experiments with free viewing, the reported effects appear to be directly related to reading. In summary, our results highlight the predictive value of small saccades for reading skill, but not necessarily for developmental dyslexia. |
Bojana Ristic; Simona Mancini; Nicola Molinaro; Adrian Staub Maintenance cost in the processing of subject–verb dependencies Journal Article In: Journal of Experimental Psychology: Learning, Memory, and Cognition, pp. 1–31, 2021. @article{Ristic2021, Although research in sentence comprehension has suggested that processing long-distance dependencies involves maintenance between the elements that form the dependency, studies on maintenance of long-distance subject–verb (SV) dependencies are scarce. The few relevant studies have delivered mixed results using self-paced reading or phoneme-monitoring tasks. In the current study, we used eye tracking during reading to test whether maintaining a long-distance SV dependency results in a processing cost on an intervening adverbial clause. In Experiment 1, we studied this question in Spanish and found that both go-past reading times and regressions out of an adverbial clause to the previous regions were significantly increased when the clause interrupts a SV dependency compared to when the same clause doesn't interrupt this dependency. We then replicated these findings in English (Experiment 2), observing significantly increased go-past reading times on a clause interrupting a SV dependency. The current study provides the first eye-tracking data showing a maintenance cost in the processing of SV dependencies cross-linguistically. Sentence comprehension models should account for the maintenance cost generated by SV dependency processing, and future research should focus on the nature of the maintained representation. (PsycInfo Database Record (c) 2021 APA, all rights reserved) |
Miriam Rivero-Contreras; Paul E. Engelhardt; David Saldaña An experimental eye-tracking study of text adaptation for readers with dyslexia: Effects of visual support and word frequency Journal Article In: Annals of Dyslexia, vol. 71, no. 1, pp. 170–187, 2021. @article{RiveroContreras2021, Easy-to-read guidelines recommend visual support and lexical simplification to facilitate text processing, but few empirical studies confirm a positive effect from these recommendations in individuals with dyslexia. This study examined the influence of the visual support and lexical simplification on sentence processing through eye movements at both the text- and word-level, and the differences between readers with and without dyslexia. Furthermore, we explored the influence of reading experience and vocabulary, as control variables. We tested 20 young adults with dyslexia and 20 chronological age-matched controls. Participants read 60 sentences in total. Half the sentences contained an image and the other half did not, and half contained a low-frequency word and half a high-frequency word. Results showed that visual support and lexical simplification facilitated sentence processing, potentially by jointly facilitating lexical semantic access. We also found that participants with lower print exposure and lower vocabulary benefited more from word-level lexical simplification. We conclude that both adaptations could benefit readers with low print exposure and smaller vocabularies, and therefore, to many dyslexic readers who show these characteristics. |
John-Ross Rizzo; Todd E. Hudson; John Martone; Weiwei Dai; Oluchi Ihionu; Yash Chaudhry; Ivan Selesnick; Laura J. Balcer; Steven L. Galetta; Janet C. Rucker How sandbag-able are concussion sideline assessments? A close look at eye movements to uncover strategies Journal Article In: Brain Injury, vol. 35, no. 4, pp. 426–435, 2021. @article{Rizzo2021, Background: Sideline diagnostic tests for concussion are vulnerable to volitional poor performance (“sandbagging”) on baseline assessments, motivated by desire to subvert concussion detection and potential removal from play. We investigated eye movements during sandbagging versus best effort on the King-Devick (KD) test, a rapid automatized naming (RAN) task. Methods: Participants performed KD testing during oculography following instructions to sandbag or give best effort. Results: Twenty healthy participants without concussion history were included (mean age 27 ± 8 years). Sandbagging resulted in longer test times (89.6 ± 39.2 s vs 48.2 ± 8.5 s, p < .001), longer inter-saccadic intervals (459.5 ± 125.4 ms vs 311.2 ± 79.1 ms, p < .001) and greater numbers of saccades (171.4 ± 47 vs 138 ± 24.2, p < .001) and reverse saccades (wrong direction for reading) (21.2% vs 11.3%, p < .001). Sandbagging was detectable using a logistic model with KD times as the only predictor, though more robustly detectable using eye movement metrics. Conclusions: KD sandbagging results in eye movement differences that are detectable by eye movement recordings and suggest an invalid test score. Objective eye movement recording during the KD test shows promise for distinguishing between best effort and post-injury performance, as well as for identifying sandbagging red flags. |
Jennifer M. Roche; Arkady Zgonnikov; Laura M. Morett; Stephen M. Camarata; Susan Nittrouer Cognitive processing of miscommunication in interactive listening: An evaluation of listener indecision and cognitive effort Journal Article In: Journal of Speech, Language, and Hearing Research, vol. 64, no. 1, pp. 159–175, 2021. @article{Roche2021, Purpose: The purpose of the current study was to evaluate the social and cognitive underpinnings of miscommunication during an interactive listening task. Method: An eye and computer mouse-tracking visualworld paradigm was used to investigate how a listener's cognitive effort (local and global) and decision-making processes were affected by a speaker's use of ambiguity that led to a miscommunication. Results: Experiments 1 and 2 found that an environmental cue that made a miscommunication more or less salient impacted listener language processing effort (eye-tracking). Experiment 2 also indicated that listeners may develop different processing heuristics dependent upon the speaker's use of ambiguity that led to a miscommunication, exerting a significant impact on cognition and decision making. We also found that perspective-taking effort and decision-making complexity metrics (computer mouse tracking) predict language processing effort, indicating that instances of miscommunication produced cognitive consequences of indecision, thinking, and cognitive pull. Conclusion: Together, these results indicate that listeners behave both reciprocally and adaptively when miscommunications occur, but the way they respond is largely dependent upon the type of ambiguity and how often it is produced by the speaker. |
Douglas Roland; Gail Mauner; Yuki Hirose The processing of pronominal relative clauses: Evidence from eye movements Journal Article In: Journal of Memory and Language, vol. 119, pp. 104244, 2021. @article{Roland2021, Relative clauses have played a key role in distinguishing between different theories of language comprehension. A reversal in processing costs between full NP and pronominal relative clauses reported by Reali and Christiansen (2007) has been used to argue for expectation-based theories of comprehension (e.g., Hale, 2001; Levy, 2008), and against memory-based theories of comprehension (e.g., Gibson, 1998, 2000; Gordon, Hendrick, & Johnson, 2001; Lewis, Vasishth, & Van Dyke, 2006). We present results relying on eye-movements during reading, in conjunction with modeling of differences between self-paced reading and eye movement data, to argue that the results observed by Reali and Christiansen and others are due to the self-paced reading paradigm, and do not reflect an actual reversal in processing costs. Overall, our results suggest that a combination of memory-based factors and spillover explains the pattern of reading times observed in various relative clause experiments such as those in Reali and Christiansen (2007), and that while comprehenders' expectations undeniably play a role in language comprehension, the role may be less dramatic than is suggested by previous studies. |
Camilo R. Ronderos; Ernesto Guerra; Pia Knoeferle The role of literal features during processing of novel verbal metaphors Journal Article In: Frontiers in Psychology, vol. 11, pp. 556624, 2021. @article{Ronderos2021, When a word is used metaphorically (for example “walrus” in the sentence “The president is a walrus”), some features of that word's meaning (“very fat,” “slow-moving”) are carried across to the metaphoric interpretation while other features (“has large tusks,” “lives near the north pole”) are not. What happens to these features that relate only to the literal meaning during processing of novel metaphors? In four experiments, the present study examined the role of the feature of physical containment during processing of verbs of physical containment. That feature is used metaphorically to signify difficulty, such as “fenced in” in the sentence “the journalist's opinion was fenced in after the change in regime.” Results of a lexical decision task showed that video clips displaying a ball being trapped by a box facilitated comprehension of verbs of physical containment when the words were presented in isolation. However, when the verbs were embedded in sentences that rendered their interpretation metaphorical in a novel way, no such facilitation was found, as evidenced by two eye-tracking reading studies. We interpret this as suggesting that features that are critical for understanding the encoded meaning of verbs but are not part of the novel metaphoric interpretation are ignored during the construction of metaphorical meaning. Results and limitations of the paradigm are discussed in relation to previous findings in the literature both on metaphor comprehension and on the interaction between language comprehension and the visual world. |
Mikael Rubin; Nilavra Bhattacharya; Jacek Gwizdka; Zenzi Griffin; Michael Telch The influence of PTSD symptoms on selective visual attention while reading Journal Article In: Cognition and Emotion, pp. 1–8, 2021. @article{Rubin2021, A large body of research has provided evidence that Posttraumatic Stress Disorder (PTSD) symptoms are associated with broad changes in attentional processes which are in turn implicated in core facets of emotion regulation. However, prior research has primarily focused on specific task-based evaluations of attention. In the current study, we evaluated eye movement behaviour among adults that endorsed a traumatic event meeting Criterion A and were experiencing a range of PTSD symptoms (N= 55) while they read short trauma-related or neutral passages. We found evidence that PTSD symptoms were associated with a small difference in attentional processes between the two types of passages, with longer first fixations to words in trauma-related passages b = 1.92, 95% CI [0.31, 3.56]. Moreover, within the trauma-related texts we found that greater PTSD symptoms were associated with longer total fixation times b = 9.53, 95% CI [2.20, 16.83] and a greater number of regressions b = 0.07, 95% CI [0.01,0.13] to trauma-related words. Inclusion of an additional 25 participants not endorsing a trauma that met Criterion A did not influence the results in any meaningful way. For the first time, we provide evidence that PTSD symptoms are linked to bias for trauma-related information during a naturalistic, everyday activity – reading. |
Danila Rusich; Lisa S. Arduino; Marika Mauti; Marialuisa Martelli; Silvia Primativo Evidence of semantic processing in parafoveal reading: A rapid parallel visual presentation (Rpvp) study Journal Article In: Brain Sciences, vol. 11, pp. 28, 2021. @article{Rusich2021, This study explores whether semantic processing in parafoveal reading in the Italian language is modulated by the perceptual and lexical features of stimuli by analyzing the results of the rapid parallel visual presentation (RPVP) paradigm experiment, which simultaneously presented two words, with one in the fovea and one in the parafovea. The words were randomly sampled from a set of semantically related and semantically unrelated pairs. The accuracy and reaction times in reading the words were measured as a function of the stimulus length and written word frequency. Fewer errors were observed in reading parafoveal words when they were semantically related to the foveal ones, and a larger semantic facilitatory effect was observed when the foveal word was highly frequent and the parafoveal word was short. Analysis of the reaction times suggests that the semantic relation between the two words sped up the naming of the foveal word when both words were short and highly frequent. Altogether, these results add further evidence in favor of the semantic processing of words in the parafovea during reading, modulated by the orthographic and lexical features of the stimuli. The results are discussed within the context of the most prominent models of word processing and eye movement controls in reading. |
Anthony J. Ryals; Megan E. Kelly; Anne M. Cleary Increased pupil dilation during tip-of-the-tongue states Journal Article In: Consciousness and Cognition, vol. 92, pp. 103152, 2021. @article{Ryals2021, Tip-of-the-tongue states (TOTs) are feelings of impending word retrieval success during a current failure to retrieve a target word. Though much is known and understood about TOT states from decades of research, research on potential psychophysiological correlates of the TOT state is still in its infancy, and existing studies point toward the involvement of neural processes that are associated with enhanced attention, motivation, and information-seeking. In the present study, we demonstrate that, during instances of target retrieval failure, TOT states are associated with greater pupillary dilation (i.e., autonomic arousal) in 91% of our sample. This is the first study to demonstrate a pupillometric correlate of the TOT experience, and this finding provides an important step toward understanding emotional attributes associated with TOT states. Mean pupil dilation also increased such that instances of target identification failure that were unaccompanied by TOT states < instances in which TOTs occurred < instances of target identification success. It is possible that TOTs reflect an intermediary state between complete target retrieval failure and full target retrieval. |
Cailey A. Salagovic; Carly J. Leonard A nonspatial sound modulates processing of visual distractors in a flanker task Journal Article In: Attention, Perception, and Psychophysics, vol. 83, no. 2, pp. 800–809, 2021. @article{Salagovic2021, Successful navigation of information-rich, multimodal environments involves processing both auditory and visual information. The extent to which information within each modality is processed varies because of many factors, but the influence of auditory stimuli on the processing of visual stimuli in these multimodal environments is not well understood. Previous research has shown that a preceding sound leads to decreased reaction times in visual tasks (Bertelson, Quarterly Journal of Experimental Psychology 19(3), 272–279, 1967). The current study examines whether a nonspatial, task-irrelevant sound additionally alters processing of visual distractors that flank a central target. We used a version of a flanker task in which participants responded to a central letter surrounded by two irrelevant flanker letters. When these flankers are associated with a conflicting response, a congruency effect occurs such that reaction time to the target is slowed (Eriksen & Eriksen, Perception & Psychophysics, 16(1), 143–149, 1974). In two experiments using this task, results showed that a preceding tone caused general speeding of reaction time across flanker types, consistent with alerting. The tone also caused decreased variation in response time. Critically, the tone modulated the congruency effect, with a greater speeding for congruent flankers than for incongruent flankers. This suggests that the influence of flanker identity was more intense after tone presentation, consistent with a nonspatial sound increasing perceptual and/or response-association processing of flanking stimuli. |
2020 |
Rishi Rajalingham; Kohitij Kar; Sachi Sanghavi; Stanislas Dehaene; James J. DiCarlo The inferior temporal cortex is a potential cortical precursor of orthographic processing in untrained monkeys Journal Article In: Nature Communications, vol. 11, pp. 3886, 2020. @article{Rajalingham2020, The ability to recognize written letter strings is foundational to human reading, but the underlying neuronal mechanisms remain largely unknown. Recent behavioral research in baboons suggests that non-human primates may provide an opportunity to investigate this question. We recorded the activity of hundreds of neurons in V4 and the inferior temporal cortex (IT) while naïve macaque monkeys passively viewed images of letters, English words and non-word strings, and tested the capacity of those neuronal representations to support a battery of orthographic processing tasks. We found that simple linear read-outs of IT (but not V4) population responses achieved high performance on all tested tasks, even matching the performance and error patterns of baboons on word classification. These results show that the IT cortex of untrained primates can serve as a precursor of orthographic processing, suggesting that the acquisition of reading in humans relies on the recycling of a brain network evolved for other visual functions. |
Anne Pycha Differences in perception and memory for speech fragments in complex versus simple words Journal Article In: The Mental Lexicon, vol. 15, no. 2, pp. 189–222, 2020. @article{Pycha2020, Two experiments investigated how people perceived and remembered fragments of spoken words that either corresponded to correct lexical entries (as in the complex word drink-er ) or did not (as in the simple word glitt-er ). Experiment 1 was a noise-rating task that probed perception. Participants heard stimuli such drink er , where strikethrough indicates noise overlaid at a controlled signal-to-noise ratio, and rated the loudness of the noise. Results showed that participants rated noise on certain pseudo-roots (e.g., glitt er ) as louder than noise on true roots ( drink er ), indicating that they perceived them with less clarity. Experiment 2 was an eye-fixation task that probed memory. Participants heard a word such as drink-er while associating each fragment with a visual shape. At test, they saw the shapes again, and were asked to look at the shape associated with a particular fragment, such as drink . Results showed that fixations to shapes associated with pseudo-affixes ( -er in glitter ) were less accurate than fixations to shapes associated with true affixes ( -er in drinker ), which suggests that they remembered the pseudo-affixes more poorly. These findings provide evidence that the presence of correct lexical entries for roots and affixes modulates people's judgments about the speech that they hear. |
Mengsheng Qian; Ningjun Xu Research on the cognitive effort of sight-interpreting complex English sentences into Chinese: Evidence from eye tracking Journal Article In: International Journal of Applied Linguistics and Translation, vol. 6, no. 4, pp. 116–123, 2020. @article{Qian2020, It is widely known that sight-interpreting, one of the typical forms of conference interpreting, requires the interpreters to exert great effort in transforming one language into another. Due to the difference between Chinese and English, some sentence structures such as relative clauses prove to be even more difficult to render. Some experienced interpreters are able to do such strenuous task with ease. Uncovering what is going on during information processing is enlightening in that it would shed light on how human brain uses certain types of mechanism to process information, which is conducive to the artificial intelligence. Eye-tracking experiment is designed, 31 subjects are recruited with an average age of 22 and comparable linguistic competence to participate in a 40-50 min experiment, during which each subject is required to sight-interpret the self-designed, expert-proven sentences which differ only in the role of the relative pronoun in the relative clauses. Data analysis clearly indicates that the cognitive effort of processing complex sentences as evidenced by two types of relative clauses (one is called OR because the relative pronouns function as object in the relative clause, the other SB because the relative pronouns function as subject in the relative clause) are different, the former requiring more cognitive effort than the latter, as shown in several key eye-movement measures such as regression-in, regression-out, first fixation duration, gaze duration, regression duration, and total reading duration. These differences are statistically significant within the AOIs such as the antecedent, relative clause. The finding further substantiates the hypothesis that sight-interpreting is more strenuous and thus requires more cognitive effort than the common readers. Besides, different structure of the relative clauses also plays a role in consuming the cognitive effort of the interpreters. However, it remains unclear whether the length of the relative clause plays a decisive role in influencing the cognition of whole sentence while sight-interpreting. Besides, whether the research results are applicable to other types of complex structure remain unanswered. More data should be collected to incorporate more complex structure in order to uncover the possible cognitive effort during sight-interpreting. WABBLE: |
Jamie Reilly; Bonnie Zuckerman; Alexandra Kelly; Maurice Flurie; Sagar Rao Neuromodulation of cursing in American English: A combined tDCS and pupillometry study Journal Article In: Brain and Language, vol. 206, pp. 1–8, 2020. @article{Reilly2020, Many neurological disorders are associated with excessive and/or uncontrolled cursing. The right prefrontal cortex has long been implicated in a diverse range of cognitive processes that underlie the propensity for cursing, including non-propositional language representation, emotion regulation, theory of mind, and affective arousal. Neurogenic cursing often poses significant negative social consequences, and there is no known behavioral intervention for this communicative disorder. We examined whether right vs. left lateralized prefrontal neurostimultion via tDCS could modulate taboo word production in neurotypical adults. We employed a pre/post design with a bilateral frontal electrode montage. Half the participants received left anodal and right cathodal stimulation; the remainder received the opposite polarity stimulation at the same anatomical loci. We employed physiological (pupillometry) and behavioral (reaction time) dependent measures as participants read aloud taboo and non-taboo words. Pupillary responses demonstrated a crossover reaction, suggestive of modulation of phasic arousal during cursing. Participants in the right anodal condition showed elevated pupil responses for taboo words post stimulation. In contrast, participants in the right cathodal condition showed relative dampening of pupil responses for taboo words post stimulation. We observed no effects of stimulation on response times. We interpret these findings as supporting modulation of right hemisphere affective arousal that disproportionately impacts taboo word processing. We discuss alternate accounts of the data and future applications to neurological disorders. |
Johannes Rennig; Kira Wegner-Clemens; Michael S. Beauchamp Face viewing behavior predicts multisensory gain during speech perception Journal Article In: Psychonomic Bulletin & Review, vol. 27, no. 1, pp. 70–77, 2020. @article{Rennig2020, Visual information from the face of an interlocutor complements auditory information from their voice, enhancing intelligibility. However, there are large individual differences in the ability to comprehend noisy audiovisual speech. Another axis of individual variability is the extent to which humans fixate the mouth or the eyes of a viewed face. We speculated that across a lifetime of face viewing, individuals who prefer to fixate the mouth of a viewed face might accumulate stronger associations between visual and auditory speech, resulting in improved comprehension of noisy audiovisual speech. To test this idea, we assessed interindividual variability in two tasks. Participants (n = 102) varied greatly in their ability to understand noisy audiovisual sentences (accuracy from 2–58%) and in the time they spent fixating the mouth of a talker enunciating clear audiovisual syllables (3–98% of total time). These two variables were positively correlated: a 10% increase in time spent fixating the mouth equated to a 5.6% increase in multisensory gain. This finding demonstrates an unexpected link, mediated by histories of visual exposure, between two fundamental human abilities: processing faces and understanding speech. |
Samy Rima; Grace Kerbyson; Elizabeth Jones; Michael C. Schmid Advantage of detecting visual events in the right hemifield is affected by reading skill Journal Article In: Vision Research, vol. 169, pp. 41–48, 2020. @article{Rima2020, Visual perception is often not homogenous across the visual field and can vary depending on situational demands. The reasons behind this inhomogeneity are not clear. Here we show that directing attention that is consistent with a western reading habit from left to right, results in a ~32% higher sensitivity to detect transient visual events in the right hemifield. This right visual field advantage was largely reduced in individuals with reading difficulties from developmental dyslexia. Similarly, visual detection became more symmetric in skilled readers, when attention was guided opposite to the reading pattern. Taken together, these findings highlight a higher sensitivity in the right visual field for detecting the onset of sudden visual events that is well accounted for by left hemisphere dominated reading habit. |
Christopher M. Robus; Christopher J. Hand; Ruth Filik; Melanie Pitchford Investigating effects of emoji on neutral narrative text: Evidence from eye movements and perceived emotional valence Journal Article In: Computers in Human Behavior, vol. 109, pp. 1–11, 2020. @article{Robus2020, Digital images of faces such as emoji in virtual communication have become increasingly popular, but current research findings are inconsistent regarding their emotional effects on perceptions of text. Similarly, emoji effects on reading behaviours are largely unknown and require further examination. The present study (N = 41) investigated how the position and emotional valence of emoji in neutral narrative sentences influenced eye movements during reading and perceptions of sentence valence. Participants read neutral narrative sentences containing smiling or frowning emoji in sentence-initial or sentence-final positions and rated the perceived emotional valence of the sentence. Results from linear mixed-effects models demonstrated significantly longer fixations on sentence-final emoji and longer sentence reading times when emoji were in sentence-final positions. These findings are comparable to sentence ‘wrap-up' effects witnessed in the processing of lexical units during sentence reading, providing new evidence towards the way readers integrate emoji into contextual processing. However, no impact of emoji valence or position on first-pass target word processing or sentence-valence ratings were found. This would refute previous suggestions that digital faces influence text valence, raising questions about reader preference for emoji or sentence sentiment, the influence of sentence formatting, and delivery/display mechanism on these effects. |
Andre Roelke; Christian Vorstius; Ralph Radach; Markus J. Hofmann Fixation-related NIRS indexes retinotopic occipital processing of parafoveal preview during natural reading Journal Article In: NeuroImage, vol. 215, pp. 116823, 2020. @article{Roelke2020, While word frequency and predictability effects have been examined extensively, any evidence on interactive effects as well as parafoveal influences during whole sentence reading remains inconsistent and elusive. Novel neuroimaging methods utilize eye movement data to account for the hemodynamic responses of very short events such as fixations during natural reading. In this study, we used the rapid sampling frequency of near-infrared spectroscopy (NIRS) to investigate neural responses in the occipital and orbitofrontal cortex to word frequency and predictability. We observed increased activation in the right ventral occipital cortex when the fixated word N was of low frequency, which we attribute to an enhanced cost during saccade planning. Importantly, unpredictable (in contrast to predictable) low frequency words increased the activity in the left dorsal occipital cortex at the fixation of the preceding word N-1, presumably due to an upcoming breach of top-down modulated expectation. Opposite to studies that utilized a serial presentation of words (e.g. Hofmann et al., 2014), we did not find such an interaction in the orbitofrontal cortex, implying that top-down timing of cognitive subprocesses is not required during natural reading. We discuss the implications of an interactive parafoveal-on-foveal effect for current models of eye movements. |
Francesco Ruotolo; Solène Kalénine; Angela Bartolo Activation of manipulation and function knowledge during visual search for objects Journal Article In: Journal of Experimental Psychology: Human Perception and Performance, vol. 46, no. 1, pp. 66–90, 2020. @article{Ruotolo2020, This study aimed at comparing the time course of the activation of function and manipulation knowledge during object identification. The influence of visual similarity and context information was also assessed. In 3 eye-tracking experiments, conducted with the Visual-World-Paradigm, participants heard the name of an object and had to identify it among four pictures. The target object (e.g., shopping cart) could be presented along with objects related by (a) function (e.g., basket), (b) manipulation (e.g., lawnmower), (c) context (e.g., cash register), (d) visual similarity (e.g., toaster), and (e) completely unrelated objects. Growth curve analyses were used to assess competition effects among semantically (a, b, and c), visually related (d), and unrelated competitors (e). Results showed that manipulation- and function-related, but not context-related objects received more fixations than the unrelated ones, with a temporal advantage for the manipulation-related objects (Experiment 1). However, the visually similar objects faded the semantic competition effects, especially for function-related objects (Experiment 2). Finally, no temporal differences appeared when manipulation- and function-related objects were shown within the same visual array (Experiment 3). These results support the idea that both function and manipulation are relevant features of object semantic representations, but in the absence of other semantic competitors the activation of manipulation features appears prioritized during object identification. |
Edin Šabić; Daniel Henning; Hunter Myüz; Audrey Morrow; Michael C. Hout; Justin A. MacDonald Examining the role of eye movements during conversational listening in noise Journal Article In: Frontiers in Psychology, vol. 11, pp. 200, 2020. @article{Sabic2020, Speech comprehension is often thought of as an entirely auditory process, but both normal hearing and hearing-impaired individuals sometimes use visual attention to disambiguate speech, particularly when it is difficult to hear. Many studies have investigated how visual attention (or the lack thereof) impacts the perception of simple speech sounds such as isolated consonants, but there is a gap in the literature concerning visual attention during natural speech comprehension. This issue needs to be addressed, as individuals process sounds and words in everyday speech differently than when they are separated into individual elements with no competing sound sources or noise. Moreover, further research is needed to explore patterns of eye movements during speech comprehension-especially in the presence of noise-as such an investigation would allow us to better understand how people strategically use visual information while processing speech. To this end, we conducted an experiment to track eye-gaze behavior during a series of listening tasks as a function of the number of speakers, background noise intensity, and the presence or absence of simulated hearing impairment. Our specific aims were to discover how individuals might adapt their oculomotor behavior to compensate for the difficulty of the listening scenario, such as when listening in noisy environments or experiencing simulated hearing loss. Speech comprehension difficulty was manipulated by simulating hearing loss and varying background noise intensity. Results showed that eye movements were affected by the number of speakers, simulated hearing impairment, and the presence of noise. Further, findings showed that differing levels of signal-to-noise ratio (SNR) led to changes in eye-gaze behavior. Most notably, we found that the addition of visual information (i.e., videos vs. auditory information only) led to enhanced speech comprehension-highlighting the strategic usage of visual information during this process. |
Anna A. Kosovicheva; Peter J. Bex What color was it? A psychophysical paradigm for tracking subjective progress in continuous tasks Journal Article In: Perception, vol. 49, no. 1, pp. 21–38, 2020. @article{Kosovicheva2020, When making a sequence of fixations, how does the timing of visual experience compare with the timing of fixation onsets? Previous studies have tracked shifts of attention or perceived gaze direction using self-report methods. We used a similar method, a dynamic color technique, to measure subjective timing in continuous tasks involving fixation sequences. Does the time that observers report reading a word coincide with their fixation on it, or is there an asynchrony, and does this relationship depend on the observer's task? Observers read sentences that continuously changed in hue and identified the color of a word at the time that they read it using a color palette. We compared responses with a nonreading condition, where observers reproduced their fixations, but viewed nonword stimuli. Results showed a delay between the color of stimuli at fixation onset and the reported color during perception. For nonword tasks, the delay was constant. However, in the reading task, the delay was larger for earlier compared with later words in the sentence. Our results offer a new method for measuring awareness or subjective progress within fixation sequences, which can be extended to other continuous tasks. |
Anuenue Kukona Lexical constraints on the prediction of form: Insights from the visual world paradigm Journal Article In: Journal of Experimental Psychology: Learning, Memory, and Cognition, vol. 46, no. 11, pp. 2153–2162, 2020. @article{Kukona2020, Two visual world experiments investigated the priming of form (e.g., phonology) during language processing. In Experiment 1, participants heard high cloze probability sentences like "In order to have a closer look, the dentist asked the man to open his . . ." while viewing visual arrays with objects like a predictable target mouth, phonological competitor mouse, and unrelated distractors. In Experiment 2, participants heard target-associated nouns like "dentist" that were isolated from the sentences in Experiment 1 while viewing the same visual arrays. In both experiments, participants fixated the target (e.g., mouth) most, but also fixated the phonological competitor (e.g., mouse) more than unrelated distractors. Taken together, these results are interpreted as supporting association-based mechanisms in prediction, such that activation spreads across both semantics and form within the mental lexicon (e.g., dentist-mouth-mouse) and likewise primes (i.e., preactivates) the form of upcoming words during sentence processing. |
Alper Kumcu; Robin L. Thompson Less imageable words lead to more looks to blank locations during memory retrieval Journal Article In: Psychological Research, vol. 84, no. 3, pp. 667–684, 2020. @article{Kumcu2020, People revisit spatial locations of visually encoded information when they are asked to retrieve that information, even when the visual image is no longer present. Such “looking at nothing” during retrieval is likely modulated by memory load (i.e., mental effort to maintain and reconstruct information) and the strength of mental representations. We investigated whether words that are more difficult to remember also lead to more looks to relevant, blank locations. Participants were presented four nouns on a two by two grid. A number of lexico-semantic variables were controlled to form high-difficulty and low-difficulty noun sets. Results reveal more frequent looks to blank locations during retrieval of high-difficulty nouns compared to low-difficulty ones. Mixed-effects modelling demonstrates that imagery-related semantic factors (imageability and concreteness) predict looking at nothing during retrieval. Results provide the first direct evidence that looking at nothing is modulated by word difficulty and in particular, word imageability. Overall, the research provides substantial support to the integrated memory account for linguistic stimuli and looking at nothing as a form of mental imagery. |
Victor Kuperman; Avital Deutsch Morphological and visual cues in compound word reading: Eye-tracking evidence from Hebrew Journal Article In: Quarterly Journal of Experimental Psychology, vol. 73, no. 12, pp. 2177–2187, 2020. @article{Kuperman2020, Hebrew noun–noun compounds offer a valuable opportunity to study the long-standing question of how morphologically complex words are processed during reading. Specifically, in some morpho-syntactic environments, the first (head) noun of a compound carries a suffix—a clear orthographic marker of being part of a compound—whereas in others it is homographic with a stand-alone noun. In addition to this morphological cue, Hebrew occasionally employs hyphenation as a visual signal that two nouns, which are typically separated by a space, are combined in a compound. In a factorial design, we orthogonally manipulated the morphological and the visual cues and recorded eye movements of 75 proficient Hebrew readers while they read sentences with embedded compounds. The effect of hyphenation on reading times was inhibitory. This slow-down was significantly weaker in compounds where the syntactic relation between constituents was overtly marked by a suffix compared with compounds without a morphological marker. We interpret these findings as evidence that hyphenation is largely a redundant cue but morphological markers of compounding are psychologically valid cues for semantic integration of compounds. We discuss the implications of this finding for accounts of morphological processing. |
Marianna Kyriacou; Kathy Conklin; Dominic Thompson Passivizability of idioms: Has the wrong tree been barked up? Journal Article In: Language and Speech, vol. 63, no. 2, pp. 404–435, 2020. @article{Kyriacou2020, A growing number of studies support the partial compositionality of idiomatic phrases, while idioms are thought to vary in their syntactic flexibility. Some idioms, like kick the bucket, have been classified as inflexible and incapable of being passivized without losing their figurative interpretation (i.e., the bucket was kicked ≠ died). Crucially, this has never been substantiated by empirical findings. In the current study, we used eye-tracking to examine whether the passive forms of (flexible and inflexible) idioms retain or lose their figurative meaning. Active and passivized idioms (he kicked the bucket/the bucket was kicked) and incongruous active and passive control phrases (he kicked the apple/the apple was kicked) were inserted in sentences biasing the figurative meaning of the respective idiom (die). Active idioms served as a baseline. We hypothesized that if passivized idioms retain their figurative meaning (the bucket was kicked = died), they should be processed more efficiently than the control phrases, since their figurative meaning would be congruous in the context. If, on the other hand, passivized idioms lose their figurative interpretation (the bucket was kicked = the pail was kicked), then their meaning should be just as incongruous as that of both control phrases, in which case we would expect no difference in their processing. Eye movement patterns demonstrated a processing advantage for passivized idioms (flexible and inflexible) over control phrases, thus indicating that their figurative meaning was not compromised. These findings challenge classifications of idiom flexibility and highlight the creative nature of language. |
Jiyeon Lee Effect of lexical accessibility on syntactic production in aphasia: an eyetracking study Journal Article In: Aphasiology, vol. 34, no. 4, pp. 391–410, 2020. @article{Lee2020, Background & Aims: Healthy speakers use both word-level and structure-level information to ease sentence production processes. Structural priming facilitates message-structure mapping in aphasia. However, it remains unclear if and how word-level information affects off-line and on-line sentence production in persons with aphasia (PWA). This eyetracking-while-speaking study examined the effect of lexical priming on production of syntactic (active/passive) structures in PWA. Methods: Eleven PWA and twenty healthy older adults (HOA) described transitive actions (woman pulling horse) following lexical priming, wherein the relative ease of lexical retrieval for the Agent or Theme was manipulated via an auditory probe (what is happening with the woman/horse?). It was examined whether or not PWA produce the sentence structure that allows earlier production of the primed word (e.g., passives when Theme was primed). Participants' eye fixation times to each character (Agent, Theme) were also monitored to examine if PWA show priming-induced preferential looks to one character from the earliest stage of production, consistent with word-driven planning. Results: HOA showed increased production of passives over actives in the Theme vs. Agent prime condition. In eye fixation data, HOA showed priming-induced Theme advantage from the earliest time window (picture onset-400 milliseconds). PWA also showed a significant priming effect in off-line sentence production, with this priming effect being greater for the individuals whose syntactic processing is better preserved. In eye fixation data, however, PWA showed preferential fixations to the primed character at a later stage of sentence planning (400–800 milliseconds), following equal fixation time to Agent and Theme during the earliest time window. Conclusion: HOA showed word-driven production in both off-line and real-time (eye fixations) production. Lexical accessibility effectively drove off-line syntactic production in PWA, especially for those whose syntactic capacity remains relatively preserved. However, PWA showed advanced processing of both characters in earliest eye fixation data, suggesting that successful word-driven off-line syntactic production was associated with atypical real-time sentence planning in aphasia. |
Amy M. Lieberman; Arielle Borovsky Lexical recognition in deaf children learning American Sign Language: Activation of semantic and phonological features of signs Journal Article In: Language Learning, vol. 70, no. 4, pp. 935–973, 2020. @article{Lieberman2020, Children learning language efficiently process single words and activate semantic, phonological, and other features of words during recognition. We investigated lexical recognition in deaf children acquiring American Sign Language (ASL) to determine how perceiving language in the visual–spatial modality affects lexical recognition. Twenty native or early-exposed signing deaf children (ages 4 to 8 years) participated in a visual world eye-tracking study. Participants were presented with a single ASL sign, target picture, and three competitor pictures that varied in their phonological and semantic relationship to the target. Participants shifted gaze to the target picture shortly after sign offset. Participants showed robust evidence for activation of semantic but not phonological features of signs. However, in their behavioral responses, participants were most susceptible to phonological competitors. Results demonstrated that single word recognition in ASL is largely parallel to spoken language recognition among children who are developing a mature lexicon. |
Jens Hjortkjær; Jonatan Märcher-Rørsted; Søren A. Fuglsang; Torsten Dau Cortical oscillations and entrainment in speech processing during working memory load Journal Article In: European Journal of Neuroscience, vol. 51, no. 5, pp. 1279–1289, 2020. @article{Hjortkjaer2020, Neuronal oscillations are thought to play an important role in working memory (WM) and speech processing. Listening to speech in real-life situations is often cognitively demanding but it is unknown whether WM load influences how auditory cortical activity synchronizes to speech features. Here, we developed an auditory n-back paradigm to investigate cortical entrainment to speech envelope fluctuations under different degrees of WM load. We measured the electroencephalogram, pupil dilations and behavioural performance from 22 subjects listening to continuous speech with an embedded n-back task. The speech stimuli consisted of long spoken number sequences created to match natural speech in terms of sentence intonation, syllabic rate and phonetic content. To burden different WM functions during speech processing, listeners performed an n-back task on the speech sequences in different levels of background noise. Increasing WM load at higher n-back levels was associated with a decrease in posterior alpha power as well as increased pupil dilations. Frontal theta power increased at the start of the trial and increased additionally with higher n-back level. The observed alpha–theta power changes are consistent with visual n-back paradigms suggesting general oscillatory correlates of WM processing load. Speech entrainment was measured as a linear mapping between the envelope of the speech signal and low-frequency cortical activity (< 13 Hz). We found that increases in both types of WM load (background noise and n-back level) decreased cortical speech envelope entrainment. Although entrainment persisted under high load, our results suggest a top-down influence of WM processing on cortical speech entrainment. |
Chen-En Ho; Tze-Wei Chen; Jie-Li Tsai How does training shape English-Chinese sight translation behaviour? An eyetracking study Journal Article In: Translation, Cognition and Behavior, vol. 3, no. 1, pp. 1–24, 2020. @article{Ho2020, This study investigated cognitive aspects of sight translation by analysing the reading behaviour in the process and the output. In our empirical study, two groups of participants-interpreting trainees and untrained bilinguals-carried out three tasks: (a) silent reading, (b) reading aloud, and (c) sight translation. The results show that the two groups were almost identical in the first two tasks, further substantiating the similarity of their language command, but were drastically different in how they tackled sight translation. Interpreting trainees provided much more accurate, fluent, and adequate renditions with much less time and fewer fixations. However, their efficiency at information retrieval was statistically similar to that of the untrained bilinguals. Thus, interpreting trainees were more efficient by being more “economical” during reading, rather than by reading ahead faster, as some would intuitively expect. Chunking skills seem to have also been at play behind their remarkable performance. |
Liv J. Hoversten; Matthew J. Traxler Zooming in on zooming out: Partial selectivity and dynamic tuning of bilingual language control during reading Journal Article In: Cognition, vol. 195, pp. 1–17, 2020. @article{Hoversten2020, Prominent models of bilingual visual word recognition posit a bottom-up nonselective view of lexical processing with parallel access to lexical candidates of both languages. However, these accounts do not accommodate recent findings of top-down effects on the relative global activation level of each language during bilingual reading. We conducted two eye-tracking experiments to systematically assess the degree of accessibility of each language in different global language contexts. When critical words were presented overtly in Experiment 1, code switches disrupted reading early during lexical processing, but not as much as pseudowords did. Participants zoomed out of the target language with increasing exposure to language switches. In Experiment 2, a monolingual language context was created by presenting critical words covertly as parafoveal previews. Here, code-switched words were treated like pseudowords, and participants remained zoomed in to the target language throughout the experiment. Switch direction analyses confirmed and extended these interpretations to provide further support for the role of global language control on lexical access, above and beyond effects due to proficiency differences across languages. Together, these data provide strong evidence for dynamic top-down adjustment of the degree of language selectivity during bilingual reading. |
Linjieqiong Huang; Xingshan Li Early, but not overwhelming: The effect of prior context on segmenting overlapping ambiguous strings when reading Chinese Journal Article In: Quarterly Journal of Experimental Psychology, vol. 73, no. 9, pp. 1382–1395, 2020. @article{Huang2020b, The current study investigated how the prior context influences word segmentation of overlapping ambiguous strings when reading Chinese. Chinese readers' eye movements were recorded as they read sentences containing a three-character overlapping ambiguous string (ABC), where both AB and BC were two-character words. In the informative condition, prior contexts provided syntactic information that supported either the first word segmentation (AB-C) or the second word segmentation (A-BC). The neutral condition did not provide syntactic constraint for word-segmentation. The post-target contexts were syntactically consistent with either the first word (AB-C) or the second word (A-BC) segmentation. The results showed that there were higher skipping rates and shorter first-fixation durations on the overlapping ambiguous string region in the informative AB-C condition than those in the informative A-BC condition, whereas no difference between the AB-C and A-BC segmentation types was found in the neutral condition. Readers still made regressions into the overlapping ambiguous string region in the informative condition. These results imply that readers use sentence context information immediately to segment the overlapping ambiguous words, but they do not use the context information fully. The first word (AB) has processing advantages over the second word (BC), suggesting a left-side word advantage. |
Ferdy Hubers; Theresa Redl; Hugo Vos; Lukas Reinarz; Helen Hoop Processing prescriptively incorrect comparative particles: Evidence from sentence-matching and eye-tracking Journal Article In: Frontiers in Psychology, vol. 11, pp. 186, 2020. @article{Hubers2020, Speakers of a language sometimes use particular constructions which violate prescriptive grammar rules. Despite their prescriptive ungrammaticality, they can occur rather frequently. One such example is the comparative construction in Dutch and similarly in German, where the equative particle is used in comparative constructions instead of the prescriptively correct comparative particle (Dutch beter als Jan and German besser wie Jan “lit. better as John”). In a series of three experiments using sentence-matching and eye-tracking methodology, we investigated whether this grammatical norm violation is processed as grammatical, as ungrammatical, or whether it falls in between these two. We hypothesized that the latter would be the case. We analyzed our data using linear mixed effects models in order to capture possible individual differences. The results of the sentence-matching experiments, which were conducted in both Dutch and German, showed that the grammatical norm violation patterns with ungrammatical sentences in both languages. Our hypothesis was therefore not borne out. However, using the more sensitive eye-tracking method on Dutch speakers only, we found that the ungrammatical alternative leads to higher reading times than the grammatical norm violation. We also found significant individual variation regarding this very effect. We furthermore replicated the processing difference between the grammatical norm violation and the prescriptively correct variant. In summary, we conclude that while the results of the more sensitive eye-tracking experiment suggest that the grammatical norm violation is not processed completely on a par with ungrammatical sentences, the results of all three experiments clearly show that the grammatical norm violation cannot be considered grammatical, either. |
Falk Huettig; Ernesto Guerra; Andrea Helo Towards understanding the task dependency of embodied language processing: The influence of colour during language-vision interactions Journal Article In: Journal of Cognition, vol. 3, no. 1, pp. 1–19, 2020. @article{Huettig2020, A main challenge for theories of embodied cognition is to understand the task dependency of embodied language processing. One possibility is that perceptual representations (e.g., typical colour of objects mentioned in spoken sentences) are not activated routinely but the influence of perceptual representation emerges only when context strongly supports their involvement in language. To explore this question, we tested the effects of colour representations during language processing in three visual-world eye-tracking experiments. On critical trials, participants listened to sentence-embedded words associated with a prototypical colour (e.g., '…spinach…') while they inspected a visual display with four printed words (Experiment 1), coloured or greyscale line drawings (Experiment 2) and a 'blank screen' after a preview of coloured or greyscale line drawings (Experiment 3). Visual context always presented a word/object (e.g., frog) associated with the same prototypical colour (e.g. green) as the spoken target word and three distractors. When hearing spinach participants did not prefer the written word frog compared to other distractor words (Experiment 1). In Experiment 2, colour competitors attracted more overt attention compared to average distractors, but only for the coloured condition and not for greyscale trials. Finally, when the display was removed at the onset of the sentence, and in contrast to the previous blank-screen experiments with semantic competitors, there was no evidence of colour competition in the eye-tracking record (Experiment 3). These results fit best with the notion that the main role of perceptual representations in language processing is to contextualize language in the immediate environment. |
Jukka Hyönä; Alexander Pollatsek; Minna Koski; Henri Olkoniemi An eye-tracking study of reading long and short novel and lexicalized compound words Journal Article In: Journal of Eye Movement Research, vol. 13, no. 4, pp. 1–17, 2020. @article{Hyoenae2020, An eye-tracking experiment examined the recognition of novel and lexicalized compound words during sentence reading. The frequency of the head noun in modifier-head compound words was manipulated to tap into the degree of compositional processing. This was done separately for long (12-16 letter) and short (7-9 letters) compound words. Based on the dual-route race model (Pollatsek et al., 2000) and the visual acuity principle (Bertram & Hyona, 2003), long lexicalized and novel compound words were predicted to be processed via the decomposition route and short lexicalized compound words via the holistic route. Gaze du-ration and selective regression-path duration demonstrated a constituent frequency effect of similar size for long lexicalized and novel compound words. For short compound words the constituent frequency effect was negligible for lexicalized words but robust for novel words. The results are consistent with the visual acuity principle that assumes long novel compound words to be recognized via the decomposition route and short lexicalized compound words via the holistic route. |
Joanne Ingram; Christopher J. Hand Words from the wizarding world: Fictional words, context, and domain knowledge Journal Article In: Journal of Experimental Psychology: Learning, Memory, and Cognition, vol. 46, no. 11, pp. 2179–2192, 2020. @article{Ingram2020, The influence of domain knowledge on reading behavior has received limited investigation compared to the influence of, for example, context and/or word frequency. The current study tested participants with and without domain knowledge of the Harry Potter (HP) universe. Fans and non-fans read sentences containing HP, high-frequency (HF), or low-frequency target-words. Targets were presented in contexts that were supportive or unsupportive within a 2 (group: fans, non-fans) × 3 (context: HP, HF, LF) × 3 (word type: HP, HF, LF) mixed design. Thirty-two fans and 22 non-fans read 72 two-sentence experimental items while eye-movement behavior was recorded: Initial sentences established context; second sentences contained target-words. Fans processed HP words faster than non-fans. No group difference was observed on HF or LF processing durations, suggesting equivalent reading capabilities. In HP contexts, HP and LF targets were processed equivalently. Processing of HF and LF words was facilitated by their supportive context as expected. Non-fans made more regressions into the target region in HP contexts and regressed more into HP targets than other targets; fans regressed into target word regions equivalently across all context and word types. Results suggest that domain knowledge influences early but not immediate lexical access, while the processing effect of novelty was seen in regressive eye movements. These results are more supportive of modular accounts of linguistic processing and serial models of eye movement control. Words without grounding in reality, or true embodiment, were integrated into fans' mental lexicons. |
Lena A. Jäger; Daniela Mertzen; Julie A. Van Dyke; Shravan Vasishth Interference patterns in subject-verb agreement and reflexives revisited: A large-sample study Journal Article In: Journal of Memory and Language, vol. 111, no. October 2019, pp. 104063, 2020. @article{Jaeger2020, Cue-based retrieval theories in sentence processing predict two classes of interference effect: (i) Inhibitory interference is predicted when multiple items match a retrieval cue: cue-overloading leads to an overall slowdown in reading time; and (ii) Facilitatory interference arises when a retrieval target as well as a distractor only partially match the retrieval cues; this partial matching leads to an overall speedup in retrieval time. Inhibitory interference effects are widely observed, but facilitatory interference apparently has an exception: reflexives have been claimed to show no facilitatory interference effects. Because the claim is based on underpowered studies, we conducted a large-sample experiment that investigated both facilitatory and inhibitory interference. In contrast to previous studies, we find facilitatory interference effects in reflexives. We also present a quantitative evaluation of the cue-based retrieval model of Engelmann, Jäger, and Vasishth (2019). |
Jill Jegerski; Irina A. Sekerina The processing of input with differential object marking by heritage Spanish speakers Journal Article In: Bilingualism: Language and Cognition, vol. 23, no. 2, pp. 274–282, 2020. @article{Jegerski2020, Heritage Spanish speakers and adult immigrant bilinguals listened to wh-questions with the differential object marker a (quién/a quién 'who/whoACC') while their eye movements across four referent pictures were tracked. The heritage speakers were less accurate than the adult immigrants in their verbal responses to the questions, leaving objects unmarked for case at a rate of 18%, but eye movement data suggested that the two groups were similar in their comprehension, with both starting to look at the target picture at the same point in the question and identifying the target sooner with a quién 'whoACC' than with quién 'who' questions. |
Shang Jiang; Xin Jiang; Anna Siyanova-Chanturia The processing of multiword expressions in children and adults: An eye-tracking study of Chinese Journal Article In: Applied Psycholinguistics, vol. 41, no. 4, pp. 901–931, 2020. @article{Jiang2020, The processing advantage for multiword expressions over novel language has long been attested in the literature. However, the evidence pertains almost exclusively to multiword expression processing in adults. Whether or not other populations are sensitive to phrase frequency effects is largely unknown. Here, we sought to address this gap by recording the eye movements of third and fourth graders, as well as adults (first-language Mandarin) as they read phrases varying in frequency embedded in sentence context. We were interested in how phrase frequency, operationalized as phrase type (collocation vs. control) or (continuous) phrase frequency, and age might influence participants' reading. Adults read collocations and higher frequency phrases consistently faster than control and lower frequency phrases, respectively. Critically, fourth, but not third, graders read collocations and higher frequency phrases faster than control and lower frequency sequences, respectively, although this effect was largely confined to a late measure. Our results reaffirm phrase frequency effects in adults and point to emerging phrase frequency effects in primary school children. The use of eye tracking has further allowed us to tap into early versus late stages of phrasal processing, to explore different areas of interest, and to probe possible differences between phrase frequency conceptualized as a dichotomy versus a continuum. |
Elizabeth Carolina Jiménez; August Romeo; Laura Pérez Zapata; Maria Solé Puig; Patricia Bustos-Valenzuela; José Cañete; Paloma Varela Casal; Hans Supèr Eye vergence responses in children with and without reading difficulties during a word detection task Journal Article In: Vision Research, vol. 169, pp. 6–11, 2020. @article{Jimenez2020, Vergence eye movements are movements of both eyes in opposite directions. Vergence is known to have a role in binocular vision. However recent studies link vergence eye movements also to attention and attention disorders. As attention may be involved in dyslexia, it is sensible to guess that the presence of reading difficulties can be associated with specific patterns in vergence responses. Data from school children performing a word-reading task have been analysed. In the task, children had to distinguish words from non-words (scrambled words or row of X's), while their eye positions were recorded. Our findings show that after stimulus presentation eyes briefly converge. These vergence responses depend on the stimulus type and age of the child, and are different for children with reading difficulties. Our findings support the idea of a role of attention in word reading and offer an explanation of altered attention in dyslexia. |
Weilin Liu; Albrecht W. Inhoff; Xingshan Li Attention shifting during the reading of Chinese sentences Journal Article In: Journal of Experimental Psychology: Human Perception and Performance, vol. 46, no. 9, pp. 979–990, 2020. @article{Liu2020c, An eye-movement-contingent probe detection task was used to determine the allocation of visual attention during Chinese reading. On a subset of trials, a to-be-detected visual probe replaced visual text when the eyes crossed and landed to the right of an invisible interword boundary. The probe was either near the fixated location or at a more distant location in the right or left visual field. Probe detection latencies were shorter for probes that were closer to fixation, and they were shorter when the probes were shown in the right rather than the left visual field when word order progressed from left to right. A right visual field advantage also emerged when word order was reversed and progressed from right to left. These results indicate that the direction of shifts of attention is preset and progresses with a script-specific word order. This directional bias can account for asymmetric extensions of the perceptual span toward upcoming words during normal reading. |
Zhifang Liu; Xuanwen Liu; Wen Tong; Fuyin Fu Word's contextual predictability and its character frequency effects in Chinese reading: Evidence From eye movements Journal Article In: Frontiers in Psychology, vol. 11, pp. 1833, 2020. @article{Liu2020e, The present study sought to establish how a word's contextual predictability impacts the early stages of word processing when reading Chinese. Two eye-movement experiments were conducted in which the predictability of the target two-character word was manipulated; the frequency of the target's initial character was manipulated in Experiment 1, as was the target's end character frequency in Experiment 2. No reliable interaction effect of predictability with initial character frequency was observed in Experiment 1. Reliable interactions of word predictability with end character frequency were observed in Experiment 2. The end character frequency effects, in which the words with high-frequency end characters were fixated for a shorter time and re-fixated less often, were only observed when reading unpredictable words. Reliable interactions were also observed with incoming saccade length, as high-frequency end character words elicited longer saccades to themselves than low-frequency end character words when reading predictable words. The effects of pervasive predictability on measures of fixation time, probability, and saccade length were noted in both experiments. Our findings suggest that a word's contextual predictability facilitates the processing of its constituent characters. |
Zhifang Liu; Wen Tong; Yongqiang Su Interaction effects of aging, word frequency, and predictability on saccade length in Chinese reading Journal Article In: PeerJ, vol. 8, pp. 1–22, 2020. @article{Liu2020f, Background. It was well known that age has an impact on word processing (word frequency or predictability) in terms of fixating time during reading. However, little is known about whether or not age modulates these impacts on saccade behaviors in Chinese reading (i.e., length of incoming/outgoing saccades for a target word). Methods. Age groups, predictability, and frequency of target words were manipulated in the present study. A larger frequency effect on lexical accessing (i.e., gaze duration) and on context integration (i.e., go-past time, total reading time), as well as larger predictability effects on data of raw total reading time, were observed in older readers when compared with their young counterparts. Results. Effect of predictability and frequency on word skipping and re-fixating rate did not differ across the two age groups. Notably, reliable interaction effects of age, along with word predictability and/or frequency, on the length of the first incoming/outgoing saccade for a target word were also observed. Discussion. Our findings suggest that the word processing function of older Chinese readers in terms of saccade targeting declines with age. |
Cristina Lozano-Argüelles; Nuria Sagarra; Joseph V. Casillas Slowly but surely: Interpreting facilitates L2 morphological anticipation based on suprasegmental and segmental information Journal Article In: Bilingualism, vol. 23, no. 4, pp. 1–11, 2020. @article{LozanoArgueelles2020, Native speakers use suprasegmental information to predict words, but less is known about segmental information. Moreover, anticipatory studies with non-native speakers are scarce and mix proficiency with anticipatory experience. To address these limitations, we investigated whether Spanish monolinguals and advanced English learners of Spanish use suprasegmentals (stress: oxytone, paroxytone) and segmentals (syllabic structure: CVC, CV) to predict word suffixes, and whether increased anticipatory experience acquired via interpreting will facilitate anticipation in non-interpreting L2 situations. Eye-tracking data revealed that: (1) the three groups made use of the linguistic variables, and L2 groups did not anticipate in CV paroxytones; (2) everybody anticipated better with the less frequent conditions (oxytones, CVC) having fewer lexical competitors; (3) monolinguals anticipated earlier than L2 learners; and (4) interpreters anticipated at a faster rate in some conditions. These findings indicate that less frequent suprasegmental and segmental information and anticipatory experience facilitate native and non-native spoken word prediction. |