Reading and Language Eye-Tracking Publications
All EyeLink eye tracker reading and language research publications up until 2024 (with some early 2025s) are listed below by year. You can search the eye-tracking publications using keywords such as Visual World, Comprehension, Speech Production, etc. You can also search for individual author names. If we missed any EyeLink reading or language research articles, please email us!
2016 |
Tania S. Zamuner; Elizabeth Morin-Lessard; Stephanie Strahm; Michael P. A. Page Spoken word recognition of novel words, either produced or only heard during learning Journal Article In: Journal of Memory and Language, vol. 89, pp. 55–67, 2016. @article{Zamuner2016a, Psycholinguistic models of spoken word production differ in how they conceptualize the relationship between lexical, phonological and output representations, making different predictions for the role of production in language acquisition and language processing. This work examines the impact of production on spoken word recognition of newly learned non-words. In Experiment 1, adults were trained on non-words with visual referents; during training, they produced half of the non-words, with the other half being heard-only. Using a visual world paradigm at test, eye tracking results indicated faster recognition of non-words that were produced compared with heard-only during training. In Experiment 2, non-words were correctly pronounced or mispronounced at test. Participants showed a different pattern of recognition for mispronunciation on non-words that were produced compared with heard-only during training. Together these results indicate that production affects the representations of newly learned words. |
Chuanli Zang; Yongsheng Wang; Xuejun Bai; Guoli Yan; Denis Drieghe; Simon P. Liversedge The use of probabilistic lexicality cues for word segmentation in Chinese reading Journal Article In: Quarterly Journal of Experimental Psychology, vol. 69, no. 3, pp. 548–560, 2016. @article{Zang2016, In an eye-tracking experiment we examined whether Chinese readers were sensitive to information concerning how often a Chinese character appears as a single-character word versus the first character in a two-character word, and whether readers use this information to segment words and adjust the amount of parafoveal processing of subsequent characters during reading. Participants read sentences containing a two-character target word with its first character more or less likely to be a single-character word. The boundary paradigm was used. The boundary appeared between the first character and the second character of the target word, and we manipulated whether readers saw an identity or a pseudocharacter preview of the second character of the target. Linear mixed-effects models revealed reduced preview benefit from the second character when the first character was more likely to be a single-character word. This suggests that Chinese readers use probabilistic combinatorial information about the likelihood of a Chinese character being single-character word or a two-character word online to modulate the extent of parafoveal processing. |
Chuanli Zang; Manman Zhang; Xuejun Bai; Guoli Yan; Kevin B. Paterson; Simon P. Liversedge Effects of word frequency and visual complexity on eye movements of young and older Chinese readers Journal Article In: Quarterly Journal of Experimental Psychology, vol. 69, no. 7, pp. 1409–1425, 2016. @article{Zang2016a, Research using alphabetic languages shows that, compared to young adults, older adults employ a risky reading strategy in which they are more likely to guess word identities and skip words to compensate for their slower processing of text. However, little is known about how ageing affects reading behaviour for naturally unspaced, logographic languages like Chinese. Accordingly, to assess the generality of age-related changes in reading strategy across different writing systems we undertook an eye movement investigation of adult age differences in Chinese reading. Participants read sentences containing a target word (a single Chinese character) that had a high or low frequency of usage and was constructed from either few or many character strokes, and so either visually simple or complex. Frequency and complexity produced similar patterns of influence for both age groups on skipping rates and fixation times for target words. Both groups therefore demonstrated sensitivity to these manipulations. But compared to the young adults, the older adults made more and longer fixations and more forward and backward eye movements overall. They also fixated the target words for longer, especially when these were visually complex. Crucially, the older adults skipped words less and made shorter progressive saccades. Therefore, in contrast with findings for alphabetic languages, older Chinese readers appear to use a careful reading strategy according to which they move their eyes cautiously along lines of text and skip words infrequently. We propose they use this more careful reading strategy to compensate for increased difficulty processing word boundaries in Chinese. |
Sandra A. Zerkle; Jennifer E. Arnold Discourse attention during utterance planning a昀fects referential form choice Journal Article In: Linguistics Vanguard, vol. 2, pp. 1–16, 2016. @article{Zerkle2016, An unstudied source of linguistic variation is the use of discourse-appropriate language. Sometimes individuals use linguistic devices (anaphors, connectors) to connect utterances to the discourse context, and sometimes not. We asked how this variation is related to utterance planning, using eyetracking with a narrative production task. Participants saw picture pairs depicting two events. They heard a description of the first event (Context picture), then added to the story by describing the second event (Target picture). We found that one group of participants produced utterances that connected with the discourse context (Context-Users), using pronouns/zeros and connectors ( and / then ) as appropriate, while another group consistently used definite NP descriptions and virtually no connectors (Context-Ignorers). Eyetracking measures reflected utterance planning within a discourse context: all participants shifted their attention from the Context picture to the Target picture throughout a trial. We also observed group differences: Context-Users directed their attention in a more systematic way than Context-Ignorers. At trial onset, Context-Users looked more at the Context picture than Context-Ignorers. Right before speaking, they looked more at the Target picture than Context-Ignorers. The Context-Users also had shorter latency to begin speaking. This study provides a first step toward characterizing individual differences in terms of utterance planning. |
Zehui Zhan; Lei Zhang; Hu Mei; Patrick S. W. Fong Online learners' reading ability detection based on eye-tracking sensors Journal Article In: Sensors, vol. 16, pp. 1457, 2016. @article{Zhan2016, © 2016 by the author; licensee MDPI, Basel, Switzerland.The detection of university online learners' reading ability is generally problematic and time-consuming. Thus the eye-tracking sensors have been employed in this study, to record temporal and spatial human eye movements. Learners' pupils, blinks, fixation, saccade, and regression are recognized as primary indicators for detecting reading abilities. A computational model is established according to the empirical eye-tracking data, and applying the multi-feature regularization machine learning mechanism based on a Low-rank Constraint. The model presents good generalization ability with an error of only 4.9% when randomly running 100 times. It has obvious advantages in saving time and improving precision, with only 20 min of testing required for prediction of an individual learner's reading ability. |
Jifan Zhou; Chia-Lin Lee; Kuei-An Li; Yung-Hsuan Tien; Su-Ling Yeh Does temporal integration occur for unrecognizable words in visual crowding? Journal Article In: PLoS ONE, vol. 11, no. 2, pp. e0149355, 2016. @article{Zhou2016d, ? 2016 Zhou et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.Visual crowding - the inability to see an object when it is surrounded by flankers in the periphery - does not block semantic activation: unrecognizable words due to visual crowding still generated robust semantic priming in subsequent lexical decision tasks. Based on the previous finding, the current study further explored whether unrecognizable crowded words can be temporally integrated into a phrase. By showing one word at a time, we presented Chinese four-word idioms with either a congruent or incongruent ending word in order to examine whether the three preceding crowded words can be temporally integrated to form a semantic context so as to affect the processing of the ending word. Results from both behavioral (Experiment 1) and Event-Related Potential (Experiment 2 and 3) measures showed congruency effect in only the non-crowded condition, which does not support the existence of unconscious multi-word integration. Aside from four-word idioms, we also found that two-word (modifier + adjective combination) integration - the simplest kind of temporal semantic integration - did not occur in visual crowding (Experiment 4). Our findings suggest that integration of temporally separated words might require conscious awareness, at least under the timing conditions tested in the current study. |
Peiyun Zhou; Kiel Christianson Auditory perceptual simulation: Simulating speech rates or accents? Journal Article In: Acta Psychologica, vol. 168, pp. 85–90, 2016. @article{Zhou2016b, When readers engage in Auditory Perceptual Simulation (APS) during silent reading, they mentally simulate characteristics of voices attributed to a particular speaker or a character depicted in the text. Previous research found that auditory perceptual simulation of a faster native English speaker during silent reading led to shorter reading times that auditory perceptual simulation of a slower non-native English speaker. Yet, it was uncertain whether this difference was triggered by the different speech rates of the speakers, or by the difficulty of simulating an unfamiliar accent. The current study investigates this question by comparing faster Indian-English speech and slower American-English speech in the auditory perceptual simulation paradigm. Analyses of reading times of individual words and the full sentence reveal that the auditory perceptual simulation effect again modulated reading rate, and auditory perceptual simulation of the faster Indian-English speech led to faster reading rates compared to auditory perceptual simulation of the slower American-English speech. The comparison between this experiment and the data from Zhou and Christianson (2016) demonstrate further that the "speakers'" speech rates, rather than the difficulty of simulating a non-native accent, is the primary mechanism underlying auditory perceptual simulation effects. |
David E. Warren; Daniel Tranel; Melissa C. Duff Impaired acquisition of new words after left temporal lobectomy despite normal fast-mapping behavior Journal Article In: Neuropsychologia, vol. 80, pp. 165–175, 2016. @article{Warren2016a, Word learning has been proposed to rely on unique brain regions including the temporal lobes, and the left temporal lobe appears to be especially important. In order to investigate the role of the left temporal lobe in word learning under different conditions, we tested whether patients with left temporal lobectomies (N=6) could learn novel words using two distinct formats. Previous research has shown that word learning in contrastive fast mapping conditions may rely on different neural substrates than explicit encoding conditions (Sharon et al., 2011). In the current investigation, we used a previously reported word learning task that implemented two distinct study formats (Warren and Duff, 2014): a contrastive fast mapping condition in which a picture of a novel item was displayed beside a picture of a familiar item while the novel item's name was presented aurally ("Click on the numbat."); and an explicit encoding (i.e., control) condition in which a picture of a novel item was displayed while its name was presented aurally ("This is a numbat."). After a delay, learning of the novel words was evaluated with memory tests including three-alternative forced-choice recognition, free recall, cued recall, and familiarity ratings. During the fast-mapping study condition both the left temporal lobectomy and healthy comparison groups performed well, but at test only the comparison group showed evidence of novel word learning. Our findings indicate that unilateral resection of the left temporal lobe including the hippocampus and temporal pole can severely impair word learning, and that fast-mapping study conditions do not promote subsequent word learning in temporal lobectomy populations. |
Dorothea Wendt; Torsten Dau; Jens Hjortkjær Impact of background noise and sentence complexity on processing demands during sentence comprehension Journal Article In: Frontiers in Psychology, vol. 7, pp. 345, 2016. @article{Wendt2016, Speech comprehension in adverse listening conditions can be effortful even when speech is fully intelligible. Acoustical distortions typically make speech comprehension more effortful, but effort also depends on linguistic aspects of the speech signal, such as its syntactic complexity. In the present study, pupil dilations, and subjective effort ratings were recorded in 20 normal-hearing participants while performing a sentence comprehension task. The sentences were either syntactically simple (subject-first sentence structure) or complex (object-first sentence structure) and were presented in two levels of background noise both corresponding to high intelligibility. A digit span and a reading span test were used to assess individual differences in the participants' working memory capacity (WMC). The results showed that the subjectively rated effort was mostly affected by the noise level and less by syntactic complexity. Conversely, pupil dilations increased with syntactic complexity but only showed a small effect of the noise level. Participants with higher WMC showed increased pupil responses in the higher-level noise condition but rated sentence comprehension as being less effortful compared to participants with lower WMC. Overall, the results demonstrate that pupil dilations and subjectively rated effort represent different aspects of effort. Furthermore, the results indicate that effort can vary in situations with high speech intelligibility. |
Sarah J. White; Denis Drieghe; Simon P. Liversedge; Adrian Staub The word frequency effect during sentence reading: A linear or nonlinear effect of log frequency? Journal Article In: Quarterly Journal of Experimental Psychology, vol. 71, no. 1, pp. 46–55, 2016. @article{White2016a, The effect of word frequency on eye movement behaviour during reading has been reported in many experimental studies. However, the vast majority of these studies compared only two levels of word frequency (high and low). Here we assess whether the effect of log word frequency on eye movement measures is linear, in an experiment in which a critical target word in each sentence was at one of three approximately equally spaced log frequency levels. Separate analyses treated log frequency as a categorical or a continuous predictor. Both analyses showed only a linear effect of log frequency on the likelihood of skipping a word, and on first fixation duration. Ex-Gaussian analyses of first fixation duration showed similar effects on distributional parameters in comparing high- and medium-frequency words, and medium- and low-frequency words. Analyses of gaze duration and the probability of a refixation suggested a nonlinear pattern, with a larger effect at the lower end of the log frequency scale. However, the nonlinear effects were small, and Bayes Factor analyses favoured the simpler linear models for all measures. The possible roles of lexical and post-lexical factors in producing nonlinear effects of log word frequency during sentence reading are discussed. |
Veronica Whitford; Debra Titone Eye movements and the perceptual span during first- and second-language sentence reading in bilingual older adults Journal Article In: Psychology and Aging, vol. 31, no. 1, pp. 58–70, 2016. @article{Whitford2016, This study addressed a central yet previously unexplored issue in the psychological science of aging, namely, whether the advantages of healthy aging (e.g., greater lifelong experience with language) or disadvantages (e.g., decreases in cognitive and sensory processing) drive L1 and L2 reading performance in bilingual older adults. To this end, we used a gaze-contingent moving window paradigm to examine both global aspects of reading fluency (e.g., reading rates, number of regressions) and the perceptual span (i.e., allocation of visual attention into the parafovea) in bilingual older adults during L1 and L2 sentence reading, as a function of individual differences in current L2 experience. Across the L1 and L2, older adults exhibited reduced reading fluency (e.g., slower reading rates, more regressions), but a similar perceptual span compared with matched younger adults. Also similar to matched younger adults, older adults' reading fluency was lower for L2 reading than for L1 reading as a function of current L2 experience. Specifically, greater current L2 experience increased L2 reading fluency, but decreased L1 reading fluency (for global reading measures only). Taken together, the dissociation between intact perceptual span and impaired global reading measures suggests that older adults may prioritize parafoveal processing despite age-related encoding difficulties. Consistent with this interpretation, post hoc analyses revealed that older adults with higher versus lower executive control were more likely to adopt this strategy. |
Bogusława Whyatt; Katarzyna Stachowiak; Marta Kajzer-Wietrzny Similar and different: Cognitive rhythm and effort in translation and paraphrasing Journal Article In: Poznan Studies in Contemporary Linguistics, vol. 52, no. 2, pp. 175–208, 2016. @article{Whyatt2016, Although Jakobson's (1959) seminal classification of translation into three kinds: interlingual, intralingual and intersemiotic has been widely accepted in Translation Studies, so far most research interest has focused on interlingual translation, defined as “translation proper”. Intralingual translation, more often understood as rewording, paraphrasing or reformulation within the same language, is a less prototypical kind of translation, yet we believe that the underlying mental operations needed to perform both tasks include similar processing stages. Bearing in mind the lack of research comparing inter-and intralingual translation we designed the ParaTrans project in which we investigate how translators make decisions in both tasks. In this article we present the results of a comparative analysis of processing effort and cognitive rhythm demonstrated by professional translators who were asked to translate and paraphrase similar texts. Having collected three streams of translation process data with such tools as key-logging, eye-tracking and screen-capture software, we are able to draw some tentative conclusions concerning the similarities and differences between language processing for interlingual translation and intralingual paraphrasing. The results confirm a higher processing effort in interlingual translation most likely due to the need to switch between languages. |
Amanda H. Wilson; Agnès Alsius; Martin Paré; Kevin G. Munhall Spatial frequency requirements and gaze strategy in visual-only and audiovisual speech perception Journal Article In: Journal of Speech, Language, and Hearing Research, vol. 59, pp. 601–615, 2016. @article{Wilson2016, Purpose: Understanding speech in background noise is difficult for many individuals; however, time constraints have limited its inclusion in the clinical audiology assessment battery. Phoneme scoring of words has been suggested as a method of reducing test time and variability. The purposes of this study were to establish a phoneme scoring rubric and use it in testing phoneme and word perception in noise in older individuals and individuals with hearing impairment. Method: Words were presented to 3 participant groups at 80 dB in speech-shaped noise at 7 signal-to-noise ratios (−10 to 35 dB). Responses were scored for words and phonemes correct. Results: It was not surprising to find that phoneme scores were up to about 30% better than word scores. Word scoring resulted in larger hearing loss effect sizes than phoneme scoring, whereas scoring method did not significantly modify age effect sizes. There were significant effects of hearing loss and some limited effects of age; age effect sizes of about 3 dB and hearing loss effect sizes of more than 10 dB were found. Conclusion: Hearing loss is the major factor affecting word and phoneme recognition with a subtle contribution of age. Phoneme scoring may provide several advantages over word scoring. A set of recommended phoneme scoring guidelines is provided. |
Matthew B. Winn Rapid release from listening effort resulting from semantic context, and effects of spectral degradation and cochlear implants Journal Article In: Trends in Hearing, vol. 20, 2016. @article{Winn2016, People with hearing impairment are thought to rely heavily on context to compensate for reduced audibility. Here, we explore the resulting cost of this compensatory behavior, in terms of effort and the efficiency of ongoing predictive language processing. The listening task featured predictable or unpredictable sentences, and participants included people with cochlear implants as well as people with normal hearing who heard full-spectrum/unprocessed or vocoded speech. The crucial metric was the growth of the pupillary response and the reduction of this response for predictable versus unpredictable sentences, which would suggest reduced cognitive load resulting from predictive processing. Semantic context led to rapid reduction of listening effort for people with normal hearing; the reductions were observed well before the offset of the stimuli. Effort reduction was slightly delayed for people with cochlear implants and considerably more delayed for normal-hearing listeners exposed to spectrally degraded noise-vocoded signals; this pattern of results was maintained even when intelligibility was perfect. Results suggest that speed of sentence processing can still be disrupted, and exertion of effort can be elevated, even when intelligibility remains high. We discuss implications for experimental and clinical assessment of speech recognition, in which good performance can arise because of cognitive processes that occur after a stimulus, during a period of silence. Because silent gaps are not common in continuous flowing speech, the cognitive/linguistic restorative processes observed after sentences in such studies might not be available to listeners in everyday conversations, meaning that speech recognition in conventional tests might overestimate sentence-processing capability. |
Elizabeth Wonnacott; Holly S. S. L. Joseph; James S. Adelman; Kate Nation Is children's reading “good enough”? Links between online processing and comprehension as children read syntactically ambiguous sentences Journal Article In: Quarterly Journal of Experimental Psychology, vol. 69, no. 5, pp. 855–879, 2016. @article{Wonnacott2016, We monitored 8- and 10-year-old children's eye movements as they read sentences containing a temporary syntactic ambiguity to obtain a detailed record of their online processing. Children showed the classic garden-path effect in online processing. Their reading was disrupted following disambiguation, relative to control sentences containing a comma to block the ambiguity, although the disruption occurred somewhat later than would be expected for mature readers. We also asked children questions to probe their comprehension of the syntactic ambiguity offline. They made more errors following ambiguous sentences than following control sentences, demonstrating that the initial incorrect parse of the garden-path sentence influenced offline comprehension. These findings are consistent with "good enough" processing effects seen in adults. While faster reading times and more regressions were generally associated with better comprehension, spending longer reading the question predicted comprehension success specifically in the ambiguous condition. This suggests that reading the question prompted children to reconstruct the sentence and engage in some form of processing, which in turn increased the likelihood of comprehension success. Older children were more sensitive to the syntactic function of commas, and, overall, they were faster and more accurate than younger children. |
Jeffrey S. Wood; Matthew Haigh; Andrew J. Stewart “This Isn't a Promise, It's a Threat” Journal Article In: Experimental Psychology, vol. 63, no. 2, pp. 89–97, 2016. @article{Wood2016, Participants had their eye movements recorded as they read vignettes containing implied promises and threats. We observed a reading time penalty when participants read the word “threat” when it anaphorically referred to an implied promise. There was no such penalty when the word “promise” was used to refer to an implied threat. On a later measure of processing we again found a reading time penalty when the word “threat” was used to refer to a promise, but also when the word “promise” was used to refer to a threat. These results suggest that anaphoric processing of such expressions is driven initially by sensitivity to the semantic scope differences of “threats” versus “promises.” A threat can be understood as a type of promise, but a promise cannot be understood as a type of threat. However, this effect was short lived; readers were ultimately sensitive to mismatched meaning, regardless of speech act performed. |
Helen Wray; Jeffrey S. Wood; Matthew Haigh; Andrew J. Stewart Threats may be negative promises (but warnings are more than negative tips) Journal Article In: Journal of Cognitive Psychology, vol. 28, no. 5, pp. 593–600, 2016. @article{Wray2016, In everyday situations conditional promises, threats, tips, and warnings are commonplace. Previous research has reported disruption to eye movements during reading when conditional promises are produced by someone who does not have control over the conditional outcome event, but no such disruption for the processing of conditional tips. In the present paper, we examine how readers process conditional threats and warnings. We compare one account which views conditional threats and warnings simply as promises and tips with negative outcomes, with an alternative account which highlights their broader pragmatic differences. In an eye-tracking experiment we find evidence suggesting that, in processing terms, while threats operate like negative promises, warnings are more than negative tips. |
Yingying Wu; Xiaohong Yang; Yufang Yang Eye movement evidence for hierarchy effects on memory representation of discourses Journal Article In: PLoS ONE, vol. 11, no. 1, pp. e0147313, 2016. @article{Wu2016b, In this study, we applied the text-change paradigm to investigate whether and how discourse hierarchy affected the memory representation of a discourse. Three kinds of three-sentence discourses were constructed. In the hierarchy-high condition and the hierarchy-low condition, the three sentences of the discourses were hierarchically organized and the last sentence of each discourse was located at the high level and the low level of the discourse hierarchy, respectively. In the linear condition, the three sentences of the discourses were linearly organized. Critical words were always located at the last sentence of the discourses. These discourses were successively presented twice and the critical words were changed to semantically related words in the second presentation. The results showed that during the early processing stage, the critical words were read for longer times when they were changed in the hierarchy-high and the linear conditions, but not in the hierarchy-low condition. During the late processing stage, the changed-critical words were again found to induce longer reading times only when they were in the hierarchy-high condition. These results suggest that words in a discourse have better memory representation when they are located at the higher rather than at the lower level of the discourse hierarchy. Global discourse hierarchy is established as an important factor in constructing the mental representation of a discourse. |
Ming Yan; Reinhold Kliegl CarPrice versus CarpRice : Word Boundary Ambiguity Influences Saccade Target Selection During the Reading of Chinese Sentences Journal Article In: Journal of Experimental Psychology: Learning, Memory, and Cognition, vol. 42, no. 11, pp. 1832–1838, 2016. @article{Yan2016, As a contribution to a theoretical debate about the degree of high-level influences on saccade targeting during sentence reading, we investigated eye movements during the reading of structurally ambiguous Chinese character strings and examined whether parafoveal word segmentation could influence saccade- target selection. As expected, ambiguous strings took longer to process. More critically there were theoretically relevant interactions between ambiguity and launch site when first-fixation location and saccade amplitude served as dependent variables: Ambiguous strings in the parafovea triggered longer saccades and more rightward fixations for close launch sites than unambiguous ones; the reverse result was obtained for far launch sites. These crossover interactions indicate that parafoveal word segmentation influences saccade generation in Chinese and provide support of the hypothesis that high-level infor- mation can be involved in the decision about where to fixate next. |
Arielle Borovsky; Erica M. Ellis; Julia L. Evans; Jeffrey L. Elman Semantic structure in vocabulary knowledge interacts with lexical and sentence processing in infancy Journal Article In: Child Development, vol. 87, no. 6, pp. 1893–1908, 2016. @article{Borovsky2016a, Although the size of a child's vocabulary associates with language-processing skills, little is understoodregarding how this relation emerges. This investigation asks whether and how the structure of vocabularyknowledge affects language processing in English-learning 24-month-old children (N = 32; 18 F, 14 M). Paren-tal vocabulary report was used to calculate semantic density in several early-acquired semantic categories.Performance on two language-processing tasks (lexical recognition and sentence processing) was compared asa function of semantic density. In both tasks, real-time comprehension was facilitated for higher density items,whereas lower density items experienced more interference. The findings indicate that language-processingskills develop heterogeneously and are influenced by the semantic network surrounding a known word. |
Andreas Brocher; Stephani Foraker; Jean Pierre Koenig Processing of irregular polysemes in sentence reading Journal Article In: Journal of Experimental Psychology: Learning, Memory, and Cognition, vol. 42, no. 11, pp. 1798–1813, 2016. @article{Brocher2016a, The degree to which meanings are related in memory affects ambiguous word processing. We examined irregular polysemes, which have related senses based on similar or shared features rather than a relational rule, like regular polysemy. We tested to what degree the related meanings of irregular polysemes ("wire") are represented with shared semantic information versus unshared information represented separately, like homonyms ("bank"). Monitoring eye fixations, we found that later context supporting the less frequent meaning of an irregular polyseme did not slow down reading compared with control conditions, whereas for homonyms it did. This indicates that in the absence of preceding biasing context, readers access a shared component of an irregular polyseme's representation. Additionally, when the same context words preceded the ambiguous word, both irregular polysemes and homonyms initially elicited longer reading times, but the observed reading slow-down was weaker and less persistent for irregular polysemes than homonyms, indicating less competition between meaning components. We interpret these results as evidence of a shared features representation for irregular polysemes, which additionally incorporates unshared portions of meaning that can compete. When preceding, biasing context is available, readers activate shared and unshared components of the senses, producing a more fully instantiated meaning. |
Trevor Brothers; Matthew J. Traxler Anticipating syntax during reading: Evidence from the boundary change paradigm Journal Article In: Journal of Experimental Psychology: Learning, Memory, and Cognition, vol. 42, no. 12, pp. 1894–1906, 2016. @article{Brothers2016, Previous evidence suggests that grammatical constraints have a rapid influence during language com- prehension, particularly at the level of word categories (noun, verb, preposition). These findings are in conflict with a recent study from Angele, Laishley, Rayner, and Liversedge (2014), in which sentential fit had no early influence on word skipping rates during reading. In the present study, we used a gaze-contingent boundary change paradigm to manipulate the syntactic congruity of an upcoming noun or verb outside of participants' awareness. Across 3 experiments (total N ⫽ 148), we observed higher skipping rates for syntactically valid previews (The admiral would not confess . . .), when compared with violation previews (The admiral would not surgeon . . .). Readers were less likely to skip an ungram- matical continuation, even when that word was repeated within the same sentence (The admiral would not admiral . . .), suggesting that word-class constraints can take precedence over lexical repetition effects. To our knowledge, these results provide the first evidence for an influence of syntactic context during parafoveal word recognition. On the basis of the early time-course of this effect, we argue that readers can use grammatical constraints to generate syntactic expectations for upcoming words. |
Susanne Brouwer; Ann R. Bradlow The temporal dynamics of spoken word recognition in adverse listening conditions Journal Article In: Journal of Psycholinguistic Research, vol. 45, no. 5, pp. 1151–1160, 2016. @article{Brouwer2016, This study examined the temporal dynamics of spoken word recognition in noise and background speech. In two visual-world experiments, English participants listened to target words while looking at four pictures on the screen: a target (e.g. candle), an onset competitor (e.g. candy), a rhyme competitor (e.g. sandal), and an unrelated distractor (e.g. lemon). Target words were presented in quiet, mixed with broadband noise, or mixed with background speech. Results showed that lexical competition changes throughout the observation window as a function of what is presented in the background. These findings suggest that, rather than being strictly sequential, stream segregation and lexical competition interact during spoken word recognition. |
Irene Ablinger; Ralph Radach Diverging receptive and expressive word processing mechanisms in a deep dyslexic reader Journal Article In: Neuropsychologia, vol. 81, pp. 12–21, 2016. @article{Ablinger2016, We report on KJ, a patient with acquired dyslexia due to cerebral artery infarction. He represents an unusually clear case of an "output" deep dyslexic reader, with a distinct pattern of pure semantic reading. According to current neuropsychological models of reading, the severity of this condition is directly related to the degree of impairment in semantic and phonological representations and the resulting imbalance in the interaction between the two word processing pathways. The present work sought to examine whether an innovative eye movement supported intervention combining lexical and segmental therapy would strengthen phonological processing and lead to an attenuation of the extreme semantic over-involvement in KJ's word identification process. Reading performance was assessed before (T1) between (T2) and after (T3) therapy using both analyses of linguistic errors and word viewing patterns. Therapy resulted in improved reading aloud accuracy along with a change in error distribution that suggested a return to more sequential reading. Interestingly, this was in contrast to the dynamics of moment-to-moment word processing, as eye movement analyses still suggested a predominantly holistic strategy, even at T3. So, in addition to documenting the success of the therapeutic intervention, our results call for a theoretically important conclusion: Real-time letter and word recognition routines should be considered separately from properties of the verbal output. Combining both perspectives may provide a promising strategy for future assessment and therapy evaluation. |
Zaeinab Afsari; José P. Ossandón; Peter Konig The dynamic effect of reading direction habit on spatial asymmetry of image perception Journal Article In: Journal of Vision, vol. 16, no. 11, pp. 1–21, 2016. @article{Afsari2016, Exploration of images after stimulus onset is initially biased to the left. Here, we studied the causes of such an asymmetry and investigated effects of reading habits, text primes, and priming by systematically biased eye movements on this spatial bias in visual exploration. Bilinguals first read text primes with right- to-left (RTL) or left-to-right (LTR) reading directions and subsequently explored natural images. In Experiment 1, native RTL speakers showed a leftward free-viewing shift after reading LTR primes but a weaker rightward bias after reading RTL primes. This demonstrates that reading direction dynamically influences the spatial bias. However, native LTR speakers wholearnedanRTL languagelateinlife showed a leftward bias after reading either LTR or RTL primes, which suggests the role of habit formation in the production of the spatial bias. In Experiment 2, LTR bilinguals showed a slightly enhanced leftward bias after reading LTR text primes in their second language. This might contribute to the differences of native RTL and LTR speakers observed in Experiment 1. In Experiment 3, LTR bilinguals read normal (LTR, habitual reading) and mirrored left-to-right (mLTR, nonhabitual reading) texts. We observed a strong leftward bias in both cases, indicating that the bias direction is influenced by habitual reading direction and is not secondary to the actual reading direction. This is confirmed in Experiment 4, in which LTR participants were asked to follow RTL and LTR moving dots in prior image presentation and showed no change in the normal spatial bias. In conclusion, the horizontal bias is a dynamic property and is modulated by habitual reading direction. Introduction |
Agnès Alsius; Rachel V. Wayne; Martin Paré; Kevin G. Munhall High visual resolution matters in audiovisual speech perception, but only for some Journal Article In: Attention, Perception, & Psychophysics, vol. 78, no. 5, pp. 1472–1487, 2016. @article{Alsius2016, The basis for individual differences in the degree to which visual speech input enhances comprehension of acoustically degraded speech is largely unknown. Previous research indicates that fine facial detail is not critical for visual enhancement when auditory information is available; however, these studies did not examine individual differences in ability to make use of fine facial detail in relation to audiovisual speech perception ability. Here, we compare participants based on their ability to benefit from visual speech information in the presence of an auditory signal degraded with noise, modulating the resolution of the visual signal through low-pass spatial frequency filtering and monitoring gaze behavior. Participants who benefited most from the addition of visual information (high visual gain) were more adversely affected by the removal of high spatial frequency information, compared to participants with low visual gain, for materials with both poor and rich contextual cues (i.e., words and sentences, respectively). Differences as a function of gaze behavior between participants with the highest and lowest visual gains were observed only for words, with participants with the highest visual gain fixating longer on the mouth region. Our results indicate that the individual variance in audiovisual speech in noise performance can be accounted for, in part, by better use of fine facial detail information extracted from the visual signal and increased fixation on mouth regions for short stimuli. Thus, for some, audiovisual speech perception may suffer when the visual input (in addition to the auditory signal) is less than perfect. |
Bernhard Angele; Timothy J. Slattery; Keith Rayner Two stages of parafoveal processing during reading: Evidence from a display change detection task Journal Article In: Psychonomic Bulletin & Review, vol. 23, no. 4, pp. 1241–1249, 2016. @article{Angele2016, We used a display change detection paradigm (Slattery, Angele, & Rayner Human Perception and Performance, 37, 1924–1938 2011) to investigate whether display change detection uses orthographic regularity and whether detection is affected by the processing difficulty of the word preceding the boundary that triggers the display change. Subjects were significantly more sensitive to display changes when the change was from a nonwordlike preview than when the change was from a wordlike preview, but the preview benefit effect on the target word was not affected by whether the preview was wordlike or nonwordlike. Additionally, we did not find any influence of preboundary word frequency on display change detection performance. Our results suggest that display change detection and lexical processing do not use the same cognitive mechanisms. We propose that parafoveal processing takes place in two stages: an early, orthography-based, preattentional stage, and a late, attention-dependent lexical access stage. |
Manabu Arai; Chie Nakamura It's harder to break a relationship when you commit long Journal Article In: PLoS ONE, vol. 11, no. 6, pp. e0156482, 2016. @article{Arai2016, Past research has produced evidence that parsing commitments strengthen over the processing of additional linguistic elements that are consistent with the commitments and undoing strong commitments takes more time than undoing weak commitments. It remains unclear, however, whether this so-called digging-in effect is exclusively due to the length of an ambiguous region or at least partly to the extra cost of processing these additional phrases. The current study addressed this issue by testing Japanese relative clause structure, where lexical content and sentence meaning were controlled for. The results showed evidence for a digging-in effect reflecting the strengthened commitment to an incorrect analysis caused by the processing of additional adjuncts. Our study provides strong support for the dynamical, self-organizing models of sentence processing but poses a problem for other models including serial two-stage models as well as frequency-based probabilistic models such as the surprisal theory. |
Scott P. Ardoin; Katherine S. Binder; Tori E. Foster; Andrea M. Zawoyski Repeated versus wide reading: A randomized control design study examining the impact of fluency interventions on underlying reading behavior Journal Article In: Journal of School Psychology, vol. 59, pp. 13–38, 2016. @article{Ardoin2016, Repeated readings (RR) has garnered much attention as an evidence based intervention designed to improve all components of reading fluency (rate, accuracy, prosody, and comprehension). Despite this attention, there is not an abundance of research comparing its effectiveness to other potential interventions. The current study presents the findings from a randomized control trial study involving the assignment of 168 second grade students to a RR, wide reading (WR), or business as usual condition. Intervention students were provided with 9–10 weeks of intervention with sessions occurring four times per week. Pre- and post-testing were conducted using Woodcock-Johnson III reading achievement measures (Woodcock, McGrew, & Mather, 2001, curriculum-based measurement (CBM) probes, measures of prosody, and measures of students' eye movements when reading. Changes in fluency were also monitored using weekly CBM progress monitoring procedures. Data were collected on the amount of time students spent reading and the number of words read by students during each intervention session. Results indicate substantial gains made by students across conditions, with some measures indicating greater gains by students in the two intervention conditions. Analyses do not indicate that RR was superior to WR. In addition to expanding the RR literature, this study greatly expands research evaluating changes in reading behaviors that occur with improvements in reading fluency. Implications regarding whether schools should provide more opportunities to repeatedly practice the same text (i.e., RR) or practice a wide range of text (i.e., WR) are provided. |
Julia Bahnmueller; Stefan Huber; Hans-Christoph Nuerk; Silke M. Göbel; Korbinian Moeller Processing multi-digit numbers: a translingual eye-tracking study Journal Article In: Psychological Research, vol. 80, no. 3, pp. 422–433, 2016. @article{Bahnmueller2016, The present study aimed at investigating the underlying cognitive processes and language specificities of three-digit number processing. More specifically, it was intended to clarify whether the single digits of three-digit numbers are processed in parallel and/or sequentially and whether processing strategies are influenced by the inversion of number words with respect to the Arabic digits [e.g., 43: dreiundvierzig (“three and forty”)] and/or by differences in reading behavior of the respective first language. Therefore, English- and German-speaking adults had to complete a three-digit number comparison task while their eye-fixation behavior was recorded. Replicating previous results, reliable hundred-decade-compatibility effects (e.g., 742_896: hundred-decade compatible because 7 < 8 and 4 < 9; 362_517: hundred-decade incompatible because 3 < 5 but 6 > 1) for English- as well as hundred-unit-compatibility effects for English- and German-speaking participants were observed, indicating parallel processing strategies. While no indices of partial sequential processing were found for the English-speaking group, about half of the German-speaking participants showed an inverse hundred-decade-compatibility effect accompanied by longer inspection time on the hundred digit indicating additional sequential processes. Thereby, the present data revealed that in transition from two- to higher multi-digit numbers, the homogeneity of underlying processing strategies varies between language groups. The regular German orthography (allowing for letter-by-letter reading) and its associated more sequential reading behavior may have promoted sequential processing strategies in multi-digit number processing. Furthermore, these results indicated that the inversion of number words alone is not sufficient to explain all observed language differences in three-digit number processing. |
Adrienne E. Barnes; Young-Suk Kim Low-skilled adult readers look like typically developing child readers: A comparison of reading skills and eye movement behavior Journal Article In: Reading and Writing, vol. 29, no. 9, pp. 1889–1914, 2016. @article{Barnes2016, The paper documents 41 European case histories that describe the seismogenic response of crystalline and sedimentary rocks to fluid injection. It is part of an on-going study to identify factors that have a bearing on the seismic hazard associated with fluid injection. The data generally support the view that injection in sedimentary rocks tends to be less seismogenic than in crystalline rocks. In both cases, the presence of faults near the wells that allow pressures to penetrate significant distances vertically and laterally can be expected to increase the risk of producing felt events. All cases of injection into crystalline rocks produce seismic events, albeit usually of non-damaging magnitudes, and all crystalline rock masses were found to be critically stressed, regardless of the strength of their seismogenic responses to injection. Thus, these data suggest that criticality of stress, whilst a necessary condition for producing earthquakes that would disturb (or be felt by) the local population, is not a sufficient condition. The data considered here are not fully consistent with the concept that injection into deeper crystalline formations tends to produce larger magnitude events. The data are too few to evaluate the combined effect of depth and injected fluid volume on the size of the largest events. Injection at sites with low natural seismicity, defined by the expectation that the local peak ground acceleration has less than a 10% chance of exceeding 0.07 g in 50 years, has not produced felt events. Although the database is limited, this suggests that low natural seismicity, corresponding to hazard levels at or below 0.07 g, may be a useful indicator of a low propensity for fluid injection to produce felt or damaging events. However, higher values do not necessarily imply a high propensity. |
Aurélie Calabrèse; Jean-Baptiste Bernard; Géraldine Faure; Louis Hoffart; Eric Castet Clustering of eye fixations: A new oculomotor determinant of reading speed in maculopathy Journal Article In: Investigative Ophthalmology & Visual Science, vol. 57, no. 7, pp. 3192–3202, 2016. @article{Calabrese2016, Purpose: To describe and quantify a largely unnoticed oculomotor pattern that often occurs when patients with central field loss (CFL) read continuous text: Horizontal distribution of eye fixations dramatically varies across sentences and often reveals clusters. Also to statistically analyze the effect of this new factor on reading speed while controlling for the effect of saccadic amplitude (measured in letters per forward saccade, L/FS), an established oculomotor effect. Methods: Quantification of nonuniformity of eye fixations (NUF factor) was based on statistical analysis of the curvature of fixation distributions. Linear mixed-effects analyses were performed to predict reading speed from oculomotor factors based on eye movements of 34 AMD and 4 Stargardt patients (better eye decimal acuity from 0.08 to 0.3). Single-line French sentences were read aloud by these patients, who all had a dense scotoma covering the fovea as assessed with MP1 microperimetry. Results: Nonuniformity of fixations is a strong determinant of reading speed (−0.76 log units; 95% confidence interval [CI] [−0.86, −0.66]). This effect is not confounded with the effect of L/FS. The per sentence proportion of trials with clustering is predicted by the frequency of occurrence of the lowest-frequency word in each sentence. Conclusions: The NUF factor is a new oculomotor predictor of reading speed. This effect is independent of the effect of L/FS. Reading performance, as well as motivation to read, might be enhanced if new visual aids or automatic text simplification were used to reduce the occurrence of fixation clustering. © |
Gareth Carrol; Kathy Conklin; Henrik Gyllstad Found in translation: The Influence of the L1 on the Reading of Idioms in a L2 Journal Article In: Studies in Second Language Acquisition, vol. 38, pp. 403–443, 2016. @article{Carrol2016, Formulaic language represents a challenge to even the most proficient of language learners. Evidence is mixed as to whether native and nonnative speakers process it in a fundamentally different way, whether exposure can lead to more nativelike processing for nonnatives, and how L1 knowledge is used to aid comprehension. In this study we investigated how advanced nonnative speakers process idioms encountered in their L2. We used eye-tracking to see whether a highly proficient group of L1 Swedes showed any evidence of a formulaic processing advantage for English idioms. We also compared translations of Swedish idioms and congruent idioms (items that exist in both languages) to see how L1 knowledge is utilized during online processing. Results support the view that L1 knowledge is automatically used from the earliest stages of processing, regardless of whether sequences are congruent, and that exposure and advanced proficiency can lead to nativelike formulaic processing in the L2. |
Gloria Chamorro; Antonella Sorace; Patrick Sturt What is the source of L1 attrition? the effect of recent L1 re-exposure on Spanish speakers under L1 attrition Journal Article In: Bilingualism: Language and Cognition, vol. 19, no. 3, pp. 520–532, 2016. @article{Chamorro2016, The recent hypothesis that L1 attrition affects the ability to process interface structures but not knowledge representations (Sorace, 2011) is tested by investigating the effects of recent L1 re-exposure on antecedent preferences for Spanish pronominal subjects, using offline judgements and online eye-tracking measures. Participants included a group of native Spanish speakers experiencing L1 attrition ('attriters'), a second group of attriters exposed exclusively to Spanish before they were tested ('re-exposed'), and a control group of Spanish monolinguals. The judgement data shows no significant differences between the groups. Moreover, the monolingual and re-exposed groups are not significantly different from each other in the eye-tracking data. The results of this novel manipulation indicate that attrition effects decrease due to L1 re-exposure, and that bilinguals are sensitive to input changes. Taken together, the findings suggest that attrition affects online sensitivity with interface structures rather than causing a permanent change in speakers' L1 knowledge representations. |
Gloria Chamorro; Patrick Sturt; Antonella Sorace Selectivity in L1 attrition: Differential object marking in Spanish near-native speakers of English Journal Article In: Journal of Psycholinguistic Research, vol. 45, no. 3, pp. 697–715, 2016. @article{Chamorro2016a, Previous research has shown L1 attrition to be restricted to structures at the interfaces between syntax and pragmatics, but not to occur with syntactic properties that do not involve such interfaces ('Interface Hypothesis', Sorace and Filiaci in Anaphora resolution in near-native speakers of Italian. Second Lang Res 22: 339-368, 2006). The present study tested possible L1 attrition effects on a syntax-semantics interface structure [Differential Object Marking (DOM) using the Spanish personal preposition] as well as the effects of recent L1 re-exposure on the potential attrition of these structures, using offline and eye-tracking measures. Participants included a group of native Spanish speakers experiencing attrition ('attriters'), a second group of attriters exposed exclusively to Spanish before they were tested, and a control group of Spanish monolinguals. The eye-tracking results showed very early sensitivity to DOM violations, which was of an equal magnitude across all groups. The off-line results also showed an equal sensitivity across groups. These results reveal that structures involving 'internal' interfaces like the DOM do not undergo attrition either at the processing or representational level. |
Charles Clifton; Lyn Frazier Accommodation to an unlikely episodic state Journal Article In: Journal of Memory and Language, vol. 86, pp. 20–34, 2016. @article{Clifton2016, Mini-discourses like (ia) seem slightly odd compared to their counterparts containing a conjunction (ib).(i)a.Speaker A:John or Bill left.Speaker B:Sam did too.b.Speaker A:John and Bill left.Speaker B:Sam did too.One possibility is that or in Speaker A's utterance in (ia) raises the potential Question Under Discussion (QUD) whether it was John or Bill who left and Speaker B's reply fails to address this QUD. A different possibility is that the epistemic state of the speaker of (ia) is somewhat unlikely or uneven: the speaker knows that someone left, and that it was John or Bill, but doesn't know which one. The results of four acceptability judgment studies confirmed that (ia) is less good or coherent than (ib) (Experiment 1), but not due to failure to address the QUD implicitly introduced by the disjunction because the penalty for disjunction persisted even in the presence of a different overt QUD (Experiment 2) and even when there was no reply to Speaker A (Experiment 3). The hypothesis that accommodating an unusual epistemic state might underlie the lower acceptability of disjunction was supported by the fact that the disjunction penalty is larger in past tense discourses than in future discourses, where partial knowledge of events is the norm (Experiment 4). The results of an eye tracking study revealed a penalty for disjunction relative to conjunction that was significantly smaller when a lead in (. I wonder if it was. . .) explicitly introduced the disjunction. This interaction (connective X lead in) appeared in early measures on the disjunctive phrase itself, suggesting that the input is related to an inferred epistemic state of the speaker in a rapid and ongoing fashion. |
Moreno I. Coco; Frank Keller; George L. Malcolm Anticipation in real-world scenes: The role of visual context and visual memory Journal Article In: Cognitive Science, vol. 40, no. 8, pp. 1995–2024, 2016. @article{Coco2016, The human sentence processor is able to make rapid predictions about upcoming linguistic input. For example, upon hearing the verb eat, anticipatory eye-movements are launched toward edible objects in a visual scene (Altmann & Kamide, 1999). However, the cognitive mechanisms that underlie anticipation remain to be elucidated in ecologically valid contexts. Previous research has, in fact, mainly used clip-art scenes and object arrays, raising the possibility that anticipatory eye-movements are limited to displays containing a small number of objects in a visually impoverished context. In Experiment 1, we confirm that anticipation effects occur in real-world scenes and investigate the mechanisms that underlie such anticipation. In particular, we demonstrate that real-world scenes provide contextual information that anticipation can draw on: When the target object is not present in the scene, participants infer and fixate regions that are contextually appropriate (e.g., a table upon hearing eat). Experiment 2 investigates whether such contextual inference requires the co-presence of the scene, or whether memory representations can be utilized instead. The same real-world scenes as in Experiment 1 are presented to participants, but the scene disappears before the sentence is heard. We find that anticipation occurs even when the screen is blank, including when contextual inference is required. We conclude that anticipatory language processing is able to draw upon global scene representations (such as scene type) to make contextual inferences. These findings are compatible with theories assuming contextual guidance, but posit a challenge for theories assuming object-based visual indices. |
Kathy Conklin; Ana Pellicer-Sánchez Using eye-tracking in applied linguistics and second language research Journal Article In: Second Language Research, vol. 32, no. 3, pp. 453–467, 2016. @article{Conklin2016, With eye-tracking technology the eye is thought to give researchers a window into the mind. Importantly, eye-tracking has significant advantages over traditional online processing measures: chiefly that it allows for more ‘natural' processing as it does not require a secondary task, and that it provides a very rich moment-to-moment data source. In recognition of the technology's benefits, an ever increasing number of researchers in applied linguistics and second language research are beginning to use it. As eye-tracking gains traction in the field, it is important to ensure that it is established in an empirically sound fashion. To do this it is important for the field to come to an understanding about what eye-tracking is, what eye-tracking measures tell us, what it can be used for, and what different eye-tracking systems can and cannot do. Further, it is important to establish guidelines for designing sound research studies using the technology. The goal of the current review is to begin to address these issues. |
R. A. Hayes; Michael Walsh Dickey; Tessa Warren Looking for a location: Dissociated effects of event-related plausibility and verb–argument information on predictive processing in aphasia Journal Article In: American Journal of Speech-Language Pathology, vol. 25, no. 3, pp. S758–S775, 2016. @article{Hayes2016a, PURPOSE: This study examined the influence of verb-argument information and event-related plausibility on prediction of upcoming event locations in people with aphasia, as well as older and younger, neurotypical adults. It investigated how these types of information interact during anticipatory processing and how the ability to take advantage of the different types of information is affected by aphasia. METHOD: This study used a modified visual-world task to examine eye movements and offline photo selection. Twelve adults with aphasia (aged 54-82 years) as well as 44 young adults (aged 18-31 years) and 18 older adults (aged 50-71 years) participated. RESULTS: Neurotypical adults used verb argument status and plausibility information to guide both eye gaze (a measure of anticipatory processing) and image selection (a measure of ultimate interpretation). Argument status did not affect the behavior of people with aphasia in either measure. There was only limited evidence of interaction between these 2 factors in eye gaze data. CONCLUSIONS: Both event-related plausibility and verb-based argument status contributed to anticipatory processing of upcoming event locations among younger and older neurotypical adults. However, event-related likelihood had a much larger role in the performance of people with aphasia than did verb-based knowledge regarding argument structure. |
Daphna Heller; Christopher Parisien; Suzanne Stevenson Perspective-taking behavior as the probabilistic weighing of multiple domains Journal Article In: Cognition, vol. 149, pp. 104–120, 2016. @article{Heller2016, Our starting point is the apparently-contradictory results in the psycholinguistic literature regarding whether, when interpreting a definite referring expressions, listeners process relative to the common ground from the earliest moments of processing. We propose that referring expressions are not interpreted relative solely to the common ground or solely to one's Private (or egocentric) knowledge, but rather reflect the simultaneous integration of the two perspectives. We implement this proposal in a Bayesian model of reference resolution, focusing on the model's predictions for two prior studies: Keysar, Barr, Balin, and Brauner (2000) and Heller, Grodner and Tanenhaus (2008). We test the model's predictions in a visual-world eye-tracking experiment, demonstrating that the original results cannot simply be attributed to different perspective-taking strategies, and showing how they can arise from the same perspective-taking behavior. |
John M. Henderson; Wonil Choi; Matthew W. Lowder; Fernanda Ferreira Language structure in the brain: A fixation-related fMRI study of syntactic surprisal in reading Journal Article In: NeuroImage, vol. 132, pp. 293–300, 2016. @article{Henderson2016, How is syntactic analysis implemented by the human brain during language comprehension? The current study combined methods from computational linguistics, eyetracking, and fMRI to address this question. Subjects read passages of text presented as paragraphs while their eye movements were recorded in an MRI scanner. We parsed the text using a probabilistic context-free grammar to isolate syntactic difficulty. Syntactic difficulty was quantified as syntactic surprisal, which is related to the expectedness of a given word's syntactic category given its preceding context. We compared words with high and low syntactic surprisal values that were equated for length, frequency, and lexical surprisal, and used fixation-related (FIRE) fMRI to measure neural activity associated with syntactic surprisal for each fixated word. We observed greater neural activity for high than low syntactic surprisal in two predicted cortical regions previously identified with syntax: left inferior frontal gyrus (IFG) and less robustly, left anterior superior temporal lobe (ATL). These results support the hypothesis that left IFG and ATL play a central role in syntactic analysis during language comprehension. More generally, the results suggest a broader cortical network associated with syntactic prediction that includes increased activity in bilateral IFG and insula, as well as fusiform and right lingual gyri. |
Roberto R. Heredia; Anna B. Cieślicka Metaphoric reference: An eye movement analysis of Spanish-English and English-Spanish bilingual readers Journal Article In: Frontiers in Psychology, vol. 7, pp. 439, 2016. @article{Heredia2016, This study examines the processing of metaphoric reference by bilingual speakers. English dominant, Spanish dominant, and balanced bilinguals read passages in English biasing either a figurative (e.g., describing a weak and soft fighter that always lost and everyone hated) or a literal (e.g., describing a donut and bakery shop that made delicious pastries) meaning of a critical metaphoric referential description (e.g., 'creampuff'). We recorded the eye movements (first fixation, gaze duration, go-past duration, and total reading time) for the critical region, which was a metaphoric referential description in each passage. The results revealed that literal vs. figurative meaning activation was modulated by language dominance, where Spanish dominant bilinguals were more likely to access the literal meaning, and English dominant and balanced bilinguals had access to both the literal and figurative meanings of the metaphoric referential description. Overall, there was a general tendency for the literal interpretation to be more active, as revealed by shorter reading times for the metaphoric reference used literally, in comparison to when it was used figuratively. Results are interpreted in terms of the Graded Salience Hypothesis (Giora, 2002, 2003) and the Literal Salience Model (Cieślicka, 2006, 2015). |
Ehab W. Hermena; Simon P. Liversedge; Denis Drieghe Parafoveal processing of Arabic diacritical marks Journal Article In: Journal of Experimental Psychology: Human Perception and Performance, vol. 42, no. 12, pp. 2021–2038, 2016. @article{Hermena2016, Diacritics are glyph-like marks on letters that convey vowel information in Arabic, thus allowing for accurate pronunciation and disambiguation of homographs. For skilled readers, diacritics are usually omitted except when their omission causes ambiguity. Undiacritized homographs are very common in Arabic and are predominantly heterophones (where each meaning sounds different), with 1 version more common (dominant) than the others (subordinate). In this study the authors investigated parafoveal processing of diacritics during reading. They presented native readers with heterophonic homographs embedded in sentences with diacritization that instantiated either dominant or subordinate pronunciations of the homographs. Using the boundary paradigm, they presented previews of these words carrying either: identical diacritization to the target; inaccurate diacritization, such that if the target had dominant diacritization, the preview contained subordinate diacritization, and vice versa; or no diacritics. The results showed that readers processed the identity of diacritics parafoveally, such that inaccurate previews of the diacritics resulted in inflated fixation durations, particularly for fixations originating at close launch sites. Moreover, our results clearly indicate that readers' expectation for dominant or subordinate diacritization patterns influences their parafoveal and foveal processing of diacritics. Specifically, a perceived absence of diacritics (either in no-diacritics previews, or because the eyes were too far away to process the presence of diacritics) induced an expectation for the dominant pronunciation, whereas the perceived presence of diacritics induced an expectation for the subordinate meaning. |
Béryl Hilberink-Schulpen; Ulrike Nederstigt; Frank Meurs; Emmie Alem Does the use of a foreign language influence attention and genre-specific viewing patterns for job advertisements? An eye-tracking study Journal Article In: Information Processing and Management, vol. 52, no. 6, pp. 1018–1030, 2016. @article{HilberinkSchulpen2016, The aim of this online experiment was to find evidence for both the alleged attention-getting function of the use of L2 English in job advertisements and for a possible genre–specific viewing pattern for job advertisements. A mixed design eye–track experiment among 30 native speakers of Dutch who saw all-Dutch and mixed Dutch– English job advertisements tested whether the use of foreign language English in Dutch ads changed the viewing pattern compared to all-Dutch job advertisements. That is, it investigated whether the use of a foreign language attracted more attention (in terms of first fixation, number and duration of fixations, and returned views), and altered the genre–specific viewing pattern for job ads. Overall, no evidence for the attention–getting ability of foreign language use in jobs ads was found. On the contrary, English used in the company information seemed to have a deterring effect. Support was found for a genre–specific viewing pattern for job ads, which, however, was not altered by the use of a foreign language. Our results suggest that use of English is not necessarily a good option to attract attention. Findings for genre-specific viewing patterns suggest that makers of job ads should make the job description as attractive as possible, since this is the first element viewed. This is the first online study to investigate the effect of language choice on attention in job ads and the viewing patterns specific to this ad genre. |
Nina S. Hsu; Jared M. Novick Dynamic engagement of cognitive control modulates recovery from misinterpretation during real-time language processing Journal Article In: Psychological Science, vol. 27, no. 4, pp. 572–582, 2016. @article{Hsu2016, Speech unfolds swiftly, yet listeners keep pace by rapidly assigning meaning to what they hear. Sometimes, though, initial interpretations turn out to be wrong. How do listeners revise misinterpretations of language input moment by moment to avoid comprehension errors? Cognitive control may play a role by detecting when processing has gone awry and then initiating behavioral adjustments accordingly. However, no research to date has investigated a cause-and-effect interplay between cognitive-control engagement and the overriding of erroneous interpretations in real time. Using a novel cross-task paradigm, we showed that Stroop-conflict detection, which mobilizes cognitive-control procedures, subsequently facilitates listeners' incremental processing of temporarily ambiguous spoken instructions that induce brief misinterpretation. When instructions followed incongruent Stroop items, compared with congruent Stroop items, listeners' eye movements to objects in a scene reflected more transient consideration of the false interpretation and earlier recovery of the correct one. Comprehension errors also decreased. Cognitive-control engagement therefore accelerates sentence-reinterpretation processes, even as linguistic input is still unfolding. |
Yi Ting Huang; Alison R. Arnold Word learning in linguistic context: Processing and memory effects Journal Article In: Cognition, vol. 156, pp. 71–87, 2016. @article{Huang2016, During language acquisition, children exploit syntactic cues within sentences to learn the meanings of words. Yet, it remains unknown how this strategy develops alongside an ability to access cues during real-time language comprehension. This study investigates how on-line sensitivity to syntactic cues impacts off-line interpretation and recall of word meanings. Adults and 5-year-olds heard novel words embedded in sentences that were (1) consistent with an agent-first bias (e.g., “The blicket will be eating the seal” → “the blicket” is an agent), (2) required revision of this bias (e.g., “The blicket will be eaten by the seal” → “the blicket” is a theme), or (3) weakened this bias through a familiar NP1 (e.g., “The seal will be eating/eaten by the blicket” → “the seal” is an agent or theme). Across both ages, eye-movements during sentences revealed decreased sensitivity to syntactic cues in contexts that required syntactic revision. In children, the magnitude of on-line sensitivity was positively associated with the accuracy of learning after the sentence. Parsing challenges during the word-learning task also negatively impacted children's later memory for word meanings during a recall task. Altogether, these results suggest that real-time demands impact word learning, through interpretive failures and memory interference. |
Falk Huettig; Esther Janse Individual differences in working memory and processing speed predict anticipatory spoken language processing in the visual world Journal Article In: Language, Cognition and Neuroscience, vol. 31, no. 1, pp. 80–93, 2016. @article{Huettig2016, Several mechanisms of predictive language processing have been proposed. The possible influence of mediating factors such as working memory and processing speed, however, has largely been ignored. We sought to find evidence for such an influence using an individual differences approach. 105 participants from 32–77 years of age received spoken instructions (e.g. “Kijk naar deCOM afgebeelde pianoCOM”– look at the displayed piano) while viewing 4 objects. Articles (Dutch “het” or “de”) were gender-marked such that the article agreed in gender only with the target. Participants could thus use article gender information to predict the target. Multiple regression analyses showed that enhanced working memory abilities and faster processing speed predicted anticipatory eye movements. Models of predictive language processing therefore must take mediating factors into account. More generally, our results are consistent with the notion that working memory grounds language in space and time, linking linguistic and visual–spatial representations. |
Jukka Hyönä; Miia Ekholm Background speech effects on sentence processing during reading: An eye movement study Journal Article In: PLoS ONE, vol. 11, no. 3, pp. e0152133, 2016. @article{Hyoenae2016, Effects of background speech on reading were examined by playing aloud different types of background speech, while participants read long, syntactically complex and less complex sentences embedded in text. Readers' eye movement patterns were used to study online sentence comprehension. Effects of background speech were primarily seen in rereading time. In Experiment 1, foreign-language background speech did not disrupt sentence pro- cessing. Experiment 2 demonstrated robust disruption in reading as a result of semantically and syntactically anomalous scrambled background speech preserving normal sentence- like intonation. Scrambled speech that was constructed from the text to-be read did not dis- rupt reading more than scrambled speech constructed from a different, semantically unre- lated text. Experiment 3 showed that scrambled speech exacerbated the syntactic complexity effect more than coherent background speech, which also interfered with read- ing. Experiment 4 demonstrated that both semantically and syntactically anomalous speech produced no more disruption in reading than semantically anomalous but syntactically cor- rect background speech. The pattern of results is best explained by a semantic account that stresses the importance of similarity in semantic processing, but not similarity in semantic content, between the reading task and background speech. Introduction |
Benjamin Gagl Blue hypertext is a good design decision: No perceptual disadvantage in reading and successful highlighting of relevant information Journal Article In: PeerJ, vol. 4, pp. 1–11, 2016. @article{Gagl2016, BACKGROUND: Highlighted text in the Internet (i.e., hypertext) is predominantly blue and underlined. The perceptibility of these hypertext characteristics was heavily questioned by applied research and empirical tests resulted in inconclusive results. The ability to recognize blue text in foveal and parafoveal vision was identified as potentially constrained by the low number of foveally centered blue light sensitive retinal cells. The present study investigates if foveal and parafoveal perceptibility of blue hypertext is reduced in comparison to normal black text during reading. METHODS: A silent-sentence reading study with simultaneous eye movement recordings and the invisible boundary paradigm, which allows the investigation of foveal and parafoveal perceptibility, separately, was realized (comparing fixation times after degraded vs. un-degraded parafoveal previews). Target words in sentences were presented in either black or blue and either underlined or normal. RESULTS: No effect of color and underlining, but a preview benefit could be detected for first pass reading measures. Fixation time measures that included re-reading, e.g., total viewing times, showed, in addition to a preview effect, a reduced fixation time for not highlighted (black not underlined) in contrast to highlighted target words (either blue or underlined or both). DISCUSSION: The present pattern reflects no detectable perceptual disadvantage of hyperlink stimuli but increased attraction of attention resources, after first pass reading, through highlighting. Blue or underlined text allows readers to easily perceive hypertext and at the same time readers re-visited highlighted words longer. On the basis of the present evidence, blue hypertext can be safely recommended to web designers for future use. |
Lesya Y. Ganushchak; Yiya Chen Incrementality in planning of speech during speaking and reading aloud: Evidence from eye-tracking Journal Article In: Frontiers in Psychology, vol. 7, pp. 33, 2016. @article{Ganushchak2016, Speaking is an incremental process where planning and articulation interleave. While incrementality has been studied in reading and online speech production separately, it has not been directly compared within one investigation. This study set out to compare the extent of planning incrementality in online sentence formulation versus reading aloud and how discourse context may constrain the planning scope of utterance preparation differently in these two modes of speech planning. Two eye-tracking experiments are reported: participants either described pictures of transitive events (Experiment 1) or read aloud the written descriptions of those events (Experiment 2). In both experiments, the information status of an object character was manipulated in the discourse preceding each picture or sentence. In the Literal condition, participants heard a story where object character was literally mentioned (e.g., fly). In the No Mention condition, stories did not literally mention nor prime the object character depicted on the picture or written in the sentence. The target response was expected to have the same structure and content in all conditions (The frog catches the fly). During naming, the results showed shorter speech onset latencies in the Literal condition than in the No Mention condition. However, no significant differences in gaze durations were found. In contrast, during reading, there were no significant differences in speech onset latencies but there were significantly longer gaze durations to the target picture/word in the Literal than in the No Mention condition. Our results shot that planning is more incremental during reading than during naming and that discourse context can be helpful during speaker but may hinder during reading aloud. Taken together our results suggest that on-line planning of response is affected by both linguistic and non-linguistic factors. |
Peter C. Gordon; Renske S. Hoedemaker Effective scheduling of looking and talking during rapid automatized naming Journal Article In: Journal of Experimental Psychology: Human Perception and Performance, vol. 42, no. 5, pp. 742–760, 2016. @article{Gordon2016, Rapid automatized naming (RAN) is strongly related to literacy gains in developing readers, reading disabilities, and reading ability in children and adults. Because successful RAN performance depends on the close coordination of a number of abilities, it is unclear what specific skills drive this RAN-reading relationship. The current study used concurrent recordings of young adult participants' vocalizations and eye movements during the RAN task to assess how individual variation in RAN performance depends on the coordination of visual and vocal processes. Results showed that fast RAN times are facilitated by having the eyes 1 or more items ahead of the current vocalization, as long as the eyes do not get so far ahead of the voice as to require a regressive eye movement to an earlier item. These data suggest that optimizing RAN performance is a problem of scheduling eye movements and vocalization given memory constraints and the efficiency of encoding and articulatory control. Both RAN completion time (con- ventionally used to indicate RAN performance) and eye-voice relations predicted some aspects of participants' eye movements on a separate sentence reading task. However, eye-voice relations predicted additional features of first-pass reading that were not predicted by RAN completion time. This shows that measurement of eye-voice patterns can identify important aspects of individual variation in reading that are not identified by the standard measure of RAN performance. We argue that RAN performance predicts reading ability because both tasks entail challenges of scheduling cognitive and linguistic processes that operate simultaneously on multiple linguistic inputs. |
Julie Gregg; Albrecht W. Inhoff Misperception of orthographic neighbors during silent and oral reading Journal Article In: Journal of Experimental Psychology: Human Perception and Performance, vol. 42, no. 6, pp. 799–820, 2016. @article{Gregg2016, The study examined whether words are misperceived during natural fluent reading and the extent to which contextual and lexical properties bias perception. Target words were pairs of orthographic neighbors that differed in frequency. Pretarget context was neutral (Experiment 1) or biased toward the higher frequency member of the pair (Experiments 2 and 3), and posttarget context was neutral, congruent, or incongruent. Critically, incongruent context was constructed so that it was congruent with the target's neighbor. First-pass viewing showed only effects of target frequency. During silent reading (Experiments 1 and 2), rereading measures showed that the target frequency effect was smaller in the incongruent posttarget context condition than in the neutral and congruent conditions, and this occurred irrespective of prior context. Presumably, lower frequency words were less impeded by incongruent context because they were often misperceived as a congruent higher frequency neighbor. An oral reading task (Experiment 3) showed that the lower frequency target was more often misread than the higher frequency neighbor, and this proneness to error was influenced by posttarget context. Although target frequency influenced proneness to error, biased prior sentence context appeared to influence the construal of sentence meaning to accommodate incongruent targets and posttarget context. |
Ann Kathrin Grohe; Andrea Weber The penefit of salience: Salient accented, but not unaccented words reveal accent adaptation effects Journal Article In: Frontiers in Psychology, vol. 7, pp. 864, 2016. @article{Grohe2016, In two eye-tracking experiments, the effects of salience in accent training and speech accentedness on spoken-word recognition were investigated. Salience was expected to increase a stimulus' prominence and therefore promote learning. A training-test paradigm was used on native German participants utilizing an artificial German accent. Salience was elicited by two different criteria: Production and listening training as a subjective criterion and accented (Experiment 1) and canonical test words (Experiment 2) as an objective criterion. During training in Experiment 1, participants either read single German words out loud and deliberately devoiced initial voiced stop consonants (e.g., Balken-"beam" pronounced as *Palken), or they listened to pre-recorded words with the same accent. In a subsequent eye-tracking experiment, looks to auditorily presented target words with the accent were analyzed. Participants from both training conditions fixated accented target words more often than a control group without training. Training was identical in Experiment 2, but during test, canonical German words that overlapped in onset with the accented words from training were presented as target words (e.g., Palme-"palm tree" overlapped in onset with the training word *Palken) rather than accented words. This time, no training effect was observed; recognition of canonical word forms was not affected by having learned the accent. Therefore, accent learning was only visible when the accented test tokens in Experiment 1, which were not included in the test of Experiment 2, possessed sufficient salience based on the objective criterion "accent." These effects were not modified by the subjective criterion of salience from the training modality. |
Qian Guo; Young-Suk Grace Kim; Li Yang; Lihui Liu Does previewing answer choice options improve performance on reading tests? Journal Article In: Reading and Writing, vol. 29, no. 4, pp. 745–760, 2016. @article{Guo2016, Previewing answer-choice options before finishing reading the text is a widely employed test-taking behavior. In the present study we examined whether previewing is related to item response accuracy and response time, using data from Chinese learners of varying English proficiency levels and English native speakers. We examined eye movement patterns of participants who completed online multiple-choice sentence completion tasks, and how previewing was related to reading performance and whether the relation varied as a function of English proficiency level. The results showed that, relative to no previewing, previewing was associated with a significantly lower probability of answering an item correctly but not with significantly longer response time. Importantly, these relations varied across English proficiency levels such that participants with higher proficiency performed better without previewing, but there was no difference for lower-intermediate learners of English. These findings suggest that previewing does not facilitate performance on a sentence comprehension task, but instead interferes with the comprehension process, particularly for individuals with relatively high language proficiency. |
Rosa E. Guzzardo Tamargo; Jorge R. Valdés Kroff; Paola E. Dussias Examining the relationship between comprehension and production processes in code-switched language Journal Article In: Journal of Memory and Language, vol. 89, pp. 138–161, 2016. @article{GuzzardoTamargo2016, We employ code-switching (the alternation of two languages in bilingual communication) to test the hypothesis, derived from experience-based models of processing (e.g., Boland, Tanenhaus, Carlson, & Garnsey, 1989; Gennari & MacDonald, 2009), that bilinguals are sensitive to the combinatorial distributional patterns derived from production and that they use this information to guide processing during the comprehension of code-switched sentences. An analysis of spontaneous bilingual speech confirmed the existence of production asymmetries involving two auxiliary + participle phrases in Spanish-English code-switches. A subsequent eye-tracking study with two groups of bilingual code-switchers examined the consequences of the differences in distributional patterns found in the corpus study for comprehension. Participants' comprehension costs mirrored the production patterns found in the corpus study. Findings are discussed in terms of the constraints that may be responsible for the distributional patterns in code-switching production and are situated within recent proposals of the links between production and comprehension. |
Julia Habicht; Birger Kollmeier; Tobias Neher Are experienced hearing aid users faster at grasping the meaning of a sentence than inexperienced users? An eye-tracking study Journal Article In: Trends in Hearing, vol. 20, 2016. @article{Habicht2016, This study assessed the effects of hearing aid (HA) experience on how quickly a participant can grasp the meaning of an acoustic sentence-in-noise stimulus presented together with two similar pictures that either correctly (target) or incorrectly (competitor) depict the meaning conveyed by the sentence. Using an eye tracker, the time taken by the participant to start fixating the target (the processing time) was measured for two levels of linguistic complexity (low vs. high) and three HA conditions: clinical linear amplification (National Acoustic Laboratories-Revised), single-microphone noise reduction with National Acoustic Laboratories-Revised, and linear amplification ensuring a sensation level of515 dB up to at least 4 kHz for the speech material used here. Timed button presses to the target stimuli after the end of the sentences (offline reaction times) were also collected. Groups of experienced (eHA) and inexperienced (iHA) HA users matched in terms of age, hearing loss, and working memory capacity took part (N¼15 each). For the offline reaction times, no effects were found. In contrast, processing times increased with linguistic complexity. Furthermore, for all HA conditions, processing times were longer (poorer) for the iHA group than for the eHA group, despite comparable speech recognition performance. Taken together, these results indicate that processing times are more sensitive to speech processing-related factors than offline reaction times. Furthermore, they support the idea that HA experience positively impacts the ability to process noisy speech quickly, irrespective of the precise gain characteristics. |
Britt Hadar; Joshua E. Skrzypek; Arthur Wingfield; Boaz M. Ben-David Working memory load affects processing time in spoken word recognition: Evidence from eye-movements Journal Article In: Frontiers in Neuroscience, vol. 10, pp. 221, 2016. @article{Hadar2016, In daily life, speech perception is usually accompanied by other tasks that tap into working memory capacity. However, the role of working memory on speech processing is not clear. The goal of this study was to examine how working memory load affects the timeline for spoken word recognition in ideal listening conditions. We used the “visual world” eye-tracking paradigm. The task consisted of spoken instructions referring to one of four objects depicted on a computer monitor (e.g., “point at the candle”). Half of the trials presented a phonological competitor to the target word that either overlapped in the initial syllable (onset) or at the last syllable (offset). Eye movements captured listeners' ability to differentiate the target noun from its depicted phonological competitor (e.g., candy or sandal). We manipulated working memory load by using a digit pre-load task, where participants had to retain either one (low-load) or four (high-load) spoken digits for the duration of a spoken word recognition trial. The data show that the high-load condition delayed real-time target discrimination. Specifically, a four-digit load was sufficient to delay the point of discrimination between the spoken target word and its phonological competitor. Our results emphasize the important role working memory plays in speech perception, even when performed by young adults in ideal listening conditions. |
Matthew Haigh; Jeffrey S. Wood; Andrew J. Stewart Slippery slope arguments imply opposition to change Journal Article In: Memory & Cognition, vol. 44, no. 5, pp. 819–836, 2016. @article{Haigh2016, Slippery slope arguments (SSAs) of the form if A, then C describe an initial proposal (A) and a predicted, undesirable consequence of this proposal (C) (e.g., “If cannabis is ever legalized, then eventually cocaine will be legalized, too”). Despite SSAs being a common rhetorical device, there has been surprisingly little empirical research into their subjective evaluation and perception. Here, we present evidence that SSAs are interpreted as a form of consequentialist argument, inviting inferences about the speaker's (or writer's) attitudes. Study 1 confirmed the common intuition that a SSA is perceived to be an argument against the initial proposal (A), whereas Study 2 showed that the subjective strength of this inference relates to the subjective undesirability of the predicted consequences (C). Because arguments are rarely made out of context, in Studies 3 and 4 we examined how one important contextual factor, the speaker's known beliefs, influences the perceived coherence, strength, and persuasiveness of a SSA. Using an unobtrusive dependent variable (eye movements during reading), in Study 3 we showed that readers are sensitive to the internal coherence between a speaker's beliefs and the implied meaning of the argument. Finally, Study 4 revealed that this degree of internal coherence influences the perceived strength and persuasiveness of the argument. Together, these data indicate that SSAs are treated as a form of negative consequentialist argument. People infer that the speaker of a SSA opposes the initial proposal; therefore, SSAs are only perceived to be persuasive and conversationally relevant when the speaker's attitudes match this inference. |
Tuomo Häikiö; Raymond Bertram; Jukka Hyönä The hyphen as a syllabification cue in reading bisyllabic and multisyllabic words among Finnish 1st and 2nd graders Journal Article In: Reading and Writing, vol. 29, no. 1, pp. 159–182, 2016. @article{Haeikioe2016, Finnish ABC books present words with hyphens inserted at syllable boundaries. Syllabification by hyphens is abandoned in the 2nd grade for bisyllabic words, but continues for words with three or more syllables. The current eye movement study investigated how and to what extent syllable hyphens in bisyllabic (kah-vi ?cof-fee?) and multisyllabic words (haa-ruk-ka ?fork?, ap-pel-sii-ni ?orange?) affect eye movement behavior and reading speed of Finnish 1st and 2nd graders. Experiment 1 showed that 2nd graders had longer gaze durations, needed more fixations and had longer selective regression path durations for hyphenated than concatenated words. This implies that hyphenated words were difficult to process when first encountered, but also hard to integrate with prior sentence context. The effects were modified by number of syllables and reading skill. That is, the hyphenation effects were larger for multisyllabic than bisyllabic words and larger for more than less proficient readers. Experiment 2 showed the same hyphenation effect for 1st graders reading long multisyllabic words, even with a hyphen that was smaller in size and hence visually less salient. We argue that syllable hyphens prevent reasonably proficient readers from using the most efficient processing route for bi- and multisyllabic words and discuss the possible implications of the results for early Finnish reading instruction. |
Jesse A. Harris Processing let alone coordination in silent reading Journal Article In: Lingua, vol. 169, pp. 70–94, 2016. @article{Harris2016, Processing research on coordination indicates that simpler conjuncts are preferred over more complex ones, and that positing ellipsis structure in the second conjunct is taxing to process when a simpler non-ellipsis structure exists. The present study investigates let alone coordination, which is argued to require clausal ellipsis in the second conjunct. It is proposed that the processor always projects a clausal structure for the second conjunct for the ellipsis, obviating a general preference for a less complex conjunct. Experiment 1 consists of several sentence-completion questionnaires testing whether a DP or VP conjunct is preferred in let alone structures as in John doesn't like Mary, let alone (Sue | love her). The results found a bias towards VP remnants that was weakly affected by syntactic placement of the focus particle even, as well as by prior context. Experiment 2 examined the effect of remnant type on eye movements during silent reading, revealing only distinct processing patterns, rather than major processing penalties, for different remnant types, and a general facilitation when even was present to signal upcoming scalar contrast. |
Muriel Dysli; Mathias Abegg Nystagmus does not limit reading ability in albinism Journal Article In: PLoS ONE, vol. 11, no. 7, pp. e0158815, 2016. @article{Dysli2016, PURPOSE: Subjects with albinism usually suffer from nystagmus and reduced visual acuity, which may impair reading performance. The contribution of nystagmus to decreased reading ability is not known. Low vision and nystagmus may have an additive effect. We aimed to address this question by motion compensation of the nystagmus in affected subjects and by simulating nystagmus in healthy controls. METHODS: Reading speed and eye movements were assessed in 9 subjects with nystagmus associated with albinism and in 12 healthy controls. We compared the reading ability with steady word presentation and with words presented on a gaze contingent display where words move in parallel to the nystagmus and thus correct for the nystagmus. As the control, healthy subjects were asked to read words and texts in steady reading conditions as well as text passages that moved in a pattern similar to nystagmus. RESULTS: Correcting nystagmus with a gaze contingent display neither improved nor reduced the reading speed for single words. Subjects with nystagmus and healthy participants achieved comparable reading speed when reading steady texts. However, movement of text in healthy controls caused a significantly reduced reading speed and more regressive saccades. CONCLUSIONS: Our results argue against nystagmus as the rate limiting factor for reading speed when words were presented in high enough magnification and support the notion that other sensory visual impairments associated with albinism (for example reduced visual acuity) might be the primary causes for reading impairment. |
Gerardo Fernández; Salvador Guinjoan; Marcelo Sapognikoff; David Orozco; Osvaldo Agamennoni Contextual predictability enhances reading performance in patients with schizophrenia Journal Article In: Psychiatry Research, vol. 241, pp. 333–339, 2016. @article{Fernandez2016, In the present work we analyzed fixation duration in 40 healthy individuals and 18 patients with chronic, stable SZ during reading of regular sentences and proverbs. While they read, their eye movements were recorded. We used lineal mixed models to analyze fixation durations. The predictability of words N-1, N, and N+1 exerted a strong influence on controls and SZ patients. The influence of the predictabilities of preceding, current, and upcoming words on SZ was clearly reduced for proverbs in comparison to regular sentences. Both controls and SZ readers were able to use highly predictable fixated words for an easier reading. Our results suggest that SZ readers might compensate attentional and working memory deficiencies by using stored information of familiar texts for enhancing their reading performance. The predictabilities of words in proverbs serve as task-appropriate cues that are used by SZ readers. To the best of our knowledge, this is the first study using eyetracking for measuring how patients with SZ process well-defined words embedded in regular sentences and proverbs. Evaluation of the resulting changes in fixation durations might provide a useful tool for understanding how SZ patients could enhance their reading performance. |
Gerardo Fernández; Facundo Manes; Luis E. Politi; David Orozco; Marcela Schumacher; Liliana Castro; Osvaldo Agamennoni; Nora P. Rotstein Patients with mild Alzheimer's disease fail when using their working memory: Evidence from the eye tracking technique Journal Article In: Journal of Alzheimer's Disease, vol. 50, no. 3, pp. 827–838, 2016. @article{Fernandez2016a, Patients with Alzheimer's disease (AD) develop progressive language, visuoperceptual, attentional, and oculomotor changes that can have an impact on their reading comprehension. However, few studies have examined reading behavior in AD, and none have examined the contribution of predictive cueing in reading performance. For this purpose we analyzed the eye movement behavior of 35 healthy readers (Controls) and 35 patients with probable AD during reading of regular and highpredictable sentences. The cloze predictability of words N- 1, and N+ 1 exerted an influence on the reader's gaze duration. The predictabilities of preceding words in high-predictable sentences served as task-appropriate cues that were used by Control readers. In contrast, these effects were not present in AD patients. In Controls, changes in predictability significantly affected fixation duration along the sentence; noteworthy, these changes did not affect fixation durations in AD patients. Hence, only in healthy readers did predictability of upcoming words influence fixation durations via memory retrieval. Our results suggest that Controls used stored information of familiar texts for enhancing their reading performance and imply that contextual-word predictability, whose processing is proposed to require memory retrieval, only affected reading behavior in healthy subjects. In AD patients, this loss reveals impairments in brain areas such as those corresponding to working memory and memory retrieval. These findings might be relevant for expanding the options for the early detection and monitoring in the early stages of AD. Furthermore, evaluation of eye movements during reading could provide a new tool for measuring drug impact on patients' behavior. |
Gerardo Fernández; Marcelo Sapognikoff; Salvador Guinjoan; David Orozco; Osvaldo Agamennoni Word processing during reading sentences in patients with schizophrenia: Evidences from the eyetracking technique Journal Article In: Comprehensive Psychiatry, vol. 68, pp. 193–200, 2016. @article{Fernandez2016b, Purpose: The current study analyze the effect of word properties (i.e., word length, word frequency and word predictability) on the eye movement behavior of patients with schizophrenia (SZ) compared to age-matched controls. Method: 18 SZ patients and 40 age matched controls participated in the study. Eye movements were recorded during reading regular sentences by using the eyetracking technique. Eye movement analyses were performed using linear mixed models. Findings: Analysis of eye movements revealed that patients with SZ decreased the amount of single fixations, increased their total number of second pass fixations compared with healthy individuals (Controls). In addition, SZ patients showed an increase in gaze duration, compared to Controls. Interestingly, the effects of current word frequency and current word length processing were similar in Controls and SZ patients. The high rate of second pass fixations and its low rate in single fixation might reveal impairments in working memory when integrating neighbor words. In contrast, word frequency and length processing might require less complex mechanisms, which were functioning in SZ patients. Conclusion: To the best of our knowledge, this is the first study measuring how patients with SZ process dynamically well-defined words embedded in regular sentences. The findings suggest that evaluation of the resulting changes in eye movement behavior may supplement current symptom-based diagnosis. |
Aline Ferreira; John Wayne Schwieter; Alexandra Gottardo; Jefferey Jones Cognitive effort in direct and inverse translation performance: Insight from eye-tracking technology Journal Article In: Cadernos de Tradução, vol. 36, no. 3, pp. 60–80, 2016. @article{Ferreira2016, This case study examined the translation performance of four professional translators with the aim of exploring the cognitive effort involved in direct and inverse translation. Four professional translators translated two comparable texts from English into Spanish and from Spa- nish into English. Eye-tracking technology was used to analyze the total time spent in each task, fixation time, and average fixation time. Fixation count in three areas of interest was measured including: source text, target text, and browser, used as an external support. Results suggested that although total time and fixation count were indicators of cognitive effort during the tasks, fixation count in the areas of interest data showed that more effort was directed toward the source text in both tasks. Overall, this study demonstrates that while more traditional measures for translation difficulty (e.g., total time) indicate more effort in the inverse translation task, eye-tracking data indicate that differences in the effort applied in both directions must be carefully analyzed, mostly regarding the areas of interest. |
Phillip D. Fletcher; Jennifer M. Nicholas; Laura E. Downey; Hannah L. Golden; Camilla N. Clark; Carolina Pires; Jennifer L. Agustus; Catherine J. Mummery; Jonathan M. Schott; Jonathan D. Rohrer; Sebastian J. Crutch; Jason D. Warren A physiological signature of sound meaning in dementia Journal Article In: Cortex, vol. 77, pp. 13–23, 2016. @article{Fletcher2016, The meaning of sensory objects is often behaviourally and biologically salient and decoding of semantic salience is potentially vulnerable in dementia. However, it remains unclear how sensory semantic processing is linked to physiological mechanisms for coding object salience and how that linkage is affected by neurodegenerative diseases. Here we addressed this issue using the paradigm of complex sounds. We used pupillometry to compare physiological responses to real versus synthetic nonverbal sounds in patients with canonical dementia syndromes (behavioural variant frontotemporal dementia - bvFTD, semantic dementia - SD; progressive nonfluent aphasia - PNFA; typical Alzheimer's disease - AD) relative to healthy older individuals. Nonverbal auditory semantic competence was assessed using a novel within-modality sound classification task and neuroanatomical associations of pupillary responses were assessed using voxel-based morphometry (VBM) of patients' brain MR images. After taking affective stimulus factors into account, patients with SD and AD showed significantly increased pupil responses to real versus synthetic sounds relative to healthy controls. The bvFTD, SD and AD groups had a nonverbal auditory semantic deficit relative to healthy controls and nonverbal auditory semantic performance was inversely correlated with the magnitude of the enhanced pupil response to real versus synthetic sounds across the patient cohort. A region of interest analysis demonstrated neuroanatomical associations of overall pupil reactivity and differential pupil reactivity to sound semantic content in superior colliculus and left anterior temporal cortex respectively. Our findings suggest that autonomic coding of auditory semantic ambiguity in the setting of a damaged semantic system may constitute a novel physiological signature of neurodegenerative diseases. |
Melinda Fricke; Judith F. Kroll; Paola E. Dussias Phonetic variation in bilingual speech: A lens for studying the production-comprehension link Journal Article In: Journal of Memory and Language, vol. 89, pp. 110–137, 2016. @article{Fricke2016, We exploit the unique phonetic properties of bilingual speech to ask how processes occurring during planning affect speech articulation, and whether listeners can use the phonetic modulations that occur in anticipation of a codeswitch to help restrict their lexical search to the appropriate language. An analysis of spontaneous bilingual codeswitching in the Bangor Miami Corpus (Deuchar, Davies, Herring, Parafita Couto, & Carter, 2014) reveals that in anticipation of switching languages, Spanish-English bilinguals produce slowed speech rate and cross-language phonological influence on consonant voice onset time. A study of speech comprehension using the visual world paradigm demonstrates that bilingual listeners can indeed exploit these low-level phonetic cues to anticipate that a codeswitch is coming and to suppress activation of the non-target language. We discuss the implications of these results for current theories of bilingual language regulation, and situate them in terms of recent proposals relating the coupling of the production and comprehension systems more generally. |
Sarah C. Creel; Dolly P. Rojo; Angelica Nicolle Paullada Effects of contextual support on preschoolers' accented speech comprehension Journal Article In: Journal of Experimental Child Psychology, vol. 146, pp. 156–180, 2016. @article{Creel2016, Young children often hear speech in unfamiliar accents, but relatively little research characterizes their comprehension capacity. The current study tested preschoolers' comprehension of familiar-accented versus unfamiliar-accented speech with varying levels of contextual support from sentence frames (full sentences vs. isolated words) and from visual context (four salient pictured alternatives vs. the absence of salient visual referents). The familiar accent advantage was more robust when visual context was absent, suggesting that previous findings of good accent comprehension in infants and young children may result from ceiling effects in easier tasks (e.g., picture fixation, picture selection) relative to the more difficult tasks often used with older children and adults. In contrast to prior work on mispronunciations, where most errors were novel object responses, children in the current study did not select novel object referents above chance levels. This suggests that some property of accented speech may dissuade children from inferring that an unrecognized familiar-but-accented word has a novel referent. Finally, children showed detectable accent processing difficulty despite presumed incidental community exposure. Results suggest that preschoolers' accented speech comprehension is still developing, consistent with theories of protracted development of speech processing. Copyright ©2016 Elsevier Inc. All rights reserved. |
Alex Carvalho; Isabelle Dautriche; Anne Christophe Preschoolers use phrasal prosody online to constrain syntactic analysis Journal Article In: Developmental Science, vol. 19, no. 2, pp. 235–250, 2016. @article{Carvalho2016, Two experiments were conducted to investigate whether young children are able to take into account phrasal prosody when computing the syntactic structure of a sentence. Pairs of French noun/verb homophones were selected to create locally ambiguous sentences ([la petite ferme] [est tr? es jolie] ‘the small farm is very nice' vs. [la petite] [ferme la fen^ etre] ‘the little girl closes the window' – brackets indicate prosodic boundaries). Although these sentences start with the same three words, ferme is a noun (farm) in the former but a verb (to close) in the latter case. The only difference between these sentence beginnings is the prosodic structure, that reflects the syntactic structure (with a prosodic boundary just before the criticalwordwhen it is a verb, and just after it when it is a noun). Crucially, all words following the homophone were masked, such that prosodic cues were the only disambiguating information. Children successfully exploited prosodic information to assign the appropriate syntactic category to the target word, in both an oral completion task (4.5-year-olds, Experiment 1) and in a preferential looking paradigm with an eye- tracker (3.5-year-olds and 4.5-year-olds, Experiment 2). These results show that both groups of children exploit the position of a word within the prosodic structure when computing its syntactic category. In other words, even younger children of 3.5 years old exploit phrasal prosody online to constrain their syntactic analysis. This ability to exploit phrasal prosody to compute syntactic structure may help children parse sentences containing unknown words, and facilitate the acquisition of word meanings. |
Floor Groot; Falk Huettig; Christian N. L. Olivers When meaning matters: The temporal dynamics of semantic influences on visual attention Journal Article In: Journal of Experimental Psychology: Human Perception and Performance, vol. 42, no. 2, pp. 180–196, 2016. @article{Groot2016, An important question is, to what extent is visual attention driven by the semantics of individual objects, rather than by their visual appearance? This study investigates the hypothesis that timing is a crucial factor in the occurrence and strength of semantic influences on visual orienting. To assess the dynamics of such influences, the authors presented the target instruction either before or after visual stimulus onset, while eye movements were continuously recorded throughout the search. The results show a substantial but delayed bias in orienting toward semantically related objects compared with visually related objects when target instruction is presented before visual stimulus onset. However, this delay can be completely undone by presenting the visual information before the target instruction (Experiment 1). Moreover, the absence or presence of visual competition does not change the temporal dynamics of the semantic bias (Experiment 2). Visual orienting is thus driven by priority settings that dynamically shift between visual and semantic representations, with each of these types of bias operating largely independently. The findings bridge the divide between the visual attention and the psycholinguistic literature. |
Judith Degen; Michael K. Tanenhaus Availability of alternatives and the processing of scalar implicatures: A visual world eye-tracking study Journal Article In: Cognitive Science, vol. 40, no. 1, pp. 172–201, 2016. @article{Degen2016, Two visual world experiments investigated the processing of the implicature associated with some using a “gumball paradigm.” On each trial, participants saw an image of a gumball machine with an upper chamber with orange and blue gumballs and an empty lower chamber. Gumballs dropped to the lower chamber, creating a contrast between a partitioned set of gumballs of one color and an unpartitioned set of the other. Participants then evaluated spoken statements, such as “You got some of the blue gumballs.” Experiment 1 investigated the time course of the pragmatic enrichment from some to not all when the only utterance alternatives available to refer to the dif- ferent sets were some and all. In Experiment 2, the number terms two, three, four, and five were also included in the set of alternatives. Scalar implicatures were delayed relative to the interpreta- tion of literal statements with all only when number terms were available. The results are inter- preted as evidence for a constraint-based account of scalar implicature processing. |
Rutvik H. Desai; Wonil Choi; Vicky T. Lai; John M. Henderson Toward semantics in the wild: Activation to manipulable nouns in naturalistic reading Journal Article In: Journal of Neuroscience, vol. 36, no. 14, pp. 4050–4055, 2016. @article{Desai2016, The neural basis of language processing, in the context of naturalistic reading of connected text, is a crucial but largely unexplored area. Here we combined functional MRI and eye tracking to examine the reading of text presented as whole paragraphs in two experiments with human subjects. We registered high-temporal resolution eye-tracking data to a low-temporal resolution BOLD signal to extract responses to single words during naturalistic reading where two to four words are typically processed per second. As a test case of a lexical variable, we examined the response to noun manipulability. In both experiments, signal in the left anterior inferior parietal lobule and posterior inferior temporal gyrus and sulcus was positively correlated with noun manipulability. These regions are associated with both action performance and action semantics, and their activation is consistent with a number of previous studies involving tool words and physical tool use. The results show that even during rapid reading of connected text, where semantics of words may be activated only partially, the meaning of manipulable nouns is grounded in action performance systems. This supports the grounded cognition view of semantics, which posits a close link between sensory-motor and conceptual systems of the brain. On the methodological front, these results demonstrate that BOLD responses to lexical variables during naturalistic reading can be extracted by simultaneous use of eye tracking. This opens up new avenues for the study of language and reading in the context of connected text. |
Yun Ding; Jing Zhao; Tao He; Yufei Tan; Lingshuang Zheng; Zhiguo Wang Selective impairments in covert shifts of attention in Chinese dyslexic children Journal Article In: Dyslexia, vol. 22, no. 4, pp. 362–378, 2016. @article{Ding2016a, Reading depends heavily on the efficient shift of attention. Mounting evidence has suggested that dyslexics have deficits in covert attentional shift. However, it remains unclear whether dyslexics also have deficits in overt attentional shift. With the majority of relevant studies carried out in alphabetic writing systems, it is also unknown whether the attentional deficits observed in dyslexics are restricted to a particular writing system. The present study examined inhibition of return (IOR)-a major driving force of attentional shifts-in dyslexic children learning to read a logographic script (i.e., Chinese). Robust IOR effects were observed in both covert and overt attentional tasks in two groups of typically developing children, who were age- or reading ability-matched to the dyslexic children. In contrast, the dyslexic children showed IOR in the overt but not in the covert attentional task. We conclude that covert attentional shift is selectively impaired in dyslexic children. This impairment is not restricted to alphabetic writing systems, and it could be a significant contributor to the difficulties encountered by children learning to read. |
2015 |
Gareth Carrol; Kathy Conklin; Josephine Guy; Rebekah Scott Processing punctuation and word changes in different editions of prose fiction Journal Article In: Scientific Study of Literature, vol. 5, no. 2, pp. 200–228, 2015. @article{Carrol2015, The digital era has brought with it a shift in the field of literary editing in terms of the amount and kind of textual variation that can reasonably be annotated by editors. However, questions remain about how far readers engage with textual variants, especially minor ones such as small-scale changes to punctuation. In this study we present an eye-tracking experiment investigating reader sensitivity to variations in surface textual features of prose fiction. We monitored eye movements while participants read textual variants from Dickens and James, hypothesising that readers may pay more attention to lexical rather than punctuation changes. We found longer reading times for both types, but only lexical changes also increased reading times for the rest of the sentence. In addition, eye-movement behaviour and conscious ability to report changes were highly correlated. We discuss the implications for how such methods might be applied to questions of “literary” significance and textual processing. |
Matthew J. Abbott; Bernhard Angele; Y. Danbi Ahn; Keith Rayner Skipping syntactically illegal the previews: The role of predictability. Journal Article In: Journal of Experimental Psychology: Learning, Memory, and Cognition, vol. 41, no. 6, pp. 1703–1714, 2015. @article{Abbott2015a, Readers tend to skip words, particularly when they are short, frequent, or predictable. Angele and Rayner (2013) recently reported that readers are often unable to detect syntactic anomalies in parafoveal vision. In the present study, we manipulated target word predictability to assess whether contextual constraint modulates the-skipping behavior. The results provide further evidence that readers frequently skip the article the when infelicitous in context. Readers skipped predictable words more often than unpredictable words, even when the, which was syntactically illegal and unpredictable from the prior context, was presented as a parafoveal preview. The results of the experiment were simulated using E-Z Reader 10 by assuming that cloze probability can be dissociated from parafoveal visual input. It appears that when a short word is predictable in context, a decision to skip it can be made even if the information available parafoveally conflicts both visually and syntactically with those predictions. |
Christopher A. Sanchez; Allison J. Jaeger If it's hard to read, it changes how long you do it: Reading time as an explanation for perceptual fluency effects on judgment Journal Article In: Psychonomic Bulletin & Review, vol. 22, no. 1, pp. 206–211, 2015. @article{Sanchez2015, Perceptual manipulations, such as changes in font type or figure-ground contrast, have been shown to increase judgments of difficulty or effort related to the presented material. Previous theory has suggested that this is the result of changes in online processing or perhaps the post-hoc influence of perceived difficulty recalled at the time of judgment. These two experiments seek to examine by which mechanism (or both) the fluency effect is pro-duced. Results indicate that disfluency does in fact change in situ reading behavior, and this change significantly me-diates judgments. Eye movement analyses corroborate this suggestion and observe a difference in how people read a disfluent presentation. These findings support the notion that readers are using perceptual cues in their reading ex-periences to change how they interact with the material, which in turn produces the observed biases. |
Rachel A. Ryskin; Aaron S. Benjamin; Jonathan Tullis; Sarah Brown-Schmidt Perspective-taking in comprehension, production, and memory: An individual differences approach Journal Article In: Journal of Experimental Psychology: General, vol. 144, no. 5, pp. 898–915, 2015. @article{Ryskin2015, The ability to take a different perspective is central to a tremendous variety of higher level cognitive skills. To communicate effectively, we must adopt the perspective of another person both while speaking and listening. To ensure the successful retrieval of critical information in the future, we must adopt the perspective of our own future self and construct cues that will survive the passage of time. Here we explore the cognitive underpinnings of perspective-taking across a set of tasks that involve communication and memory, with an eye toward evaluating the proposal that perspective-taking is domain-general (e.g., Wardlow, 2013). We measured participants' perspective-taking ability in a language production task, a language comprehension task, and a memory task in which people generated their own cues for the future. Surprisingly, there was little variance common to the 3 tasks, a result that suggests that perspective-taking is not domain-general. Performance in the language production task was predicted by a measure of working memory, whereas performance in the cue-generation memory task was predicted by a combination of working memory and long-term memory measures. These results indicate that perspective-taking relies on differing cognitive capacities in different situations. |
Elizabeth R. Schotter; Michelle Lee; Michael Reiderman; Keith Rayner The effect of contextual constraint on parafoveal processing in reading Journal Article In: Journal of Memory and Language, vol. 83, pp. 118–139, 2015. @article{Schotter2015, Semantic preview benefit in reading is an elusive and controversial effect because empirical studies do not always (but sometimes) find evidence for it. Its presence seems to depend on (at least) the language being read, visual properties of the text (e.g., initial letter capitalization), the type of relationship between preview and target, and as shown here, semantic constraint generated by the prior sentence context. Schotter (2013) reported semantic preview benefit for synonyms, but not semantic associates when the preview/target was embedded in a neutral sentence context. In Experiment 1, we embedded those same previews/targets into constrained sentence contexts and in Experiment 2 we replicated the effects reported by Schotter (2013; in neutral sentence contexts) and Experiment 1 (in constrained contexts) in a within-subjects design. In both experiments, we found an early (i.e., first-pass) apparent preview benefit for semantically associated previews in constrained contexts that went away in late measures (e.g., total time). These data suggest that sentence constraint (at least as manipulated in the current study) does not operate by making a single word form expected, but rather generates expectations about what kinds of words are likely to appear. Furthermore, these data are compatible with the assumption of the E-Z Reader model that early oculomotor decisions reflect "hedged bets" that a word will be identifiable and, when wrong, lead the system to identify the wrong word, triggering regressions. |
Sarah Schuster; Stefan Hawelka; Fabio Richlan; Philipp Ludersdorfer; Florian Hutzler Eyes on words: A fixation-related fMRI study of the left occipito-temporal cortex during self-paced silent reading of words and pseudowords Journal Article In: Scientific Reports, vol. 5, pp. 12686, 2015. @article{Schuster2015, The predominant finding of studies assessing the response of the left ventral occipito-temporal cortex (vOT) to familiar words and to unfamiliar, but pronounceable letter strings (pseudowords) is higher activation for pseudowords. One explanation for this finding is that readers automatically generate predictions about a letter string's identity – pseudowords mismatch these predictions and the higher vOT activation is interpreted as reflecting the resultant prediction errors. The majority of studies, however, administered tasks which imposed demands above and beyond the intrinsic requirements of visual word recognition. The present study assessed the response of the left vOT to words and pseudowords by using the onset of the first fixation on a stimulus as time point for modeling the BOLD signal (fixation-related fMRI). This method allowed us to assess the neural correlates of self-paced silent reading with minimal task demands and natural exposure durations. In contrast to the predominantly reported higher vOT activation for pseudowords, we found higher activation for words. This finding is at odds with the expectation of higher vOT activation for pseudowords due to automatically generated predictions and the accompanying elevation of prediction errors. Our finding conforms to an alternative explanation which considers such top-down processing to be non-automatic and task-dependent. |
Tessa Warren; Evelyn Milburn; Nikole D. Patson; Michael Walsh Dickey Comprehending the impossible: what role do selectional restriction violations play? Journal Article In: Language, Cognition and Neuroscience, vol. 30, no. 8, pp. 932–939, 2015. @article{Warren2015, To elucidate how different kinds of knowledge are used during comprehension, readers' eye movements were monitored as they read sentences that were: plausible, impossible because of a selectional restriction violation (SRV) or impossible because of a violation of general world knowledge. Eye movements on the pre-critical, critical, and post-critical words evidenced disruption in the SRV condition compared to the other two conditions. These findings suggest that disruption associated with reading about impossible events is not directly determined by how impossible the event seems. Rather, the relationship between the verb and arguments in the sentence seems to matter. These findings are the strongest evidence to date that processing effects associated with selectional restrictions can dissociate from those associated with general world knowledge about events. |
Jeffrey Weiler; Cameron D. Hassall; Olave E. Krigolson; Matthew Heath The unidirectional prosaccade switch-cost: Electroencephalographic evidence of task-set inertia in oculomotor control Journal Article In: Behavioural Brain Research, vol. 278, pp. 323–329, 2015. @article{Weiler2015, The execution of an antisaccade selectively increases the reaction time (RT) of a subsequent prosaccade (the unidirectional prosaccade switch-cost). To explain this finding, the task-set inertia hypothesis asserts that an antisaccade requires a cognitively mediated non-standard task-set that persists inertially and delays the planning of a subsequent prosaccade. The present study sought to directly test the theoretical tenets of the task-set inertia hypothesis by examining the concurrent behavioural and the event-related brain potential (ERP) data associated with the unidirectional prosaccade switch-cost. Participants pseudo-randomly alternated between pro- and antisaccades while electroencephalography (EEG) data were recorded. As expected, the completion of an antisaccade selectively increased the RT of a subsequent prosaccade, whereas the converse switch did not influence RTs. Thus, the behavioural results demonstrated the unidirectional prosaccade switch-cost. In terms of the ERP findings, we observed a reliable change in the amplitude of the P3 - time-locked to task-instructions - when trials were switched from a prosaccade to an antisaccade; however, no reliable change was observed when switching from an antisaccade to a prosaccade. This is a salient finding because extensive work has shown that the P3 provides a neural index of the task-set required to execute a to-be-completed response. As such, results showing that prosaccades completed after antisaccades exhibited increased RTs in combination with a P3 amplitude comparable to antisaccades provides convergent evidence that the unidirectional prosaccade switch-cost is attributed to the persistent activation of a non-standard antisaccade task-set. |
Dorothea Wendt; Birger Kollmeier; Thomas Brand How hearing impairment affects sentence comprehension: Using eye fixations to investigate the duration of speech processing Journal Article In: Trends in Hearing, vol. 19, 2015. @article{Wendt2015, The main objective of this study was to investigate the extent to which hearing impairment influences the duration of sentence processing. An eye-tracking paradigm is introduced that provides an online measure of how hearing impairment prolongs processing of linguistically complex sentences; this measure uses eye fixations recorded while the participant listens to a sentence. Eye fixations toward a target picture (which matches the aurally presented sentence) were measured in the presence of a competitor picture. Based on the recorded eye fixations, the single target detection amplitude, which reflects the tendency of the participant to fixate the target picture, was used as a metric to estimate the duration of sentence processing. The single target detection amplitude was calculated for sentence structures with different levels of linguistic complexity and for different listening conditions: in quiet and in two different noise conditions. Participants with hearing impairment spent more time processing sentences, even at high levels of speech intelligibility. In addition, the relationship between the proposed online measure and listener-specific factors, such as hearing aid use and cognitive abilities, was investigated. Longer processing durations were measured for participants with hearing impairment who were not accustomed to using a hearing aid. Moreover, significant correlations were found between sentence processing duration and individual cognitive abilities (such as working memory capacity or susceptibility to interference). These findings are discussed with respect to audiological applications. |
Sarah J. White; Kayleigh L. Warrington; Victoria A. McGowan; Kevin B. Paterson Eye movements during reading and topic scanning: Effects of word frequency Journal Article In: Journal of Experimental Psychology: Human Perception and Performance, vol. 41, no. 1, pp. 233–248, 2015. @article{White2015a, The study examined the nature of eye movement control and word recognition during scanning for a specific topic, compared with reading for comprehension. Experimental trials included a manipulation of word frequency: the critical word was frequent (and orthographically familiar) or infrequent (2 conditions: orthographically familiar and orthographically unfamiliar). First-pass reading times showed effects of word frequency for both reading and scanning, with no interactions between word characteristics and task. Therefore, in contrast to the task of searching for a single specific word (Rayner & Fischer, 1996), there were immediate and localized influences of lexical processing when scanning for a specific topic, indicating that early word recognition processes are similar during reading and topic scanning. In contrast, there were interactions for later measures, with larger effects of word frequency during reading than scanning, indicating that reading goals can modulate later processes such as the integration of words into sentence context. Additional analyses of the distribution of first-pass single fixation durations indicated that first-pass fixations of all durations were shortened during scanning compared with reading, and reading for comprehension produced a larger subset of longer first-pass fixations compared with scanning. The implications for the nature of word recognition and eye movement control are discussed. |
Veronica Whitford; Debra Titone In: Journal of Experimental Psychology: Learning, Memory, and Cognition, vol. 41, no. 4, pp. 1118–1129, 2015. @article{Whitford2015, Eye movement measures demonstrate differences in first-language (L1) and second-language (L2) paragraph-level reading as a function of individual differences in current L2 exposure among bilinguals (Whitford & Titone, 2012). Specifically, as current L2 exposure increases, the ease of L2 word processing increases, but the ease of L1 word processing decreases. Here, we investigate whether current L2 exposure also relates to more general aspects of reading performance, including global eye movement measures and how bilinguals use parafoveal information to the right of fixation during L1 and L2 sentence-level reading, through use of a gaze-contingent moving window paradigm (McConkie & Rayner, 1975). We found that bilinguals with high versus low current L2 exposure exhibited increased L2 reading fluency (faster reading rates, shorter forward fixation durations), but decreased L1 reading fluency (slower reading rates, longer forward fixation durations). We also found that bilinguals with high versus low current L2 exposure were more affected by reductions in window size during L2 reading (indicative of a larger L2 perceptual span), but were less affected by reductions in window size during L1 reading (indicative of a smaller L1 perceptual span). Taken together, these findings suggest that individual differences in current L2 exposure among bilinguals also modulate more general aspects of reading behavior, including global measures of reading difficulty and the allocation of visual attention into the parafovea during both L1 and L2 sentence-level reading. |
Ming Xiang; Sui Ping Wang; Yan Ling Cui Constructing covert dependencies-The case of Mandarin wh-in-situ dependency Journal Article In: Journal of Memory and Language, vol. 84, pp. 139–166, 2015. @article{Xiang2015, Wh-in-situ constructions in Mandarin Chinese, as opposed to their English counterparts that front wh-phrases to the beginning of the sentence, have the same word order as regular non-wh declaratives. We argue that despite their surface word order, processing wh-in-situ constructions involves constructing a covert non-local syntactic dependency between the in-situ wh-phrase and a higher scope position at a clause boundary, leading to behavioral patterns similar to those associated with the processing of overt dependencies. In two comprehension experiments, we showed that the process of linking an in-situ wh-phrase and its scope position induces a similarity-based memory interference effect if another clause boundary position intervenes. In addition, a set of sentence completion studies also showed that the production of wh-in-situ constructions is heavily modulated by the increased working memory burden that results from planning and maintaining a non-local dependency. |
Ming Yan Visually complex foveal words increase the amount of parafoveal information acquired Journal Article In: Vision Research, vol. 111, no. Part A, pp. 91–96, 2015. @article{Yan2015, This study investigates the effect of foveal load (i.e., processing difficulty of currently fixated words) on parafoveal information processing. Contrary to the commonly accepted view that high foveal load leads to reduced parafoveal processing efficiency, results of the present study showed that increasing foveal visual (but not linguistic) processing load actually increased the amount of parafoveal information acquired, presumably due to the fact that longer fixation duration on the pretarget word provided more time for parafoveal processing of the target word. It is therefore proposed in the present study that foveal linguistic processing load is not the only factor that determines parafoveal processing; preview time (afforded by foveal word visual processing load) may jointly influence parafoveal processing. |
Ming Yan; Reinhold Kliegl Perceptual Span Depends on Font Size During the Reading of Chinese Sentences Journal Article In: Journal of Experimental Psychology: Learning, Memory, and Cognition, vol. 41, no. 1, pp. 209–219, 2015. @article{Yan2015a, The present study explored the perceptual span (i.e., the physical extent of an area from which useful visual information is extracted during a single fixation) during the reading of Chinese sentences in 2 experiments. In Experiment 1, we tested whether the rightward span can go beyond 3 characters when visually similar masks were used. Results showed that Chinese readers needed at least 4 characters to the right of fixation to maintain a normal reading behavior when visually similar masks were used and when characters were displayed in small fonts, indicating that the span is dynamically influenced by masking materials. In Experiments 2 and 3, we asked whether the perceptual span varies as a function of font size in spaced (German) and unspaced (Chinese) scripts. Results clearly suggest perceptual span depends on font size in Chinese, but we failed to find such evidence for German. We propose that the perceptual span in Chinese is flexible; it is strongly constrained by its language-specific properties such as high information density and lack of word spacing. Implications for saccade-target selection during the reading of Chinese sentences are discussed. |
Ming Yan; Jinger Pan; Nathalie N. Bélanger; Hua Shu Chinese deaf readers have early access to parafoveal semantics Journal Article In: Journal of Experimental Psychology: Learning, Memory, and Cognition, vol. 41, no. 1, pp. 254–261, 2015. @article{Yan2015c, In the present study, we manipulated different types of information available in the parafovea during the reading of Chinese sentences and examined how deaf readers make use of the parafoveal information. Results clearly indicate that although the reading-level matched hearing readers make greater use of orthographic information in the parafovea, parafoveal semantic information is obtained earlier among the deaf readers. In addition, a phonological preview benefit effect was found for the better deaf readers (relative to less-skilled deaf readers), although we also provide an alternative explanation for this effect. Providing evidence that Chinese deaf readers have higher efficiency when processing parafoveal semantics, the study indicates flexibility across individuals in the mechanisms underlying word recognition adapting to the inputs available in the linguistic environment. |
Matthias J. Sjerps; Antje S. Meyer Variation in dual-task performance reveals late initiation of speech planning in turn-taking Journal Article In: Cognition, vol. 136, pp. 304–324, 2015. @article{Sjerps2015, The smooth transitions between turns in natural conversation suggest that speakers often begin to plan their utterances while listening to their interlocutor. The presented study investigates whether this is indeed the case and, if so, when utterance planning begins. Two hypotheses were contrasted: that speakers begin to plan their turn as soon as possible (in our experiments less than a second after the onset of the interlocutor's turn), or that they do so close to the end of the interlocutor's turn. Turn-taking was combined with a finger tapping task to measure variations in cognitive load. We assumed that the onset of speech planning in addition to listening would be accompanied by deterioration in tapping performance. Two picture description experiments were conducted. In both experiments there were three conditions: (1) Tapping and Speaking, where participants tapped a complex pattern while taking over turns from a pre-recorded speaker, (2) Tapping and Listening, where participants carried out the tapping task while overhearing two pre-recorded speakers, and (3) Speaking Only, where participants took over turns as in the Tapping and Speaking condition but without tapping. The experiments differed in the amount of tapping training the participants received at the beginning of the session. In Experiment 2, the participants' eye-movements were recorded in addition to their speech and tapping. Analyses of the participants' tapping performance and eye movements showed that they initiated the cognitively demanding aspects of speech planning only shortly before the end of the turn of the preceding speaker. We argue that this is a smart planning strategy, which may be the speakers' default in many everyday situations. |
Anja Sperlich; Daniel J. Schad; Jochen Laubrock When preview information starts to matter: Development of the perceptual span in German beginning readers Journal Article In: Journal of Cognitive Psychology, vol. 27, no. 5, pp. 511–530, 2015. @article{Sperlich2015, How is reading development reflected in eye-movement measures? How does the perceptual span change during the initial years of reading instruction? Does parafoveal processing require competence in basic word-decoding processes? We report data from the first cross-sectional measurement of the perceptual span of German beginning readers (n = 139), collected in the context of the large longitudinal PIER (Potsdamer Intrapersonale Entwicklungsrisiken/Potsdam study of intra-personal developmental risk factors) study of intrapersonal developmental risk factors. Using the moving-window paradigm, eye movements of three groups of students (Grades 1–3) were measured with gaze-contingent presentation of a variable amount of text around fixation. Reading rate increased from Grades 1–3, with smaller increases for higher grades. Perceptual-span results showed the expected main effects of grade and window size: fixation durations and refixation probability decreased with grade and window size, whereas reading rate and saccade length increased. Critically, for reading rate, first-fixation duration, saccade length and refixation probability, there were significant interactions of grade and window size that were mainly based on the contrast between Grades 3 and 2 rather than Grades 2 and 1. Taken together, development of the perceptual span only really takes off between Grades 2 and 3, suggesting that efficient parafoveal processing presupposes that basic processes of reading have been mastered. |
Mallory C. Stites; Kara D. Federmeier Subsequent to suppression: Downstream comprehension consequences of noun/verb ambiguity in natural reading Journal Article In: Journal of Experimental Psychology: Learning, Memory, and Cognition, vol. 41, no. 5, pp. 1497–1515, 2015. @article{Stites2015, We used eye tracking to investigate the downstream processing consequences of encountering noun/verb (NV) homographs (i.e., park) in semantically neutral but syntactically constraining contexts. Target words were followed by a prepositional phrase containing a noun that was plausible for only 1 meaning of the homograph. Replicating previous work, we found increased first fixation durations on NV homographs compared with unambiguous words, which persisted into the next sentence region. At the downstream noun, we found plausibility effects following ambiguous words that were correlated with the size of a reader's first fixation effect, suggesting that this effect reflects the recruitment of processing resources necessary to suppress the homograph's context-inappropriate meaning. Using these same stimuli, Lee and Federmeier (2012) found a sustained frontal negativity to the NV homographs, and, on the downstream noun, found a plausibility effect that was also positively correlated with the size of a reader's ambiguity effect. Together, these findings suggest that when only syntactic constraints are available, meaning selection recruits inhibitory mechanisms that can be measured in both first fixation slowdown and event-related potential ambiguity effects. |
Simon P. Tiffin-Richards; Sascha Schroeder Children's and adults' parafoveal processes in German: Phonological and orthographic effects Journal Article In: Journal of Cognitive Psychology, vol. 27, no. 5, pp. 531–548, 2015. @article{TiffinRichards2015, Phonological and orthographic information has been shown to play an important role in parafoveal processing in skilled adult reading in English. In the present study, we investigated whether similar parafoveal effects can be found in children using the boundary eye tracking method. Children and adults read sentences in German with embedded target nouns which were presented in original, pseudohomophone (PsH), transposed-letter (TL), lower-case and control conditions to assess phonological and orthographic preview effects. We found evidence of PsH preview benefit effects for children. We also found TL preview benefit effects for adults, while children only showed these effects under specific conditions. Results are consistent with the developmental view that reading initially depends on phonological processes and that orthographic processes become increasingly important. |
Simon P. Tiffin-Richards; Sascha Schroeder Word length and frequency effects on children's eye movements during silent reading Journal Article In: Vision Research, vol. 113, pp. 33–43, 2015. @article{TiffinRichards2015a, In the present study we measured the eye movements of a large sample of 2nd grade German speaking children and a control group of adults during a silent reading task. To be able to directly investigate the interaction of word length and frequency effects we employed controlled sentence frames with embedded target words in an experimental design in which length and frequency were manipulated independently of one another. Unlike previous studies which have investigated the interaction of word length and frequency effects in children, we used age-appropriate word frequencies for children. We found significant effects of word length and frequency for both children and adults while effects were generally greater for children. The interaction of word length and frequency was significant for children in gaze duration and total viewing time eye movement measures but not for adults. Our results suggest that children rely on sublexical decoding of infrequent words, leading to greater length effects for infrequent than frequent words while adults do not show this effect when reading children's reading materials. |
Sandrine Zufferey; Willem M. Mak; Liesbeth Degand; Ted J. M. Sanders Advanced learners' comprehension of discourse connectives: The role of L1 transfer across on-line and off-line tasks Journal Article In: Second Language Research, vol. 31, no. 3, pp. 389–411, 2015. @article{Zufferey2015, Discourse connectives are important indicators of textual coherence, and mastering them is an essential part of acquiring a language. In this article, we compare advanced learners' sensitivity to the meaning conveyed by connectives in an off-line grammaticality judgment task and an on-line reading experiment using eye-tracking. We also assess the influence of first language (L1) transfer by comparing learners' comprehension of two non-native-like semantic uses of connectives in English, often produced by learners due to transfer from French and Dutch. Our results indicate that in an off-line task transfer is an important factor accounting for French-and Dutch-speaking learners' non-native-like comprehension of connectives. During on-line processing, however, learners are as sensitive as native speakers to the meaning conveyed by connectives. These results raise intriguing questions regarding explicit vs. implicit knowledge in language learners. |
Ming Yan; Werner Sommer Parafoveal-on-foveal effects of emotional word semantics in reading chinese sentences: Evidence from eye movements Journal Article In: Journal of Experimental Psychology: Learning, Memory, and Cognition, vol. 41, no. 4, pp. 1237–1243, 2015. @article{Yan2015b, Despite the well-known influence of emotional meaning on cognition, relatively less is known about its effects on reading behavior. We investigated whether fixation behavior during the reading of Chinese sentences is influenced by emotional word meaning in the parafovea. Two-character target words embedded into the same sentence frames provided emotionally positive, negative, or neutral contents. Fixation durations on neutral pretarget words were prolonged for positive parafoveal words and for highly frequent negative parafoveal words. In addition, fixation durations on foveal emotional words were shorter than those on neutral words. We also found that the role of emotional words varied as a function of their valence during foveal and parafoveal processing. These findings suggest a processing advantage for emotional words relative to emotionally neutral stimuli in foveal and parafoveal vision. We discuss implications for the notion of attention attraction due to emotional content. |
Menahem Yeari; Paul W. Broek; Marja Oudega Processing and memory of central versus peripheral information as a function of reading goals: evidence from eye-movements Journal Article In: Reading and Writing, vol. 28, no. 8, pp. 1071–1097, 2015. @article{Yeari2015, The present study examined the effect of reading goals on the processing and memory of central and peripheral textual information. Using eye-tracking methodology, we compared the effect of four common reading goals—entertainment, presentation, studying for a close-ended (multiple-choice) questions test, and studying for an open-ended questions test—on the specific reading time of central and peripheral information and the overall reading time of expository texts. Text memory was tested using multiple-choice questions. Results showed that readers devoted more time to central information than peripheral information during initial reading, regardless of reading goal, but that they adjusted their rereading to the reading goal, with total reading time being longer for central information under some (entertainment and presentation) but not all (open-ended and close-ended questions tests) reading goals. Moreover, readers devoted more time to reading the texts for a study purpose (test or presentation) than for an entertainment purpose, and devoted more time in reading the texts to answer open-ended questions than close-ended questions. Finally, we found that readers remembered more central information than peripheral information under all reading goals. These findings suggest that centrality affects readers' early processing of text whereas reading goals only affect subsequent processing. Interestingly, processing time during reading predicted memory for peripheral information but not for central information. |
Keir X. X. Yong; Kishan Rajdev; Timothy J. Shakespeare; Alexander P. Leff; Sebastian J. Crutch Facilitating text reading in posterior cortical atrophy Journal Article In: Neurology, vol. 85, no. 4, pp. 339–348, 2015. @article{Yong2015, OBJECTIVE: We report (1) the quantitative investigation of text reading in posterior cortical atrophy (PCA), and (2) the effects of 2 novel software-based reading aids that result in dramatic improvements in the reading ability of patients with PCA. METHODS: Reading performance, eye movements, and fixations were assessed in patients with PCA and typical Alzheimer disease and in healthy controls (experiment 1). Two reading aids (single- and double-word) were evaluated based on the notion that reducing the spatial and oculomotor demands of text reading might support reading in PCA (experiment 2). RESULTS: Mean reading accuracy in patients with PCA was significantly worse (57%) compared with both patients with typical Alzheimer disease (98%) and healthy controls (99%); spatial aspects of passages were the primary determinants of text reading ability in PCA. Both aids led to considerable gains in reading accuracy (PCA mean reading accuracy: single-word reading aid = 96%; individual patient improvement range: 6%-270%) and self-rated measures of reading. Data suggest a greater efficiency of fixations and eye movements under the single-word reading aid in patients with PCA. CONCLUSIONS: These findings demonstrate how neurologic characterization of a neurodegenerative syndrome (PCA) and detailed cognitive analysis of an important everyday skill (reading) can combine to yield aids capable of supporting important everyday functional abilities. CLASSIFICATION OF EVIDENCE: This study provides Class III evidence that for patients with PCA, 2 software-based reading aids (single-word and double-word) improve reading accuracy. |
Andrea M. Zawoyski; Scott P. Ardoin; Katherine S. Binder Using eye tracking to observe differential effects of repeated readings for second-grade students as a function of achievement level Journal Article In: Reading Research Quarterly, vol. 50, no. 2, pp. 171–184, 2015. @article{Zawoyski2015, Repeated readings (RR) is an evidence-based instructional technique in which students read the same text multiple times. Currently, little is known about how effects of RR may differ based on students' achievement levels. Eye tracking provides a means for closely examining instructional effects because it permits measurement of subtle changes that occur during RR. The current study measured changes in the reading behavior of second-grade students who were divided into two groups of 22 students each based on their reading achievement levels. Participants read a grade-level passage embedded with low-and high-frequency target words four times in a single session while their eye movements were recorded. Findings replicated those of previous research, suggesting that RR facilitated reading for students in both groups, particularly on low-frequency target words. Results indicated both similarities and differences in patterns of performance between lower and higher performing readers. Additionally, results implied that effects were greater for lower performing readers because they made greater improvements on high-frequency target words, whereas effects were diminished for higher performing readers. The findings have implications for improving future eye movement research investigating young students' reading and the efficiency of RR in the classroom. |
Likan Zhan; Stephen Crain; Peng Zhou The online processing of only if and even if conditional statements: Implications for mental models Journal Article In: Journal of Cognitive Psychology, vol. 27, pp. 367–379, 2015. @article{Zhan2015, A sentential connective like only if or even if merges two simple propositions into a complex statement. This study used a visual world paradigm experiment to explore how this merging process proceeds online. We first presented participants with a short animation, illustrating different simple propositions that are possible to be merged by the sentential connectives. We then auditorily played an only if or an even if statement and recorded participants' eye movements on the concurrent test image. We observed that hearing the sentential connective results in more fixations on the tokens of the appropriate propositions that are eligible to be merged by the sentential connective. Each sentential connective elicited anticipatory effect suggests that once they heard the sentential connective, participants knew which propositions could be merged. We then discussed the implications of our results to the mental model theory of conditionals and the experimental studies reported in literature. |
Wenjia Zhang; Nan Li; Xiaoyue Wang; Suiping Wang Integration of sentence-level semantic information in parafovea: Evidence from the RSVP-flanker paradigm Journal Article In: PLoS ONE, vol. 10, no. 9, pp. e0139016, 2015. @article{Zhang2015b, During text reading, the parafoveal word was usually presented between 2° and 5° from the point of fixation. Whether semantic information of parafoveal words can be processed during sentence reading is a critical and long-standing issue. Recently, studies using the RSVP-flanker paradigm have shown that the incongruent parafoveal word, presented as right flanker, elicited a more negative N400 compared with the congruent parafoveal word. This suggests that the semantic information of parafoveal words can be extracted and integrated during sentence reading, because the N400 effect is a classical index of semantic integration. However, as most previous studies did not control the word-pair congruency of the parafoveal and the foveal words that were presented in the critical triad, it is still unclear whether such integration happened at the sentence level or just at the word-pair level. The present study addressed this question by manipulating verbs in Chinese sentences to yield either a semantically congruent or semantically incongruent context for the critical noun. In particular, the interval between the critical nouns and verbs was controlled to be 4 or 5 characters. Thus, to detect the incongruence of the parafoveal noun, participants had to integrate it with the global sentential context. The results revealed that the N400 time-locked to the critical triads was more negative in incongruent than in congruent sentences, suggesting that parafoveal semantic information can be integrated at the sentence level during Chinese reading. |