Reading and Language Eye-Tracking Publications
All EyeLink eye tracker reading and language research publications up until 2024 (with some early 2025s) are listed below by year. You can search the eye-tracking publications using keywords such as Visual World, Comprehension, Speech Production, etc. You can also search for individual author names. If we missed any EyeLink reading or language research articles, please email us!
2015 |
Maya Dank; Avital Deutsch; Kathryn Bock Resolving conflicts in natural and grammatical gender agreement: Evidence from eye movements Journal Article In: Journal of Psycholinguistic Research, vol. 44, no. 4, pp. 435–467, 2015. @article{Dank2015,The present research investigated the attraction phenomenon, which commonly occurs in the domain of production but is also apparent in comprehension. It particularly focused on its accessibility to conceptual influence, in analogy to previous findings in production in Hebrew (Deutsch and Dank, J Mem Lang, 60:112–143, 2009). The experiments made use of the contrast between grammatical and natural gender in Hebrew, using complex subject noun phrases containing head nouns and prepositional phrases with local nouns. Noun phrases were manipulated to produce (a) matches and mismatches in grammatical gender between heads and local nouns; and (b) inanimate nouns and animate nouns with natural gender that served either as head or as local nouns. These noun phrases were the subjects of sentences that ended with predicates agreeing in gender with the head noun, with the local noun, or both. The ungrammatical sentences were those in which the gender of the predicate and the head noun did not match. To assess the impact of conflicts in grammatical and natural gender on the time course of reading, participants' eye movements were monitored. The results revealed clear disruptions in reading the predicate due to grammatical-gender mismatches with head and local nouns, in analogy to attraction in production. When the head nouns conveyed natural gender these effects were amplified, but variations in the natural gender of local nouns had negligible consequences. The results imply that comprehension and production are similarly sensitive to the control of grammatical agreement by grammatical and natural gender in subject noun phrases. |
Isabelle Dautriche; Daniel Swingley; Anne Christophe Learning novel phonological neighbors: Syntactic category matters Journal Article In: Cognition, vol. 143, pp. 77–86, 2015. @article{Dautriche2015,Novel words (like tog) that sound like well-known words (dog) are hard for toddlers to learn, even though children can hear the difference between them (Swingley & Aslin, 2002, 2007). One possibility is that phonological competition alone is the problem. Another is that a broader set of probabilistic considerations is responsible: toddlers may resist considering tog as a novel object label because its neighbor dog is also an object. In three experiments, French 18-month-olds were taught novel words whose word forms were phonologically similar to familiar nouns (noun-neighbors), to familiar verbs (verb-neighbors) or to nothing (no-neighbors). Toddlers successfully learned the no-neighbors and verb-neighbors but failed to learn the noun-neighbors, although both novel neighbors had a familiar phonological neighbor in the toddlers' lexicon. We conclude that when creating a novel lexical entry, toddlers' evaluation of similarity in the lexicon is multidimensional, incorporating both phonological and semantic or syntactic features. |
Jakub Dotlačil; Adrian Brasoveanu The manner and time course of updating quantifier scope representations in discourse Journal Article In: Language, Cognition and Neuroscience, vol. 30, no. 3, pp. 305–323, 2015. @article{Dotlacil2015,We present the results of two experiments, an eye-tracking study and a follow-up self-paced reading study, investigating the interpretation of quantifier scope in sentences with three quantifiers: two indefinites in subject and object positions and a universal distributive quantifier in ad-junct position. In addition to the fact that such three-way scope inter-actions have not been experimentally investigated before, they enable us to distinguish between different theories of quantifier scope interpretation in ways that are not possible when only simpler, two-way interactions are considered. The experiments show that contrary to underspecifica-tion theories of scope, a totally ordered scope-hierarchy representation is maintained and modified across sentences and this scope representation cannot be reduced to the truth-conditional/mental model representation of sentential meaning. The experiments also show that the processor uses scope-disambiguating information as early as possible to (re)analyze scope representation. |
Jon Andoni Duñabeitia; Albert Costa Lying in a native and foreign language Journal Article In: Psychonomic Bulletin & Review, vol. 22, no. 4, pp. 1124–1129, 2015. @article{Dunabeitia2015,This study explores the interaction between deceptive language and second language processing. One hundred participants were asked to produce veridical and false statements in either their first or second language. Pupil size, speech latencies, and utterance durations were analyzed. Results showed additive effects of statement veracity and the language in which these statements were produced. That is, false statements elicited larger pupil dilations and longer naming latencies compared with veridical statements, and statements in the foreign language elicited larger pupil dilations and longer speech durations and compared with first language. Importantly, these two effects did not interact, suggesting that the processing cost associated with deception is similar in a native and foreign language. The theoretical implications of these observations are discussed. |
Pierce Edmiston; Gary Lupyan What makes words special? Words as unmotivated cues Journal Article In: Cognition, vol. 143, pp. 93–100, 2015. @article{Edmiston2015,Verbal labels, such as the words "dog" and "guitar," activate conceptual knowledge more effectively than corresponding environmental sounds, such as a dog bark or a guitar strum, even though both are unambiguous cues to the categories of dogs and guitars (Lupyan & Thompson-Schill, 2012). We hypothesize that this advantage of labels emerges because word-forms, unlike other cues, do not vary in a motivated way with their referent. The sound of a guitar cannot help but inform a listener to the type of guitar making it (electric, acoustic, etc.). The word "guitar" on the other hand, can leave the type of guitar unspecified. We argue that as a result, labels gain the ability to cue a more abstract mental representation, promoting efficient processing of category members. In contrast, environmental sounds activate representations that are more tightly linked to the specific cause of the sound. Our results show that upon hearing environmental sounds such as a dog bark or guitar strum, people cannot help but activate a particular instance of a category, in a particular state, at a particular time, as measured by patterns of response times on cue-picture matching tasks (Exps. 1-2) and eye-movements in a task where the cues are task-irrelevant (Exp. 3). In comparison, labels activate concepts in a more abstract, decontextualized way-a difference that we argue can be explained by labels acting as "unmotivated cues". |
Kaitlin Falkauskas; Victor Kuperman When experience meets language statistics: Individual variability in processing english compound words Journal Article In: Journal of Experimental Psychology: Learning, Memory, and Cognition, vol. 41, no. 6, pp. 1607–1627, 2015. @article{Falkauskas2015,Statistical patterns of language use demonstrably affect language comprehension and language production. This study set out to determine whether the variable amount of exposure to such patterns leads to individual differences in reading behavior as measured via eye-movements. Previous studies have demonstrated that more proficient readers are less influenced by distributional biases in language (e.g., frequency, predictability, transitional probability) than poor readers. We hypothesized that a probabilistic bias that is characteristic of written but not spoken language would preferentially affect readers with greater exposure to printed materials in general and to the specific pattern engendering the bias. Readers of varying reading experience were presented with sentences including English compound words that can occur in 2 spelling formats with differing probabilities: concatenated (windowsill, used 40% of the time) or spaced (window sill, 60%). Linear mixed effects multiple regression models fitted to the eye-movement measures showed that the probabilistic bias toward the presented spelling had a stronger facilitatory effect on compounds that occurred more frequently (in any spelling) or belonged to larger morphological families, and on readers with higher scores on a test of exposure-to-print. Thus, the amount of support toward the compound's spelling is effectively exploited when reading, but only when the spelling patterns are entrenched in an individual's mental lexicon via overall exposure to print and to compounds with alternating spelling. We argue that research on the interplay of language use and structure is incomplete without proper characterization of how particular individuals, with varying levels of experience and skill, learn these language structures. (PsycINFO Database Record (c) 2015 APA, all rights reserved) |
Thomas A. Farmer; Shaorong Yan; Klinton Bicknell; Michael K. Tanenhaus Form-to-expectation matching effects on first-pass eye movement measures during reading Journal Article In: Journal of Experimental Psychology: Human Perception and Performance, vol. 41, no. 4, pp. 958–976, 2015. @article{Farmer2015,Recent Electroencephalography/Magnetoencephalography (EEG/MEG) studies suggest that when contextual information is highly predictive of some property of a linguistic signal, expectations generated from context can be translated into surprisingly low-level estimates of the physical form-based properties likely to occur in subsequent portions of the unfolding signal. Whether form-based expectations are generated and assessed during natural reading, however, remains unclear. We monitored eye movements while participants read phonologically typical and atypical nouns in noun-predictive contexts (Experiment 1), demonstrating that when a noun is strongly expected, fixation durations on furst-pass eye movement measures, including first fixation duration, gaze durations, and go-past times, are shorter for nouns with category typical form-based features. In Experiments 2 and 3, typical and atypical nouns were placed in sentential contexts normed to create expectations of variable strength for a noun. Context and typicality interacted significantly at gaze duration. These results suggest that during reading, form-based expectations that are translated from higher-level category-based expectancies can facilitate the processing of a word in context, and that their effect on lexical processing is graded based on the strength of category expectancy. |
Heather J. Ferguson; Ian Apperly; Jumana Ahmad; Markus Bindemann; James Cane Task constraints distinguish perspective inferences from perspective use during discourse interpretation in a false belief task Journal Article In: Cognition, vol. 139, pp. 50–70, 2015. @article{Ferguson2015,Interpreting other peoples' actions relies on an understanding of their current mental states (e.g. beliefs, desires and intentions). In this paper, we distinguish between listeners' ability to infer others' perspectives and their explicit use of this knowledge to predict subsequent actions. In a visual-world study, two groups of participants (passive observers vs. active participants) watched short videos, depicting transfer events, where one character ('Jane') either held a true or false belief about an object's location. We tracked participants' eye-movements around the final visual scene, time-locked to related auditory descriptions (e.g. "Jane will look for the chocolates in the container on the left".). Results showed that active participants had already inferred the character's belief in the 1. s preview period prior to auditory onset, before it was possible to use this information to predict an outcome. Moreover, they used this inference to correctly anticipate reference to the object's initial location on false belief trials at the earliest possible point (i.e. from "Jane" onwards). In contrast, passive observers only showed evidence of a belief inference from the onset of "Jane", and did not show reliable use of this inference to predict Jane's behaviour on false belief trials until much later, when the location ("left/right") was auditorily available. These results show that active engagement in a task activates earlier inferences about others' perspectives, and drives immediate use of this information to anticipate others' actions, compared to passive observers, who are susceptible to influences from egocentric or reality biases. Finally, we review evidence that using other peoples' perspectives to predict their behaviour is more cognitively effortful than simply using one's own. |
Gerardo Fernández; Liliana R. Castro; Marcela Schumacher; Osvaldo E. Agamennoni Diagnosis of mild Alzheimer disease through the analysis of eye movements during reading Journal Article In: Journal of Integrative Neuroscience, vol. 14, no. 1, pp. 1–13, 2015. @article{Fernandez2015,Reading requires the integration of several central cognitive subsystems, ranging from attention and oculomotor control to word identification and language comprehension. Reading saccades and fixations contain information that can be correlated with word properties. When reading a sentence, the brain must decide where to direct the next saccade according to what has been read up to the actual fixation. In this process, the retrieval memory brings information about the current word features and attributes into working memory. According to this information, the prefrontal cortex predicts and triggers the next saccade. The frequency and cloze predictability of the fixated word, the preceding words and the upcoming ones affect when and where the eyes will move next. In this paper we present a diagnostic technique for early stage cognitive impairment detection by analyzing eye movements during reading proverbs. We performed a case-control study involving 20 patients with probable Alzheimer's disease and 40 age-matched, healthy control patients. The measurements were analyzed using linear mixed-effects models, revealing that eye movement behavior while reading can provide valuable information about whether a person is cognitively impaired. To the best of our knowledge, this is the first study using word-based properties, proverbs and linear mixed-effect models for identifying cognitive abnormalities. |
Gerardo Fernández; Marcela Schumacher; Liliana Castro; David Orozco; Osvaldo Agamennoni Patients with mild Alzheimer's disease produced shorter outgoing saccades when reading sentences Journal Article In: Psychiatry Research, vol. 229, no. 1-2, pp. 470–478, 2015. @article{Fernandez2015a,In the present work we analyzed forward saccades of thirty five elderly subjects (Controls) and of thirty five mild Alzheimer's disease (AD) during reading regular and high-predictable sentences. While they read, their eye movements were recorded. The pattern of forward saccade amplitudes as a function of word predictability was clearly longer in Controls. Our results suggest that Controls might use stored information of words for enhancing their reading performance. Further, cloze predictability increased outgoing saccades amplitudes, as this increase stronger in high-predictable sentences. Quite the contrary, patients with mild AD evidenced reduced forward saccades even at early stages of the disease. This reduction might reveal impairments in brain areas such as those corresponding to working memory, memory retrieval, and semantic memory functions that are already present at early stages of AD. Our findings might be relevant for expanding the options for the early detection and monitoring of in the early stages of AD. Furthermore, eye movements during reading could provide a new tool for measuring a drug's impact on patient's behavior. |
Francesca Foppolo; Marco Marelli; Luisa Meroni; Andrea Gualmini Hey little sister, who's the only one? Modulating informativeness in the resolution of privative ambiguity Journal Article In: Cognitive science, vol. 39, no. 7, pp. 1646–1674, 2015. @article{Foppolo2015,We present two eye-tracking experiments on the interpretation of sentences like "The tall girl is (not) the only one that …," which are ambiguous between the anaphoric (the only girl that …) and the exophoric interpretation (the only individual that …). These interpretations differ in informativeness: in a positive context, the exophoric (strong) reading entails the anaphoric (weak), while in a negative context the entailment pattern is reversed and the anaphoric reading is the strongest one. We tested whether adults rely on considerations about informativeness in solving the ambiguity. The results show that participants interpreted one exophorically in both positive and negative contexts. Given these findings, we cast doubts on the idea that Informativeness plays a role in ambiguity resolution and proposes a Principle of Maximal Exploitation: When a context is provided, adults extend their domain of evaluation to include the whole scenario, independently from truth-conditional considerations about informativity and strength. |
Michael Frazier; Lauren Ackerman; Peter Baumann; David Potter; Masaya Yoshida Wh-filler-gap dependency formation guides reflexive antecedent search Journal Article In: Frontiers in Psychology, vol. 6, pp. 1504, 2015. @article{Frazier2015,Prior studies on online sentence processing have shown that the parser can resolve non-local dependencies rapidly and accurately. This study investigates the interaction between the processing of two such non-local dependencies: wh-filler-gap dependencies (WhFGD) and reflexive-antecedent dependencies. We show that reflexive-antecedent dependency resolution is sensitive to the presence of a WhFGD, and argue that the filler-gap dependency established by WhFGD resolution is selected online as the antecedent of a reflexive dependency. We investigate the processing of constructions like (1), where two NPs might be possible antecedents for the reflexive, namely which cowgirl and Mary. Even though Mary is linearly closer to the reflexive, the only grammatically licit antecedent for the reflexive is the more distant wh-NP, which cowgirl. (1). Which cowgirl did Mary expect to have injured herself due to negligence? Four eye-tracking text-reading experiments were conducted on examples like (1), differing in whether the embedded clause was non-finite (1 and 3) or finite (2 and 4), and in whether the tail of the wh-dependency intervened between the reflexive and its closest overt antecedent (1 and 2) or the wh-dependency was associated with a position earlier in the sentence (3 and 4). The results of Experiments 1 and 2 indicate the parser accesses the result of WhFGD formation during reflexive antecedent search. The resolution of a wh-dependency alters the representation that reflexive antecedent search operates over, allowing the grammatical but linearly distant antecedent to be accessed rapidly. In the absence of a long-distance WhFGD (Experiments 3 and 4), wh-NPs were not found to impact reading times of the reflexive, indicating that the parser's ability to select distant wh-NPs as reflexive antecedents crucially involves syntactic structure. |
Steven Frisson About bound and scary books: The processing of book polysemies Journal Article In: Lingua, vol. 157, pp. 17–35, 2015. @article{Frisson2015,There are competing views on the on-line processing of polysemous words such as book, which have distinct but semantically related senses (as in bound book vs. scary book). According to a Sense-Enumeration Lexicon (SEL) view, different senses are represented separately, just as the different meanings of a homonym (e.g. bank). According to an underspecification view, initial processing does not distinguish between the different senses. According to a Relevance Theory (RT)-inspired view, the context will immediately guide interpretation to a specific sense. In Experiment 1, participants indicated whether an adjective-noun construction made sense or not. Switching from one sense to another was costly, but there was no effect of sense frequency (contra SEL). In Experiment 2, eye movements were recorded when participants read sentences in which a polyseme was disambiguated to a specific sense following a neutral context, a sense was repeated, or a sense was switched. The results showed no effect of sense dominance in the neutral condition, no advantage when a sense was repeated, and a cost when switched, especially when switching from a concrete to an abstract interpretation. These data cannot be fitted in an SEL or RT-inspired account, questioning the validity of both as a processing account. |
Stefan Hawelka; Sarah Schuster; Benjamin Gagl; Florian Hutzler On forward inferences of fast and slow readers. An eye movement study Journal Article In: Scientific Reports, vol. 5, pp. 8432, 2015. @article{Hawelka2015,Unimpaired readers process words incredibly fast and hence it was assumed that top-down processing, such as predicting upcoming words, would be too slow to play an appreciable role in reading. This runs counter the major postulate of the predictive coding framework that our brain continually predicts probable upcoming sensory events. This means, it may generate predictions about the probable upcoming word during reading (dubbed forward inferences). Trying to asses these contradictory assumptions, we evaluated the effect of the predictability of words in sentences on eye movement control during silent reading. Participants were a group of fluent (i.e., fast) and a group of speed-impaired (i.e., slow) readers. The findings indicate that fast readers generate forward inferences, whereas speed-impaired readers do so to a reduced extent - indicating a significant role of predictive coding for fluent reading. |
Alison W. Heard; Michael E. J. Masson; Daniel N. Bub Time course of action representations evoked during sentence comprehension Journal Article In: Acta Psychologica, vol. 156, pp. 98–103, 2015. @article{Heard2015,The nature of hand-action representations evoked during language comprehension was investigated using a variant of the visual-world paradigm in which eye fixations were monitored while subjects viewed a screen displaying four hand postures and listened to sentences describing an actor using or lifting a manipulable object. Displayed postures were related to either a functional (using) or volumetric (lifting) interaction with an object that matched or did not match the object mentioned in the sentence. Subjects were instructed to select the hand posture that matched the action described in the sentence. Even before the manipulable object was mentioned in the sentence, some sentence contexts allowed subjects to infer the object's identity and the type of action performed with it and eye fixations immediately favored the corresponding hand posture. This effect was assumed to be the result of ongoing motor or perceptual imagery in which the action described in the sentence was mentally simulated. In addition, the hand posture related to the manipulable object mentioned in a sentence, but not related to the described action (e.g., a writing posture in the context of a sentence that describes lifting, but not using, a pencil), was favored over other hand postures not related to the object. This effect was attributed to motor resonance arising from conceptual processing of the manipulable object, without regard to the remainder of the sentence context. |
Daphna Heller; Jennifer E. Arnold; Natalie M. Klein; Michael K. Tanenhaus Inferring difficulty: Flexibility in the real-time processing of disfluency Journal Article In: Language and Speech, vol. 58, no. 2, pp. 190–203, 2015. @article{Heller2015,Upon hearing a disfluent referring expression, listeners expect the speaker to refer to an object that is previously unmentioned, an object that does not have a straightforward label, or an object that requires a longer description. Two visual-world eye-tracking experiments examined whether listeners directly associate disfluency with these properties of objects, or whether disfluency attribution is more flexible and involves situation-specific inferences. Since in natural situations reference to objects that do not have a straightforward label or that require a longer description is correlated with both production difficulty and with disfluency, we used a mini-artificial lexicon to dissociate difficulty from these properties, building on the fact that recently learned names take longer to produce than existing words in one's mental lexicon. The results demonstrate that disfluency attribution involves situation-specific inferences; we propose that in new situations listeners spontaneously infer what may cause production difficulty. However, the results show that these situation-specific inferences are limited in scope: listeners assessed difficulty relative to their own experience with the artificial names, and did not adapt to the assumed knowledge of the speaker. |
John M. Henderson; Wonil Choi; Steven G. Luke; Rutvik H. Desai Neural correlates of fixation duration in natural reading: Evidence from fixation-related fMRI Journal Article In: NeuroImage, vol. 119, pp. 390–397, 2015. @article{Henderson2015a,A key assumption of current theories of natural reading is that fixation duration reflects underlying attentional, language, and cognitive processes associated with text comprehension. The neurocognitive correlates of this relationship are currently unknown. To investigate this relationship, we compared neural activation associated with fixation duration in passage reading and a pseudo-reading control condition. The results showed that fixation duration was associated with activation in oculomotor and language areas during text reading. Fixation duration during pseudo-reading, on the other hand, showed greater involvement of frontal control regions, suggesting flexibility and task dependency of the eye movement network. Consistent with current models, these results provide support for the hypothesis that fixation duration in reading reflects attentional engagement and language processing. The results also demonstrate that fixation-related fMRI provides a method for investigating the neurocognitive bases of natural reading. |
Ehab W. Hermena; Denis Drieghe; Sam Hellmuth; Simon P. Liversedge Processing of Arabic diacritical marks: Phonological-syntactic disambiguation of homographic verbs and visual crowding effects Journal Article In: Journal of Experimental Psychology: Human Perception and Performance, vol. 41, no. 2, pp. 494–507, 2015. @article{Hermena2015,Diacritics convey vowel sounds in Arabic, allowing accurate word pronunciation. Mostly, modern Arabic is printed nondiacritized. Otherwise, diacritics appear either only on homographic words when not disambiguated by surrounding text or on all words as in religious or educational texts. In an eye-tracking experiment, we examined sentence processing in the absence of diacritics and when diacritics were presented in either modes. Heterophonic homographic target verbs that have different pronunciations in active and passive were embedded in temporarily ambiguous sentences in which in the absence of diacritics, readers cannot be certain whether the verb was active or passive. Passive sentences were disambiguated by an extra word. Our results show that readers benefitted from the disambiguating diacritics when present only on the homographic verb. When disambiguating diacritics were absent, Arabic readers followed their parsing preference for active verb analysis, and garden path effects were observed. When reading fully diacritized sentences, readers incurred only a small cost, likely due to increased visual crowding, but did not extensively process the (mostly superfluous) diacritics, thus resulting in a lack of benefit from the disambiguating diacritics on the passive verb. |
Florian Hintz; Antje S. Meyer Prediction and production of simple mathematical equations: Evidence from visual world eye-tracking Journal Article In: PLoS ONE, vol. 10, no. 7, pp. e0130766, 2015. @article{Hintz2015,The relationship between the production and the comprehension systems has recently become a topic of interest for many psycholinguists. It has been argued that these systems are tightly linked and in particular that listeners use the production system to predict upcoming content. In this study, we tested how similar production and prediction processes are in a novel version of the visual world paradigm. Dutch speaking participants (native speakers in Experiment 1; German-Dutch bilinguals in Experiment 2) listened to mathematical equations while looking at a clock face featuring the numbers 1 to 12. On alternating trials, they either heard a complete equation ("three plus eight is eleven") or they heard the first part ("three plus eight is") and had to produce the result ("eleven") themselves. Participants were encouraged to look at the relevant numbers throughout the trial. Their eye movements were recorded and analyzed. We found that the participants' eye movements in the two tasks were overall very similar. They fixated the first and second number of the equations shortly after they were mentioned, and fixated the result number well before they named it on production trials and well before the recorded speaker named it on comprehension trials. However, all fixation latencies were shorter on production than on comprehension trials. These findings suggest that the processes involved in planning to say a word and anticipating hearing a word are quite similar, but that people are more aroused or engaged when they intend to respond than when they merely listen to another person. |
Yufen Hsieh; Julie E. Boland Semantic support and parallel parsing in Chinese Journal Article In: Journal of Psycholinguistic Research, vol. 44, no. 3, pp. 251–276, 2015. @article{Hsieh2015,Two eye-tracking experiments were conducted using written Chinese sentences that contained a multi-word ambiguous region. The goal was to determine whether readers maintained multiple interpretations throughout the ambiguous region or selected a single interpretation at the point of ambiguity. Within the ambiguous region, we manipulated the strength of support for the complement clause (CC) analysis and the relative clause (RC) analysis of the ambiguous construction Verb NP1 de NP2. In Experiment 1, the critical sentences were disambiguated to the dispreferred CC interpretation; in Experiment 2, the sentences were disambiguated as the preferred RC interpretation. Unsurprisingly, processing difficulty at the point of disambiguation was observed only in Experiment 1. As predicted by a parallel mechanism, greater processing difficulty arose at disambiguation when the RC interpretation was much more strongly supported by semantic cues relative to the CC alternative, than when the two analyses were semantically supported to a similar degree. Regression analyses confirmed that the degree of semantic support predicted processing difficulty at disambiguation. The findings provide evidence for a parallel constraint-based parsing mechanism. |
Falk Huettig; Susanne Brouwer Delayed anticipatory spoken language processing in adults with dyslexia - Evidence from eye-tracking Journal Article In: Dyslexia, vol. 21, no. 2, pp. 97–122, 2015. @article{Huettig2015,It is now well established that anticipation of upcoming input is a key characteristic of spoken language comprehension. It has also frequently been observed that literacy influences spoken language processing. Here, we investigated whether anticipatory spoken language processing is related to individuals' word reading abilities. Dutch adults with dyslexia and a control group participated in two eye-tracking experiments. Experiment 1 was conducted to assess whether adults with dyslexia show the typical language-mediated eye gaze patterns. Eye movements of both adults with and without dyslexia closely replicated earlier research: spoken language is used to direct attention to relevant objects in the environment in a closely time-locked manner. In Experiment 2, participants received instructions (e.g., 'Kijk naar deCOM afgebeelde pianoCOM ', look at the displayed piano) while viewing four objects. Articles (Dutch 'het' or 'de') were gender marked such that the article agreed in gender only with the target, and thus, participants could use gender information from the article to predict the target object. The adults with dyslexia anticipated the target objects but much later than the controls. Moreover, participants' word reading scores correlated positively with their anticipatory eye movements. We conclude by discussing the mechanisms by which reading abilities may influence predictive language processing. |
Heeju Hwang; Elsi Kaiser Accessibility effects on production vary cross-linguistically: Evidence from English and Korean Journal Article In: Journal of Memory and Language, vol. 84, pp. 190–204, 2015. @article{Hwang2015,Previous work on English suggests that accessibility of individual lexical items plays an important role in shaping speakers' choice of sentence structure, providing evidence for lexically incremental production. In order to investigate the role of accessibility in cross-linguistic production, we manipulated accessibility in English and Korean via semantic priming in Experiment 1 and visual cueing in Experiment 2. We recorded English and Korean speakers' speech and eye movements as they described pictured events. The production results show that English speakers' choice of sentence structure was significantly affected by semantic priming or visual cueing, consistent with the findings of prior research: Priming the patient entity significantly increased the production of passive sentences. In contrast, Korean speakers' choice of sentence structure was not influenced by accessibility of lexical items. Analyses of participants' eye-movements are consistent with the production results. In Experiment 1, English speakers fixated the semantically primed entity in the visual scene, whereas Korean speakers did not. Even when the visual cueing manipulation drew Korean speakers' focus of attention toward the cued entity in Experiment 2, Korean speakers' choice of the first referent was not influenced by the lexical accessibility. These findings strongly suggest that lexically incremental production is not a universal production mechanism. In light of the typological differences between English and Korean, we suggest that the relative contributions of accessibility during language production are mediated by the grammatical constraints of a language. |
Benjamin Gagl; Stefan Hawelka; Heinz Wimmer On sources of the word length effect in uoung readers Journal Article In: Scientific Studies of Reading, vol. 19, no. 4, pp. 289–306, 2015. @article{Gagl2015,We investigated how letter length, phoneme length, and consonant clusters contribute to the word length effect in 2nd- and 4th-grade children. They read words from three different conditions: In one condition, letter length increased but phoneme length did not due to multiletter graphemes (Haus-Bauch-Schach). In the remaining conditions, phoneme length increased in correspondence with letter length. One presented monosyllabic words with consonant clusters (Herbst); the other presented disyllabic words without consonant clusters (Kö.nig). Phoneme and letter length contributed to the length effect in naming latencies. Words with consonant clusters elicited the largest length effect. We interpreted this finding as reflecting difficulties of young readers with accessing the output phonology of the tightly coarticulated consonant clusters from the separate phonemes delivered from serial grapheme-to-phoneme conversions. Moreover, eye-movement data indicated that increased reading speed, accompanied with decreased word length effects, is due to more efficient grapheme-to-phoneme conversions rather than the emergence of whole-word recognition. |
Marcel R. Giezen; Henrike K. Blumenfeld; Anthony Shook; Viorica Marian; Karen Emmorey Parallel language activation and inhibitory control in bimodal bilinguals Journal Article In: Cognition, vol. 141, pp. 9–25, 2015. @article{Giezen2015,Findings from recent studies suggest that spoken-language bilinguals engage nonlinguistic inhibitory control mechanisms to resolve cross-linguistic competition during auditory word recognition. Bilingual advantages in inhibitory control might stem from the need to resolve perceptual competition between similar-sounding words both within and between their two languages. If so, these advantages should be lessened or eliminated when there is no perceptual competition between two languages. The present study investigated the extent of inhibitory control recruitment during bilingual language comprehension by examining associations between language co-activation and nonlinguistic inhibitory control abilities in bimodal bilinguals, whose two languages do not perceptually compete. Cross-linguistic distractor activation was identified in the visual world paradigm, and correlated significantly with performance on a nonlinguistic spatial Stroop task within a group of 27 hearing ASL-English bilinguals. Smaller Stroop effects (indexing more efficient inhibition) were associated with reduced co-activation of ASL signs during the early stages of auditory word recognition. These results suggest that inhibitory control in auditory word recognition is not limited to resolving perceptual linguistic competition in phonological input, but is also used to moderate competition that originates at the lexico-semantic level. |
Aline Godfroid; Le Anne Spino Reconceptualizing reactivity of think-alouds and eye tracking: Absence of evidence is not evidence of absence Journal Article In: Language Learning, vol. 65, no. 4, pp. 896–928, 2015. @article{Godfroid2015,This study extends previous reactivity research on the cognitive effects of think-alouds to include eye-tracking methodology. Unlike previous studies, we supplemented traditional superiority tests with equivalence tests, because only the latter are conceptually appropriate for demonstrating nonreactivity. Advanced learners of English read short English texts embedded with pseudowords in an eye-tracking (n = 28), think-aloud (n = 28), or silent control condition (n = 46). Results indicated that neither eye tracking nor thinking aloud affected text comprehension. In terms of vocabulary recognition, thinking aloud had a small, positive effect, and the results for eye tracking were mixed. We discuss challenges and opportunities of equivalence testing and explore ways to improve study quality more generally in second language acquisition research. |
Junjuan Gu; Xingshan Li The effects of character transposition within and across words in Chinese reading Journal Article In: Attention, Perception, & Psychophysics, vol. 77, no. 1, pp. 272–281, 2015. @article{Gu2015,Given the lack of spaces between words in Chinese text, Chinese readers must parse these characters into words using their word knowledge. In this situation, are the characters belonging to a single word or to different words understood via different character-order encoding processes? In this study, we explored the effects of word boundaries in Chinese text on character-order encoding. We used four-character words (the one-word condition) and two two-character words (the two-word condition) as our targets. We embedded the target words into sentences and then manipulated the previews of the words using the boundary paradigm. The preview was identical to the target word (identity condition), had the two middle characters of the target word transposed (TC condition), or had two middle characters that were different from those in the target word (SC condition). Fixation durations on the target word in the TC condition were much longer than those in the identity condition for the two-word condition, but they were not significantly different for the one-word condition. Furthermore, for the one-word condition, gaze durations were longer in the SC than in the TC condition, whereas for the two-word condition, the difference between the TC and SC conditions was not significant. Word boundaries were found to affect the character-order encoding in Chinese reading, further suggesting the early occurrence of word segmentation. |
Junjuan Gu; Xingshan Li; Simon P. Liversedge Character order processing in Chinese reading Journal Article In: Journal of Experimental Psychology: Human Perception and Performance, vol. 41, no. 1, pp. 127–137, 2015. @article{Gu2015a,We explored how character order information is encoded in isolated word processing or Chinese sentence reading in 2 experiments using a masked priming paradigm and a gaze-contingent display-change paradigm. The results showed that response latencies in the lexical decision task and reading times on the target word region were longer in the unrelated condition (the prime or the preview was unrelated with the target word) than the transposed-character condition (the prime or the preview was a transposition of the 2 characters of the target word), which were respectively longer than in the identity condition (the prime or preview was identical to the target word). These results show that character order is encoded at an early stage of processing in Chinese reading, but character position encoding was not strict. We also found that character order encoding was similar for single-morpheme and multiple-morpheme words, suggesting that morphemic status does not affect character order encoding. The current results represent an early contribution to our understanding of character order encoding during Chinese reading. |
Demet Gurler; Nathan Doyle; Edgar Walker; John Magnotti; Michael S. Beauchamp A link between individual differences in multisensory speech perception and eye movements Journal Article In: Attention, Perception, & Psychophysics, vol. 77, no. 4, pp. 1333–1341, 2015. @article{Gurler2015,The McGurk effect is an illusion in which visual speech information dramatically alters the perception of auditory speech. However, there is a high degree of individual variability in how frequently the illusion is perceived: some individuals almost always perceive the McGurk effect, while others rarely do. Another axis of individual variability is the pattern of eye movements make while viewing a talking face: some individuals often fixate the mouth of the talker, while others rarely do. Since the talker's mouth carries the visual speech necessary information to induce the McGurk effect, we hypothesized that individuals who frequently perceive the McGurk effect should spend more time fixating the talker's mouth. We used infrared eye tracking to study eye movements as 40 participants viewed audiovisual speech. Frequent perceivers of the McGurk effect were more likely to fixate the mouth of the talker, and there was a significant correlation between McGurk frequency and mouth looking time. The noisy encoding of disparity model of McGurk perception showed that individuals who frequently fixated the mouth had lower sensory noise and higher disparity thresholds than those who rarely fixated the mouth. Differences in eye movements when viewing the talker's face may be an important contributor to interindividual differences in multisensory speech perception. |
Matthew Haigh; Jean François Bonnefon Conditional sentences create a blind spot in theory of mind during narrative comprehension Journal Article In: Acta Psychologica, vol. 160, pp. 194–201, 2015. @article{Haigh2015a,We identify a blind spot in the early Theory of Mind processing of conditional sentences that describe a protagonist's potential action, and its predictable consequences. We propose that such sentences create expectations through two independent channels. A decision theoretic channel creates an expectation that the action will be taken (viz., not taken) if it has desirable (viz., undesirable) consequences, but a structural channel acts in parallel to create an expectation that the action will be taken, irrespective of desirability. Accordingly, reading should be disrupted when a protagonist avoids an action with desirable consequences, but reading should not be disrupted when a protagonist takes an action with undesirable consequences. This prediction was supported by the eye movements of participants reading systematically varied vignettes. Reading was always disrupted when the protagonist avoided an action with desirable consequences, but disruptions were either delayed (Experiment 1) or recovered from faster (Experiment 2) when the protagonist took an action with undesirable consequences. |
Matthew Haigh; Jean François Bonnefon Eye movements reveal how readers infer intentions from the beliefs and desires of others Journal Article In: Experimental Psychology, vol. 62, no. 3, pp. 206–213, 2015. @article{Haigh2015,We examine how the beliefs and desires of a protagonist are used by readers to predict their intentions as a narrative vignette unfolds. Eye movement measures revealed that readers rapidly inferred an intention when the protagonist desired an outcome, even when this inference was not licensed by the protagonist's belief state. Reading was immediately disrupted when participants encountered a described action that contradicted this inference. During intermediate processing, desire inferences were moderated by the protagonist's belief state. Effects that emerged later in the text were again driven solely by the protagonist's desires. These data suggest that desire-based inferences are initially drawn irrespective of belief state, but are then quickly inhibited if not licensed by relevant beliefs. This inhibition of desire-based inferences may be an effortful process as it was not systematically sustained in later steps of processing. |
Jesse A. Harris Structure modulates similarity-based interference in sluicing: An eye tracking study Journal Article In: Frontiers in Psychology, vol. 6, pp. 1839, 2015. @article{Harris2015,In cue-based content-addressable approaches to memory, a target and its competitors are retrieved in parallel from memory via a fast, associative cue-matching procedure under a severely limited focus of attention. Such a parallel matching procedure could in principle ignore the serial order or hierarchical structure characteristic of linguistic relations. I present an eye tracking while reading experiment that investigates whether the sentential position of a potential antecedent modulates the strength of similarity-based interference, a well-studied effect in which increased similarity in features between a target and its competitors results in slower and less accurate retrieval overall. The manipulation trades on an independently established Locality bias in sluiced structures to associate a wh-remnant (which ones) in clausal ellipsis with the most local correlate (some wines), as in "The tourists enjoyed some wines, but I don't know which ones." The findings generally support cue-based parsing models of sentence processing that are subject to similarity-based interference in retrieval, and provide additional support to the growing body of evidence that retrieval is sensitive to both the structural position of a target antecedent and its competitors, and the specificity of retrieval cues. |
2014 |
Steven Frisson; Hannah Koole; Louisa Hughes; Andrew Olson; Linda Wheeldon Competition between orthographically and phonologically similar words during sentence reading: Evidence from eye movements Journal Article In: Journal of Memory and Language, vol. 73, no. 1, pp. 148–173, 2014. @article{Frisson2014a,Two eye movement experiments tested the effect of orthographic and/or phonological overlap between prime and target words embedded in a sentence. In Experiment 1, four types of overlap were tested: phonological and orthographic overlap (O+P+) occurring word initially .strain-strait) or word finally .wings-kings), orthographic overlap alone (O+P-, bear-gear) and phonological overlap alone (O-P+, smile-aisle). Only O+P+ overlap resulted in inhibition, with the rhyming condition showing an immediate inhibition effect on the target word and the non-rhyming condition on the spillover region. No priming effects were found on any eye movement measure for the O+P- or the O-P+ conditions. Experiment 2 demonstrated that the size of this inhibition effect is affected by both the distance between the prime and target words and by syntactic structure. Inhibition was again observed when primes and targets appeared close together (approximately 3 words). In contrast, no inhibition was observed when the separation was nine words on average, with the prime and target either appearing in the same sentence or separated by a sentence break. However, when the target was delayed but still in the same sentence, the size of the inhibitory effect was affected by the participants' level of reading comprehension. Skilled comprehenders were more negatively impacted by related primes than less skilled comprehenders. This suggests that good readers keep lexical representations active across larger chunks of text, and that they discard this activation at the end of the sentence. This pattern of results is difficult to accommodate in existing competition or episodic memory models of priming. |
Benjamin Gagl; Stefan Hawelka; Florian Hutzler A similar correction mechanism in slow and fluent readers after suboptimal landing positions Journal Article In: Frontiers in Human Neuroscience, vol. 8, pp. 355, 2014. @article{Gagl2014,The present eye movements study investigated the optimal viewing position (OVP) and inverted-optimal viewing position (I-OVP) effects in slow readers. The basis of these effects is a phenomenon called corrective re-fixations, which describes a short saccade from a suboptimal landing position (word beginning or end) to the center of the word. The present study found corrective re-fixations in slow readers, which was evident from the I-OVP effects in first fixation durations, the OVP effect in number of fixations and the OVP effect in re-fixation probability. The main result is that slow readers, despite being characterized by a fragmented eye movement pattern during reading, nevertheless share an intact mechanism for performing corrective re-fixations. This correction mechanism is not linked to linguistic processing, but to visual and oculomotor processes, which suggests the integrity of oculomotor and visual processes in slow readers. |
Benjamin Gagl; Stefan Hawelka; Fabio Richlan; Sarah Schuster; Florian Hutzler Parafoveal preprocessing in reading revisited: Evidence from a novel preview manipulation Journal Article In: Journal of Experimental Psychology: Learning, Memory, and Cognition, vol. 40, no. 2, pp. 588–595, 2014. @article{Gagl2014a,The study investigated parafoveal preprocessing by the means of the classical invisible boundary paradigm and a novel manipulation of the parafoveal previews (i.e., visual degradation). Eye movements were investigated on 5-letter target words with constraining (i.e., highly informative) initial letters or similarly constraining final letters. Visual degradation was administered to all, no, the initial, or the final 2 letters of the parafoveal preview of the target words. Critically, the manipulation of the parafoveal previews did not interfere with foveal processing. Thus, we had a proper baseline to which we could relate our main findings, which were as follows: First, the valid (i.e., nondegraded) preview of the target words' final letters led to shorter fixation times compared to the baseline condition (i.e., the degradation of all letters). Second, this preview benefit for the final letters was comparable to the benefit of previewing the initial letters. Third, the preview of a constraining initial letter sequence, however, yielded a larger preview benefit than the preview of an unconstraining initial letter sequence. The latter finding indicates that preprocessing constraining initial letters is particularly conducive to foveal word recognition. |
Lesya Y. Ganushchak; Agnieszka E. Konopka; Yiya Chen What the eyes say about planning of focused referents during sentence formulation: A cross-linguistic investigation Journal Article In: Frontiers in Psychology, vol. 5, pp. 1124, 2014. @article{Ganushchak2014,This study investigated how sentence formulation is influenced by a preceding discourse context. In two eye-tracking experiments, participants described pictures of two-character transitive events in Dutch (Experiment 1) and Chinese (Experiment 2). Focus was manipulated by presenting questions before each picture. In the Neutral condition, participants first heard "What is happening here?" In the Object or Subject Focus conditions, the questions asked about the Object or Subject character (What is the policeman stopping? Who is stopping the truck?). The target response was the same in all conditions (The policeman is stopping the truck). In both experiments, sentence formulation in the Neutral condition showed the expected pattern of speakers fixating the subject character (policeman) before the object character (truck). In contrast, in the focus conditions speakers rapidly directed their gaze preferentially only to the character they needed to encode to answer the question (the new, or focused, character). The timing of gaze shifts to the new character varied by language group (Dutch vs. Chinese): shifts to the new character occurred earlier when information in the question can be repeated in the response with the same syntactic structure (in Chinese but not in Dutch). The results show that discourse affects the timecourse of linguistic formulation in simple sentences and that these effects can be modulated by language-specific linguistic structures such as parallels in the syntax of questions and declarative sentences. |
Mackenzie G. Glaholt; Keith Rayner; Eyal M. Reingold A rapid effect of stimulus quality on the durations of individual fixations during reading Journal Article In: Visual Cognition, vol. 22, no. 3-4, pp. 377–389, 2014. @article{Glaholt2014,We developed a variant of the single fixation replacement paradigm (Yang & McConkie, 2001, 2004) in order to examine the effect of stimulus quality on fixation duration during reading. Subjects' eye movements were monitored while they read passages of text for comprehension. During critical fixations, equal changes to the luminance of the background produced either an increase (Up-Contrast) or a decrease (Down-Contrast) of the contrast of the text. The durations of critical fixations were found to be lengthened in the Down-Contrast but not the Up-Contrast condition. Ex-Gaussian modelling of the distributions of fixation durations showed that the reduction in stimulus quality lengthened the majority of fixations, and a survival analysis estimated the onset of this effect to be approximately 141 ms following fixation onset. Because the stimulus quality of the text during critical fixations could not be predicted or parafoveally previewed prior to foveation, the present effect can be attributed to an immediate effect of stimulus quality on fixation duration. |
Tamar H. Gollan; Elizabeth R. Schotter; Joanne Gomez; Mayra Murillo; Keith Rayner Multiple levels of bilingual language control: Evidence from language intrusions in reading aloud Journal Article In: Psychological Science, vol. 25, no. 2, pp. 585–595, 2014. @article{Gollan2014,Bilinguals rarely produce words in an unintended language. However, we induced such intrusion errors (e.g., saying el instead of he) in 32 Spanish-English bilinguals who read aloud single-language (English or Spanish) and mixed-language (haphazard mix of English and Spanish) paragraphs with English or Spanish word order. These bilinguals produced language intrusions almost exclusively in mixed-language paragraphs, and most often when attempting to produce dominant-language targets (accent-only errors also exhibited reversed language-dominance effects). Most intrusion errors occurred for function words, especially when they were not from the language that determined the word order in the paragraph. Eye movements showed that fixating a word in the nontarget language increased intrusion errors only for function words. Together, these results imply multiple mechanisms of language control, including (a) inhibition of the dominant language at both lexical and sublexical processing levels, (b) special retrieval mechanisms for function words in mixed-language utterances, and (c) attentional monitoring of the target word for its match with the intended language. |
Katherine Guérard; Jean Saint-Aubin; Marilyne Maltais; Hugo Lavoie The role of verbal memory in regressions during reading is modulated by the target word's recency in memory Journal Article In: Memory & Cognition, vol. 42, no. 7, pp. 1155–1170, 2014. @article{Guerard2014,During reading, a number of eye movements are made backward, on words that have already been read. Recent evidence suggests that such eye movements, called regressions, are guided by memory. Several studies point to the role of spatial memory, but evidence for the role of verbal memory is more limited. In the present study, we examined the factors that modulate the role of verbal memory in regressions. Participants were required to make regressions on target words located in sentences displayed on one or two lines. Verbal interference was shown to affect regressions, but only when participants executed a regression on a word located in the first part of the sentence, irrespective of the number of lines on which the sentence was displayed. Experiments 2 and 3 showed that the effect of verbal interference on words located in the first part of the sentence disappeared when participants initiated the regression from the middle of the sentence. Our results suggest that verbal memory is recruited to guide regressions, but only for words read a longer time ago. |
Ernesto Guerra; Pia Knoeferle Spatial distance effects on incremental semantic interpretation of abstract sentences: Evidence from eye tracking Journal Article In: Cognition, vol. 133, no. 3, pp. 535–552, 2014. @article{Guerra2014,A large body of evidence has shown that visual context information can rapidly modulate language comprehension for concrete sentences and when it is mediated by a referential or a lexical-semantic link. What has not yet been examined is whether visual context can also modulate comprehension of abstract sentences incrementally when it is neither referenced by, nor lexically associated with, the sentence. Three eye-tracking reading experiments examined the effects of spatial distance between words (Experiment 1) and objects (Experiment 2 and 3) on participants' reading times for sentences that convey similarity or difference between two abstract nouns (e.g., 'Peace and war are certainly different...'). Before reading the sentence, participants inspected a visual context with two playing cards that moved either far apart or close together. In Experiment 1, the cards turned and showed the first two nouns of the sentence (e.g., 'peace', 'war'). In Experiments 2 and 3, they turned but remained blank. Participants' reading times at the adjective (Experiment 1: first-pass reading time; Experiment 2: total times) and at the second noun phrase (Experiment 3: first-pass times) were faster for sentences that expressed similarity when the preceding words/objects were close together (vs. far apart) and for sentences that expressed dissimilarity when the preceding words/objects were far apart (vs. close together). Thus, spatial distance between words or entirely unrelated objects can rapidly and incrementally modulate the semantic interpretation of abstract sentences. |
Matthew Haigh; Heather J. Ferguson; Andrew J. Stewart An eye-tracking investigation into readers' sensitivity to actual versus expected utility in the comprehension of conditionals Journal Article In: Quarterly Journal of Experimental Psychology, vol. 67, no. 1, pp. 166–185, 2014. @article{Haigh2014,The successful comprehension of a utility conditional (i.e., an "if p, then q" statement where p and/or q is valued by one or more agents) requires the construction of a mental representation of the situation described by that conditional and integration of this representation with prior context. In an eye-tracking experiment, we examined the time course of integrating conditional utility information into the broader discourse model. Specifically, the experiment determined whether readers were sensitive, during rapid heuristic processing, to the congruency between the utility of the consequent clause of a conditional (positive or negative) and a reader's subjective expectations based on prior context. On a number of eye-tracking measures we found that readers were sensitive to conditional utility-conditionals for which the consequent utility mismatched the utility that would be anticipated on the basis of prior context resulted in processing disruption. Crucially, this sensitivity emerged on measures that are accepted to indicate early processing within the language comprehension system and suggests that the evaluation of a conditional's utility informs the early stages of conditional processing. |
Ashley Benatar; Charles Clifton Newness, givenness and discourse updating: Evidence from eye movements Journal Article In: Journal of Memory and Language, vol. 71, no. 1, pp. 1–16, 2014. @article{Benatar2014,Three experiments examined the effect of contextual givenness on eye movements in reading, following Schwarzschild's (1999) analysis of givenness and focus-marking in which relations among entities as well as the entities themselves can be given. In each study, a context question was followed by an answer in which a critical word was either given, new, or contrastively (correctively) focused. Target words were read faster when the critical word provided given information than when it provided new information, and faster when it provided new information than when it corrected prior information. Repetition of target words was controlled in two ways: by mentioning a non-given target word in the context in a relation other than that in which it occurred as a target, and by using a synonym or subordinate of a given target to refer to it in the context question. Verbatim repetition was not responsible for the observed effects of givenness and contrastiveness. Besides clarifying previous inconsistent results of the effects of focus and givenness on reading speed, these results indicate that reading speed can be influenced essentially immediately by a reader's discourse representation, and that the extent of the influence is graded, with corrections to a representation having a larger effect than simple additions. |
Jean-Baptiste Bernard; Aurélie Calabrèse; Eric Castet Role of syllable segmentation processes in peripheral word recognition Journal Article In: Vision Research, vol. 105, pp. 226–232, 2014. @article{Bernard2014,Previous studies of foveal visual word recognition provide evidence for a low-level syllable decomposition mechanism occurring during the recognition of a word. We investigated if such a decomposition mechanism also exists in peripheral word recognition. Single words were visually presented to subjects in the peripheral field using a 6° square gaze-contingent simulated central scotoma. In the first experiment, words were either unicolor or had their adjacent syllables segmented with two different colors (color/syllable congruent condition). Reaction times for correct word identification were measured for the two different conditions and for two different print sizes. Results show a significant decrease in reaction time for the color/syllable congruent condition compared with the unicolor condition. A second experiment suggests that this effect is specific to syllable decomposition and results from strategic, presumably involving attentional factors, rather than stimulus-driven control. |
Hazel I. Blythe; Rebecca L. Johnson; Simon P. Liversedge; Keith Rayner Reading transposed text: effects of transposed letter distance and consonant-vowel status on eye movements Journal Article In: Attention, Perception, & Psychophysics, vol. 76, no. 8, pp. 2424–2440, 2014. @article{Blythe2014,Two experiments were conducted to investigate the flexibility of letter-position encoding in word identification during reading. In both experiments, two tasks were used. First, participants' eye movements were measured as they read sentences containing transposed letter (TL) strings. Second, participants were presented with the TL strings in isolation and were asked to discriminate them from nonwords. In Experiment 1, we manipulated the distance between transposed letters (ligament vs. liagment vs. limagent vs. lieamgnt). Reading/response times increased with the distance between TLs. In Experiment 2, we manipulated whether the TLs were consonants, vowels, or one of each (ssytem vs. faeture vs. fromat). Reading/response times showed that CV transpositions were the most disruptive. In both experiments, response accuracy was particularly poor for words presented in isolation when there was an intervening letter between TLs. These data show that processing across multiple fixations, and the presence of a meaningful sentence context, are important for flexible letter position encoding in lexical identification. |
Hans Rutger Bosker; Hugo Quené; Ted J. M. Sanders; Nivja H. Jong Native 'um's elicit prediction of low-frequency referents, but non-native 'um's do not Journal Article In: Journal of Memory and Language, vol. 75, pp. 104–116, 2014. @article{Bosker2014,Speech comprehension involves extensive use of prediction. Linguistic prediction may be guided by the semantics or syntax, but also by the performance characteristics of the speech signal, such as disfluency. Previous studies have shown that listeners, when presented with the filler uh, exhibit a disfluency bias for discourse-new or unknown referents, drawing inferences about the source of the disfluency. The goal of the present study is to study the contrast between native and non-native disfluencies in speech comprehension. Experiment 1 presented listeners with pictures of high-frequency (e.g., a hand) and low-frequency objects (e.g., a sewing machine) and with fluent and disfluent instructions. Listeners were found to anticipate reference to low-frequency objects when encountering disfluency, thus attributing disfluency to speaker trouble in lexical retrieval. Experiment 2 showed that, when participants listened to disfluent non-native speech, no anticipation of low-frequency referents was observed. We conclude that listeners can adapt their predictive strategies to the (non-native) speaker at hand, extending our understanding of the role of speaker identity in speech comprehension. |
Oliver Boxell Lexical fillers permit real-time gap-search inside island domains Journal Article In: Journal of Cognitive Science, vol. 14, no. 1, pp. 97–136, 2014. @article{Boxell2014,It has often been reported that lexical fillers (e.g. which house) improve the overall acceptability of many island constraint violations relative to bare fillers (e.g. what). The current study attempts to test for the first time whether lexical fillers reduce real-time sensitivity to wh-islands as well. Results from an eyetracking-while-reading study are reported that demonstrate native English speakers' sensitivity to a plausibility manipulation between a fronted filler phrase and a downstream subcategorizing verb inside a wh-island domain. The effect is found as the verb was encountered in real-time, and only when the filler element contains lexical information, not when it is bare. This is taken to show that online sensitivity to the wh-island constraint is reduced when the filler preceding it is lexical. The strengths and weaknesses and overall compatibility of a range of grammatical and processing theories are considered in relation to this finding. |
Allison E. Britt; Daniel Mirman; Sergey A. Kornilov; James S. Magnuson Effect of repetition proportion on language-driven anticipatory eye movements Journal Article In: Acta Psychologica, vol. 145, no. 1, pp. 128–138, 2014. @article{Britt2014,Previous masked priming research in word recognition has demonstrated that repetition priming is influenced by experiment-wise information structure, such as proportion of target repetition. Research using naturalistic tasks and eye-tracking has shown that people use linguistic knowledge to anticipate upcoming words. We examined whether the proportion of target repetition within an experiment can have a similar effect on anticipatory eye movements. We used a word-to-picture matching task (i.e., the visual world paradigm) with target repetition proportion carefully controlled. Participants' eye movements were tracked starting when the pictures appeared, one second prior to the onset of the target word. Targets repeated from the previous trial were fixated more than other items during this preview period when target repetition proportion was high and less than other items when target repetition proportion was low. These results indicate that linguistic anticipation can be driven by short-term within-experiment trial structure, with implications for the generalization of priming effects, the bases of anticipatory eye movements, and experiment design. |
Jon Brock; Kate Nation The hardest butter to button: Immediate context effects in spoken word identification Journal Article In: Quarterly Journal of Experimental Psychology, vol. 67, no. 1, pp. 114–123, 2014. @article{Brock2014,According to some theories, the context in which a spoken word is heard has no impact on the earliest stages of word identification. This view has been challenged by recent studies indicating an interactive effect of context and acoustic similarity on language-mediated eye movements. However, an alternative explanation for these results is that participants looked less at acoustically similar objects in constraining contexts simply because they were looking more at other objects that were cued by the context. The current study addressed this concern whilst providing a much finer grained analysis of the temporal evolution of context effects. Thirty-two adults listened to sentences while viewing a computer display showing four objects. As expected, shortly after the onset of a target word (e.g., "button") in a neutral context, participants saccaded preferentially towards a cohort competitor of the word (e.g., butter). This effect was significantly reduced when the preceding verb made the competitor an unlikely referent (e.g., "Sam fastened the button"), even though there were no other contextually congruent objects in the display. Moreover, the time-course of these two effects was identical to within approximately 30 ms, indicating that certain forms of contextual information can have a near-immediate effect on word identification. |
Irene Ablinger; Walter Huber; Ralph Radach Eye movement analyses indicate the underlying reading strategy in the recovery of lexical readers Journal Article In: Aphasiology, vol. 28, no. 6, pp. 640–657, 2014. @article{Ablinger2014,Background: Psycholinguistic error analysis of dyslexic responses in various reading tasks provides the primary basis for clinically discriminating subtypes of pathological reading. Within this framework, phonology-related errors are indicative of a sequential word processing strategy, whereas lexical and semantic errors are associated with a lexical reading strategy. Despite the large number of published intervention studies, relatively little is known about changes in error distributions during recovery in dyslexic patients.Aims: The main purpose of the present work was to extend the scope of research on the time course of recovery in readers with acquired dyslexia, using eye tracking methodology to examine word processing in real time. The guiding hypothesis was that in lexical readers a reduction of lexical errors and an emerging predominant production of phonological errors should be associated with a change to a more segmental moment-to-moment reading behaviour.Methods & Procedures: Five patients participated in an eye movement supported reading intervention, where both lexical and segmental reading was facilitated. Reading performance was assessed before (T1) and after (T2) therapy intervention via recording of eye movements. Analyses included a novel way to examine the spatiotemporal dynamics of processing using distributions of fixation positions as different time intervals. These subdistributions reveal the gradual shifting of fixation positions during word processing, providing an adequate metric for objective classification of online reading strategies.Outcome & Results: Therapy intervention led to improved reading accuracy in all subjects. In three of five participants, analyses revealed a restructuring in the underlying reading mechanisms from predominantly lexical to more segmental word processing. In contrast, two subjects maintained their lexical reading procedures. Importantly, the fundamental assumption that a high number of phonologically based reading errors must be associated with segmental word processing routines, while the production of lexical errors is indicative of a holistic reading strategy could not be verified.Conclusions: Our results indicate that despite general improvements in reading performance, only some patients reorganised their word identification process. Contradictive data raise doubts on the validity of psycholinguistic error analysis as an exclusive indicator of changes in reading strategy. We suggest this traditional approach to combine with innovative eye tracking methodology in the interest of more comprehensive diagnostic strategies. |
Irene Ablinger; Kerstin Heyden; Christian Vorstius; Katja Halm; Walter Huber; Ralph Radach An eye movement based reading intervention in lexical and segmental readers with acquired dyslexia Journal Article In: Neuropsychological Rehabilitation, vol. 24, no. 6, pp. 833–867, 2014. @article{Ablinger2014a,Due to their brain damage, aphasic patients with acquired dyslexia often rely to a greater extent on lexical or segmental reading procedures. Thus, therapy intervention is mostly targeted on the more impaired reading strategy. In the present work we introduce a novel therapy approach based on real-time measurement of patients' eye movements as they attempt to read words. More specifically, an eye movement contingent technique of stepwise letter de-masking was used to support sequential reading, whereas fixation-dependent initial masking of non-central letters stimulated a lexical (parallel) reading strategy. Four lexical and four segmental readers with acquired central dyslexia received our intensive reading intervention. All participants showed remarkable improvements as evident in reduced total reading time, a reduced number of fixations per word and improved reading accuracy. Both types of intervention led to item-specific training effects in all subjects. A generalisation to untrained items was only found in segmental readers after the lexical training. Eye movement analyses were also used to compare word processing before and after therapy, indicating that all patients, with one exclusion, maintained their preferred reading strategy. However, in several cases the balance between sequential and lexical processing became less extreme, indicating a more effective individual interplay of both word processing routes. |
Noor Z. Al Dahhan; George K. Georgiou; Rickie Hung; Douglas P. Munoz; Rauno Parrila; John R. Kirby Eye movements of university students with and without reading difficulties during naming speed tasks Journal Article In: Annals of Dyslexia, vol. 64, no. 2, pp. 137–150, 2014. @article{AlDahhan2014,Although naming speed (NS) has been shown to predict reading into adulthood and differentiate between adult dyslexics and controls, the question remains why NS is related to reading. To address this question, eye movement methodology was combined with three letter NS tasks (the original letter NS task by Denckla & Rudel, Cortex 10:186-202, 1974, and two more developed by Compton, The Journal of Special Education 37:81-94, 2003, with increased phonological or visual similarity of the letters). Twenty undergraduate students with reading difficulties (RD) and 27 without (NRD) were tested on letter NS tasks (eye movements were recorded during the NS tasks), phonological processing, and reading fluency. The results indicated first that the RD group was slower than the NRD group on all NS tasks with no differences between the NS tasks. In addition, the NRD group had shorter fixation durations, longer saccades, and fewer saccades and fixations than the RD group. Fixation duration and fixation count were significant predictors of reading fluency even after controlling for phonological processing measures. Taken together, these findings suggest that the NS-reading relationship is due to two factors: less able readers require more time to acquire stimulus information during fixation and they make more saccades. |
Bernhard Angele; Abby E. Laishley; Keith Rayner; Simon P. Liversedge The effect of high- and low-frequency previews and sentential fit on word skipping during reading Journal Article In: Journal of Experimental Psychology: Learning, Memory, and Cognition, vol. 40, no. 4, pp. 1181–1203, 2014. @article{Angele2014,In a previous gaze-contingent boundary experiment, Angele and Rayner (2013) found that readers are likely to skip a word that appears to be the definite article the even when syntactic constraints do not allow for articles to occur in that position. In the present study, we investigated whether the word frequency of the preview of a 3-letter target word influences a reader's decision to fixate or skip that word. We found that the word frequency rather than the felicitousness (syntactic fit) of the preview affected how often the upcoming word was skipped. These results indicate that visual information about the upcoming word trumps information from the sentence context when it comes to making a skipping decision. Skipping parafoveal instances of the therefore may simply be an extreme case of skipping high-frequency words. |
Manabu Arai; Reiko Mazuka The development of Japanese passive syntax as indexed by structural priming in comprehension Journal Article In: Quarterly Journal of Experimental Psychology, vol. 67, no. 1, pp. 60–78, 2014. @article{Arai2014,A number of previous studies reported a phenomenon of syntactic priming with young children as evidence for cognitive representations required for processing syntactic structures. However, it remains unclear how syntactic priming reflects children's grammatical competence. The current study investigated structural priming of the Japanese passive structure with 5- and 6-year-old children in a visual-world setting. Our results showed a priming effect as anticipatory eye movements to an upcoming referent in these children but the effect was significantly stronger in magnitude in 6-year-olds than in 5-year-olds. Consistently, the responses to comprehension questions revealed that 6-year-olds produced a greater number of correct answers and more answers using the passive structure than 5-year-olds. We also tested adult participants who showed even stronger priming than the children. The results together revealed that language users with the greater linguistic competence with the passives exhibited stronger priming, demonstrating a tight relationship between the effect of priming and the development of grammatical competence. Furthermore, we found that the magnitude of the priming effect decreased over time. We interpret these results in the light of an error-based learning account. Our results also provided evidence for prehead as well as head-independent priming. |
Ellen Gurman Bard; Robin L. Hill; Mary Ellen Foster; Manabu Arai Tuning accessibility of referring expressions in situated dialogue Journal Article In: Language, Cognition and Neuroscience, vol. 29, no. 8, pp. 928–949, 2014. @article{Bard2014,Accessibility theory associates more complex referring expressions with less accessible referents. Felicitous referring expressions should reflect accessibility from the addressee's perspective, which may be difficult for speakers to assess incrementally. If mechanisms shared by perception and production help interlocutors align internal representations, then dyads with different roles and different things to say should profit less from alignment. We examined introductory mentions of on-screen shapes within a joint task for effects of access to the addressee's attention, of players' actions and of speakers' roles. Only speakers' actions affected the form of referring expression and only different role dyads made egocentric use of actions hidden from listeners. Analysis of players' gaze around referring expressions confirmed this pattern; only same role dyads coordinated attention as the accessibility theory predicts. The results are discussed within a model distributing collaborative effort under the cons... |
Dale J. Barr; Laura Jackson; Isobel Phillips Using a voice to put a name to a face: The psycholinguistics of proper name comprehension Journal Article In: Journal of Experimental Psychology: General, vol. 143, no. 1, pp. 404–413, 2014. @article{Barr2014,We propose that hearing a proper name (e.g., Kevin) in a particular voice serves as a compound memory cue that directly activates representations of a mutually known target person, often permitting reference resolution without any complex computation of shared knowledge. In a referential communication study, pairs of friends played a communication game, in which we monitored the eyes of one friend (the addressee) while he or she sought to identify the target person, in a set of four photos, on the basis of a name spoken aloud. When the name was spoken by a friend, addressees rapidly identified the target person, and this facilitation was independent of whether the friend was articulating a message he or she had designed versus one from a third party with whom the target person was not shared. Our findings suggest that the comprehension system takes advantage of regularities in the environment to minimize effortful computation about who knows what. |
Aurélie Calabrèse; Jean-Baptiste Bernard; Géraldine Faure; Louis Hoffart; Eric Castet Eye movements and reading speed in macular disease: The shrinking perceptual span hypothesis requires and is supported by a mediation analysis Journal Article In: Investigative Ophthalmology & Visual Science, vol. 55, no. 6, pp. 3638–3645, 2014. @article{Calabrese2014,Purpose. Reading speed of patients with Central Field Loss (CFL) correlates with the size of saccades (measured in letters per forward saccade - L/FS). We assessed whether this effect is mediated by the total number of fixations, by the average fixation duration, or by a mixture of both. Methods. We measured eye movements (with a video eyetracker) of 35 AMD and 4 Stargardt patients (better eye decimal acuity from 0.08 to 0.3) while they monocularly read single-line French sentences continuously displayed on a screen. All patients had a dense scotoma covering the fovea, as assessed with MP1 microperimetry, and therefore used eccentric viewing. Results were analyzed with regression-based mediation analysis, a modeling framework that informs on the underlying factors by which an independent variable affects a dependent variable. Results. Reading speed and average fixation duration are negatively correlated, a result that was not observed in prior studies with CFL patients. This effect of fixation duration on reading speed is still significant when partialling out the effect of the total number of fixations (slope:-0.75, p<0.001). Despite this large effect of fixation duration, mediation analysis shows that the effect of L/FS on reading speed is fully mediated by the total number of fixations (effect size: 0.96; CI[0.82, 1.12]) and not by fixation duration (effect size: 0.02; CI[-0.11,0.14]). Conclusions. Results are consistent with the shrinking perceptual span hypothesis: reading speed decreases with the average number of letters traversed on each forward saccade, an effect fully mediated by the total number of fixations. |
Myriam Chanceaux; Jonathan Grainger Effects of number, complexity, and familiarity of flankers on crowded letter identification Journal Article In: Journal of Vision, vol. 14, no. 2014, pp. 1–17, 2014. @article{Chanceaux2014,We tested identification of target letters surrounded by a varying number (2, 4, 6) of horizontally aligned flanking elements. Strings were presented left or right of a central fixation dot, and targets were always at the center of the string. Flankers could be other letters, digits, symbols, simple shapes, or false fonts, and thus varied both in terms of visual complexity and familiarity. Two-alternative forced choice (2AFC) speed and accuracy was measured for choosing the target letter versus an alternative letter that was not present in the string. Letter identification became harder as the number of flankers increased. Greater flanker complexity led to more interference in target identification, whereas more complex targets were easier to identify. Effects of flanker complexity were found to depend on visual field and position of flankers, with the strongest effects seen for leftward flankers in the left visual field. Visual complexity predicted flanker interference better than familiarity, and better than target-flanker similarity. These results provide further support for an excessive feature- integration account of the interfering effects of both adjacent and nonadjacent flanking elements in horizontally aligned strings. |
Wonil Choi; Peter C. Gordon Word skipping during sentence reading: effects of lexicality on parafoveal processing Journal Article In: Attention, Perception, & Psychophysics, vol. 76, no. 1, pp. 201–213, 2014. @article{Choi2014b,Two experiments examined how lexical status affects the targeting of saccades during reading by using the boundary technique to vary independently the content of a letter string when seen in parafoveal preview and when directly fixated. Experiment 1 measured the skipping rate for a target word embedded in a sentence under three parafoveal preview conditions: full preview (e.g., brain-brain), pseudohomophone preview (e.g., brane-brain), and orthographic nonword control preview (e.g., brant-brain); in the first condition, the preview string was always an English word, while in the second and third conditions, it was always a nonword. Experiment 2 investigated three conditions where the preview string was always a word: full preview (e.g., beach-beach), homophone preview (e.g., beech-beach), and orthographic control preview (e.g., bench-beach). None of the letter string manipulations used to create the preview conditions in the experiments disrupted sublexical orthographic or phonological patterns. In Experiment 1, higher skipping rates were observed for the full (lexical) preview condition, which consisted of a word, than for the nonword preview conditions (pseudohomophone and orthographic control). In contrast, Experiment 2 showed no difference in skipping rates across the three types of lexical preview conditions (full, homophone, and orthographic control), although preview type did influence reading times. This pattern indicates that skipping not only depends on the presence of disrupted sublexical patterns of orthography or phonology, but also is critically dependent on processes that are sensitive to the lexical status of letter strings in the parafovea. |
Wing Yee Chow; Shevaun Lewis; Colin Phillips Immediate sensitivity to structural constraints in pronoun resolution Journal Article In: Frontiers in Psychology, vol. 5, pp. 630, 2014. @article{Chow2014,Real-time interpretation of pronouns is sometimes sensitive to the presence of grammatically-illicit antecedents and sometimes not. This occasional sensitivity has been taken as evidence that structural constraints do not immediately impact the initial antecedent retrieval for pronoun interpretation. We argue that it is important to separate effects that reflect the initial antecedent retrieval process from those that reflect later processes. We present results from five reading comprehension experiments. Both the current results and previous evidence support the hypothesis that agreement features and structural constraints immediately constrain the antecedent retrieval process for pronoun interpretation. Occasional sensitivity to grammatically-illicit antecedents may be due to repair processes triggered when the initial retrieval fails to return a grammatical antecedent. |
Moreno I. Coco; George L. Malcolm; Frank Keller The interplay of bottom-up and top-down mechanisms in visual guidance during object naming Journal Article In: Quarterly Journal of Experimental Psychology, vol. 67, no. 6, pp. 1096–1120, 2014. @article{Coco2014a,An ongoing issue in visual cognition concerns the roles played by low- and high-level information in guiding visual attention, with current research remaining inconclusive about the interaction between the two. In this study, we bring fresh evidence into this long-standing debate by investigating visual saliency and contextual congruency during object naming (Experiment 1), a task in which visual processing interacts with language processing. We then compare the results of this experiment to data of a memorization task using the same stimuli (Experiment 2). In Experiment 1, we find that both saliency and congruency influence visual and naming responses and interact with linguistic factors. In particular, incongruent objects are fixated later and less often than congruent ones. However, saliency is a significant predictor of object naming, with salient objects being named earlier in a trial. Furthermore, the saliency and congruency of a named object interact with the lexical frequency of the associated word and mediate the time-course of fixations at naming. In Experiment 2, we find a similar overall pattern in the eye-movement responses, but only the congruency of the target is a significant predictor, with incongruent targets fixated less often than congruent targets. Crucially, this finding contrasts with claims in the literature that incongruent objects are more informative than congruent objects by deviating from scene context and hence need a longer processing. Overall, this study suggests that different sources of information are interactively used to guide visual attention on the targets to be named and raises new questions for existing theories of visual attention. |
Andrew L. Cohen; Adrian Staub Online processing of novel noun-noun compounds: Eye movement evidence Journal Article In: Quarterly Journal of Experimental Psychology, vol. 67, no. 1, pp. 147–165, 2014. @article{Cohen2014,Three eye-tracking experiments investigated online processing of novel noun-noun compounds. The experiments compared processing of compounds that are difficult to interpret in isolation (e.g., dictionary treatment) and more easily interpretable adjective-noun and noun-noun sequences (e.g., rough treatment and torture treatment). In all three experiments, first-pass reading time was longer on the head noun (treatment) when it occurred in a difficult compound. Further, a preceding sentence that provided a potential interpretation of the critical compound reduced processing difficulty, but this modulation by context occurred in later eye movement measures, or downstream of the compound itself. These results are interpreted in relation to the eye movement literature on the processing of implausibility, which demonstrates a similar pattern in which the disruption in early eye movement measures is not alleviated by context, but context does have a later effect. The results also suggest that the interpretation of noun-noun compounds in context does initially depend on the availability of an out-of-context interpretation. |
Derya Çokal; Patrick Sturt; Fernanda Ferreira Deixis: This and that in written narrative discourse Journal Article In: Discourse Processes, vol. 51, no. 3, pp. 201–229, 2014. @article{Cokal2014,The existing literature presents conflicting models of how this and that access different segments of a written discourse, frequently relying on implicit analogies with spoken discourse. On the basis of this literature, we hypothesized that in written discourse, this more readily accesses the adjacent/right frontier of a preceding chunk of text, whereas that more readily accesses the distant/left. We tested this hypothesis in two eye-tracking experiments, one sentence completion experiment, and one corpus study. Our results showed that both this and that access the adjacent frontier more easily than the distant. Contrary to existing theories, this accessed the distant frontier more frequently and easily than that. We propose a processing model integrating segmented discourse representation theory's concept of the left/distant leaf with Grosz and Sidner's attentional and intentional model and Garrod and Sandford's focus framework model, suggesting an important role for working memory and emphasizing the different production modes of readers and writers. |
Hannah Harvey; Robin Walker Reading with peripheral vision: A comparison of reading dynamic scrolling and static text with a simulated central scotoma Journal Article In: Vision Research, vol. 98, pp. 54–60, 2014. @article{Harvey2014a,Horizontally scrolling text is, in theory, ideally suited to enhance viewing strategies recommended to improve reading performance under conditions of central vision loss such as macular disease, although it is largely unproven in this regard. This study investigated if the use of scrolling text produced an observable improvement in reading performed under conditions of eccentric viewing in an artificial scotoma paradigm. Participants (n=17) read scrolling and static text with a central artificial scotoma controlled by an eye-tracker. There was an improvement in measures of reading accuracy, and adherence to eccentric viewing strategies with scrolling, compared to static, text. These findings illustrate the potential benefits of scrolling text as a potential reading aid for those with central vision loss. |
Anna Hatzidaki; Manon W. Jones; M. Santesteban; H. P. Branigan It's not what you see: It's the language you say it in Journal Article In: Language, Cognition and Neuroscience, vol. 29, no. 10, pp. 1233–1239, 2014. @article{Hatzidaki2014,In an eye-tracking experiment, we investigated the interplay between visual and linguistic information processing during time-telling, and how this is affected by speaking in a non-native language. We compared time-telling in Greek and English, which differ in time-telling word order (hour vs. minute mentioned first), by contrasting Greek-English bilinguals speaking in their L1-Greek or their L2-English, and English monolingual speakers. All three groups were faster when telling the time for digital than for analogue clocks, and when telling the time for the first half-hour than the second half-hour. Critically, first fixation and gaze duration analyses for the hour and minute regions showed a different pattern for Greek-English bilinguals when speaking in their L1 versus L2, with the latter resembling that of English monolinguals. Our results suggest that bilingual speakers' eye-movement programming was influenced by the type of time-telling utterance specific to the language of production currently in use.$backslash$nIn an eye-tracking experiment, we investigated the interplay between visual and linguistic information processing during time-telling, and how this is affected by speaking in a non-native language. We compared time-telling in Greek and English, which differ in time-telling word order (hour vs. minute mentioned first), by contrasting Greek-English bilinguals speaking in their L1-Greek or their L2-English, and English monolingual speakers. All three groups were faster when telling the time for digital than for analogue clocks, and when telling the time for the first half-hour than the second half-hour. Critically, first fixation and gaze duration analyses for the hour and minute regions showed a different pattern for Greek-English bilinguals when speaking in their L1 versus L2, with the latter resembling that of English monolinguals. Our results suggest that bilingual speakers' eye-movement programming was influenced by the type of time-telling utterance specific to the language of production currently in use. |
Daphna Heller; Craig G. Chambers Would a blue kite by any other name be just as blue? Effects of descriptive choices on subsequent referential behavior Journal Article In: Journal of Memory and Language, vol. 70, no. 1, pp. 53–67, 2014. @article{Heller2014,Using objects that contrast along multiple dimensions, we examined how the earlier description of an object using one dimension (size/color) influences reference to as-yet unmentioned objects, and how this depends on whether the two objects contrast with each other (i.e., whether they belong to the same nominal category). The dimensions of size and color were used because of their different sensitivity, with size adjectives being more closely tied to the presence of a contrasting object from the same category in the situational context. Experiment 1 elicited speakers' descriptions for an object following an earlier description of another object, and Experiment 2 investigated the real-time comprehension of the second description in a two-utterance sequence. Although the priming of linguistic forms may play a role in explaining some of the observed referential patterns, the full set of data suggests that precedence effects in referential descriptions are best explained in terms of a representation that maps those forms onto a mental representation of entities, namely, a discourse model that encodes relationships between entities. The results also highlight how color and size adjectives are processed differently from the earliest moments in comprehension. |
Renske S. Hoedemaker; Peter C. Gordon Embodied language comprehension: Encoding-based and goal-driven processes Journal Article In: Journal of Experimental Psychology: General, vol. 143, no. 2, pp. 914–929, 2014. @article{Hoedemaker2014,Theories of embodied language comprehension have proposed that language is understood through perceptual simulation of the sensorimotor characteristics of its meaning. Strong support for this claim requires demonstration of encoding-based activation of sensorimotor representations that is distinct from task-related or goal-driven processes. Participants in 3 eye-tracking experiments were presented with triplets of either numbers or object and animal names. In Experiment 1, participants indicated whether the size of the referent of the middle object or animal name was in between the size of the 2 outer items. In Experiment 2, the object and animal names were encoded for an immediate recognition memory task. In Experiment 3, participants completed the same comparison task of Experiment 1 for both words and numbers. During the comparison tasks, word and number decision times showed a symbolic distance effect, such that response time was inversely related to the size difference between the items. A symbolic distance effect was also observed for animal and object encoding times in cases where encoding time likely reflected some goal-driven processes as well. When semantic size was irrelevant to the task (Experiment 2), it had no effect on word encoding times. Number encoding times showed a numerical distance priming effect: Encoding time increased with numerical difference between items. Together these results suggest that while activation of numerical magnitude representations is encoding-based as well as goal-driven, activation of size information associated with words is goal-driven and does not occur automatically during encoding. This conclusion challenges strong theories of embodied cognition which claim that language comprehension consists of activation of analog sensorimotor representations irrespective of higher level processes related to context or task-specific goals. |
Sven Hohenstein; Reinhold Klieg Semantic preview benefit during reading Journal Article In: Journal of Experimental Psychology: Learning, Memory, and Cognition, vol. 40, no. 1, pp. 166–190, 2014. @article{Hohenstein2014,Word features in parafoveal vision influence eye movements during reading. The question of whether readers extract semantic information from parafoveal words was studied in 3 experiments by using a gaze-contingent display change technique. Subjects read German sentences containing 1 of several preview words that were replaced by a target word during the saccade to the preview (boundary paradigm). In the 1st experiment the preview word was semantically related or unrelated to the target. Fixation durations on the target were shorter for semantically related than unrelated previews, consistent with a semantic preview benefit. In the 2nd experiment, half the sentences were presented following the rules of German spelling (i.e., previews and targets were printed with an initial capital letter), and the other half were presented completely in lowercase. A semantic preview benefit was obtained under both conditions. In the 3rd experiment, we introduced 2 further preview conditions, an identical word and a pronounceable nonword, while also manipulating the text contrast. Whereas the contrast had negligible effects, fixation durations on the target were reliably different for all 4 types of preview. Semantic preview benefits were greater for pretarget fixations closer to the boundary (large preview space) and, although not as consistently, for long pretarget fixation durations (long preview time). The results constrain theoretical proposals about eye movement control in reading. |
Stephanie Huette; Bodo Winter; Teenie Matlock; David H. Ardell; Michael J. Spivey Eye movements during listening reveal spontaneous grammatical processing Journal Article In: Frontiers in Psychology, vol. 5, pp. 410, 2014. @article{Huette2014,Recent research using eye-tracking typically relies on constrained visual contexts in particular goal-oriented contexts, viewing a small array of objects on a computer screen and performing some overt decision or identification. Eyetracking paradigms that use pictures as a measure of word or sentence comprehension are sometimes touted as ecologically invalid because pictures and explicit tasks are not always present during language comprehension. This study compared the comprehension of sentences with two different grammatical forms: the past progressive (e.g., was walking), which emphasizes the ongoing nature of actions, and the simple past (e.g., walked), which emphasizes the end-state of an action. The results showed that the distribution and timing of eye movements mirrors the underlying conceptual structure of this linguistic difference in the absence of any visual stimuli or task constraint: Fixations were shorter and saccades were more dispersed across the screen, as if thinking about more dynamic events when listening to the past progressive stories. Thus, eye movement data suggest that visual inputs or an explicit task are unnecessary to solicit analog representations of features such as movement, that could be a key perceptual component to grammatical comprehension. |
Heeju Hwang; Elsi Kaiser The role of the verb in grammatical function assignment in English and Korean Journal Article In: Journal of Experimental Psychology: Learning, Memory, and Cognition, vol. 40, no. 5, pp. 1363–1376, 2014. @article{Hwang2014,One of the central questions in speech production is how speakers decide which entity to assign to which grammatical function. According to the lexical hypothesis (e. g., Bock & Levelt, 1994), verbs play a key role in this process (e. g., "send" and "receive" result in different entities being assigned to the subject position). In contrast, according to the structural hypothesis (e. g., Bock, Irwin, & Davidson, 2004), grammatical functions can be assigned based on a speaker's conceptual representation of an event, even before a particular verb is chosen. In order to examine the role of the verb in grammatical function assignment, we investigated whether English and Korean speakers exhibit semantic interference effects for verbs during a scene description task. We also analyzed speakers' eye movements during production. We found that English speakers exhibited verb interference effects and also fixated the action/verb region before the subject region. In contrast, Korean speakers did not show any verb interference effects and did not fixate the action/verb region before the subject region. Rather, in Korean, looks to the action/verb region sharply increased following looks to the object region. The findings provide evidence for the lexical hypothesis for English and are compatible with the structural hypothesis for Korean. We suggest that whether the verb is retrieved before speech onset depends on the role that the verb plays in grammatical function assignment or structural choice in a particular language. |
Lei Cui; Denis Drieghe; Xuejun Bai; Guoli Yan; Simon P. Liversedge Parafoveal preview benefit in unspaced and spaced Chinese reading Journal Article In: Quarterly Journal of Experimental Psychology, vol. 67, no. 11, pp. 2172–2188, 2014. @article{Cui2014,In an eye movement experiment during reading, we compared parafoveal preview benefit during the reading of Chinese sentences either in the familiar, unspaced format or with spaces inserted between the words. Single-character words or the first of a two-character word were either presented normally or were replaced by a pseudocharacter in the preview. Results indicate that word spacing increased the parafoveal preview benefit but only for the one-character target words. We hypothesized that the incorrect preview of the first character of the two-character word prevented parafoveal processing of the ensuing character(s), effectively nullifying any benefits from the spacing. Our results suggest that word boundary demarcation allows for more precise focusing of attention. |
Ian Cunnings; Clare Patterson; Claudia Felser Variable binding and coreference in sentence comprehension: Evidence from eye movements Journal Article In: Journal of Memory and Language, vol. 71, no. 1, pp. 39–56, 2014. @article{Cunnings2014a,The hypothesis that pronouns can be resolved via either the syntax or the discourse representation has played an important role in linguistic accounts of pronoun interpretation (e.g. Grodzinsky & Reinhart, 1993). We report the results of an eye-movement monitoring study investigating the relative timing of syntactically-mediated variable binding and discourse-based coreference assignment during pronoun resolution. We examined whether ambiguous pronouns are preferentially resolved via either the variable binding or coreference route, and in particular tested the hypothesis that variable binding should always be computed before coreference assignment. Participants' eye movements were monitored while they read sentences containing a pronoun and two potential antecedents, a c-commanding quantified noun phrase and a non c-commanding proper name. Gender congruence between the pronoun and either of the two potential antecedents was manipulated as an experimental diagnostic for dependency formation. In two experiments, we found that participants' reading times were reliably longer when the linearly closest antecedent mismatched in gender with the pronoun. These findings fail to support the hypothesis that variable binding is computed before coreference assignment, and instead suggest that antecedent recency plays an important role in affecting the extent to which a variable binding antecedent is considered. We discuss these results in relation to models of memory retrieval during sentence comprehension, and interpret the antecedent recency preference as an example of forgetting over time. |
Ian Cunnings; Patrick Sturt Coargumenthood and the processing of reflexives Journal Article In: Journal of Memory and Language, vol. 75, pp. 117–139, 2014. @article{Cunnings2014,We report three eye-movement experiments and an antecedent choice task investigating the interpretation of reflexives in different syntactic contexts. This included contexts in which the reflexive and a local antecedent were coarguments of the same verbal predicate (John heard that the soldier had injured himself), and also so-called picture noun phrases, either with a possessor (John heard about the soldier's picture of himself) or without (John heard that the soldier had a picture of himself). While results from the antecedent choice task indicated that comprehenders would choose a nonlocal antecedent ('John' above) for reflexives in either type of picture noun phrase, the eye-movement experiments suggested that participants preferred to initially interpret the reflexive in each context as referring to the local antecedent ('the soldier'), as indexed by longer reading times when it mismatched in gender with the reflexive. We also observed a difference in the time-course of this effect. While it was observed during first-pass processing at the reflexive for coargument reflexives and those in picture noun phrases with a possessor, it was comparatively delayed for reflexives in possessorless picture noun phrases. These results suggest that locality constraints are more strongly weighted cues to retrieval than gender agreement for both coargument reflexives and those inside picture noun phrases. We interpret the observed time-course differences as indexing the relative ease of accessing the local antecedent in different syntactic contexts. |
Michael G. Cutter; Denis Drieghe; Simon P. Liversedge Preview benefit in English spaced compounds Journal Article In: Journal of Experimental Psychology: Learning, Memory, and Cognition, vol. 40, no. 6, pp. 1778–1786, 2014. @article{Cutter2014,In an eye tracking experiment during reading we examined whether preview benefit could be observed from 2 words to the right of the currently fixated word if that word was the 2nd constituent of a spaced compound. The boundary paradigm (Rayner, 1975) was used to orthogonally manipulate whether participants saw an identity or nonword preview of the 1st (e.g., teddy) and 2nd constituent (e.g., bear) of a spaced compound located immediately beyond the boundary, respectively, words n + 1 and n + 2. Linear mixed-effects models revealed that participants gained an n + 2 preview benefit, such that they spent less time fixated on word n + 1 when given an identity preview of word n + 2. However, this effect was only observed if there was also an identity preview of word n + 1. Our findings suggest that the 2 constituent words of spaced compounds are processed as part of a larger lexical unit during natural reading. |
Yulia Esaulova; Chiara Reali; Lisa Stockhausen Influences of grammatical and stereotypical gender during reading: Eye movements in pronominal and noun phrase anaphor resolution Journal Article In: Language, Cognition and Neuroscience, vol. 29, no. 7, pp. 781–803, 2014. @article{Esaulova2014,Two eye-tracking studies addressed the processing of grammatical and stereotypical gender cues in anaphor resolution in German. The authors investigated pronominal (er ‘he'/sie ‘she') and noun phrase (dieser Mann ‘this man'/diese Frau ‘this woman') anaphors in sentences containing stereotypical role nouns as antecedents (Example: Oft hatte der Elektriker gute Einfalle, regelmassig plante er/dieser Mann neue Projekte' Often had the electrician good ideas, regularly planned he/this man new projects'). Participants were native speakers of German (N=40 and N=24 in Experiments 1 and 2, respectively). Results show that influences of grammatical gender occur in early stages of processing, whereas the influences of stereotypical gender appear only in later measures. Both effects, however, strongly depend on the type of anaphor. Furthermore, the results provide evidence for asymmetries in processing feminine and masculine grammatical gender and are discussed with reference to two-stage models of anaphor resolution. |
Gerardo Fernández; Diego E. Shalom; Reinhold Kliegl; Mariano Sigman Eye movements during reading proverbs and regular sentences: The incoming word predictability effect Journal Article In: Language, Cognition and Neuroscience, vol. 29, no. 3, pp. 260–273, 2014. @article{Fernandez2014b,Reading is an everyday activity requiring the efficient integration of several central cognitive subsystems ranging from attention and oculomotor control to word identification and language comprehension. Effects of frequency, length and cloze predictability of words on reading times reliably indicate local processing difficulty of fixated words; also, a reader's expectation about an upcoming word apparently influences fixation duration even before the eyes reach this word. Moreover, this effect has been reported as noncanonical (i.e., longer fixation durations on word N when word N1 is of high cloze predictability). However, this effect is difficult to observe because in natural sentences the fluctuations in predictability in content words are very small. To overcome this difficulty we investigated eye movements while reading proverbs as well as sentences constructed for high- and low-average cloze predictability. We also determined for each sentence a word at which predictability of words jumps from a low to high value. Fixation durations while reading proverbs and high-predictable sentences exhibited significant effects of the change in predictability along the sentence (when the successive word is more predictable than the fixated word). Results are in agreement with the proposal that cloze predictability of upcoming words exerts an influence on fixation durations via memory retrieval. |
Ruth Filik; Hartmut Leuthold; Katie Wallington; Jemma Page Testing theories of irony processing using eye-tracking and ERPs Journal Article In: Journal of Experimental Psychology: Learning, Memory, and Cognition, vol. 40, no. 3, pp. 811–828, 2014. @article{Filik2014,Not much is known about how people comprehend ironic utterances, and to date, most studies have simply compared processing of ironic versus non-ironic statements. A key aspect of the graded salience hypothesis, distinguishing it from other accounts (such as the standard pragmatic view and direct access view), is that it predicts differences between processing of familiar and unfamiliar ironies. Specifically, if an ironic utterance is familiar, then the ironic interpretation should be available without the need for extra inferential processes, whereas for unfamiliar ironies, the literal interpretation would be computed first, and a mismatch with context would lead to a re-interpretation of the statement as being ironic. We recorded participants' eye movements while they were reading (Experiment 1), and electrical brain activity while they were listening to (Experiment 2), familiar and unfamiliar ironies compared to non-ironic controls. Results show disruption to eye movements and an N400-like effect for unfamiliar ironies only, supporting the predictions of the graded salience hypothesis. In addition, in Experiment 2, a late positivity was found for both familiar and unfamiliar ironic materials, compared to non-ironic controls. We interpret this positivity as reflecting ongoing conflict between the literal and ironic interpretations of the utterance. |
Joel Fishbein; Jesse A. Harris Making sense of Kafka: Structural biases induce early sense commitment for metonyms Journal Article In: Journal of Memory and Language, vol. 76, pp. 94–112, 2014. @article{Fishbein2014,Prior research suggests that the language processor initially activates an underspecified representation of a metonym consistent with all its senses, potentially selecting a specific sense if supported by contextual and lexical information. We explored whether a structural heuristic, the Subject as Agent Principle, which provisionally assigns an agent theta role to canonical subjects, would prompt immediate sense selection. In Experiment 1, we found initial evidence that this principle is active during offline and online processing of metonymic names like Kafka. Reading time results from Experiments 2 and 3 demonstrated that previous context biasing towards the metonymic sense of the name reduced, but did not remove, the agent preference, consistent with Frazier's (1999) proposal that the processor may avoid selecting a specific sense, unless grammatically required. |
Steven Frisson; Nathalie N. Bélanger; Keith Rayner Phonological and orthographic overlap effects in fast and masked priming Journal Article In: Quarterly Journal of Experimental Psychology, vol. 67, no. 9, pp. 1742–1767, 2014. @article{Frisson2014,We investigated how orthographic and phonological information is activated during reading, using a fast priming task, and during single word recognition, using masked priming. Specifically, different types of overlap between prime and target were contrasted: high orthographic and high phonological overlap (track-crack), high orthographic and low phonological overlap (bear-gear), or low orthographic and high phonological overlap (fruit-chute). In addition, we examined whether (orthographic) beginning overlap (swoop-swoon) yielded the same priming pattern as end (rhyme) overlap (track-crack). Prime durations were 32 and 50ms in the fast priming version, and 50ms in the masked priming version, and mode of presentation (prime and target in lower case) was identical. The fast priming experiment showed facilitatory priming effects when both orthography and phonology overlapped, with no apparent differences between beginning and end overlap pairs. Facilitation was also found when prime and target only overlapped orthographically. In contrast, the masked priming experiment showed inhibition for both types of end overlap pairs (with and without phonological overlap), and no difference for begin overlap items. When prime and target only shared principally phonological information, facilitation was only found with a long prime duration in the fast priming experiment, while no differences were found in the masked priming version. These contrasting results suggest that fast priming and masked priming do not necessarily tap into the same type of processing. |
Annie Tremblay; Elsa Spinelli English listeners' use of distributional and acoustic-phonetic cues to liaison in French: Evidence from eye movements Journal Article In: Language and Speech, vol. 57, no. 3, pp. 310–337, 2014. @article{Tremblay2014,This study investigates English listeners' use of distributional and acoustic-phonetic cues to liaison in French. Liaison creates a misalignment of the syllable and word boundaries, but is signaled by distributional cues (/z/ is a frequent liaison but not a frequent word onset; /t/ is a frequent word onset but a less frequent liaison) and acoustic-phonetic cues (liaison consonants are 15 per cent shorter than word-initial consonants). English-speaking French learners completed a visual- world eye-tracking experiment in which they heard adjective-noun sequences where the pivotal consonant was /t/ (expected advantage for consonant-initial words) or /z/ (expected advantage for liaison-initial words). Their results were compared to those of native French speakers. Both groups showed an advantage for consonant-initial targets with /t/ but no advantage for consonant- or liaison-initial targets with /z/. Both groups' competitor fixations were modulated by the duration of the pivotal consonant, but only the learners' fixations to liaison-initial targets were modulated by the duration of the pivotal consonant. This suggests that English listeners use both top-down (distributional) and bottom-up (acoustic-phonetic) cues to liaison in French. Their greater reliance on acoustic-phonetic cues is hypothesized to stem in part from English, where such cues play an important role for locating word boundaries. |
Danijela Trenkic; Jelena Mirkovic; Gerry T. M. Altmann Real-time grammar processing by native and non-native speakers: Constructions unique to the second language Journal Article In: Bilingualism: Language and Cognition, vol. 17, no. 2, pp. 237–257, 2014. @article{Trenkic2014,We investigated second language (L2) comprehension of grammatical structures that are unique to the L2, and which are known to cause persistent difficulties in production. A visual-world eye-tracking experiment focused on online comprehension of English articles by speakers of the article-lacking Mandarin, and a control group of English native speakers. The results show that non-native speakers from article-lacking backgrounds can incrementally utilise the information signalled by L2 articles in real time to constrain referential domains and resolve reference more efficiently. The findings support the hypothesis that L2 processing does not always over-rely on pragmatic affordances, and that some morphosyntactic structures unique to the target language can be processed in a targetlike manner in comprehension-despite persistent difficulties with their production. A novel proposal, based on multiple meaning-to-form, but consistent form-to-meaning mappings, is developed to account for such comprehension-production asymmetries. © 2013 Cambridge University Press. |
Maartje Velde; Antje S. Meyer; Agnieszka E. Konopka Message formulation and structural assembly: Describing "easy" and "hard" events with preferred and dispreferred syntactic structures Journal Article In: Journal of Memory and Language, vol. 71, no. 1, pp. 124–144, 2014. @article{Velde2014,When formulating simple sentences to describe pictured events, speakers look at the referents they are describing in the order of mention. Accounts of incrementality in sentence production rely heavily on analyses of this gaze-speech link. To identify systematic sources of variability in message and sentence formulation, two experiments evaluated differences in formulation for sentences describing "easy" and "hard" events (more codable and less codable events) with preferred and dispreferred structures (actives and passives). Experiment 1 employed a subliminal cuing manipulation and a cumulative priming manipulation to increase production of passive sentences. Experiment 2 examined the influence of event codability on formulation without a cuing manipulation. In both experiments, speakers showed an early preference for looking at the agent of the event when constructing active sentences. This preference was attenuated by event codability, suggesting that speakers were less likely to prioritize encoding of a single character at the outset of formulation in "easy" events than in "harder" events. Accessibility of the agent influenced formulation primarily when an event was "harder" to describe. Formulation of passive sentences in Experiment 1 also began with early fixations to the agent but changed with exposure to passive syntax: speakers were more likely to consider the patient as a suitable sentential starting point after cumulative priming. The results show that the message-to-language mapping in production can vary with the ease of encoding an event structure and of generating a suitable linguistic structure. |
Aaron Veldre; Sally Andrews Lexical quality and eye movements: Individual differences in the perceptual span of skilled adult readers Journal Article In: Quarterly Journal of Experimental Psychology, vol. 67, no. 4, pp. 703–727, 2014. @article{Veldre2014,Two experiments used the gaze-contingent moving-window paradigm to investigate whether reading comprehension and spelling ability modulate the perceptual span of skilled adult readers during sentence reading. Highly proficient reading and spelling were both associated with increased use information to the right of fixation, but did not systematically modulate the extraction of information to the left of fixation. Individuals who were high in both reading and spelling ability showed the greatest benefit from window sizes larger than 11 characters, primarily because of increases in forward saccade length. They were also significantly more disrupted by being denied close parafoveal information than those poor in reading and/or spelling. These results suggest that, in addition to supporting rapid lexical retrieval of fixated words, the high quality lexical representations indexed by the combination of high reading and spelling ability support efficient processing of parafoveal information and effective saccadic targeting. |
Aiping Wang; Wei Zhou; Hua Shu; Ming Yan Reading proficiency modulates parafoveal processing efficiency: Evidence from reading Chinese as a second language Journal Article In: Acta Psychologica, vol. 152, pp. 29–33, 2014. @article{Wang2014g,In the present study, we manipulated different types of information available in the parafovea during the reading of Chinese sentences and examined how native Korean readers who learned Chinese as a second language make use of the parafoveal information. Results clearly indicate that, only identical and orthographically similar previews facilitated processing of the target words when they were subsequently fixated. More critically, more parafoveal information was obtained by subjects with higher reading proficiency. These results suggest that, mainly low-level features of the parafoveal words are obtained by the non-native Chinese readers and less attentional resources are available for the readers with lower reading proficiency, thereby causing a reduction of the perceptual span. |
Chandan Singh; Dhananjay Yadav; Jinho Lee Reader comprehension ranking by monitoring eye gaze using eye tracker Journal Article In: International Journal of Intelligent Systems Technologies and Applications, vol. 13, no. 4, pp. 294–307, 2014. @article{Singh2014,This paper concentrates on measuring comprehension ability of a reader by calculating reader ranking based on correct answer lines recorded by eye gaze tracker (mounted on reader's eye) and number of correct answers given by reader. Time is measured to find the answer line (page time T1) and time spent on the answer line (score time T2). The ratio (T2/T1) of both these time parameters plays vital role in evaluation of rank of reader. Score is calculated only if reader reads the answer line/s and after that gives the correct answer otherwise the score will be zero for same question. Finally, the reader gets score and rank among the existing readers on the basis of time ratio and correctness of answers. |
Laura J. Speed; Gabriella Vigliocco Eye movements reveal the dynamic simulation of speed in language Journal Article In: Cognitive Science, vol. 38, no. 2, pp. 367–382, 2014. @article{Speed2014,This study investigates how speed of motion is processed in language. In three eye-tracking experiments, participants were presented with visual scenes and spoken sentences describing fast or slow events (e.g., The lion ambled/dashed to the balloon). Results showed that looking time to relevant objects in the visual scene was affected by the speed of verb of the sentence, speaking rate, and configuration of a supporting visual scene. The results provide novel evidence for the mental simulation of speed in language and show that internal dynamic simulations can be played out via eye movements toward a static visual scene. |
Maria Staudte; Matthew W. Crocker; Alexis Heloir; Michael Kipp The influence of speaker gaze on listener comprehension: Contrasting visual versus intentional accounts Journal Article In: Cognition, vol. 133, no. 1, pp. 317–328, 2014. @article{Staudte2014,Previous research has shown that listeners follow speaker gaze to mentioned objects in a shared environment to ground referring expressions, both for human and robot speakers. What is less clear is whether the benefit of speaker gaze is due to the inference of referen- tial intentions (Staudte and Crocker, 2011) or simply the (reflexive) shifts in visual atten- tion. That is, is gaze special in how it affects simultaneous utterance comprehension? In four eye-tracking studies we directly contrast speech-aligned speaker gaze of a virtual agent with a non-gaze visual cue (arrow). Our findings show that both cues similarly direct listeners' attention and that listeners can benefit in utterance comprehension from both cues. Only when they are similarly precise, however, does this equality extend to incongru- ent cueing sequences: that is, even when the cue sequence does not match the concurrent sequence of spoken referents can listeners benefit from gaze as well as arrows. The results suggest that listeners are able to learn a counter-predictive mapping of both cues to the sequence of referents. Thus, gaze and arrows can in principle be applied with equal flexi- bility and efficiency during language comprehension. |
Benjamin Swets; Matthew E. Jacovina; Richard J. Gerrig Individual differences in the scope of speech planning: Evidence from eye-movements Journal Article In: Language and Cognition, vol. 6, no. 1, pp. 12–44, 2014. @article{Swets2014,Previous research has demonstrated that the scope of speakers' planning in language production varies in response to external forces such as time pressure. This susceptibility to external pressures indicates a flexibly incremental production system: speakers plan utterances piece by piece, but external pressures affect the size of the pieces speakers buffer. In the current study, we explore internal constraints on speech planning. Specifi cally, we examine whether individual differences in working memory predict the scope and efficiency of advance planning. In our task, speakers described picture arrays to partners in a matching game. The arrays sometimes required speakers to note a contrast between a sentence-initial object (e.g., a four-legged cat) and a sentence-final object (e.g., a three-legged cat). Based on prior screening, we selected participants who differed on verbal working memory span. Eye-movement measures revealed that high-span speakers were more likely to gaze at the contrasting pictures prior to articulation than were low-span speakers. As a result, high-span speakers were also more likely to reference the contrast early in speech. We conclude that working memory plays a substantial role in the fl exibility of incremental speech planning. |
Rachel A. Ryskin; Sarah Brown-Schmidt; Enriqueta Canseco-Gonzalez; Loretta K. Yiu; Elizabeth T. Nguyen Visuospatial perspective-taking in conversation and the role of bilingual experience Journal Article In: Journal of Memory and Language, vol. 74, pp. 46–76, 2014. @article{Ryskin2014,Little is known about how listeners use spatial perspective information to guide comprehension. Perspective-taking abilities have been linked to executive function in both children and adults. Bilingual children excel at perspective-taking tasks compared to their monolingual counterparts (e.g., Greenberg, Bellana, & Bialystok, 2013), possibly due to the executive function benefits conferred by the experience of switching between languages. Here we examine the mechanisms of visuo-spatial perspective-taking in adults, and the effects of bilingualism on this process. We report novel results regarding the ability of listeners to appreciate the spatial perspective of another person in conversation: While spatial perspective-taking does pose challenges, listeners rapidly accommodated the speaker's perspective, in time to guide the on-line processing of the speaker's utterances. Moreover, once adopted, spatial perspectives were enduring, resulting in costs when switching to a different perspective, even when that perspective is one's own. In addition to these findings, direct comparison of monolingual and bilingual participants offer no support for the hypothesis that bilingualism improves the ability to appreciate the perspective of another person during language comprehension. In fact, in some cases adult bilinguals have significantly more difficulty with perspective-laden language. |
Stanislav M. Sajin; Cynthia M. Connine Semantic richness: The role of semantic features in processing spoken words Journal Article In: Journal of Memory and Language, vol. 70, no. 1, pp. 13–35, 2014. @article{Sajin2014,A lexical decision and two visual world paradigm experiments are reported that investigated the role of semantic representations in recognizing spoken words. Semantic richness (NOF: number of features) influenced lexical decision reaction times in that semantically rich words (high NOF) were processed faster than semantically impoverished words (low NOF). Processing in the VWP was faster for high NOF words but only when an onset competitor was present in the display (target BREAD, onset competitor BRICK). Adding background speech babble to the spoken stimuli resulted in an advantage for processing high NOF words with and without onset competitors in the display. The results suggest that semantic representations directly contribute to the recognition of spoken words and that sub-optimal listening conditions (e.g., background babble) enhance the role of semantics. |
Robert J. Sall; Timothy J. Wright; Walter R. Boot Driven to distraction? The effect of simulated red light running camera flashes on attention and oculomotor control Journal Article In: Visual Cognition, vol. 22, no. 1, pp. 57–73, 2014. @article{Sall2014,Do similar factors influence the allocation of attention in visually sparse and abstract laboratory paradigms and complex real-world scenes? To explore this question we conducted a series of experiments that examined whether the flash that accompanies a Red Light Running Camera (RLRC) can capture observers' attention away from important roadway changes. Inhibition of Return (IOR) and eye movement direction served as indices of the spatial allocation of attention. In two experiments, participants were slower to respond to the brake lights of a vehicle in a driving scene when an RLRC flash occurred nearby or were slower to initiate eye movements to brake light signals (IOR effects). In a third experiment, we found evidence that less prevalent RLRC flashes disrupted eye movement control. Results suggest that attention can be misdirected as a result of RLRC flashes and provide additional evidence that findings from simple laboratory paradigms can predict the allocation of attention in complex settings that are more familiar to observers. |
Anne Pier Salverda; Dave Kleinschmidt; Michael K. Tanenhaus Immediate effects of anticipatory coarticulation in spoken-word recognition Journal Article In: Journal of Memory and Language, vol. 71, no. 1, pp. 145–163, 2014. @article{Salverda2014,Two visual-world experiments examined listeners' use of pre word-onset anticipatory coarticulation in spoken-word recognition. Experiment 1 established the shortest lag with which information in the speech signal influences eye-movement control, using stimuli such as ". The ladder is the target". With a neutral token of the definite article preceding the target word, saccades to the referent were not more likely than saccades to an unrelated distractor until 200-240. ms after the onset of the target word. In Experiment 2, utterances contained definite articles which contained natural anticipatory coarticulation pertaining to the onset of the target word ("The ladder is the target"). A simple Gaussian classifier was able to predict the initial sound of the upcoming target word from formant information from the first few pitch periods of the article's vowel. With these stimuli, effects of speech on eye-movement control began about 70. ms earlier than in Experiment 1, suggesting rapid use of anticipatory coarticulation. The results are interpreted as support for "data explanation" approaches to spoken-word recognition. Methodological implications for visual-world studies are also discussed. |
Daniel J. Schad; Sarah Risse; Timothy J. Slattery; Keith Rayner Word frequency in fast priming: Evidence for immediate cognitive control of eye movements during reading Journal Article In: Visual Cognition, vol. 22, no. 3-4, pp. 390–414, 2014. @article{Schad2014,Numerous studies have demonstrated effects of word frequency on eye movements during reading, but the precise timing of this influence has remained unclear. The fast priming paradigm (Sereno & Rayner, 1992) was previously used to study influences of related versus unrelated primes on the target word. Here, we used this procedure to investigate whether the frequency of the prime word has a direct influence on eye movements during reading when the prime-target relation is not manipulated. We found that with average prime intervals of 32 ms readers made longer single fixation durations on the target word in the low than in the high frequency prime condition. Distributional analyses demonstrated that the effect of prime frequency on single fixation durations occurred very early, supporting theories of immediate cognitive control of eye movements. Finding prime frequency effects only 207 ms after visibility of the prime and for prime durations of 32 ms yields new time constraints for cognitive processes controlling eye movements during reading. Our variant of the fast priming paradigm provides a new approach to test early influences of word processing on eye movement control during reading. |
Elizabeth R. Schotter; Klinton Bicknell; Ian Howard; Roger P. Levy; Keith Rayner Task effects reveal cognitive flexibility responding to frequency and predictability: Evidence from eye movements in reading and proofreading Journal Article In: Cognition, vol. 131, no. 1, pp. 1–27, 2014. @article{Schotter2014a,It is well-known that word frequency and predictability affect processing time. These effects change magnitude across tasks, but studies testing this use tasks with different response types (e.g., lexical decision, naming, and fixation time during reading; Schilling, Rayner, & Chumbley, 1998), preventing direct comparison. Recently, Kaakinen and Hyönä (2010) overcame this problem, comparing fixation times in reading for comprehension and proofreading, showing that the frequency effect was larger in proofreading than in reading. This result could be explained by readers exhibiting substantial cognitive flexibility, and qualitatively changing how they process words in the proofreading task in a way that magnifies effects of word frequency. Alternatively, readers may not change word processing so dramatically, and instead may perform more careful identification generally, increasing the magnitude of many word processing effects (e.g., both frequency and predictability). We tested these possibilities with two experiments: subjects read for comprehension and then proofread for spelling errors (letter transpositions) that produce nonwords (e.g., trcak for track as in Kaakinen & Hyönä) or that produce real but unintended words (e.g., trial for trail) to compare how the task changes these effects. Replicating Kaakinen and Hyönä, frequency effects increased during proofreading. However, predictability effects only increased when integration with the sentence context was necessary to detect errors (i.e., when spelling errors produced words that were inappropriate in the sentence; trial for trail). The results suggest that readers adopt sophisticated word processing strategies to accommodate task demands. |
Elizabeth R. Schotter; Annie Jia; Victor S. Ferreira; Keith Rayner Preview benefit in speaking occurs regardless of preview timing Journal Article In: Psychonomic Bulletin & Review, vol. 21, no. 3, pp. 755–762, 2014. @article{Schotter2014b,Speakers access information from objects they will name but have not looked at yet, indexed by preview benefit–faster processing of the target when a preview object previously occupying its location was related rather than unrelated to the target. This suggests that speakers distribute attention over multiple objects, but it does not reveal the time course of the processing of a current and a to-be-named object. Is the preview benefit a consequence of attention shifting to the next-to-be-named object shortly before the eyes move to that location, or does the benefit reflect a more unconstrained deployment of attention to upcoming objects? Using the multiple-object naming paradigm with a gaze-contingent display change manipulation, we addressed this issue by manipulating the latency of the onset of the preview (SOA) and whether the preview represented the same concept as (but a different visual token of) the target or an unrelated concept. The results revealed that the preview benefit was robust, regardless of the latency of the preview onset or the latency of the saccade to the target (the lag between preview offset and fixation on the target). Together, these data suggest that preview benefit is not restricted to the time during an attention shift preceding an eye movement, and that speakers are able to take advantage of information from nonfoveal objects whenever such objects are visually available. |
Elizabeth R. Schotter; Randy Tran; Keith Rayner Don't believe what you read (Only Once): Comprehension is supported by regressions during reading Journal Article In: Psychological Science, vol. 25, no. 6, pp. 1218–1226, 2014. @article{Schotter2014,Recent Web apps have spurred excitement around the prospect of achieving speed reading by eliminating eye movements (i.e., with rapid serial visual presentation, or RSVP, in which words are presented briefly one at a time and sequentially). Our experiment using a novel trailing-mask paradigm contradicts these claims. Subjects read normally or while the display of text was manipulated such that each word was masked once the reader's eyes moved past it. This manipulation created a scenario similar to RSVP: The reader could read each word only once; regressions (i.e., rereadings of words), which are a natural part of the reading process, were functionally eliminated. Crucially, the inability to regress affected comprehension negatively. Furthermore, this effect was not confined to ambiguous sentences. These data suggest that regressions contribute to the ability to understand what one has read and call into question the viability of speed-reading apps that eliminate eye movements (e.g., those that use RSVP). |
Daniel Schreij; Sander A. Los; Jan Theeuwes; James T. Enns; Christian N. L. Olivers The interaction between stimulus-driven and goal-driven orienting as revealed by eye movements Journal Article In: Journal of Experimental Psychology: Human Perception and Performance, vol. 40, no. 1, pp. 378–390, 2014. @article{Schreij2014,It is generally agreed that attention can be captured in a stimulus-driven or in a goal-driven fashion. In studies that investigated both types of capture, the effects on mean manual response time (reaction time [RT]) are generally additive, suggesting two independent underlying processes. However, potential interactions between the two types of capture may fail to be expressed in manual RT, as it likely reflects multiple processing steps. Here we measured saccadic eye movements along with manual responses. Participants searched a target display for a red letter. To assess contingent capture, this display was preceded by an irrelevant red cue. To assess stimulus-driven capture, the target display could be accompanied by the simultaneous onset of an irrelevant new object. At the level of eye movements, the results showed strong interactions between cue validity and onset presence on the spatiotemporal trajectories of the saccades. However, at the level of manual responses, these effects cancelled out, leading to additive effects on mean RT. We conclude that both types of capture influence a shared spatial orienting mechanism and we provide a descriptive computational model of their dynamics. |
Yamila Sevilla; Mora Maldonado; Diego E. Shalom Pupillary dynamics reveal computational cost in sentence planning Journal Article In: Quarterly Journal of Experimental Psychology, vol. 67, no. 6, pp. 1041–1052, 2014. @article{Sevilla2014,This study investigated the computational cost associated with grammatical planning in sentence production. We measured people's pupillary responses as they produced spoken descriptions of depicted events. We manipulated the syntactic structure of the target by training subjects to use different types of sentences following a colour cue. The results showed higher increase in pupil size for the production of passive and object dislocated sentences than for active canonical subject-verb-object sentences, indicating that more cognitive effort is associated with more complex noncanonical thematic order. We also manipulated the time at which the cue that triggered structure-building processes was presented. Differential increase in pupil diameter for more complex sentences was shown to rise earlier as the colour cue was presented earlier, suggesting that the observed pupillary changes are due to differential demands in relatively independent structure-building processes during grammatical planning. Task-evoked pupillary responses provide a reliable measure to study the cognitive processes involved in sentence production. |
Jingxin Wang; Jing Tian; Weijin Han; Simon P. Liversedge; Kevin B. Paterson Inhibitory stroke neighbour priming in character recognition and reading in Chinese Journal Article In: Quarterly Journal of Experimental Psychology, vol. 67, no. 11, pp. 2149–2171, 2014. @article{Wang2014d,In alphabetic languages, prior exposure to a target word's orthographic neighbour influences word recognition in masked priming experiments and the process of word identification that occurs during normal reading. We investigated whether similar neighbour priming effects are observed in Chinese in 4 masked priming experiments (employing a forward mask and 33-ms, 50-ms, and 67-ms prime durations) and in an experiment that measured eye movements while reading. In these experiments, the stroke neighbour of a Chinese character was defined as any character that differed by the addition, deletion, or substitution of one or two strokes. Prime characters were either stroke neighbours or stroke non-neighbours of the target character, and each prime character had either a higher or a lower frequency of occurrence in the language than its corresponding target character. Frequency effects were observed in all experiments, demonstrating that the manipulation of character frequency was successful. In addition, a robust inhibitory priming effect was observed in response times for target characters in the masked priming experiments and in eye fixation durations for target characters in the reading experiment. This stroke neighbour priming was not modulated by the relative frequency of the prime and target characters. The present findings therefore provide a novel demonstration that inhibitory neighbour priming shown previously for alphabetic languages is also observed for nonalphabetic languages, and that neighbour priming (based on stroke overlap) occurs at the level of the character in Chinese. |
Dorothea Wendt; Thomas Brand; Birger Kollmeier An eye-tracking paradigm for analyzing the processing time of sentences with different linguistic complexities Journal Article In: PLoS ONE, vol. 9, no. 6, pp. e100186, 2014. @article{Wendt2014a,An eye-tracking paradigm was developed for use in audiology in order to enable online analysis of the speech comprehension process. This paradigm should be useful in assessing impediments in speech processing. In this paradigm, two scenes, a target picture and a competitor picture, were presented simultaneously with an aurally presented sentence that corresponded to the target picture. At the same time, eye fixations were recorded using an eye-tracking device. The effect of linguistic complexity on language processing time was assessed from eye fixation information by systematically varying linguistic complexity. This was achieved with a sentence corpus containing seven German sentence structures. A novel data analysis method computed the average tendency to fixate the target picture as a function of time during sentence processing. This allowed identification of the point in time at which the participant understood the sentence, referred to as the decision moment. Systematic differences in processing time were observed as a function of linguistic complexity. These differences in processing time may be used to assess the efficiency of cognitive processes involved in resolving linguistic complexity. Thus, the proposed method enables a temporal analysis of the speech comprehension process and has potential applications in speech audiology and psychoacoustics. |
Veronica Whitford; Debra Titone The effects of reading comprehension and launch site on frequency-predictability interactions during paragraph reading Journal Article In: Quarterly Journal of Experimental Psychology, vol. 67, no. 6, pp. 1151–1165, 2014. @article{Whitford2014,We used eye movement measures of paragraph reading to examine whether word frequency and predictability interact during the earliest stages of lexical processing, with a specific focus on whether these effects are modulated by individual differences in reading comprehension or launch site (i.e., saccade length between the prior and currently fixated word–a proxy for the amount of parafoveal word processing). The joint impact of frequency and predictability on reading will elucidate whether these variables additively or multiplicatively affect the earliest stages of lexical access, which, in turn, has implications for computational models of eye movements during reading. Linear mixed effects models revealed additive effects during both early- and late-stage reading, where predictability effects were comparable for low- and high-frequency words. Moreover, less cautious readers (e.g., readers who engaged in skimming, scanning, mindless reading) demonstrated smaller frequency effects than more cautious readers. Taken together, our findings suggest that during extended reading, frequency and predictability exert additive influences on lexical and postlexical processing, and that individual differences in reading comprehension modulate sensitivity to the effects of word frequency. |
Heather Winskel; Manuel Perea Can parafoveal-on-foveal effects be obtained when reading an unspaced alphasyllabic script (Thai)? Journal Article In: Writing Systems Research, vol. 6, no. 1, pp. 94–104, 2014. @article{Winskel2014,One controversial question in the field of eye movements and reading is whether there is evidence of parafoveal-on-foveal effects. This is an important issue because some models of eye movements in reading make quite different predictions in this respect (e.g., E-Z Reader vs. SWIFT models). The aim of the current study was to investigate if parafoveal-on-foveal effects occur when reading Thai, an unspaced, alphasyllabic orthography. Word frequency (high and low) of the word to the right of the currently fixated word was manipulated to examine if it would influence processing of the fixated word. Thirty-six participants read single sentences while having their eye movements monitored. There was no evidence of the effect of word frequency of the parafoveal word on fixation duration measures of the foveal word, as assessed by p(H0|D) values - except for a marginal effect in the skipping rates. Thus, the present data are in line with previous studies using spaced Indo-European languages which have found small/null results for parafoveal effects of word frequency during one-line sentence reading. © 2013 Taylor & Francis. |