EyeLink Clinical and Oculomotor Eye-Tracking Publications
EyeLink clinical and oculomotor research publications up until 2023 (with some early 2024s) are listed below by year. You can search the publications using keywords such as Saccadic Adaptation, Schizophrenia, Nystagmus, etc. You can also search for individual author names, and limit searches by year (choose the year then click the search button). If we missed any EyeLink clinical or oculomotor articles, please email us!
2017 |
Andrea Helo; Sandrien Ommen; Sebastian Pannasch; Lucile Danteny-Dordoigne; Pia Rämä Influence of semantic consistency and perceptual features on visual attention during scene viewing in toddlers Journal Article In: Infant Behavior and Development, vol. 49, pp. 248–266, 2017. @article{Helo2017, Conceptual representations of everyday scenes are built in interaction with visual environment and these representations guide our visual attention. Perceptual features and object-scene semantic consistency have been found to attract our attention during scene exploration. The present study examined how visual attention in 24-month-old toddlers is attracted by semantic violations and how perceptual features (i. e. saliency, centre distance, clutter and object size) and linguistic properties (i. e. object label frequency and label length) affect gaze distribution. We compared eye movements of 24-month-old toddlers and adults while exploring everyday scenes which either contained an inconsistent (e.g., soap on a breakfast table) or consistent (e.g., soap in a bathroom) object. Perceptual features such as saliency, centre distance and clutter of the scene affected looking times in the toddler group during the whole viewing time whereas looking times in adults were affected only by centre distance during the early viewing time. Adults looked longer to inconsistent than consistent objects either if the objects had a high or a low saliency. In contrast, toddlers presented semantic consistency effect only when objects were highly salient. Additionally, toddlers with lower vocabulary skills looked longer to inconsistent objects while toddlers with higher vocabulary skills look equally long to both consistent and inconsistent objects. Our results indicate that 24-month-old children use scene context to guide visual attention when exploring the visual environment. However, perceptual features have a stronger influence in eye movement guidance in toddlers than in adults. Our results also indicate that language skills influence cognitive but not perceptual guidance of eye movements during scene perception in toddlers. |
Ehab W. Hermena; Simon P. Liversedge; Denis Drieghe In: Journal of Experimental Psychology: Learning, Memory, and Cognition, vol. 43, no. 3, pp. 451–471, 2017. @article{Hermena2017, The authors conducted 2 eye movement experiments in which they used the typographical and linguistic properties of Arabic to disentangle the influences of words' number of letters and spatial extent on measures of fixation duration and saccade targeting (Experiment 1), and to investigate the influence of initial bigram characteristics on saccade targeting during reading (Experiment 2). In the first experiment, through the use of a proportional font, which is more natural-looking in Arabic compared to monospaced fonts, the authors manipulated the number of letters (5 vs. 7) and the spatial extent (wide vs. narrow) of words embedded in frame sentences. The results obtained replicate and expand upon previous findings in other alphabetic languages that the number of letters influences fixation durations, whereas saccade targeting (as indicated by measures of fixation count and probability of skipping and refixation) is more influenced by the word's spatial extent. In the second experiment, the authors compared saccade targeting measures (saccade amplitude and initial fixation location) in 6- and 7-letter words beginning with initial bigrams that were of extremely high frequency ([character omitted] the), relatively high frequency ([character omitted] to/for the), or beginning with the letters of the word stem. The results showed negligible modulation of saccade targeting by initial bigram characteristics. The results also highlighted the importance of selecting the appropriate measures of initial fixation location (spatial vs. character-based measures) during reading text rendered using proportional fonts. |
Florian Hintz; Antje S. Meyer; Falk Huettig Predictors of verb-mediated anticipatory eye movements in the visual world Journal Article In: Journal of Experimental Psychology: Learning, Memory, and Cognition, vol. 43, no. 9, pp. 1352–1374, 2017. @article{Hintz2017, Many studies have demonstrated that listeners use information extracted from verbs to guide anticipatory eye movements to objects in the visual context that satisfy the selection restrictions of the verb. An important question is what underlies such verb-mediated anticipatory eye gaze. Based on empirical and theoretical suggestions, we investigated the influence of 5 potential predictors of this behavior: functional associations and general associations between verb and target object, as well as the listeners' production fluency, receptive vocabulary knowledge, and nonverbal intelligence. In 3 eye-tracking experiments, participants looked at sets of 4 objects and listened to sentences where the final word was predictable or not predictable (e.g., "The man peels/draws an apple"). On predictable trials only the target object, but not the distractors, were functionally and associatively related to the verb. In Experiments 1 and 2, objects were presented before the verb was heard. In Experiment 3, participants were given a short preview of the display after the verb was heard. Functional associations and receptive vocabulary were found to be important predictors of verb-mediated anticipatory eye gaze independent of the amount of contextual visual input. General word associations did not and nonverbal intelligence was only a very weak predictor of anticipatory eye movements. Participants' production fluency correlated positively with the likelihood of anticipatory eye movements when participants were given the long but not the short visual display preview. These findings fit best with a pluralistic approach to predictive language processing in which multiple mechanisms, mediating factors, and situational context dynamically interact. |
Paul Metzner; Titus Malsburg; Shravan Vasishth; Frank Rösler The importance of reading naturally: Evidence from combined recordings of eye movements and electric brain potentials Journal Article In: Cognitive Science, vol. 41, pp. 1232–1263, 2017. @article{Metzner2017, How important is the ability to freely control eye movements for reading comprehension? And how does the parser make use of this freedom? We investigated these questions using coregistration of eye movements and event-related brain potentials (ERPs) while participants read either freely or in a computer-controlled word-by-word format (also known as RSVP). Word-by-word presentation and natural reading both elicited qualitatively similar ERP effects in response to syntactic and semantic violations (N400 and P600 effects). Comprehension was better in free reading but only in trials in which the eyes regressed to previous material upon encountering the anomaly. A more fine-grained ERP analysis revealed that these regressions were strongly associated with the well-known P600 effect. In trials without regressions, we instead found sustained centro-parietal negativities starting at around 320 ms post-onset; however, these negativities were only found when the violation occurred in sentence-final position. Taken together, these results suggest that the sentence processing system engages in strategic choices: In response to words that don't match built-up expectations, it can either explore alternative interpretations (reflected by regressions, P600 effects, and good com-prehension) or pursue a " good-enough " processing strategy that tolerates a deficient interpretation (reflected by progressive saccades, sustained negativities, and relatively poor comprehension). |
Martina Micai; Holly S. S. L. Joseph; Mila Vulchanova; David Saldaña Strategies of readers with autism when responding to inferential questions: An eye-movement study Journal Article In: Autism Research, vol. 10, no. 5, pp. 888–900, 2017. @article{Micai2017, Previous research suggests that individuals with autism spectrum disorder (ASD) have difficulties with inference generation in reading tasks. However, most previous studies have examined how well children understand a text after reading or have measured on-line reading behavior without response to questions. The aim of this study was to investigate the online strategies of children and adolescents with autism during reading and at the same time responding to a question by monitoring their eye movements. The reading behavior of participants with ASD was compared with that of age-, language-, nonverbal intelligence-, reading-, and receptive language skills-matched participants without ASD (control group). The results showed that the ASD group were as accurate as the control group in generating inferences when answering questions about the short texts, and no differences were found between the two groups in the global paragraph reading and responding times. However, the ASD group displayed longer gaze latencies on a target word necessary to produce an inference. They also showed more regressions into the word that supported the inference compared to the control group after reading the question, irrespective of whether an inference was required or not. In conclusion, the ASD group achieved an equivalent level of inferential comprehension, but showed subtle differences in reading comprehension strategies compared to the control group. |
Sanako Mitsugi Incremental comprehension of Japanese passives: Evidence from the visual-world paradigm Journal Article In: Applied Psycholinguistics, vol. 38, no. 4, pp. 953–983, 2017. @article{Mitsugi2017, Psycholinguistic research has shown that sentence processing is incremental (e.g., Altmann & Kamide, 1999). In Japanese, a verb-final language, native speakers use case markers to incrementally assign thematic roles and predictively activate a structural representation of upcoming linguistic items. This study examined whether second-language learners of Japanese, guided by case markers, generate predictions as to whether the upcoming verb involves the active or passive voice. The results show that the native speakers made predictive eye movements before the verb, but the learners did not; the learners were less efficient in using case-marker cues than the native speakers and relied more on verb morphology information. These results suggest that case markers guide thematic role assignments, expediting the processing for Japanese native speakers. Learners may depend more on information from the verb to compensate for the inefficiency in case-marker-driven predictive processing. |
Holger Mitterer; Eva Reinisch Visual speech influences speech perception immediately but not automatically Journal Article In: Attention, Perception, and Psychophysics, vol. 79, no. 2, pp. 660–678, 2017. @article{Mitterer2017, Two experiments examined the time course of the use of auditory and visual speech cues to spoken word recognition using an eye-tracking paradigm. Results of the first experiment showed that the use of visual speech cues from lipreading is reduced if concurrently presented pictures require a division of attentional resources. This reduction was evident even when listeners' eye gaze was on the speaker rather than the (static) pictures. Experiment 2 used a deictic hand gesture to foster attention to the speaker. At the same time, the visual processing load was reduced by keeping the visual display constant over a fixed number of successive trials. Under these conditions, the visual speech cues from lipreading were used. Moreover, the eye-tracking data indicated that visual information was used immediately and even earlier than auditory information. In combination, these data indicate that visual speech cues are not used automatically, but if they are used, they are used immediately. |
Koji Miwa; Ton Dijkstra Lexical processes in the recognition of Japanese horizontal and vertical compounds Journal Article In: Reading and Writing, vol. 30, no. 4, pp. 791–812, 2017. @article{Miwa2017a, This lexical decision eye-tracking study investigated whether horizontal and vertical readings elicit comparable behavioral patterns and whether reading directions modulate lexical processes. Response times and eye movements were recorded during a lexical decision task with Japanese bimorphemic compound words presented vertically. The data were then analyzed together with those obtained in a horizontal lexical decision experiment of Miwa, Libben, Dijkstra, and Baayen (2014). Linear mixed-effects analyses of response times and eye movements revealed that, although response times and first fixation durations were notably shorter in horizontal reading than vertical reading, the vertical reading elicited fewer fixations. Furthermore, while compounds were recognized largely in comparable ways regardless of reading direction, several lexical processes were found to be reading-direction-dependent. Particularly, processing of the first morpheme was modulated by reading direction in a late time frame, such that a horizontal reading advantage was observed for words with a high frequency first morpheme. All in all, the two reading directions do not only differ quantitatively in processing speed, but also qualitatively in terms of underlying processing mechanisms. |
Koji Miwa; Gary Libben; Yu Ikemoto Visual trimorphemic compound recognition in a morphographic script Journal Article In: Language, Cognition and Neuroscience, vol. 32, no. 1, pp. 1–20, 2017. @article{Miwa2017, This lexical decision with eye-tracking study investigated how Japanese trimorphemic compounds (e.g. 体温計 “clinical thermometer”) are recognised. The questions answered were, in the course of decomposing and composing Japanese trimorphemic compounds, (1) whether recognition processes are tuned for a specific branching direction, (2) whether the morphological processing proceeds in a bottom-up combinatorial manner, and (3) whether the three constituents of trimorphemic compounds are equally important and processed serially. Mixed-effects regression analyses of response times and fixation durations revealed that a left-branching advantage appears in a late time frame and that, although there was early processing of the whole compound from the first fixation, a character frequency effect was also observed. Furthermore, the first and the third, but not the second, constituent frequencies contributed to compound recognition. This bathtub-like effect was further supported by corpus-based evidence: the conditional probability for the second constituent is incomparably high. |
Vincenzo Moscati; Likan Zhan; Peng Zhou Children's on-line processing of epistemic modals Journal Article In: Journal of Child Language, vol. 44, pp. 1025–1040, 2017. @article{Moscati2017, In this paper we investigated the real-time processing of epistemic modals in five-year-olds. In a simple reasoning scenario, we monitored children's eye-movements while processing a sentence with modal expressions of different force (might/must). Children were also asked to judge the truth-value of the target sentences at the end of the reasoning task. Consistent with previous findings (Noveck, 2001), we found that children's behavioural responses were much less accurate compared to adults. Their eye-movements, however, revealed that children did not treat the two modal expressions alike. As soon as a modal expression was presented, children and adults showed a similar fixation pattern that varied as a function of the modal expression they heard. It is only at the very end of the sentence that children's fixations diverged from the adult ones. We discuss these findings in relation to the proposal that children narrow down the set of possible outcomes in undetermined reasoning scenarios and endorse only one possibility among several (Acredolo & Horobin, 1987, Ozturk & Papafragou, 2015). |
Hermann J. Mueller; Thomas Geyer; Franziska Günther; Jim Kacian; Stella Pierides Reading English-Language haiku: Processes of meaning construction revealed by eye movements Journal Article In: Journal of Eye Movement Research, vol. 10, no. 1, pp. 1–33, 2017. @article{Mueller2017, In the present study, poets and cognitive scientists came together to investigate the construction of meaning in the process of reading normative, 3-line English-language haiku (ELH), as found in leading ELH journals. The particular haiku which we presented to our readers consisted of two semantically separable parts, or images, that were set in a ‘tense' relationship by the poet. In our sample of poems, the division, or cut, between the two parts was positioned either after line 1 or after line 2; and the images related to each other in terms of either a context–action association (context–action haiku) or a conceptually more abstract association (juxtaposition haiku). From a constructivist perspective, understanding such haiku would require the reader to integrate these parts into a coherent ‘meaning Gestalt', mentally (re-)creating the pattern intended by the poet (or one from within the poem's meaning potential). To examine this process, we recorded readers' eye movements, and we obtained measures of memory for the read poems as well as subjective ratings of comprehension difficulty and understanding achieved. The results indicate that processes of meaning construction are reflected in patterns of eye movements during reading (1st-pass) and re-reading (2nd- and 3rd-pass). From those, the position of the cut (after line 1 vs. after line 2) and, to some extent, the type of haiku (context–action vs. juxtaposition) can be ‘recovered'. Moreover, post-reading, readers tended to explicitly recognize a particular haiku they had read if they had been able to understand the poem, pointing to a role of actually resolving the haiku's meaning (rather than just attempting to resolve it) for memory consolidation and subsequent retrieval. Taken together, these first findings are promising, suggesting that haiku can be a paradigmatic material for studying meaning construction during poetry reading. |
Daniel J. Olson Bilingual language switching costs in auditory comprehension Journal Article In: Language, Cognition and Neuroscience, vol. 32, no. 4, pp. 494–513, 2017. @article{Olson2017, Previous research on bilingual language switching and lexical access has demonstrated a consistent reaction time cost associated with producing a switched token. While some studies have shown these costs to be asymmetrical, with bilinguals evidencing a greater delay when producing switches into their dominant language relative to the non-dominant language, others have shown symmetrical costs, depending on individual (e.g. proficiency) and contextual (e.g. language mode) factors. The current study, employing an eye-tracking paradigm, extends this line of research by examining the potential for switch costs during auditory comprehension. Paralleling previous production-oriented research, results of the current study demonstrate flexible switch costs during auditory comprehension. Switch costs were asymmetrical in monolingual mode, with greater costs incurred when switching into the dominant language, and uniformly absent in bilingual mode. Results are discussed with respect to bilingual language selection mechanisms in both production and comprehension. |
2016 |
Sujaya Neupane; Daniel Guitton; Christopher C. Pack Two distinct types of remapping in primate cortical area V4 Journal Article In: Nature Communications, vol. 7, pp. 10402, 2016. @article{Neupane2016a, Visual neurons typically receive information from a limited portion of the retina, and such receptive fields are a key organizing principle for much of visual cortex. At the same time, there is strong evidence that receptive fields transiently shift around the time of saccades. The nature of the shift is controversial: Previous studies have found shifts consistent with a role for perceptual constancy; other studies suggest a role in the allocation of spatial attention. Here we present evidence that both the previously documented functions exist in individual neurons in primate cortical area V4. Remapping associated with perceptual constancy occurs for saccades in all directions, while attentional shifts mainly occur for neurons with receptive fields in the same hemifield as the saccade end point. The latter are relatively sluggish and can be observed even during saccade planning. Overall these results suggest a complex interplay of visual and extraretinal influences during the execution of saccades. |
Jean-Baptiste Bernard; Carlos Aguilar; Eric Castet In: PLoS ONE, vol. 11, no. 4, pp. e0152506, 2016. @article{Bernard2016b, Reading speed is dramatically reduced when readers cannot use their central vision. This is because low visual acuity and crowding negatively impact letter recognition in the periphery. In this study, we designed a new font (referred to as the Eido font) in order to reduce inter-letter similarity and consequently to increase peripheral letter recognition performance. We tested this font by running five experiments that compared the Eido font with the standard Courier font. Letter spacing and x-height were identical for the two monospaced fonts. Six normally-sighted subjects used exclusively their peripheral vision to run two aloud reading tasks (with eye movements), a letter recognition task (without eye movements), a word recognition task (without eye movements) and a lexical decision task. Results show that reading speed was not significantly different between the Eido and the Courier font when subjects had to read single sentences with a round simulated gaze-contingent central scotoma (10° diameter). In contrast, Eido significantly decreased perceptual errors in peripheral crowded letter recognition (-30% errors on average for letters briefly presented at 6° eccentricity) and in peripheral word recognition (-32% errors on average for words briefly presented at 6° eccentricity). |
Nayoung So; Veit Stuphorn Supplementary eye field encodes confidence in decisions under risk Journal Article In: Cerebral Cortex, vol. 26, no. 2, pp. 764–782, 2016. @article{So2016, Choices are made with varying degrees of confidence, a cognitive signal representing the subjective belief in the optimality of the choice. Confidence has been mostly studied in the context of perceptual judgments, in which choice accuracy can be measured using objective criteria. Here, we study confidence in subjective value-based decisions. We recorded in the supplementary eye field (SEF) of monkeys performing a gambling task, where they had to use subjective criteria for placing bets. We found neural signals in the SEF that explicitly represent choice confidence independent from reward expectation. This confidence signal appeared after the choice and diminished before the choice outcome. Most of this neuronal activity was negatively correlated with confidence, and was strongest in trials on which the monkey spontaneously withdrew his choice. Such confidence-related activity indicates that the SEF not only guides saccade selection, but also evaluates the likelihood that the choice was optimal. This internal evaluation influences decisions concerning the willingness to bear later costs that follow from the choice or to avoid them. More generally, our findings indicate that choice confidence is an integral component of all forms of decision-making, whether they are based on perceptual evidence or on value estimations. |
Megan H. Papesh; Stephen D. Goldinger; Michael C. Hout Eye movements reveal fast, voice-specific priming Journal Article In: Journal of Experimental Psychology: General, vol. 145, no. 3, pp. 314–337, 2016. @article{Papesh2016, In spoken word perception, voice specificity effects are well-documented: When people hear repeated words in some task, performance is generally better when repeated items are presented in their originally heard voices, relative to changed voices. A key theoretical question about voice specificity effects concerns their time-course: Some studies suggest that episodic traces exert their influence late in lexical processing (the time-course hypothesis; McLennan & Luce, 2005), whereas others suggest that episodic traces influence immediate, online processing. We report 2 eye-tracking studies investigating the time-course of voice-specific priming within and across cognitive tasks. In Experiment 1, participants performed modified lexical decision or semantic classification to words spoken by 4 speakers. The tasks required participants to click a red "x" or a blue "+" located randomly within separate visual half-fields, necessitating trial-by-trial visual search with consistent half-field response mapping. After a break, participants completed a second block with new and repeated items, half spoken in changed voices. Voice effects were robust very early, appearing in saccade initiation times. Experiment 2 replicated this pattern while changing tasks across blocks, ruling out a response priming account. In the General Discussion, we address the time-course hypothesis, focusing on the challenge it presents for empirical disconfirmation, and highlighting the broad importance of indexical effects, beyond studies of priming. |
Bob McMurray; Ashley Farris-Trimble; Michael Seedorff; Hannah Rigler The effect of residual acoustic hearing and adaptation to uncertainty on speech perception in cochlear implant users: Evidence from eye-tracking Journal Article In: Ear & Hearing, vol. 37, no. 1, pp. e37–e51, 2016. @article{McMurray2016, OBJECTIVES: While outcomes with cochlear implants (CIs) are generally good, performance can be fragile. The authors examined two factors that are crucial for good CI performance. First, while there is a clear benefit for adding residual acoustic hearing to CI stimulation (typically in low frequencies), it is unclear whether this contributes directly to phonetic categorization. Thus, the authors examined perception of voicing (which uses low-frequency acoustic cues) and fricative place of articulation (s/ʃ, which does not) in CI users with and without residual acoustic hearing. Second, in speech categorization experiments, CI users typically show shallower identification functions. These are typically interpreted as deriving from noisy encoding of the signal. However, psycholinguistic work suggests shallow slopes may also be a useful way to adapt to uncertainty. The authors thus employed an eye-tracking paradigm to examine this in CI users. DESIGN: Participants were 30 CI users (with a variety of configurations) and 22 age-matched normal hearing (NH) controls. Participants heard tokens from six b/p and six s/ʃ continua (eight steps) spanning real words (e.g., beach/peach, sip/ship). Participants selected the picture corresponding to the word they heard from a screen containing four items (a b-, p-, s- and ʃ-initial item). Eye movements to each object were monitored as a measure of how strongly they were considering each interpretation in the moments leading up to their final percept. RESULTS: Mouse-click results (analogous to phoneme identification) for voicing showed a shallower slope for CI users than NH listeners, but no differences between CI users with and without residual acoustic hearing. For fricatives, CI users also showed a shallower slope, but unexpectedly, acoustic + electric listeners showed an even shallower slope. Eye movements showed a gradient response to fine-grained acoustic differences for all listeners. Even considering only trials in which a participant clicked "b" (for example), and accounting for variation in the category boundary, participants made more looks to the competitor ("p") as the voice onset time neared the boundary. CI users showed a similar pattern, but looked to the competitor more than NH listeners, and this was not different at different continuum steps. CONCLUSION: Residual acoustic hearing did not improve voicing categorization suggesting it may not help identify these phonetic cues. The fact that acoustic + electric users showed poorer performance on fricatives was unexpected as they usually show a benefit in standardized perception measures, and as sibilants contain little energy in the low-frequency (acoustic) range. The authors hypothesize that these listeners may overweight acoustic input, and have problems when this is not available (in fricatives). Thus, the benefit (or cost) of acoustic hearing for phonetic categorization may be complex. Eye movements suggest that in both CI and NH listeners, phoneme categorization is not a process of mapping continuous cues to discrete categories. Rather listeners preserve gradiency as a way to deal with uncertainty. CI listeners appear to adapt to their implant (in part) by amplifying competitor activation to preserve their flexibility in the face of potential misperceptions. |
Ascensión Pagán; Hazel I. Blythe; Simon P. Liversedge Parafoveal preprocessing of word initial trigrams during reading in adults and children Journal Article In: Journal of Experimental Psychology: Learning, Memory, and Cognition, vol. 42, no. 3, pp. 411–432, 2016. @article{Pagan2016a, Although previous research has shown that letter position information for the first letter of a parafoveal word is encoded less flexibly than internal word beginning letters (Johnson, Perea & Rayner, 2007; White et al., 2008), it is not clear how positional encoding operates over the initial trigram in English. This experiment explored the preprocessing of letter identity and position information of a parafoveal word's initial trigram by adults and children using the boundary paradigm during normal sentence reading. Seven previews were generated: Identity (captain); transposed letter and substituted letter nonwords in Positions 1 and 2 (acptain-imptain); 1 and 3 (pactain-gartain), and 2 and 3 (cpatain-cgotain). Results showed a transposed letter effect (TLE) in Position 13 for gaze duration in the pretarget word; and TLE in Positions 12 and 23 but not in Position 13 in the target word for both adults and children. These findings suggest that children, similar to adults, extract letter identity and position information flexibly using a spatial coding mechanism; supporting isolated word recognition models such as SOLAR (Davis, 1999, 2010) and SERIOL (Whitney, 2001) models. |
Ascensión Pagán; Kevin B. Paterson; Hazel I. Blythe; Simon P. Liversedge An inhibitory influence of transposed-letter neighbors on eye movements during reading Journal Article In: Psychonomic Bulletin & Review, vol. 23, no. 1, pp. 278–284, 2016. @article{Pagan2016, Previous research has shown that prior exposure to a word's substitution neighbor earlier in the same sentence can disrupt processing of that word, indicating that interword lexical priming occurs naturally during reading, due to the competition between lexical candidates during word identification. Through the present research, we extended these findings by investigating the effects of prior exposure to a word's transposed-letter neighbor (TLN) earlier in a sentence. TLNs are constituted from the same letters, but in different orders. The findings revealed an inhibitory TLN effect, with longer total reading times for target words, and increased regressions to prime and target words, when the target followed a TLN rather than a control word. These findings indicate that prior exposure to a TLN can disrupt word identification during reading. We suggest that this is caused by a failure of word identification, due to the initial misidentification of the target word (potentially as its TLN) triggering postlexical checking. |
Jinger Pan; Jochen Laubrock; Ming Yan In: Journal of Experimental Psychology: Learning, Memory, and Cognition, vol. 42, no. 8, pp. 1257–1273, 2016. @article{Pan2016, We examined how reading mode (i.e., silent vs. oral reading) influences parafoveal semantic and phonological processing during the reading of Chinese sentences, using the gaze-contingent boundary paradigm. In silent reading, we found in 2 experiments that reading times on target words were shortened with semantic previews in early and late processing, whereas phonological preview effects mainly occurred in gaze duration or second-pass reading. In contrast, results showed that phonological preview information is obtained early on in oral reading. Strikingly, in oral reading, we observed a semantic preview cost on the target word in Experiment 1 and a decrease in the effect size of preview benefit from first- to second-pass measures in Experiment 2, which we hypothesize to result from increased preview duration. Taken together, our results indicate that parafoveal semantic information can be obtained irrespective of reading mode, whereas readers more efficiently process parafoveal phonological information in oral reading. We discuss implications for notions of information processing priority and saccade generation during silent and oral reading. |
Hyojin Park; Christoph Kayser; Gregor Thut; Joachim Gross Lip movements entrain the observers' low-frequency brain oscillations to facilitate speech intelligibility Journal Article In: eLife, vol. 5, pp. 1–17, 2016. @article{Park2016, During continuous speech, lip movements provide visual temporal signals that facilitate speech processing. Here, using MEG we directly investigated how these visual signals interact with rhythmic brain activity in participants listening to and seeing the speaker. First, we investigated coherence between oscillatory brain activity and speaker's lip movements and demonstrated significant entrainment in visual cortex. We then used partial coherence to remove contributions of the coherent auditory speech signal from the lip-brain coherence. Comparing this synchronization between different attention conditions revealed that attending visual speech enhances the coherence between activity in visual cortex and the speaker's lips. Further, we identified a significant partial coherence between left motor cortex and lip movements and this partial coherence directly predicted comprehension accuracy. Our results emphasize the importance of visually entrained and attention-modulated rhythmic brain activity for the enhancement of audiovisual speech processing. |
Umesh Patil; Shravan Vasishth; Richard L. Lewis Retrieval interference in syntactic processing: The case of reflexive binding in English Journal Article In: Frontiers in Psychology, vol. 7, pp. 329, 2016. @article{Patil2016, It has been proposed that in online sentence comprehension the dependency between a reflexive pronoun such as himself/herself and its antecedent is resolved using exclusively syntactic constraints. Under this strictly syntactic search account, Principle A of the binding theory-which requires that the antecedent c-command the reflexive within the same clause that the reflexive occurs in-constrains the parser's search for an antecedent. The parser thus ignores candidate antecedents that might match agreement features of the reflexive (e.g., gender) but are ineligible as potential antecedents because they are in structurally illicit positions. An alternative possibility accords no special status to structural constraints: in addition to using Principle A, the parser also uses non-structural cues such as gender to access the antecedent. According to cue-based retrieval theories of memory (e.g., Lewis and Vasishth, 2005), the use of non-structural cues should result in increased retrieval times and occasional errors when candidates partially match the cues, even if the candidates are in structurally illicit positions. In this paper, we first show how the retrieval processes that underlie the reflexive binding are naturally realized in the Lewis and Vasishth (2005) model. We present the predictions of the model under the assumption that both structural and non-structural cues are used during retrieval, and provide a critical analysis of previous empirical studies that failed to find evidence for the use of non-structural cues, suggesting that these failures may be Type II errors. We use this analysis and the results of further modeling to motivate a new empirical design that we use in an eye tracking study. The results of this study confirm the key predictions of the model concerning the use of non-structural cues, and are inconsistent with the strictly syntactic search account. These results present a challenge for theories advocating the infallibility of the human parser in the case of reflexive resolution, and provide support for the inclusion of agreement features such as gender in the set of retrieval cues. |
Brennan R. Payne; Mallory C. Stites; Kara D. Federmeier Out of the corner of my eye: Foveal semantic load modulates parafoveal processing in reading Journal Article In: Journal of Experimental Psychology: Human Perception and Performance, vol. 42, no. 11, pp. 1839–1857, 2016. @article{Payne2016, In 2 experiments, we examined the impact of foveal semantic expectancy and congruity on parafoveal word processing during reading. Experiment 1 utilized an eye-tracking gaze-contingent display change paradigm, and Experiment 2 measured event-related brain potentials (ERPs) in a modified flanker rapid serial visual presentation (RSVP) paradigm. Eye-tracking and ERP data converged to reveal graded effects of foveal load on parafoveal processing. In Experiment 1, when word n was highly expected, and thus foveal load was low, there was a large parafoveal preview benefit to word n = 1. When word n was unexpected but still plausible, preview benefits to n = 1 were reduced in magnitude, and when word n was semantically incongruent, the preview benefit to n = 1 was unreliable in early pass measures. In Experiment 2, ERPs indicated that when word n was expected, and thus foveal load was low, readers successfully discriminated between valid and orthographically invalid previews during parafoveal perception. However, when word n was unexpected, parafoveal processing of n = 1 was reduced, and it was eliminated when word n was semantically incongruent. Taken together, these findings suggest that sentential context modulates the allocation of attention in the parafovea, such that covert allocation of attention to parafoveal processing is disrupted when foveal words are inconsistent with expectations based on various contextual constraints. |
Ana Pellicer-Sánchez Incidental L2 vocabulary acquisition from and while reading: An eye-tracking study Journal Article In: Studies in Second Language Acquisition, vol. 38, no. 1, pp. 97–130, 2016. @article{PellicerSanchez2016, Previous studies have shown that reading is an important source of incidental second language (L2) vocabulary acquisition. However, we still do not have a clear picture of what happens when readers encounter unknown words. Combining offline (vocabulary tests) and online (eye-tracking) measures, the incidental acquisition of vocabulary knowledge from reading and the online reading of unknown lexical items were examined. L2 English learners read a story containing unknown items while their eye movements were recorded. After eight exposures, L2 readers recognized the form and the meaning of 86% and 75% of the target nonwords, respectively, whereas they recalled the meaning of 55% of the nonwords. After three to four encounters, nonwords were read significantly faster, and by eight encounters they were read in a similar manner to previously known real words. Results also showed a positive relationship between new vocabulary learning outcomes and online reading, with longer reading times associated with higher vocabulary recall test scores. The study was also conducted with first language (L1) readers to provide baseline data for comparison. Results confirmed the L2 findings while also indicating an interesting L1-L2 distinction in the rate rather than in the ultimate outcome of the acquisition process. |
Manuel Perea; Lourdes Giner; Ana Marcet; Pablo Gomez Does extra interletter spacing help text reading in skilled adult readers? Journal Article In: Spanish Journal of Psychology, vol. 19, pp. 1–7, 2016. @article{Perea2016, A number of experiments have shown that, in skilled adult readers, a small increase in interletter spacing speeds up the process of visual word recognition relative to the default settings (i.e., judge faster than judge). The goal of the present experiment was to examine whether this effect can be generalized to a more ecological scenario: text reading. Each participant read two stories (367 words each) taken from a standardized reading test. The stories were presented with the standard interletter spacing or with a small increase in interletter spacing (+1.2 points to default) in a within-subject design. An eyetracker was used to register the participants' eye movements. Comprehension scores were also examined. Results showed that, on average, fixation durations were shorter while reading the text with extra spacing than while reading the text with the default settings (237 vs. 245 ms, respectively; η2 =. 41 |
Ewa Pluciennicka; Yann Coello; Solène Kalénine In: Cognitive Development, vol. 38, pp. 75–88, 2016. @article{Pluciennicka2016, This study assessed the implicit processing development of three types of semantic relations during manipulable artifact identification. Thirteen adults and thirty-nine children (age 6, 8, and 10 years) participated. Fixation temporal dynamics were used to assess competition effects from thematic (e.g., wood), specific function (e.g., axe), and general function (e.g., knife) distractors during target identification (e.g., saw). Competition effects were analyzed depending on distractor type and age group. Developmental results demonstrate emergence of competition effects with general function distractors with age, whereas competition effects with thematic and specific function distractors were stable from 6. Findings highlight fined-grained development of similarity-based semantic mechanism implicit use during object processing from 6 to adulthood. They further suggest that complementarity-based mechanism is efficiently used during object semantic processing starting from 6 and likely involved in processing both thematic and specific function relations. |
Ewa Pluciennicka; Yannick Wamain; Yann Coello; Solène Kalénine Impact of action primes on implicit processing of thematic and functional similarity relations: Evidence from eye-tracking Journal Article In: Psychological Research, vol. 80, no. 4, pp. 566–580, 2016. @article{Pluciennicka2016a, The aim of this study was to specify the role of action representations in thematic and functional similarity relations between manipulable artifact objects. Recent behavioral and neurophysiological evidence indicates that while they are all relevant for manipulable artifact concepts, semantic relations based on thematic (e.g., saw-wood), specific function similarity (e.g., saw-axe), and general function similarity (e.g., saw-knife) are differently processed, and may relate to different levels of action representation. Point-light displays of object-related actions previously encoded at the gesture level (e.g., "sawing") or at the higher level of action representation (e.g., "cutting") were used as primes before participants identified target objects (e.g., saw) among semantically related and unrelated distractors (e.g., wood, feather, piano). Analysis of eye movements on the different objects during target identification informed about the amplitude and the timing of implicit activation of the different semantic relations. Results showed that action prime encoding impacted the processing of thematic relations, but not that of functional similarity relations. Semantic competition with thematic distractors was greater and earlier following action primes encoded at the gesture level compared to action primes encoded at higher level. As a whole, these findings highlight the direct influence of action representations on thematic relation processing, and suggest that thematic relations involve gesture-level representations rather than intention-level representations. |
Yanping Liu; Erik D. Reichle; Xingshan Li The effect of word frequency and parafoveal preview on saccade length during the reading of Chinese Journal Article In: Journal of Experimental Psychology: Human Perception and Performance, vol. 42, no. 7, pp. 1008–1025, 2016. @article{Liu2016, There are currently 2 theoretical accounts of how readers of Chinese select their saccade targets: (a) by moving their eyes to specific saccade targets (i.e., the default-targeting hypothesis) and (b) by adjusting their saccade lengths to accommodate lexical processing (i.e., the dynamic-adjustment hypothesis). In this article, we first report the results of an eye-movement experiment using a gaze-contingent boundary paradigm. This experiment demonstrates that both target-word frequency and its preview validity modulate the lengths of the saccades entering and exiting the target words, with longer saccades to/from high-frequency words when their preview was available. We then report the results of 2 simulations using computational models that instantiate the core theoretical assumptions of the default-targeting and dynamic-adjustment hypotheses. Comparisons of these simulations indicate that the dynamic-adjustment hypothesis provides a better quantitative account of the data from our experiment using fewer free parameters. We conclude by discussing evidence for dynamic saccade adjustment during the reading of alphabetic languages, and why such a heuristic may be necessary to fully explain eye-movement control during the reading of both alphabetic and nonalphabetic languages. |
Simon P. Liversedge; Denis Drieghe; Xin Li; Guoli Yan; Xuejun Bai; Jukka Hyönä Universality in eye movements and reading: A trilingual investigation Journal Article In: Cognition, vol. 147, pp. 1–20, 2016. @article{Liversedge2016, Universality in language has been a core issue in the fields of linguistics and psycholinguistics for many years (e.g., Chomsky, 1965). Recently, Frost (2012) has argued that establishing universals of process is critical to the development of meaningful, theoretically motivated, cross-linguistic models of reading. In contrast, other researchers argue that there is no such thing as universals of reading (e.g., Coltheart & Crain, 2012). Reading is a complex, visually mediated psychological process, and eye movements are the behavioural means by which we encode the visual information required for linguistic processing. To investigate universality of representation and process across languages we examined eye movement behaviour during reading of very comparable stimuli in three languages, Chinese, English and Finnish. These languages differ in numerous respects (character based vs. alphabetic, visual density, informational density, word spacing, orthographic depth, agglutination, etc.). We used linear mixed modelling techniques to identify variables that captured common variance across languages. Despite fundamental visual and linguistic differences in the orthographies, statistical models of reading behaviour were strikingly similar in a number of respects, and thus, we argue that their composition might reflect universality of representation and process in reading. |
Shawn Loewen; Solène Inceoglu The effectiveness of visual input enhancement on the noticing and L2 development of the Spanish past tense Journal Article In: Studies in Second Language Learning and Teaching, vol. 6, no. 1, pp. 89–110, 2016. @article{Loewen2016, Textual manipulation is a common pedagogic tool used to emphasize specific features of a second language (L2) text, thereby facilitating noticing and, ideally, second language development. Visual input enhancement has been used to investigate the effects of highlighting specific grammatical structures in a text. The current study uses a quasi-experimental design to determine the extent to which textual manipulation increase (a) learners' perception of targeted forms and (b) their knowledge of the forms. Input enhancement was used to highlight the Spanish preterit and imperfect verb forms and an eye tracker measured the frequency and duration of participants' fixation on the targeted items. In addition, pretests and posttests of the Spanish past tense provided information about participants' knowledge of the targeted forms. Results indicate that learners were aware of the highlighted grammatical forms in the text; however, there was no difference in the amount of attention between the enhanced and unenhanced groups. In addition, both groups improved in their knowledge of the L2 forms; however, again, there was no differential improvement between the two groups. |
Matthew W. Lowder; Fernanda Ferreira Prediction in the processing of repair disfluencies: Evidence from the Visual-World Paradigm Journal Article In: Journal of Experimental Psychology: Learning, Memory, and Cognition, vol. 42, no. 9, pp. 1400–1416, 2016. @article{Lowder2016, Two visual-world eye-tracking experiments investigated the role of prediction in the processing of repair disfluencies (e.g., "The chef reached for some salt uh I mean some ketchup . . ."). Experiment 1 showed that listeners were more likely to fixate a critical distractor item (e.g., pepper) during the processing of repair disfluencies compared with the processing of coordination structures (e.g., ". . . some salt and also some ketchup . . ."). Experiment 2 replicated the findings of Experiment 1 for disfluency versus coordination constructions and also showed that the pattern of fixations to the critical distractor for disfluency constructions was similar to the fixation patterns for sentences employing contrastive focus (e.g., ". . . not some salt but rather some ketchup . . ."). The results suggest that similar mechanisms underlie the processing of repair disfluencies and contrastive focus, with listeners generating sets of entities that stand in semantic contrast to the reparandum in the case of disfluencies or the negated entity in the case of contrastive focus. |
Matthew W. Lowder; Peter C. Gordon Eye-tracking and corpus-based analyses of syntax-semantics interactions in complement coercion Journal Article In: Language, Cognition and Neuroscience, vol. 31, no. 7, pp. 921–939, 2016. @article{Lowder2016a, Previous work has shown that the difficulty associated with processing complex semantic expressions is reduced when the critical constituents appear in separate clauses as opposed to when they appear together in the same clause. We investigated this effect further, focusing in particular on complement coercion, in which an event-selecting verb (e.g. began) combines with a complement that represents an entity (e.g. began the memo). Experiment 1 compared reading times for coercion versus control expressions when the critical verb and complement appeared together in a subject-extracted relative clause (SRC) (e.g. The secretary that began/wrote the memo) compared to when they appeared together in a simple sentence. Readers spent more time processing coercion expressions than control expressions, replicating the typical coercion cost. In addition, readers spent less time processing the verb and complement in SRCs than in simple sentences; however, the magnitude of the coercion cost did not depend on sentence structure. In contrast, Experiment 2 showed that the coercion cost was reduced when the complement appeared as the head of an object-extracted relative clause (ORC) (e.g. The memo that the secretary began/wrote) compared to when the constituents appeared together in an SRC. Consistent with the eye-tracking results of Experiment 2, a corpus analysis showed that expressions requiring complement coercion are more frequent when the constituents are separated by the clause boundary of an ORC compared to when they are embedded together within an SRC. The results provide important information about the types of structural configurations that contribute to reduced difficulty with complex semantic expressions, as well as how these processing patterns are reflected in naturally occurring language. |
Steven G. Luke; Kiel Christianson Limits on lexical prediction during reading Journal Article In: Cognitive Psychology, vol. 88, pp. 22–60, 2016. @article{Luke2016, Efficient language processing may involve generating expectations about upcoming input. To investigate the extent to which prediction might facilitate reading, a large-scale survey provided cloze scores for all 2689 words in 55 different text passages. Highly predictable words were quite rare (5% of content words), and most words had a more-expected competitor. An eye-tracking study showed sensitivity to cloze probability but no mis-prediction cost. Instead, the presence of a more-expected competitor was found to be facilitative in several measures. Further, semantic and morphosyntactic information was highly predictable even when word identity was not, and this information facilitated reading above and beyond the predictability of the full word form. The results are consistent with graded prediction but inconsistent with full lexical prediction. Implications for theories of prediction in language comprehension are discussed. |
Steven G. Luke; John M. Henderson The influence of content meaningfulness on eye movements across tasks: Evidence from scene viewing and reading Journal Article In: Frontiers in Psychology, vol. 7, pp. 257, 2016. @article{Luke2016a, The present study investigated the influence of content meaningfulness on eye-movement control in reading and scene viewing. Texts and scenes were manipulated to make them uninterpretable, and then eye-movements in reading and scene-viewing were compared to those in pseudo-reading and pseudo-scene viewing. Fixation durations and saccade amplitudes were greater for pseudo-stimuli. The effect of the removal of meaning was seen exclusively in the tail of the fixation duration distribution in both tasks, and the size of this effect was the same across tasks. These findings suggest that eye movements are controlled by a common mechanism in reading and scene viewing. They also indicate that not all eye movements are responsive to the meaningfulness of stimulus content. Implications for models of eye movement control are discussed. |
Viorica Marian; Henrike K. Blumenfeld; Max R. Freeman; Scott R. Schroeder; Susan C. Bobb Auditory word recognition across the lifespan: Links between linguistic and nonlinguistic inhibitory control in bilinguals and monolinguals Journal Article In: Linguistic Approaches to Bilingualism, vol. 6, no. 1-2, pp. 119–146, 2016. @article{Marian2016, Recent research suggests that bilingual experience reconfigures linguistic and nonlinguistic cognitive processes. We examined the relationship between linguistic competition resolution and nonlinguistic cognitive control in younger and older adults who were either bilingual or monolingual. Participants heard words in English and identified the referent among four pictures while eye-movements were recorded. Target pictures (e.g., cab ) appeared with a phonological competitor picture (e.g., cat ) and two filler pictures. After each eye-tracking trial, priming probes assessed residual activation and inhibition of target and competitor words. When accounting for processing speed, results revealed that age-related changes in activation and inhibition are smaller in bilinguals than in monolinguals. Moreover, younger and older bilinguals, but not monolinguals, recruited similar inhibition mechanisms during word identification and during a nonlinguistic Stroop task. Results suggest that, during lexical access, bilinguals show more consistent competition resolution and recruitment of cognitive control across the lifespan than monolinguals. |
Christina Marx; Florian Hutzler; Sarah Schuster; Stefan Hawelka On the development of parafoveal preprocessing: Evidence from the incremental boundary paradigm Journal Article In: Frontiers in Psychology, vol. 7, pp. 514, 2016. @article{Marx2016, Parafoveal preprocessing of upcoming words and the resultant preview benefit are key aspects of fluent reading. Evidence regarding the development of parafoveal preprocessing during reading acquisition, however, is scarce. The present developmental (cross-sectional) eye tracking study estimated the magnitude of parafoveal preprocessing of beginning readers with a novel variant of the classical boundary paradigm. Additionally, we assessed the association of parafoveal preprocessing with several reading-related psychometric measures. The participants were children learning to read the regular German orthography with about 1, 3, and 5 years of formal reading instruction (Grade 2, 4, and 6, respectively). We found evidence of parafoveal preprocessing in each Grade. However, an effective use of parafoveal information was related to the individual reading fluency of the participants (i.e., the reading rate expressed as words-per-minute) which substantially overlapped between the Grades. The size of the preview benefit was furthermore associated with the children's performance in rapid naming tasks and with their performance in a pseudoword reading task. The latter task assessed the children's efficiency in phonological decoding and our findings show that the best decoders exhibited the largest preview benefit. |
Katrine Sand; Thomas Habekost; Anders Petersen; Randi Starrfelt The Word Superiority Effect in central and peripheral vision Journal Article In: Visual Cognition, vol. 24, no. 4, pp. 293–303, 2016. @article{Sand2016, The Word Superiority Effect (WSE) is a well-known phenomenon in reading research, where words are reported more accurately than single letters or non-words. We report two experiments that investigate the WSE in the central and peripheral visual field, as well as laterality differences in the perception of words and letters, using methods based on the Theory of Visual Attention. The results show a WSE in the central visual field, reflected in mean scores, perception thresholds, and processing speed, whereas the effect is eliminated or reversed in the periphery. This may be caused by crowding, which prevents lexical analysis of a word in the periphery. We conclude that perception of words and letters differs according to location in the visual field. Linking our results to previous studies of crowding effects in patients with reading impairments, we hypothesize that similar mechanisms may limit normal word peripheral processing. |
Kyle C. Scherr; Stephen J. Agauas; Jane Ashby The text matters: Eye movements reflect the cognitive processing of interrogation rights Journal Article In: Applied Cognitive Psychology, vol. 30, no. 2, pp. 234–241, 2016. @article{Scherr2016, Suspects' decisions to waive or invoke interrogation rights have considerable impact on whether subsequent interrogations ensue, self-incriminating information is offered, and in the case of innocent suspects, wrongful convictions occur. Although interrogation warnings differ in their text characteristics, empirically examining the influence of these text differences on suspects' ability to process and comprehend their rights has largely been neglected, which is especially problematic for vulnerable populations. Using a novel approach, we monitored the eye movements of 60 juveniles as they silently read different versions of Miranda warnings in order to investigate the relationship among text characteristics, processing difficulty, and comprehension problems. Results indicated that text characteristics were associated with processing difficulties and these processing difficulties were strongly correlated with comprehension of the warnings. Along with advancing basic and applied research programs, this approach can inform policy decisions and benefit vulnerable populations whose comprehension of interrogation rights is encumbered by legalese. |
Elizabeth R. Schotter; Annie Jia Semantic and plausibility preview benefit effects in English: Evidence from eye movements Journal Article In: Journal of Experimental Psychology: Learning, Memory, and Cognition, vol. 42, no. 12, pp. 1839–1866, 2016. @article{Schotter2016a, Theories of preview benefit in reading hinge on integration across saccades and the idea that preview benefit is greater the more similar the preview and target are. Schotter (2013) reported preview benefit from a synonymous preview, but it is unclear whether this effect occurs because of similarity between the preview and target (i.e., integration), or because of contextual fit of the preview—synonyms satisfy both accounts. Studies in Chinese have found evidence for preview benefit for words that are unrelated to the target, but are contextually plausible (Yang, Li, Wang, Slattery, & Rayner, 2014; Yang, Wang, Tong, & Rayner, 2012), which is incompatible with an integration account but supports a contextual fit account. Here, we used plausible and implausible unrelated previews in addition to plausible synonym, antonym, and identical previews to further investigate these accounts for readers of English. Early reading measures were shorter for all plausible preview conditions compared to the implausible preview condition. In later reading measures, a benefit for the plausible unrelated preview condition was not observed. In a second experiment, we asked questions that probed whether the reader encoded the preview or target. Readers were more likely to report the preview when they had skipped the word and not regressed to it, and when the preview was plausible. Thus, under certain circumstances, the preview word is processed to a high level of representation (i.e., semantic plausibility) regardless of its relationship to the target, but its influence on reading is relatively short-lived, being replaced by the target word, when fixated. |
Elizabeth R. Schotter; Mallorie Leinenger Reversed preview benefit effects: Forced fixations emphasize the importance of parafoveal vision for efficient reading Journal Article In: Journal of Experimental Psychology: Human Perception and Performance, vol. 42, no. 12, pp. 2039–2067, 2016. @article{Schotter2016, Current theories of eye movement control in reading posit that processing of an upcoming parafoveal preview word is used to facilitate processing of that word once it is fixated (i.e., as a foveal target word). This preview benefit is demonstrated by shorter fixation durations in the case of valid (i.e., identical or linguistically similar) compared with invalid (i.e., dissimilar) preview conditions. However, we suggest that processing of the preview can directly influence fixation behavior on the target, independent of similarity between them. In Experiment 1, unrelated high and low frequency words were used as orthogonally crossed previews and targets and we observed a reversed preview benefit for low frequency targets—shorter fixation durations with an invalid, higher frequency preview compared with a valid, low frequency preview. In Experiment 2, the target words were replaced with orthographically legal and illegal nonwords and we found a similar effect of preview frequency on fixation durations on the targets, as well as a bimodal distribution in the illegal nonword target conditions with a denser early peak for high than low frequency previews. In Experiment 3, nonwords were used as previews for high and low frequency targets, replicating standard findings that “denied” preview increases fixation durations and the influence of target properties. These effects can be explained by forced fixations, cases in which fixations on the target were shortened as a consequence of the timing of word recognition of the preview relative to the time course of saccade programming to that word from the prior one. That is, the preview word was (at least partially) recognized so that it should have been skipped, but the word could not be skipped because the saccade to that word was in a nonlabile stage. In these cases, the system preinitiates the subsequent saccade off the upcoming word to the following word and the intervening fixation is short. |
Jillian M. Schuh; Inge Marie Eigsti; Daniel Mirman Discourse comprehension in autism spectrum disorder: Effects of working memory load and common ground Journal Article In: Autism Research, vol. 9, no. 12, pp. 1340–1352, 2016. @article{Schuh2016, Pragmatic language impairments are nearly universal in autism spectrum disorders (ASD). Discourse requires that we monitor information that is shared or mutually known, called "common ground." While many studies have examined the role of Theory of Mind (ToM) in such impairments, few have examined working memory (WM). Common ground impairments in ASD could reflect limitations in both WM and ToM. This study explored common ground use in youth ages 8-17 years with high-functioning ASD (n = 13) and typical development (n = 22); groups did not differ on age, gender, IQ, or standardized language. We tracked participants' eye movements while they performed a discourse task in which some information was known only to the participant (e.g., was privileged; a manipulation of ToM). In addition, the amount of privileged information varied (a manipulation of WM). All participants were slower to fixate the target when considering privileged information, and this effect was greatest during high WM load trials. Further, the ASD group was more likely to fixate competing (non-target) shapes. Predictors of fixation patterns included ASD symptomatology, language ability, ToM, and WM. Groups did not differ in ToM. Individuals with better WM fixated the target more rapidly, suggesting an association between WM capacity and efficient discourse. In addition to ToM knowledge, WM capacity constrains common ground representation and impacts pragmatic skills in ASD. Social impairments in ASD are thus associated with WM capacity, such that deficits in domain-general, nonsocial processes such as WM exert an influence during complex social interactions. |
Sarah Schuster; Stefan Hawelka; Florian Hutzler; Martin Kronbichler; Fabio Richlan Words in context: The effects of length, frequency, and predictability on brain responses during natural reading Journal Article In: Cerebral Cortex, vol. 26, no. 10, pp. 3889–3904, 2016. @article{Schuster2016, Word length, frequency, and predictability count among the most influential variables during reading. Their effects are well-documented in eye movement studies, but pertinent evidence from neuroimaging primarily stem from single-word presentations. We investigated the effects of these variables during reading of whole sentences with simultaneous eye-tracking and functional magnetic resonance imaging (fixation-related fMRI). Increasing word length was associated with increasing activation in occipital areas linked to visual analysis. Additionally, length elicited a U-shaped modulation (i.e., least activation for medium-length words) within a brain stem region presumably linked to eye movement control. These effects, however, were diminished when accounting for multiple fixation cases. Increasing frequency was associated with decreasing activation within left inferior frontal, superior parietal, and occipito-temporal regions. The function of the latter region-hosting the putative visual word form area-was originally considered as limited to sublexical processing. An exploratory analysis revealed that increasing predictability was associated with decreasing activation within middle temporal and inferior frontal regions previously implicated in memory access and unification. The findings are discussed with regard to their correspondence with findings from single-word presentations and with regard to neurocognitive models of visual word recognition, semantic processing, and eye movement control during reading. |
Florian Schwarz False but slow: Evaluating statements with Non-referring definites Journal Article In: Journal of Semantics, vol. 33, pp. 177–214, 2016. @article{Schwarz2016, One central debate in the analysis of definite descriptions concerns the truth-value of sentences where there is no entity that meets the description in the definite. Classical Russellian accounts predict them to be plain false, whereas presuppositional accounts predict them to be infelicitous. Recent discussions have homed in on the factors that affect actual judgment behaviour in relation to the underlying status posited by different accounts. This article presents experimental evidence for a presuppositional view based on response times for judging statements with non-referring definites to be ‘false', which were longer relative to control statements where existence was asserted. I discuss the theoretical implications ofthese results, as well as of other findings from the literature, arguing that they support a presuppositional view of definites that sees the existence presupposition as conventionally encoded. The article also makes a methodological contribution, as systematic evidence on speakers' judgments in these cases turns out to be hard to come by. Finally, the results inform the more general issue of the online processes involved in the interpretation of presupposed, as opposed to asserted, content. |
Mustafa Seckin; M. Marsel Mesulam; Alfred W. Rademaker; Joel L. Voss; Sandra Weintraub; Emily J. Rogalski; Robert S. Hurley Eye movements as probes of lexico-semantic processing in a patient with primary progressive aphasia Journal Article In: Neurocase, vol. 22, no. 1, pp. 65–75, 2016. @article{Seckin2016, Eye movement trajectories during a verbally cued object search task were used as probes of lexico-semantic associations in an anomic patient with primary progressive aphasia. Visual search was normal on trials where the target object could be named but became lengthy and inefficient on trials where the object failed to be named. The abnormality was most profound if the noun denoting the object could not be recognized. Even trials where the name of the target object was recognized but not retrieved triggered abnormal eye movements, demonstrating that retrieval failures can have underlying associative components despite intact comprehension of the corresponding noun. |
Mustafa Seckin; M. Marsel Mesulam; Joel L. Voss; Wei Huang; Emily J. Rogalski; Robert S. Hurley Am I looking at a cat or a dog? Gaze in the semantic variant of primary progressive aphasia is subject to excessive taxonomic capture Journal Article In: Journal of Neurolinguistics, vol. 37, pp. 68–81, 2016. @article{Seckin2016a, Object naming impairments or anomias are the most frequent symptom in aphasia, and can be caused by a variety of underlying neurocognitive mechanisms. Anomia in neurodegenerative or primary progressive aphasias (PPA) often appears to be based on taxonomic blurring of word meaning: words such as "dog" and "cat" are still recognized generically as referring to animals, but are no longer conceptually differentiated from each other, leading to coordinate errors in word-object matching. This blurring is the hallmark symptom of the "semantic variant" of PPA, who invariably show focal atrophy in the left anterior temporal lobe. In this study we used eye tracking to characterize information processing online (in real time) as non-aphasic controls, semantic and non-semantic PPA participants completed a word-to-object matching task. All participants (including controls) showed taxonomic capture of gaze, spending more time viewing foils that were from the same category as the target compared to unrelated foils, but capture was more extreme in the semantic PPA group. The semantic group showed heightened capture even on trials where they ultimately pointed to the correct target, demonstrating the superiority of eye movements over traditional testing methods in detecting subtle processing impairments. Heightened capture was primarily driven by a tendency to direct gaze back and forth, repeatedly, between a set of related foils on each trial, a behavior almost never shown by controls or non-semantic participants. This suggests semantic PPA participants were accumulating and weighing evidence for a probabilistic rather than definitive mapping between the noun and several candidate objects. Neurodegeneration in PPA thus appears to distort lexical concepts prior to extinguishing them altogether, causing uncertainty in recognition and word-object matching. |
Naveed A. Sheikh; Debra Titone The embodiment of emotional words in a second language: An eye-movement study Journal Article In: Cognition and Emotion, vol. 30, no. 3, pp. 488–500, 2016. @article{Sheikh2016, The hypothesis that word representations are emotionally impoverished in a second language (L2) has variable support. However, this hypothesis has only been tested using tasks that present words in isolation or that require laboratory-specific decisions. Here, we recorded eye movements for 34 bilinguals who read sentences in their L2 with no goal other than comprehension, and compared them to 43 first language readers taken from our prior study. Positive words were read more quickly than neutral words in the L2 across first-pass reading time measures. However, this emotional advantage was absent for negative words for the earliest measures. Moreover, negative words but not positive words were influenced by concreteness, frequency and L2 proficiency in a manner similar to neutral words. Taken together, the findings suggest that only negative words are at risk of emotional disembodiment during L2 reading, perhaps because a positivity bias in L2 experiences ensures that positive words are emotionally grounded. |
Wei Shen; Qingqing Qu; Xingshan Li In: Attention, Perception, and Psychophysics, vol. 78, no. 5, pp. 1267–1284, 2016. @article{Shen2016a, In the present study, we investigated whether the activation of semantic information during spoken word recognition can mediate visual attention's deployment to printed Chinese words. We used a visual-world paradigm with printed words, in which participants listened to a spoken target word embedded in a neutral spoken sentence while looking at a visual display of printed words. We examined whether a semantic competitor effect could be observed in the printed-word version of the visual-world paradigm. In Experiment 1, the relationship between the spoken target words and the printed words was manipulated so that they were semantically related (a semantic competitor), phonologically related (a phonological competitor), or unrelated (distractors). We found that the probability of fixations on semantic competitors was significantly higher than that of fixations on the distractors. In Experiment 2, the orthographic similarity between the spoken target words and their semantic competitors was manipulated to further examine whether the semantic competitor effect was modulated by orthographic similarity. We found significant semantic competitor effects regardless of orthographic similarity. Our study not only reveals that semantic information can affect visual attention, it also provides important new insights into the methodology employed to investigate the semantic processing of spoken words during spoken word recognition using the printed-word version of the visual-world paradigm. |
Heather Sheridan; Erik D. Reichle; Eyal M. Reingold Why does removing inter-word spaces produce reading deficits? The role of parafoveal processing Journal Article In: Psychonomic Bulletin & Review, vol. 23, no. 5, pp. 1543–1552, 2016. @article{Sheridan2016, To examine the role of inter-word spaces during reading, we used a gaze-contingent boundary paradigm to manipulate parafoveal preview (i.e., valid vs. invalid preview) in a normal text condition that contained spaces (e.g., "John decided to sell the table") and in an unsegmented text condition that contained random numbers instead of spaces (e.g.,"John4decided8to5sell9the7table"). Preview effects on mean first-fixation durations were larger for normal than unsegmented text conditions, and survival analyses revealed a delay in the onset of both preview validity and word-frequency effects on first-fixation durations for unsegmented relative to normal text. Taken together with simulations that were conducted using the E-Z Reader model, the present findings indicated that unsegmented text deficits reflect disruptions to both parafoveal processing and lexical processing. We discuss the implications of our results for models of eye-movement control. |
Anthony Shook; Viorica Marian The influence of native-language tones on lexical access in the second language Journal Article In: The Journal of the Acoustical Society of America, vol. 139, no. 6, pp. 3102–3109, 2016. @article{Shook2016, When listening to speech in a second language, bilinguals' perception of acoustic-phonetic properties is often influenced by the features that are important in the native language of the bilingual. Furthermore, changes in the perception of segmental contrasts due to L1 experience can influence L2 lexical access during comprehension. The present study investigates whether the effect of L1 experience on L2 processing seen at the segmental level extends to suprasegmental processing. In an eye-tracking task, Mandarin–English bilinguals heard an auditorily presented English word and selected which of two visually presented Chinese characters represented the correct Mandarin translation. The pitch contour of the spoken word was manipulated to either match or mismatch the lexical tone of the Mandarin translation. Results revealed that bilinguals were significantly faster to correctly identify the target and made earlier eye movements to targets when the suprasegmental information of the word spoken in English matched that of its Mandarin translation. The findings provide compelling evidence for bilinguals' sensitivity to suprasegmental tone information, even when listening to a non-tonal language. These results have important implications for the effect of L1 experience on L2 lexical access and language interaction in bilinguals, and are consistent with a highly interactive account of language processing. |
Timothy J. Slattery; Mark Yates; Bernhard Angele Interword and interletter spacing effects during reading revisited: Interactions with word and font characteristics Journal Article In: Journal of Experimental Psychology: Applied, vol. 22, no. 4, pp. 406–422, 2016. @article{Slattery2016, Despite the large number of eye movement studies conducted over the past 30+ years, relatively few have examined the influence that font characteristics have on reading. However, there has been renewed interest in 1 particular font characteristic, letter spacing, which has both theoretical (visual word recognition) and applied (font design) importance. Recently published results that letter spacing has a bigger impact on the reading performance of dyslexic children have perhaps garnered the most attention (Zorzi et al., 2012). Unfortunately, the effects of increased interletter spacing have been mixed with some authors reporting facilitation and others reporting inhibition (van den Boer & Hakvoort, 2015). The authors present findings from 3 experiments designed to resolve the seemingly inconsistent letter-spacing effects and provide clarity to researchers and font designers and researchers. The results indicate that the direction of spacing effects depend on the size of the default spacing chosen by font developers. Experiment 3 found that interletter spacing interacts with interword spacing, as the required space between words depends on the amount of space used between letters. Interword spacing also interacted with word type as the inhibition seen with smaller interword spacing was evident with nouns and verbs but not with function words. |
Manon W. Jones; Margaret J. Snowling; Kristina Moll What automaticity deficit? Activation of lexical information by readers with dyslexia in a rapid automatized naming Stroop-switch task Journal Article In: Journal of Experimental Psychology: Learning, Memory, and Cognition, vol. 42, no. 3, pp. 465–474, 2016. @article{Jones2016, Reading fluency is often predicted by rapid automatized naming (RAN) speed, which as the name implies, measures the automaticity with which familiar stimuli (e.g., letters) can be retrieved and named. Readers with dyslexia are considered to have less "automatized" access to lexical information, reflected in longer RAN times compared with nondyslexic readers. We combined the RAN task with a Stroop-switch manipulation to test the automaticity of dyslexic and nondyslexic readers' lexical access directly within a fluency task. Participants named letters in 10 × 4 arrays while eye movements and speech responses were recorded. Upon fixation, specific letter font colors changed from black to a different color, whereupon the participant was required to rapidly switch from naming the letter to naming the letter color. We could therefore measure reading group differences on "automatic" lexical processing, insofar as it was task-irrelevant. Readers with dyslexia showed obligatory lexical processing and a timeline for recognition that was overall similar to typical readers, but a delay emerged in the output (naming) phase. Further delay was caused by visual-orthographic competition between neighboring stimuli. Our findings outline the specific processes involved when researchers speak of "impaired automaticity" in dyslexic readers' fluency, and are discussed in the context of the broader literature in this field. |
Timothy R. Jordan; Jasmine Dixon; Victoria A. Mcgowan; Stoyan Kurtev; Kevin B. Paterson Fast and slow readers and the effectiveness of the spatial frequency content of text : Evidence from reading times and eye movements Journal Article In: Journal of Experimental Psychology: Human Perception and Performance, vol. 42, no. 8, pp. 1066–1071, 2016. @article{Jordan2016, Text contains a range of different spatial frequencies but the effectiveness of spatial frequencies for normal variations in skilled adult reading ability is unknown. Accordingly, young skilled adult readers showing fast or slow reading ability read sentences displayed as normal or filtered to contain only very low, low, medium, high, or very high spatial frequencies. Reading times and eye movement measures of fixations and saccades assessed the effectiveness of these displays for reading. Reading times showed that, for each reading ability, medium, high, and very high spatial frequencies were all more effective than lower spatial frequencies. Indeed, for each reading ability, reading times for normal text were maintained when text contained only medium, high, or very high spatial frequencies. However, reading times for normal text and for each spatial frequency were all substantially shorter for fast readers than for slow readers, and this advantage for fast readers was similar for normal, medium, high, and very high spatial frequencies but much larger for low and very low spatial frequencies. In addition, fast readers made fewer and shorter fixations, fewer and shorter regressions, and longer forward saccades, than slow readers, and these differences were generally similar in size for normal, medium, high, and very high spatial frequencies, but larger when spatial frequencies were lower. These findings suggest that fast and slow adult readers can each use a range of different spatial frequencies for reading but fast readers make more effective use of these spatial frequencies and especially those that are lower. |
Timothy R. Jordan; Jasmine Dixon; Victoria A. McGowan; Stoyan Kurtev; Kevin B. Paterson Effects of spatial frequencies on word identification by fast and slow readers: Evidence from eye movements Journal Article In: Frontiers in Psychology, vol. 7, pp. 1433, 2016. @article{Jordan2016b, Recent research has shown that differences in the effectiveness of spatial frequencies for fast and slow skilled adult readers may be an important component of differences in reading ability in the skilled adult reading population (Jordan, McGowan, Dixon, Kurtev & Paterson, 2016). But the precise nature of this influence on lexical processing during reading remains to be fully determined. Accordingly, to gain more insight into the use of spatial frequencies by skilled adult readers with fast and slow reading abilities, the present study looked at effects of spatial frequencies on the processing of specific target words in sentences. These target words were of either high or low lexical frequency and each sentence was displayed as normal or filtered to contain only very low, low, medium, high, or very high spatial frequencies. Eye movement behavior for target words was closest to normal for each reading ability when text was shown in medium or higher spatial frequency displays, although reading occurred for all spatial frequencies. Moreover, typical word frequency effects (the processing advantage for words with higher lexical frequencies) were observed for each reading ability across a broad range of spatial frequencies, indicating that many different spatial frequencies provide access to lexical representations during textual reading for both fast and slow skilled adult readers. Crucially, however, target word fixations were fewer and shorter for fast readers than for slow readers for all display types, and this advantage for fast readers appeared to be similar for normal, medium, high and very high spatial frequencies but larger for low and very low spatial frequencies. Therefore, although fast and slow skilled adult readers can both use a broad range of spatial frequencies when reading, fast readers make more effective use of these spatial frequencies, and especially those that are lower, when processing the identities of words. |
Timothy R. Jordan; Victoria A. McGowan; Stoyan Kurtev; Kevin B. Paterson A further look at postview effects in reading: An eye-movements study of influences from the left of fixation Journal Article In: Journal of Experimental Psychology: Learning, Memory, and Cognition, vol. 42, no. 2, pp. 296–307, 2016. @article{Jordan2016a, When reading from left to right, useful information acquired during each fixational pause is widely assumed to extend 14 to 15 characters to the right of fixation but just 3 to 4 characters to the left, and certainly no further than the beginning of the fixated word. However, this leftward extent is strikingly small and seems inconsistent with other aspects of reading performance and with the general horizontal symmetry of visual input. Accordingly, 2 experiments were conducted to examine the influence of text located to the left of fixation during each fixational pause using an eye-tracking paradigm in which invisible boundaries were created in sentence displays. Each boundary corresponded to the leftmost edge of each word so that, as each sentence was read, the normal letter content of text to the left of each fixated word was corrupted by letter replacements that were either visually similar or visually dissimilar to the originals. The proximity of corrupted text to the left of fixation was maintained at 1, 2, 3, or 4 words from the left boundary of each fixated word. In both experiments, relative to completely normal text, reading performance was impaired when each type of letter replacement was up to 2 words to the left of fixated words but letter replacements further from fixation produced no impairment. These findings suggest that key aspects of reading are influenced by information acquired during each fixational pause from much further leftward than is usually assumed. Some of the implications of these findings for reading are discussed. |
Marta Kajzer-Wietrzny; Bogusława Whyatt; Katarzyna Stachowiak Simplification in inter- and intralingual translation – combining corpus linguistics, key logging and eye-tracking Journal Article In: Poznan Studies in Contemporary Linguistics, vol. 52, no. 2, pp. 235–267, 2016. @article{KajzerWietrzny2016, As some scholars view inter- and intralingual translation as a parallel activity, it is vital to establish to what extent the products of these processes are alike, and whether the processes themselves differ. This paper investigates stylistic simplification, a frequently hypothesised translation universal which involves, among others, breaking up long sentences in the process of translation (Laviosa 2002). One of the parameters commonly used in the investigations of simplification in translations is the average sentence length. In the present study we focus on sentence length to see if the tendency to incorporate stylistic simplification is equally present in the products of inter- and intralingual translation; what phases of the translation process are decisive for sentence length; whether the scope of consultation with the source text affects sentence length. Finally, we will try to verify if average sentence length is dependent on the level of translation experience. |
Yuki Kamide; Shane Lindsay; Christoph Scheepers; Anuenue Kukona Event processing in the visual world: Projected motion paths during spoken sentence comprehension Journal Article In: Journal of Experimental Psychology: Learning, Memory, and Cognition, vol. 42, no. 5, pp. 804–812, 2016. @article{Kamide2016, Motion events in language describe the movement of an entity to another location along a path. In 2 eye-tracking experiments, we found that comprehension of motion events involves the online construction of a spatial mental model that integrates language with the visual world. In Experiment 1, participants listened to sentences describing the movement of an agent to a goal while viewing visual scenes depicting the agent, goal, and empty space in between. Crucially, verbs suggested either upward (e.g., jump) or downward (e.g., crawl) paths. We found that in the rare event of fixating the empty space between the agent and goal, visual attention was biased upward or downward in line with the verb. In Experiment 2, visual scenes depicted a central obstruction, which imposed further constraints on the paths and increased the likelihood of fixating the empty space between the agent and goal. The results from this experiment corroborated and refined the previous findings. Specifically, eye-movement effects started immediately after hearing the verb and were in line with data from an additional mouse-tracking task that encouraged a more explicit spatial reenactment of the motion event. In revealing how event comprehension operates in the visual world, these findings suggest a mental simulation process whereby spatial details of motion events are mapped onto the world through visual attention. The strength and detectability of such effects in overt eye-movements is constrained by the visual world and the fact that perceivers rarely fixate regions of empty space. |
Efthymia C. Kapnoula; Bob McMurray Training alters the resolution of lexical interference: Evidence for plasticity of competition and inhibition Journal Article In: Journal of Experimental Psychology: General, vol. 145, no. 1, pp. 8–30, 2016. @article{Kapnoula2016, Language learning is generally described as a problem of acquiring new information (e.g., new words). However, equally important are changes in how the system processes known information. For example, a wealth of studies has suggested dramatic changes over development in how efficiently children recognize familiar words, but it is unknown what kind of experience-dependent mechanisms of plasticity give rise to such changes in real-time processing. We examined the plasticity of the language processing system by testing whether a fundamental aspect of spoken word recognition, lexical interference, can be altered by experience. Adult participants were trained on a set of familiar words over a series of 4 tasks. In the high-competition (HC) condition, tasks were designed to encourage coactivation of similar words (e.g., net and neck) and to require listeners to resolve this competition. Tasks were similar in the low-competition (LC) condition, but did not enhance this competition. Immediately after training, interlexical interference was tested using a visual world paradigm task. Participants in the HC group resolved interference to a fuller degree than those in the LC group, demonstrating that experience can shape the way competition between words is resolved. TRACE simulations showed that the observed late differences in the pattern of interference resolution can be attributed to differences in the strength of lexical inhibition. These findings inform cognitive models in many domains that involve competition/interference processes, and suggest an experience-dependent mechanism of plasticity that may underlie longer term changes in processing efficiency associated with both typical and atypical development. |
Hossein Karimi; Fernanda Ferreira Informativity renders a referent more accessible: Evidence from eyetracking Journal Article In: Psychonomic Bulletin & Review, vol. 23, no. 2, pp. 507–525, 2016. @article{Karimi2016, The amount of information attached to a noun phrase (henceforth, NP) has been shown to enhance accessibility and increase pronominal reference in language production. However, both the effect of information quantity on the comprehension of ambiguous pronouns and the time course of any informativity effect have been left unexplored. In two eyetracking experiments, we investigated how additional information on the part of NP referents influenced the resolution of following ambiguous pronouns. The results of the first experiment revealed an informativity effect, with more looks to the informationally richer referent than to the competitor. However, the effect of additional information emerged late in time when the referent was the object of the verb. The second experiment replicated the results of the first and also showed that, consistent with the online results, an ambiguous pronoun is interpreted as referring to the informationally richer NP in an offline, explicit pronoun resolution tas k. The results lend support to theories of language processing that assume that explicit information increases the accessibility of the associated concept, in contrast to approaches that assume that accessibility is associated with givenness. |
Benjawan Kasisopa; Ronan G. Reilly; Sudaporn Luksaneeyanawin; Denis Burnham Child readers' eye movements in reading Thai Journal Article In: Vision Research, vol. 123, pp. 8–19, 2016. @article{Kasisopa2016, It has recently been found that adult native readers of Thai, an alphabetic scriptio continua language, engage similar oculomotor patterns as readers of languages written with spaces between words; despite the lack of inter-word spaces, first and last characters of a word appear to guide optimal placement of Thai readers' eye movements, just to the left of word-centre. The issue addressed by the research described here is whether eye movements of Thai children also show these oculomotor patterns. Here the effect of first and last character frequency and word frequency on the eye movements of 18 Thai children when silently reading normal unspaced and spaced text was investigated. Linear mixed-effects model analyses of viewing time measures (first fixation duration, single fixation duration, and gaze duration) and of landing site location revealed that Thai children's eye movement patterns were similar to their adult counterparts. Both first character frequency and word frequency played important roles in Thai children's landing sites; children tended to land their eyes further into words, close to the word centre, if the word began with higher frequency first characters, and this effect was facilitated in higher frequency words. Spacing also facilitated more effective use of first character frequency and it also assisted in decreasing children's viewing time. The use of last-character frequency appeared to be a later development, affecting mainly single fixation duration and gaze duration. In general, Thai children use the same oculomotor control mechanisms in reading spaced and unspaced texts as Thai adults, who in turn have similar oculomotor control as readers of spaced texts. Thus, it appears that eye movements in reading converge on the optimal landing site using whatever cues are available to guide such placement. |
Jason J. Ki; Simon P. Kelly; Lucas C. Parra Attention strongly modulates reliability of neural responses to naturalistic narrative stimuli Journal Article In: Journal of Neuroscience, vol. 36, no. 10, pp. 3092–3101, 2016. @article{Ki2016, Attentional engagement is a major determinant of how effectively we gather information through our senses. Alongside the sheer growth in the amount and variety of information content that we are presented with through modern media, there is increased variability in the degree to which we "absorb" that information. Traditional research on attention has illuminated the basic principles of sensory selection to isolated features or locations, but it provides little insight into the neural underpinnings of our attentional engagement with modern naturalistic content. Here, we show in human subjects that the reliability of an individual's neural responses with respect to a larger group provides a highly robust index of the level of attentional engagement with a naturalistic narrative stimulus. Specifically, fast electroencephalographic evoked responses were more strongly correlated across subjects when naturally attending to auditory or audiovisual narratives than when attention was directed inward to a mental arithmetic task during stimulus presentation. This effect was strongest for audiovisual stimuli with a cohesive narrative and greatly reduced for speech stimuli lacking meaning. For compelling audiovisual narratives, the effect is remarkably strong, allowing perfect discrimination between attentional state across individuals. Control experiments rule out possible confounds related to altered eye movement trajectories or order of presentation. We conclude that reliability of evoked activity reproduced across subjects viewing the same movie is highly sensitive to the attentional state of the viewer and listener, which is aided by a cohesive narrative. |
Esther S. Kim; Shannon F. Lemke Behavioural and eye-movement outcomes in response to text-based reading treatment for acquired alexia Journal Article In: Neuropsychological Rehabilitation, vol. 26, no. 1, pp. 60–86, 2016. @article{Kim2016, Text-based reading treatments, such as Multiple Oral Rereading (MOR) and Oral Reading for Language in Aphasia (ORLA) have been used successfully to remediate reading impairments in individuals with acquired alexia, but the mechanisms underlying such improvements are not well understood. In this study, an individual with acquired alexia who demonstrated reliance on a sub-lexical reading strategy (i.e., presence of spelling regularity effect and phonologically plausible errors) underwent 12 weeks of text-based reading treatment combining MOR and ORLA procedures. Behavioural assessments of single-word and text reading, along with eye-tracking assessments were conducted pre-treatment, post-treatment and at 5 month follow-up. Improved reading fluency (rate, accuracy) was observed for both trained and untrained passages. Evidence from behavioural and eye-tracking assessment suggested text-based reading treatment facilitated use of a lexical-semantic reading strategy. Increased frequency and lexicality effects, as well as a shift in initial landing position towards the centre of the word (the "optimal viewing position") were observed at post-treatment and follow-up assessments. These results demonstrate the potential utility of using eye movements as a parameter of interest in addition to traditional behavioural outcomes when investigating response to reading treatment. |
John Kingston; Joshua Levy; Amanda Rysling; Adrian Staub Eye movement evidence for an immediate Ganong effect Journal Article In: Journal of Experimental Psychology: Human Perception and Performance, vol. 42, no. 12, pp. 1969–1988, 2016. @article{Kingston2016, Listeners tend to categorize an ambiguous speech sound so that it forms a word with its context (Ganong, 1980). This effect could reflect feedback from the lexicon to phonemic activation (McClelland & Elman, 1986), or the operation of a task-specific phonemic decision system (Norris, McQueen, & Cutler, 2000). Because the former account involves feedback between lexical and phonemic levels, it predicts that the lexicon's influence on phonemic decisions should be delayed and should gradually increase in strength. Previous response time experiments have not delivered a clear verdict as to whether this is the case, however. In 2 experiments, listeners' eye movements were tracked as they categorized phonemes using visually displayed response options. Lexically relevant information in the signal, the timing of which was confirmed by separate gating experiments, immediately increased eye movements toward the lexically supported response. This effect on eye movements then diminished over the course of the trial rather than continuing to increase. These results challenge the lexical feedback account. The present work also introduces a novel method for analyzing data from ‘visual-world' type tasks, designed to assess when an experimental manipulation influences the probability of an eye movement toward the target. |
Xaver Koch; Esther Janse Speech rate effects on the processing of conversational speech across the adult life span Journal Article In: The Journal of the Acoustical Society of America, vol. 139, no. 4, pp. 1618–1636, 2016. @article{Koch2016, This study investigates the effect of speech r ate on spoken word recognition across the adult life span. Contrary to previous studies, convers ational materials with a natural variation in speech rate were used rather than lab-recorded stimuli that are subseque ntly artificially time-compressed. It was investigated whether older adults' speech recognition is more adversely affected by increased speech rate compared to younger and middle-aged adults, and which individual listener characteristics (e.g., hearing, fluid cognitive processi ng ability) predict the size of the speech rate effect on recognition performance. In an eye-trac king experiment, par-ticipants indicated with a mous e-click which visually presented words they recognized in a conversational fragment. Click response times , gaze, and pupil size data were analyzed. As expected, click response times and gaze behavi or were affected by speech rate, indicating that word recognition is more difficult if speec h rate is faster. Contrary to earlier findings, increased speech rate affecte d the age groups to the same extent. Fluid cognitive processing ability predicted general re cognition performance, but did not modulate the speech rate effect. These findings emphasize that earlier results of age by speech rate interactions mainly obtained with artificially speeded materials ma y not generalize to speech rate variation as encountered in conversational speech. |
Arnout W. Koornneef; Jakub Dotlačil; Paul W. Broek; Ted J. M. Sanders The influence of linguistic and cognitive factors on the time course of verb-based implicit causality Journal Article In: Quarterly Journal of Experimental Psychology, vol. 69, no. 3, pp. 455–481, 2016. @article{Koornneef2016, In three eye-tracking experiments the influence of the Dutch causal connective "want" (because) and the working memory capacity of readers on the usage of verb-based implicit causality was examined. Experiments 1 and 2 showed that although a causal connective is not required to activate implicit causality information during reading, effects of implicit causality surfaced more rapidly and were more pronounced when a connective was present in the discourse than when it was absent. In addition, Experiment 3 revealed that-in contrast to previous claims-the activation of implicit causality is not a resource-consuming mental operation. Moreover, readers with higher and lower working memory capacities behaved differently in a dual-task situation. Higher span readers were more likely to use implicit causality when they had all their working memory resources at their disposal. Lower span readers showed the opposite pattern as they were more likely to use the implicit causality cue in the case of an additional working memory load. The results emphasize that both linguistic and cognitive factors mediate the impact of implicit causality on text comprehension. The implications of these results are discussed in terms of the ongoing controversies in the literature-that is, the focusing-integration debate and the debates on the source of implicit causality. |
Nina S. Hsu; Jared M. Novick Dynamic engagement of cognitive control modulates recovery from misinterpretation during real-time language processing Journal Article In: Psychological Science, vol. 27, no. 4, pp. 572–582, 2016. @article{Hsu2016, Speech unfolds swiftly, yet listeners keep pace by rapidly assigning meaning to what they hear. Sometimes, though, initial interpretations turn out to be wrong. How do listeners revise misinterpretations of language input moment by moment to avoid comprehension errors? Cognitive control may play a role by detecting when processing has gone awry and then initiating behavioral adjustments accordingly. However, no research to date has investigated a cause-and-effect interplay between cognitive-control engagement and the overriding of erroneous interpretations in real time. Using a novel cross-task paradigm, we showed that Stroop-conflict detection, which mobilizes cognitive-control procedures, subsequently facilitates listeners' incremental processing of temporarily ambiguous spoken instructions that induce brief misinterpretation. When instructions followed incongruent Stroop items, compared with congruent Stroop items, listeners' eye movements to objects in a scene reflected more transient consideration of the false interpretation and earlier recovery of the correct one. Comprehension errors also decreased. Cognitive-control engagement therefore accelerates sentence-reinterpretation processes, even as linguistic input is still unfolding. |
Yi Ting Huang; Alison R. Arnold Word learning in linguistic context: Processing and memory effects Journal Article In: Cognition, vol. 156, pp. 71–87, 2016. @article{Huang2016, During language acquisition, children exploit syntactic cues within sentences to learn the meanings of words. Yet, it remains unknown how this strategy develops alongside an ability to access cues during real-time language comprehension. This study investigates how on-line sensitivity to syntactic cues impacts off-line interpretation and recall of word meanings. Adults and 5-year-olds heard novel words embedded in sentences that were (1) consistent with an agent-first bias (e.g., “The blicket will be eating the seal” → “the blicket” is an agent), (2) required revision of this bias (e.g., “The blicket will be eaten by the seal” → “the blicket” is a theme), or (3) weakened this bias through a familiar NP1 (e.g., “The seal will be eating/eaten by the blicket” → “the seal” is an agent or theme). Across both ages, eye-movements during sentences revealed decreased sensitivity to syntactic cues in contexts that required syntactic revision. In children, the magnitude of on-line sensitivity was positively associated with the accuracy of learning after the sentence. Parsing challenges during the word-learning task also negatively impacted children's later memory for word meanings during a recall task. Altogether, these results suggest that real-time demands impact word learning, through interpretive failures and memory interference. |
Falk Huettig; Esther Janse Individual differences in working memory and processing speed predict anticipatory spoken language processing in the visual world Journal Article In: Language, Cognition and Neuroscience, vol. 31, no. 1, pp. 80–93, 2016. @article{Huettig2016, Several mechanisms of predictive language processing have been proposed. The possible influence of mediating factors such as working memory and processing speed, however, has largely been ignored. We sought to find evidence for such an influence using an individual differences approach. 105 participants from 32–77 years of age received spoken instructions (e.g. “Kijk naar deCOM afgebeelde pianoCOM”– look at the displayed piano) while viewing 4 objects. Articles (Dutch “het” or “de”) were gender-marked such that the article agreed in gender only with the target. Participants could thus use article gender information to predict the target. Multiple regression analyses showed that enhanced working memory abilities and faster processing speed predicted anticipatory eye movements. Models of predictive language processing therefore must take mediating factors into account. More generally, our results are consistent with the notion that working memory grounds language in space and time, linking linguistic and visual–spatial representations. |
Jukka Hyönä; Miia Ekholm Background speech effects on sentence processing during reading: An eye movement study Journal Article In: PLoS ONE, vol. 11, no. 3, pp. e0152133, 2016. @article{Hyoenae2016, Effects of background speech on reading were examined by playing aloud different types of background speech, while participants read long, syntactically complex and less complex sentences embedded in text. Readers' eye movement patterns were used to study online sentence comprehension. Effects of background speech were primarily seen in rereading time. In Experiment 1, foreign-language background speech did not disrupt sentence pro- cessing. Experiment 2 demonstrated robust disruption in reading as a result of semantically and syntactically anomalous scrambled background speech preserving normal sentence- like intonation. Scrambled speech that was constructed from the text to-be read did not dis- rupt reading more than scrambled speech constructed from a different, semantically unre- lated text. Experiment 3 showed that scrambled speech exacerbated the syntactic complexity effect more than coherent background speech, which also interfered with read- ing. Experiment 4 demonstrated that both semantically and syntactically anomalous speech produced no more disruption in reading than semantically anomalous but syntactically cor- rect background speech. The pattern of results is best explained by a semantic account that stresses the importance of similarity in semantic processing, but not similarity in semantic content, between the reading task and background speech. Introduction |
Gunnar Jacob; Claudia Felser Reanalysis and semantic persistence in native and non-native garden-path recovery Journal Article In: Quarterly Journal of Experimental Psychology, vol. 69, no. 5, pp. 907–925, 2016. @article{Jacob2016, We report the results from an eye-movement monitoring study investigating how native and non-native speakers of English process temporarily ambiguous sentences such as While the gentleman was eating the burgers were still being reheated in the microwave, in which an initially plausible direct-object analysis is first ruled out by a syntactic disambiguation (were) and also later on by semantic information (being reheated). Both participant groups showed garden-path effects at the syntactic disambiguation, with native speakers showing significantly stronger effects of ambiguity than non-native speakers in later eye-movement measures but equally strong effects in first-pass reading times. Ambiguity effects at the semantic disambiguation and in participants' end-of-trial responses revealed that for both participant groups, the incorrect direct-object analysis was frequently maintained beyond the syntactic disambiguation. The non-native group showed weaker reanalysis effects at the syntactic disambiguation and was more likely to misinterpret the experimental sentences than the native group. Our results suggest that native language (L1) and non-native language (L2) parsing are similar with regard to sensitivity to syntactic and semantic error signals, but different with regard to processes of reanalysis. |
Debra Jared; Jane Ashby; Stephen J. Agauas; Betty Ann Levy Phonological activation of word meanings in grade 5 readers Journal Article In: Journal of Experimental Psychology: Learning, Memory, and Cognition, vol. 42, no. 4, pp. 524–541, 2016. @article{Jared2016, Three experiments examined the role of phonology in the activation of word meanings in Grade 5 students. In Experiment 1, homophone and spelling control errors were embedded in a story context and participants performed a proofreading task as they read for meaning. For both good and poor readers, more homophone errors went undetected than spelling control errors. In Experiments 2 and 3, homophone and spelling control errors were in sentence contexts. Experiment 2 used an online sentence verification task, and found that both good and poor readers were less accurate when sentences contained a homophone error than a spelling control error. Furthermore, a difference between the 2 types of sentences was observed even when participants were concurrently performing an articulation task. In Experiment 3, initial reading times were shorter on homophone errors than on spelling controls, and participants were less likely to make a regression from homophone errors than spelling controls. These experiments provide clear evidence that phonology makes an important contribution to the activation of word meanings in Grade 5 readers. |
Yu-Cin Jian Fourth graders' cognitive processes and learning strategies for reading illustrated biology texts: Eye movement measurements Journal Article In: Reading Research Quarterly, vol. 51, no. 1, pp. 93–109, 2016. @article{Jian2016, Previous research suggests that multiple representations can improve sci- ence reading comprehension. This facilitation effect is premised on the observation that readers can efficiently integrate information in text and diagram formats; however, this effect in young readers is still contested. Using eye- tracking technology and sequential analysis, this study investi- gated students' reading strategies and comprehension of illustrated biology texts in relation to adult readers' performance. The target population was fourth- grade students with high reading ability, and the control group was university students. All participants read a biology article from an elemen- tary school science textbook containing two illustrations, one representa- tional and one decorative. After the reading task, participants answered questions on recognition, textual, and illustration items. Unsurprisingly, the university students outperformed the younger students on all tests; how- ever, more interestingly, eye movement patterns differed across the two groups. The adult readers demonstrated bidirectional reading pathways for both text and illustrations, whereas the fourth graders' eye fixations only went back and forth within paragraphs in the text and between the illustrations, but made fewer references to both text and illustration. This suggests that regardless of their high reading ability, fourth-grade students' visual literacy is not mature enough to perceive connections between corresponding features of different representations crucial to reading comprehension. Despite differences in cognitive processes between adult readers and young readers, high-ability young readers still have certain capabilities in reading comprehension. The results of sequential analysis showed that they looked back to previous paragraphs frequently, indicating that they were monitoring their comprehension. |
Anne Pycha; Delphine Dahan Differences in coda voicing trigger changes in gestural timing: A test case from the American English diphthong /aI/ Journal Article In: Journal of Phonetics, vol. 56, pp. 15–37, 2016. @article{Pycha2016, We investigate the hypothesis that duration and spectral differences in vowels before voiceless versus voiced codas originate from a single source, namely the reorganization of articulatory gestures relative to one another in time. As a test case, we examine the American English diphthong /aI/, in which the acoustic manifestations of the nucleus /a/ and offglide /I/ gestures are relatively easy to identify, and we use the ratio of nucleus-to-offglide duration as an index of the temporal distance between these gestures. Experiment 1 demonstrates that, in production, the ratio is smaller before voiceless codas than before voiced codas; this effect is consistent across speakers as well as changes in speech rate and phrasal position. Experiment 2 demonstrates that, in perception, diphthongs with contextually incongruent ratios delay listeners' identification of target words containing voiceless codas, even when the other durational and spectral correlates of voicing remain intact. This, we argue, is evidence that listeners are sensitive to the gestural origins of voicing differences. Both sets of results support the idea that the voicing contrast triggers changes in timing: gestures are close to one another in time before voiceless codas, but separated from one another before voiced codas. |
Chen Qingrong; Gu Wentao; Christoph Scheepers Effects of text segmentation on silent reading of Chinese regulated poems: Evidence from eye movements Journal Article In: Journal of Chinese Linguistics, vol. 44, no. 2, pp. 265–286, 2016. @article{Qingrong2016, Interword spaces have been reported to play an important role in silent reading of alphabetic languages. However, it has not yet been clear whether text spacing/segmentation facilitates the cognitive process in silent reading of Chinese, a logographic language, especially in reading Chinese regulated poems which have predefined rhythmic structures. An eye-tracking experiment was conducted to monitor eye movements of native participants in reading Chinese regulated poems in four segmenting conditions: normal text, character segmentation, rhythmic segmentation, and syntactic segmentation. By comparing a set of measures of eye movements, both global and local analyses showed that syntactic segmentation boosted reading efficiency, while rhythmic segmentation did not. The findings demonstrate that not rhythmic but syntactic structure plays major roles in the cognitive process in reading Chinese regulated poems, suggesting an intrinsic difference in the information structure between spoken and written languages. |
Anne K. Rau; Kristina Moll; Korbinian Moeller; Stefan Huber; Margaret J. Snowling; Karin Landerl Same same, but different: Word and sentence reading in German and English Journal Article In: Scientific Studies of Reading, vol. 20, no. 3, pp. 203–219, 2016. @article{Rau2016, The current study compared eye fixation patterns during word and sentence processing in a consistent and an inconsistent alphabetic orthography. German and English children as well as adults matched on word reading ability read matched sentences while their eye fixation behavior was recorded. Results indicated that German children read in a more small-unit plodder-like style with more diligent first-pass reading and less rereading. In contrast, English children read in a more large-unit explorer-like style with a greater tendency to skip words, and more regressions. It is important that these cross-linguistic processing differences largely persisted in the adult readers. Orthographic consistency thus influences both local word recognition and global sentence processing in developing and skilled readers. |
Eyal M. Reingold; Heather Sheridan; Katie L. Meadmore; Denis Drieghe; Simon P. Liversedge Attention and eye-movement control in reading: The selective reading paradigm Journal Article In: Journal of Experimental Psychology: Human Perception and Performance, vol. 42, no. 12, pp. 2003–2020, 2016. @article{Reingold2016, We introduced a novel paradigm for investigating covert attention and eye-movement control in reading. In 2 experiments, participants read sentence words (shown in blue color) while ignoring interleaved distractor strings (shown in orange color). Each single-line text display contained a target word and a critical distractor. Critical distractors were located just prior to the target in the text and were either words or symbol strings (e.g., @#%&). Target word availability for parafoveal processing (i.e., preview validity) was also manipulated. The results indicated much shallower processing of distractors than targets, and this pattern was more pronounced for symbol than word distractors. The influences of word frequency and fixation location on first-pass fixation durations on distractors were dramatically different than the well-documented pattern obtained in normal reading. Robust preview benefits were demon- strated both when the critical distractors were fixated and when the critical distractors were skipped. Finally, with the exception of larger preview benefits that were obtained in the condition in which the target and critical distractor were identical, the magnitude of the preview effect was largely unaffected by the nature of the critical distractor. Implications of the present paradigm and findings to the study of eye-movement control in reading are discussed. |
Annie Roy-Charland; Melanie Perron; Krystle-Lee Turgeon; Nichola Hoffman; Justin A. Chamberland The link between text difficulty, reading speed and exploration of printed text during shared book reading Journal Article In: Reading and Writing, vol. 29, no. 4, pp. 731–743, 2016. @article{RoyCharland2016, In the current study the reading speed of the narration and the difficulty of the text was manipulated and links were explored with children's attention to the printed text in shared book reading. Thirty-nine children (24 grade 1 and 15 grade 2) were presented easy and difficult books at slow (syllable by syllable) or fast (adult reading speed) pace while their eye movements were monitored. Results revealed an interaction between speed and difficulty. For the easy and difficult books, children spent more time and made more fixations on the printed text when it was presented at slow speed than at fast speed. However, at fast speed, children spend more time and made more fixations on the text of the easy rather than the difficult books, but at slow speed no difference was observed. In addition, at slow speed positive correlations were observed between attention to print and letter knowledge and word reading skills. Results provide important information for the practice of shared book reading suggesting that to increase attention to print, speed should be reduced. Future research should investigate the role of reading speed on reading related outcomes such as discourse comprehension and children's interest in reading activities. |
Cristina Rubino; Sherryse L. Corrow; Jeffrey C. Corrow; Brad Duchaine; Jason J. S. Barton Word and text processing in developmental prosopagnosia Journal Article In: Cognitive Neuropsychology, vol. 33, no. 5-6, pp. 315–328, 2016. @article{Rubino2016a, The many-to-many hypothesis proposes that visual object processing is supported by distributed circuits that overlap for different object categories. For faces and words the hypothesis posits that both posterior fusiform regions contribute to both face and visual word perception and predicts that unilateral lesions impairing one will affect the other. However, studies testing this hypothesis have produced mixed results. We evaluated visual word processing in subjects with developmental prosopagnosia, a condition linked to right posterior fusiform abnormalities. Ten developmental prosopagnosic subjects performed a word-length effect task and a task evaluating the recognition of word content across variations in text style, and the recognition of style across variations in word content. All subjects had normal word-length effects. One had prolonged sorting time for word recognition in handwritten stimuli. These results suggest that the deficit in developmental prosopagnosia is unlikely to affect visual word processing, contrary to predictions of the many-to-many hypothesis. |
Paula Rubio-Fernández; Chris Cummins; Ye Tian Are single and extended metaphors processed differently? A test of two Relevance-Theoretic accounts Journal Article In: Journal of Pragmatics, vol. 94, pp. 15–28, 2016. @article{RubioFernandez2016, Carston (2010) proposes that metaphors can be processed via two different routes. In line with the standard Relevance-Theoretic account of loose use, single metaphors are interpreted by a local pragmatic process of meaning adjustment, resulting in the construction of an ad hoc concept. In extended metaphorical passages, by contrast, the reader switches to a second processing mode because the various semantic associates in the passage are mutually reinforcing, which makes the literal meaning highly activated relative to possible meaning adjustments. In the second processing mode the literal meaning of the whole passage is metarepresented and entertained as an 'imaginary world' and the intended figurative implications are derived later in processing. The results of three experiments comparing the interpretation of the same target expressions across literal, single-metaphorical and extended-metaphorical contexts, using self-paced reading (Experiment 1), eye-tracking during natural reading (Experiment 2) and cued recall (Experiment 3), offered initial support to Carston's distinction between the processing of single and extended metaphors. We end with a comparison between extended metaphors and allegories, and make a call for further theoretical and experimental work to increase our understanding of the similarities and differences between the interpretation and processing of different figurative uses, single and extended. |
Rachel A. Ryskin; Ranxiao Frances Wang; Sarah Brown-Schmidt Listeners use speaker identity to access representations of spatial perspective during online language comprehension Journal Article In: Cognition, vol. 147, pp. 75–84, 2016. @article{Ryskin2016, Little is known about how listeners represent another person's spatial perspective during language processing (e.g., two people looking at a map from different angles). Can listeners use contextual cues such as speaker identity to access a representation of the interlocutor's spatial perspective? In two eye-tracking experiments, participants received auditory instructions to move objects around a screen from two randomly alternating spatial perspectives (45° vs. 315° or 135° vs. 225° rotations from the participant's viewpoint). Instructions were spoken either by one voice, where the speaker's perspective switched at random, or by two voices, where each speaker maintained one perspective. Analysis of participant eye-gaze showed that interpretation of the instructions improved when each viewpoint was associated with a different voice. These findings demonstrate that listeners can learn mappings between individual talkers and viewpoints, and use these mappings to guide online language processing. |
Molood S. Safavi; Samar Husain; Shravan Vasishth In: Frontiers in Psychology, vol. 7, pp. 403, 2016. @article{Safavi2016, Delaying the appearance of a verb in a noun-verb dependency tends to increase processing difficulty at the verb; one explanation for this locality effect is decay and/or interference of the noun in working memory. Surprisal, an expectation-based account, predicts that delaying the appearance of a verb either renders it no more predictable or more predictable, leading respectively to a prediction of no effect of distance or a facilitation. Recently, Husain et al (2014) suggested that when the exact identity of the upcoming verb is predictable (strong predictability), increasing argument-verb distance leads to facilitation effects, which is consistent with surprisal; but when the exact identity of the upcoming verb is not predictable (weak predictability), locality effects are seen. We investigated Husain et al.'s proposal using Persian complex predicates (CPs), which consist of a non-verbal element—a noun in the current study—and a verb. In CPs, once the noun has been read, the exact identity of the verb is highly predictable (strong predictability); this was confirmed using a sentence completion study. In two self-paced reading (SPR) and two eye-tracking (ET) experiments, we delayed the appearance of the verb by interposing a relative clause (Expt. 1 and 3) or a long PP (Expt. 2 and 4). We also included a simple Noun-Verb predicate configuration with the same distance manipulation; here, the exact identity of the verb was not predictable (weak predictability). Thus, the design crossed Predictability Strength and Distance. We found that, consistent with surprisal, the verb in the strong predictability conditions was read faster than in the weak predictability conditions. Furthermore, greater verb-argument distance led to slower reading times; strong predictability did not neutralize or attenuate the locality effects. As regards the effect of distance on dependency resolution difficulty, these four experiments present evidence in favor of working memory accounts of argument-verb dependency resolution, and against the surprisal-based expectation account of Levy (2008). However, another expectation-based measure, entropy, which was computed using the offline sentence completion data, predicts reading times in Experiment 1. We suggest that forgetting due to memory overload leads to greater entropy at the verb. |
Anuenue Kukona; David Braze; Clinton L. Johns; W. Einar Mencl; Julie A. Van Dyke; James S. Magnuson; Kenneth R. Pugh; Donald P. Shankweiler; Whitney Tabor The real-time prediction and inhibition of linguistic outcomes: Effects of language and literacy skill Journal Article In: Acta Psychologica, vol. 171, pp. 72–84, 2016. @article{Kukona2016, Recent studies have found considerable individual variation in language comprehenders' predictive behaviors, as revealed by their anticipatory eye movements during language comprehension. The current study investigated the relationship between these predictive behaviors and the language and literacy skills of a diverse, community-based sample of young adults. We found that rapid automatized naming (RAN) was a key determinant of comprehenders' prediction ability (e.g., as reflected in predictive eye movements to a WHITE CAKE on hearing “The boy will eat the white…”). Simultaneously, comprehension-based measures predicted participants' ability to inhibit eye movements to objects that shared features with predictable referents but were implausible completions (e.g., as reflected in eye movements to a white but inedible WHITE CAR). These findings suggest that the excitatory and inhibitory mechanisms that support prediction during language processing are closely linked with specific cognitive abilities that support literacy. We show that a self-organizing cognitive architecture captures this pattern of results. |
Nayoung Kwon; Patrick Sturt Processing control information in a nominal control construction: An eye-tracking study Journal Article In: Journal of Psycholinguistic Research, vol. 45, no. 4, pp. 779–793, 2016. @article{Kwon2016, In an eye-tracking experiment, we examined the processing of the nominal control construction. Participants' eye-movements were monitored while they read sentences that included either giver control nominals (e.g. promise in Luke's promise to Sophia to photograph himself) or recipient control nominals (e.g. plea in Luke's plea to Sophia to photograph herself). In order to examine both the initial access of control information, and its later use in on-line processing, we combined a manipulation of nominal control with a gender match/mismatch paradigm. Results showed that there was evidence of processing difficulty for giver control sentences (relative to recipient control sentences) at the point where the control dependency was initially created, suggesting that control information was accessed during the early parsing stages. This effect is attributed to a recency preference in the formation of control dependencies; the parser prefers to assign a recent antecedent to PRO. In addition, readers slowed down after reading a reflexive pronoun that mismatched with the gender of the antecedent indicated by the control nominal (e.g. Luke's promise to Sophia to photograph herself). The mismatch cost suggests that control information of the nominal control construction was used to constrain dependency formation involving a controller, PRO and a reflexive, confirming the use of control information in on-line interpretation. |
Nayoung Kwon; Patrick Sturt Attraction effects in honorific agreement in Korean Journal Article In: Frontiers in Psychology, vol. 7, pp. 1302, 2016. @article{Kwon2016a, Previous studies have suggested that sentence processing is mediated by content-addressable direct retrieval processes (McElree, 2000; McElree et al., 2003). However, the memory retrieval processes may differ as a function of the type of dependency. For example, while many studies have reported facilitatory intrusion effects associated with a structurally illicit antecedent during the processing of subject-verb number or person agreement and negative polarity items (Pearlmutter et al., 1999; Xiang et al., 2009; Dillon et al., 2013), studies investigating reflexives have not found consistent evidence of intrusion effects (Parker et al., 2015; Sturt and Kwon, 2015; cf. Nicol and Swinney, 1989; Sturt, 2003). Similarly, the memory retrieval processes could be also sensitive to cross-linguistic differences (cf. Lago et al., 2015). We report one self-paced reading experiment and one eye-tracking experiment that examine the processing of subject-verb honorific agreement, a dependency that is different from those that have been studied to date, in Korean, a typologically different language from those previously studied. The overall results suggest that the retrieval processes underlying the processing of subject-verb honorific agreement in Korean are susceptible to facilitatory intrusion effects from a structurally illicit but feature-matching subject, with a pattern that is similar to subject-verb agreement in English. In addition, the attraction effect was not limited to the ungrammatical sentences but was also found in grammatical sentences. The clear attraction effect in the grammatical sentences suggest that the attraction effect does not solely arise as the result of an error-driven process (cf. Wagers et al., 2009), but is likely also to result from general mechanisms of retrieval processes of activating of potential items in memory (Vasishth et al., 2008). |
Christelle Lemoine-Lardennois; Nadia Alahyane; Coline Tailhefer; Thérèse Collins; Jacqueline Fagard; Karine Doré-Mazars Saccadic adaptation in 10–41 month-old children Journal Article In: Frontiers in Human Neuroscience, vol. 10, pp. 241, 2016. @article{LemoineLardennois2016, When saccade amplitude becomes systematically inaccurate, adaptation mechanisms gradually decrease or increase it until accurate saccade targeting is recovered. Adaptive shortening and adaptive lengthening of saccade amplitude rely on separate mechanisms in adults. When these adaptation mechanisms emerge during development is poorly known except that adaptive shortening processes are functional in children above 8 years of age. Yet, saccades in infants are consistently inaccurate (hypometric) as if adaptation mechanisms were not fully functional in early childhood. Here, we tested reactive saccade adaptation in 10–41 month-old children compared to a group of 20–30 year-old adults. A visual target representing a cartoon character appeared at successive and unpredictable locations 10◦ apart on a computer screen. During the eye movement toward the target, it systematically stepped in the direction opposite to the saccade to induce an adaptive shortening of saccade amplitude (Experiment 1). In Experiment 2, the target stepped in the same direction as the ongoing saccade to induce an adaptive lengthening of saccade amplitude. In both backward and forward adaptation experiments, saccade adaptation was compared to a control condition where there was no intrasaccadic target step. Analysis of baseline performance revealed both longer saccade reaction times and hypometric saccades in children compared to adults. In both experiments, children on average showed gradual changes in saccade amplitude consistent with the systematic intrasaccadic target steps. Moreover, the amount of amplitude change was similar between children and adults for both backward and forward adaptation. Finally, adaptation abilities in our child group were not related to age. Overall the results suggest that the neural mechanisms underlying reactive saccade adaptation are in place early during development. |
Arielle Borovsky; Erica M. Ellis; Julia L. Evans; Jeffrey L. Elman Semantic structure in vocabulary knowledge interacts with lexical and sentence processing in infancy Journal Article In: Child Development, vol. 87, no. 6, pp. 1893–1908, 2016. @article{Borovsky2016, Although the size of a child's vocabulary associates with language-processing skills, little is understoodregarding how this relation emerges. This investigation asks whether and how the structure of vocabularyknowledge affects language processing in English-learning 24-month-old children (N = 32; 18 F, 14 M). Paren-tal vocabulary report was used to calculate semantic density in several early-acquired semantic categories.Performance on two language-processing tasks (lexical recognition and sentence processing) was compared asa function of semantic density. In both tasks, real-time comprehension was facilitated for higher density items,whereas lower density items experienced more interference. The findings indicate that language-processingskills develop heterogeneously and are influenced by the semantic network surrounding a known word. |
Andreas Brocher; Stephani Foraker; Jean Pierre Koenig Processing of irregular polysemes in sentence reading Journal Article In: Journal of Experimental Psychology: Learning, Memory, and Cognition, vol. 42, no. 11, pp. 1798–1813, 2016. @article{Brocher2016a, The degree to which meanings are related in memory affects ambiguous word processing. We examined irregular polysemes, which have related senses based on similar or shared features rather than a relational rule, like regular polysemy. We tested to what degree the related meanings of irregular polysemes ("wire") are represented with shared semantic information versus unshared information represented separately, like homonyms ("bank"). Monitoring eye fixations, we found that later context supporting the less frequent meaning of an irregular polyseme did not slow down reading compared with control conditions, whereas for homonyms it did. This indicates that in the absence of preceding biasing context, readers access a shared component of an irregular polyseme's representation. Additionally, when the same context words preceded the ambiguous word, both irregular polysemes and homonyms initially elicited longer reading times, but the observed reading slow-down was weaker and less persistent for irregular polysemes than homonyms, indicating less competition between meaning components. We interpret these results as evidence of a shared features representation for irregular polysemes, which additionally incorporates unshared portions of meaning that can compete. When preceding, biasing context is available, readers activate shared and unshared components of the senses, producing a more fully instantiated meaning. |
Trevor Brothers; Matthew J. Traxler Anticipating syntax during reading: Evidence from the boundary change paradigm Journal Article In: Journal of Experimental Psychology: Learning, Memory, and Cognition, vol. 42, no. 12, pp. 1894–1906, 2016. @article{Brothers2016, Previous evidence suggests that grammatical constraints have a rapid influence during language com- prehension, particularly at the level of word categories (noun, verb, preposition). These findings are in conflict with a recent study from Angele, Laishley, Rayner, and Liversedge (2014), in which sentential fit had no early influence on word skipping rates during reading. In the present study, we used a gaze-contingent boundary change paradigm to manipulate the syntactic congruity of an upcoming noun or verb outside of participants' awareness. Across 3 experiments (total N ⫽ 148), we observed higher skipping rates for syntactically valid previews (The admiral would not confess . . .), when compared with violation previews (The admiral would not surgeon . . .). Readers were less likely to skip an ungram- matical continuation, even when that word was repeated within the same sentence (The admiral would not admiral . . .), suggesting that word-class constraints can take precedence over lexical repetition effects. To our knowledge, these results provide the first evidence for an influence of syntactic context during parafoveal word recognition. On the basis of the early time-course of this effect, we argue that readers can use grammatical constraints to generate syntactic expectations for upcoming words. |
Susanne Brouwer; Ann R. Bradlow The temporal dynamics of spoken word recognition in adverse listening conditions Journal Article In: Journal of Psycholinguistic Research, vol. 45, no. 5, pp. 1151–1160, 2016. @article{Brouwer2016, This study examined the temporal dynamics of spoken word recognition in noise and background speech. In two visual-world experiments, English participants listened to target words while looking at four pictures on the screen: a target (e.g. candle), an onset competitor (e.g. candy), a rhyme competitor (e.g. sandal), and an unrelated distractor (e.g. lemon). Target words were presented in quiet, mixed with broadband noise, or mixed with background speech. Results showed that lexical competition changes throughout the observation window as a function of what is presented in the background. These findings suggest that, rather than being strictly sequential, stream segregation and lexical competition interact during spoken word recognition. |
Aurélie Calabrèse; Jean-Baptiste Bernard; Géraldine Faure; Louis Hoffart; Eric Castet Clustering of eye fixations: A new oculomotor determinant of reading speed in maculopathy Journal Article In: Investigative Ophthalmology & Visual Science, vol. 57, no. 7, pp. 3192–3202, 2016. @article{Calabrese2016, Purpose: To describe and quantify a largely unnoticed oculomotor pattern that often occurs when patients with central field loss (CFL) read continuous text: Horizontal distribution of eye fixations dramatically varies across sentences and often reveals clusters. Also to statistically analyze the effect of this new factor on reading speed while controlling for the effect of saccadic amplitude (measured in letters per forward saccade, L/FS), an established oculomotor effect. Methods: Quantification of nonuniformity of eye fixations (NUF factor) was based on statistical analysis of the curvature of fixation distributions. Linear mixed-effects analyses were performed to predict reading speed from oculomotor factors based on eye movements of 34 AMD and 4 Stargardt patients (better eye decimal acuity from 0.08 to 0.3). Single-line French sentences were read aloud by these patients, who all had a dense scotoma covering the fovea as assessed with MP1 microperimetry. Results: Nonuniformity of fixations is a strong determinant of reading speed (−0.76 log units; 95% confidence interval [CI] [−0.86, −0.66]). This effect is not confounded with the effect of L/FS. The per sentence proportion of trials with clustering is predicted by the frequency of occurrence of the lowest-frequency word in each sentence. Conclusions: The NUF factor is a new oculomotor predictor of reading speed. This effect is independent of the effect of L/FS. Reading performance, as well as motivation to read, might be enhanced if new visual aids or automatic text simplification were used to reduce the occurrence of fixation clustering. © |
Julie Mercier; Irina Pivneva; Debra Titone The role of prior language context on bilingual spoken word processing: Evidence from the visual world task Journal Article In: Bilingualism: Language and Cognition, vol. 19, no. 2, pp. 376–399, 2016. @article{Mercier2016, We investigated whether speaking in one language affects cross- and within-language activation when subsequently switching to a task performed in the same or different language. English-French bilinguals (L1 English |
Audrey L. Michal; David Uttal; Priti Shah; Steven L. Franconeri Visual routines for extracting magnitude relations Journal Article In: Psychonomic Bulletin & Review, vol. 23, no. 6, pp. 1802–1809, 2016. @article{Michal2016, Linking relations described in text with relations in visualizations is often difficult. We used eye tracking to measure the optimal way to extract such relations in graphs, college students, and young children (6- and 8-year-olds). Participants compared relational statements ("Are there more blueberries than oranges?") with simple graphs, and two systematic patterns emerged: eye movements that followed the verbal order of the question (inspecting the "blueberry" value first) versus those that followed a left-first bias (regardless of the left value's identity). Question-order patterns led substantially to faster responses and increased in prevalence with age, whereas the left-first pattern led to far slower responses and was the dominant strategy for younger children. We argue that the optimal way to verify a verbally expressed relation'scon- sistency with visualization is for the eyes to mimic the verbal ordering but that this strategy requires executive control and coordination with language. |
Evelyn Milburn; Tessa Warren; Michael Walsh Dickey World knowledge affects prediction as quickly as selectional restrictions: Evidence from the visual world paradigm Journal Article In: Language, Cognition and Neuroscience, vol. 31, no. 4, pp. 536–548, 2016. @article{Milburn2016, There has been considerable debate regarding the question of whether linguistic knowledge and world knowledge are separable and used differently during processing or not (Hagoort et al, 2004). Integration of word meaning and world knowledge in language comprehension (Matsuki et al, 2011). Event-based plausibility immediately influences on-line language comprehension (Paczynski et al, 2012). Multiple influences of semantic memory on sentence processing: Distinct effects of semantic relatedness on violations of real-world event/state knowledge and animacy selection restrictions (Warren et al, 2007). Investigating effects of selectional restriction violations and plausibility violation severity on eye movements in reading. Previous investigations into this question have provided mixed evidence as to whether violations of selectional restrictions are detected earlier than violations of world knowledge. We report a visual world eye-tracking study comparing the timing of facilitation contributed by selectional restrictions vs. world knowledge. College-aged adults (n = 36) viewed photographs of natural scenes while listening to sentences. Participants anticipated upcoming direct objects similarly regardless of whether facilitation was provided by only world knowledge or a combination of selectional restrictions and world knowledge. These results suggest that selectional restrictions are not available earlier in comprehension than world knowledge. |
Luis Morales; Daniela Paolieri; Paola E. Dussias; Jorge R. Valdés Kroff; Chip Gerfen; María Teresa Bajo The gender congruency effect during bilingual spoken-word recognition Journal Article In: Bilingualism: Language and Cognition, vol. 19, no. 2, pp. 294–310, 2016. @article{Morales2016, We investigate the 'gender-congruency' effect during a spoken-word recognition task using the visual world paradigm. Eye movements of Italian-Spanish bilinguals and Spanish monolinguals were monitored while they viewed a pair of objects on a computer screen. Participants listened to instructions in Spanish (encuentra la bufanda / 'find the scarf') and clicked on the object named in the instruction. Grammatical gender of the objects' name was manipulated so that pairs of objects had the same (congruent) or different (incongruent) gender in Italian, but gender in Spanish was always congruent. Results showed that bilinguals, but not monolinguals, looked at target objects less when they were incongruent in gender, suggesting a between-language gender competition effect. In addition, bilinguals looked at target objects more when the definite article in the spoken instructions provided a valid cue to anticipate its selection (different-gender condition). The temporal dynamics of gender processing and cross-language activation in bilinguals are discussed. |
Iris Mulders; Kriszta Szendroi Early association of prosodic focus with alleen 'only': Evidence from eye movements in the visual-world paradigm Journal Article In: Frontiers in Psychology, vol. 7, pp. 150, 2016. @article{Mulders2016, In three visual-world eye tracking studies, we investigated the processing of sentences containing the focus-sensitive operator alleen 'only' and different pitch accents, such as the Dutch Ik heb alleen SELDERIJ aan de brandweerman gegeven 'I only gave CELERY to the fireman' versus Ik heb alleen selderij aan de BRANDWEERMAN gegeven 'I only gave celery to the FIREMAN'. Dutch, like English, allows accent shift to express different focus possibilities. Participants judged whether these utterances match different pictures: in Experiment 1 the Early Stress utterance matched the picture, in Experiment 2 both the Early and Late Stress utterance did, and in Experiment 3 neither did. We found that eye-gaze patterns start to diverge across the conditions already as the indirect object is being heard. Our data also indicate that participants perform anticipatory eye-movements based on the presence of prosodic focus during auditory sentence processing. Our investigation is the first to report the effect of varied prosodic accent placement on different arguments in sentences with a semantic operator, alleen 'only', on the time course of looks in the visual world paradigm. Using an operator in the visual world paradigm allowed us to confirm that prosodic focus information immediately gets integrated into the semantic parse of the proposition. Our study thus provides further evidence for fast, incremental prosodic focus processing in natural language. |
Jana Annina Müller; Dorothea Wendt; Birger Kollmeier; Thomas Brand Comparing eye tracking with electrooculography for measuring individual sentence comprehension duration Journal Article In: PLoS ONE, vol. 11, no. 10, pp. e0164627, 2016. @article{Mueller2016b, The aim of this study was to validate a procedure for performing the audio-visual paradigm introduced by Wendt et al. (2015) with reduced practical challenges. The original paradigm records eye fixations using an eye tracker and calculates the duration of sentence comprehension based on a bootstrap procedure. In order to reduce practical challenges, we first reduced the measurement time by evaluating a smaller measurement set with fewer trials. The results of 16 listeners showed effects comparable to those obtained when testing the original full measurement set on a different collective of listeners. Secondly, we introduced electrooculography as an alternative technique for recording eye movements. The correlation between the results of the two recording techniques (eye tracker and electrooculography) was r = 0.97, indicating that both methods are suitable for estimating the processing duration of individual participants. Similar changes in processing duration arising from sentence complexity were found using the eye tracker and the electrooculography procedure. Thirdly, the time course of eye fixations was estimated with an alternative procedure, growth curve analysis, which is more commonly used in recent studies analyzing eye tracking data. The results of the growth curve analysis were compared with the results of the bootstrap procedure. Both analysis methods show similar processing durations. |
Chie Nakamura; Manabu Arai Persistence of initial misanalysis with no referential ambiguity Journal Article In: Cognitive Science, vol. 40, no. 4, pp. 909–940, 2016. @article{Nakamura2016, Previous research reported that in processing structurally ambiguous sentences comprehenders often preserve an initial incorrect analysis even after adopting a correct analysis following structural disambiguation. One criticism is that the sentences tested in previous studies involved referential ambiguity and allowed comprehenders to make inferences about the initial interpretation using pragmatic information, suggesting the possibility that the initial analysis persisted due to comprehenders' pragmatic inference but not to their failure to perform complete reanalysis of the initial misanalysis. Our study investigated this by testing locally ambiguous relative clause sentences in Japanese, in which the initial misinterpretation contradicts the correct interpretation. Our study using a self-paced reading technique demonstrated evidence for the persistence of the initial analysis with this structure. The results from an eye-tracking study further suggested that the phenomenon directly reflected the amount of support given to the initial incorrect analysis prior to disambiguating information: The more supported the incorrect main clause analysis was, the more likely comprehenders were to preserve the analysis even after the analysis was falsified. Our results thus demonstrated that the preservation of the initial analysis occurs not due to referential ambiguities but to comprehenders' difficulty to fully revise the highly supported initial interpretation. |
Jessie S. Nixon; Jacolien Rij; Peggy Mok; R. Harald Baayen; Yiya Chen The temporal dynamics of perceptual uncertainty: Eye movement evidence from Cantonese segment and tone perception Journal Article In: Journal of Memory and Language, vol. 90, pp. 103–125, 2016. @article{Nixon2016, Two visual world eyetracking experiments investigated how acoustic cue value and statistical variance affect perceptual uncertainty during Cantonese consonant (Experiment 1) and tone perception (Experiment 2). Participants heard low- or high-variance acoustic stimuli. Euclidean distance of fixations from target and competitor pictures over time was analysed using Generalised Additive Mixed Modelling. Distance of fixations from target and competitor pictures varied as a function of acoustic cue, providing evidence for gradient, nonlinear sensitivity to cue values. Moreover, cue value effects significantly interacted with statistical variance, indicating that the cue distribution directly affects perceptual uncertainty. Interestingly, the time course of effects differed between target distance and competitor distance models. The pattern of effects over time suggests a global strategy in response to the level of uncertainty: as uncertainty increases, verification looks increase accordingly. Low variance generally creates less uncertainty, but can lead to greater uncertainty in the face of unexpected speech tokens. |
Nazbanou Nozari; Daniel Mirman; Sharon L. Thompson-Schill The ventrolateral prefrontal cortex facilitates processing of sentential context to locate referents Journal Article In: Brain and Language, vol. 157-158, pp. 1–13, 2016. @article{Nozari2016, Left ventrolateral prefrontal cortex (VLPFC) has been implicated in both integration and conflict resolution in sentence comprehension. Most evidence in favor of the integration account comes from processing ambiguous or anomalous sentences, which also poses a demand for conflict resolution. In two eye-tracking experiments we studied the role of VLPFC in integration when demands for conflict resolution were minimal. Two closely-matched groups of individuals with chronic post-stroke aphasia were tested: the Anterior group had damage to left VLPFC, whereas the Posterior group had left temporo-parietal damage. In Experiment 1 a semantic cue (e.g., "She will eat the apple") uniquely marked the target (apple) among three distractors that were incompatible with the verb. In Experiment 2 phonological cues (e.g., "She will see an eagle."/"She will see a bear.") uniquely marked the target among three distractors whose onsets were incompatible with the cue (e.g., all consonants when the target started with a vowel). In both experiments, control conditions had a similar format, but contained no semantic or phonological contextual information useful for target integration (e.g., the verb "see", and the determiner "the"). All individuals in the Anterior group were slower in using both types of contextual information to locate the target than were individuals in the Posterior group. These results suggest a role for VLPFC in integration beyond conflict resolution. We discuss a framework that accommodates both integration and conflict resolution. |
Nazbanou Nozari; John C. Trueswell; Sharon L. Thompson-Schill In: Psychonomic Bulletin & Review, vol. 23, no. 6, pp. 1942–1953, 2016. @article{Nozari2016a, During sentence comprehension, real-time identification of a referent is driven both by local, context-independent lexical information and by more global sentential information related to the meaning of the utterance as a whole. This paper investigates the cognitive factors that limit the consideration of referents that are supported by local lexical information but not supported by more global sentential information. In an eye-tracking paradigm, participants heard sentences like "She will eat the red pear" while viewing four black-and-white (colorless) line-drawings. In the experimental condition, the display contained a "local attractor" (e.g., a heart), which was locally compatible with the adjective but incompatible with the context ("eat"). In the control condition, the local attractor was replaced by a picture which was incompatible with the adjective (e.g., "igloo"). A second factor manipulated contextual constraint, by using either a constraining verb (e.g., "eat"), or a non-constraining one (e.g., "see"). Results showed consideration of the local attractor, the magnitude of which was modulated by verb constraint, but also by each subject's cognitive control abilities, as measured in a separate Flanker task run on the same subjects. The findings are compatible with a processing model in which the interplay between local attraction, context, and domain-general control mechanisms determines the consideration of possible referents. |
Henri Olkoniemi; Henri Ranta; Johanna K. Kaakinen Individual differences in the processing of written sarcasm and metaphor: Evidence from eye movements Journal Article In: Journal of Experimental Psychology: Learning, Memory, and Cognition, vol. 42, no. 3, pp. 433–450, 2016. @article{Olkoniemi2016, The present study examined individual differences in the processing of different forms of figurative language. Sixty participants read sarcastic, metaphorical, and literal sentences embedded in story contexts while their eye movements were recorded, and responded to a text memory and an inference question after each story. Individual differences in working memory capacity (WMC), need for cognition (NFC), and cognitive-affective processing were measured. The results showed that the processing of metaphors was characterized by slow-down during first-pass reading of the utterances, whereas sarcasm produced mainly delayed effects in the eye movement records. Sarcastic utterances were also harder to comprehend than literal or metaphorical utterances as indicated by poorer performance in responses to inference questions. Individual differences in general cognitive factors (WMC and NFC) were related to the processing of metaphors, whereas individual differences in both general cognitive factors (WMC) as well as processing of emotional information were related to the processing of sarcasm. The results indicate that different forms of figurative language pose different cognitive demands to the reader, and show that reader characteristics play a prominent role in figurative language comprehension. |