EyeLink Cognitive Publications
All EyeLink cognitive and perception research publications up until 2023 (with some early 2024s) are listed below by year. You can search the publications using keywords such as Visual Search, Scene Perception, Face Processing, etc. You can also search for individual author names. If we missed any EyeLink cognitive or perception articles, please email us!
2023 |
Aaron J. Levi; Yuan Zhao; Il Memming Park; Alexander C. Huk Sensory and choice responses in MT distinct from motion encoding Journal Article In: Journal of Neuroscience, vol. 43, no. 12, pp. 2090–2103, 2023. @article{Levi2023, The macaque middle temporal (MT) area is well known for its visual motion selectivity and relevance to motion perception, but the possibility of it also reflecting higher-level cognitive functions has largely been ignored. We tested for effects of task performance distinct from sensory encoding by manipulating subjects' temporal evidence-weighting strategy during a direction discrimination task while performing electrophysiological recordings from groups of MT neurons in rhesus macaques (one male, one female). This revealed multiple components of MT responses that were, surprisingly, not interpretable as behaviorally relevant modulations of motion encoding, or as bottom-up consequences of the readout of motion direction from MT. The time-varying motion-driven responses of MT were strongly affected by our strategic manipulation—but with time courses opposite the subjects' temporal weighting strategies. Furthermore, large choice-correlated signals were represented in population activity distinct from its motion responses, with multiple phases that lagged psychophysical readout and even continued after the stimulus (but which preceded motor responses). In summary, a novel experimental manipulation of strategy allowed us to control the time course of readout to challenge the correlation between sensory responses and choices, and population-level analyses of simultaneously recorded ensembles allowed us to identify strong signals that were so distinct from direction encoding that conventional, single-neuron-centric analyses could not have revealed or properly characterized them. Together, these approaches revealed multiple cognitive contributions to MT responses that are task related but not functionally relevant to encoding or decoding of motion for psychophysical direction discrimination, providing a new perspective on the assumed status of MT as a simple sensory area. |
Mathieu Lesourd; Alia Afyouni; Franziska Geringswald; Fabien Cignetti; Lisa Raoul; Julien Sein; Bruno Nazarian; Jean-Luc Anton; Marie-Hélène Grosbras Action observation network activity related to object-directed and socially-directed actions in adolescents Journal Article In: Journal of Neuroscience, vol. 43, no. 1, pp. 125–141, 2023. @article{Lesourd2023, The human action observation network (AON) encompasses brain areas consistently engaged when we observe other's actions. Although the core nodes of the AON are present from childhood, it is not known to what extent they are sensitive to different action features during development. Because social cognitive abilities continue to mature during adolescence, the AON response to socially-oriented actions, but not to object-related actions, may differ in adolescents and adults. To test this hypothesis, we scanned with functional magnetic resonance imaging (fMRI) male and female typically-developing teenagers (n = 28; 13 females) and adults (n = 25; 14 females) while they passively watched videos of manual actions varying along two dimensions: sociality (i.e., directed toward another person or not) and transitivity (i.e., involving an object or not). We found that action observation recruited the same fronto-parietal and occipito-temporal regions in adults and adolescents. The modulation of voxel-wise activity according to the social or transitive nature of the action was similar in both groups of participants. Multivariate pattern analysis, however, revealed that decoding accuracies in intraparietal sulcus (IPS)/superior parietal lobe (SPL) for both sociality and transitivity were lower for adolescents compared with adults. In addition, in the lateral occipital temporal cortex (LOTC), generalization of decoding across the orthogonal dimension was lower for sociality only in adolescents. These findings indicate that the representation of the content of others' actions, and in particular their social dimension, in the adolescent AON is still not as robust as in adults. |
Pedro Lencastre; Marit Gjersdal; Leonardo Rydin Gorjão; Anis Yazidi; Pedro G. Lind Modern AI versus century-old mathematical models: How far can we go with generative adversarial networks to reproduce stochastic processes? Journal Article In: Physica D: Nonlinear Phenomena, vol. 453, pp. 1–11, 2023. @article{Lencastre2023, The usage of generative adversarial networks (GAN)s for synthetic time-series data generation has been gaining popularity in recent years with applications from finance to music composition and processing of textual content. However, beyond their reported success, few comparisons exist with other artificial intelligence (AI) methods or standard mathematical models. Here, we test GANs performance, comparing them with a well-known mathematical model, namely a Markov chain. We implement comparative metrics based on one- and two-point statistics to evaluate the performance of each method. We find that, similarly to other AI approaches, GANs struggle to capture rare events and cross-feature relations and are unable to create synthetic faithful data. GANs are relatively successful in replicating the auto-correlation function, but they still lag significantly behind simple Markov chains. We also provide a qualitative explanation for this limitation of AI approaches. |
Rony Lemel; Lilach Shalev; Gal Nitsan; Boaz M. Ben-David Listen up! ADHD slows spoken-word processing in adverse listening conditions: Evidence from eye movements Journal Article In: Research in Developmental Disabilities, vol. 133, pp. 1–15, 2023. @article{Lemel2023, Background: Cognitive skills such as sustained attention, inhibition and working memory are essential for speech processing, yet are often impaired in people with ADHD. Offline measures have indicated difficulties in speech recognition on multi-talker babble (MTB) background for young adults with ADHD (yaADHD). However, to-date no study has directly tested online speech processing in adverse conditions for yaADHD. Aims: Gauging the effects of ADHD on segregating the spoken target-word from its sound-sharing competitor, in MTB and working-memory (WM) load. Methods and procedures: Twenty-four yaADHD and 22 matched controls that differ in sustained attention (SA) but not in WM were asked to follow spoken instructions presented on MTB to touch a named object, while retaining one (low-load) or four (high-load) digit/s for later recall. Their eye fixations were tracked. Outcomes and results: In the high-load condition, speech processing was less accurate and slowed by 140ms for yaADHD. In the low-load condition, the processing advantage shifted from early perceptual to later cognitive stages. Fixation transitions (hesitations) were inflated for yaADHD. Conclusions and implications: ADHD slows speech processing in adverse listening conditions and increases hesitation, as speech unfolds in time. These effects, detected only by online eyetracking, relate to attentional difficulties. We suggest online speech processing as a novel purview on ADHD. What this paper adds?: We suggest speech processing in adverse listening conditions as a novel vantage point on ADHD. Successful speech recognition in noise is essential for performance across daily settings: academic, employment and social interactions. It involves several executive functions, such as inhibition and sustained attention. Impaired performance in these functions is characteristic of ADHD. However, to date there is only scant research on speech processing in ADHD. The current study is the first to investigate online speech processing as the word unfolds in time using eyetracking for young adults with ADHD (yaADHD). This method uncovered slower speech processing in multi-talker babble noise for yaADHD compared to matched controls. The performance of yaADHD indicated increased hesitation between the spoken word and sound-sharing alternatives (e.g., CANdle-CANdy). These delays and hesitations, on the single word level, could accumulate in continuous speech to significantly impair communication in ADHD, with severe implications on their quality of life and academic success. Interestingly, whereas yaADHD and controls were matched on WM standardized tests, WM load appears to affect speech processing for yaADHD more than for controls. This suggests that ADHD may lead to inefficient deployment of WM resources that may not be detected when WM is tested alone. Note that these intricate differences could not be detected using traditional offline accuracy measures, further supporting the use of eyetracking in speech tasks. Finally, communication is vital for active living and wellbeing. We suggest paying attention to speech processing in ADHD in treatment and when considering accessibility and inclusion. |
Yen-Lin Lee; Hsuan-Chih Chen; Yu-Chen Chan The attentional bias of gelotophobes towards emotion words containing the Chinese character for ‘laugh': An eye-tracking approach Journal Article In: Current Psychology, vol. 42, no. 19, pp. 16330–16343, 2023. @article{Lee2023c, Gelotophobes are typically characterized by the fear of laughter, social withdrawal, and humorlessness, possibly related to negative experiences of being laughed at in the past. The present study seeks to expand our understanding of gelotophobia through a relatively novel approach: using eye-tracking to investigate the attentional bias of gelotophobes and non-gelotophobes towards negative emotion words that do and do not contain the Chinese character for “laugh,” by comparing responses to negative ridicule words (RID), negative contempt words (CONT), positive pleasure words (PLE) and neutral words (NEU). Results of the start time of the first run of fixations showed that gelotophobes and non-gelotophobes both focused on negative words before other words. Gelotophobes' attentional bias towards RID and CONT was greater than that of non-gelotophobes in first gaze duration, percentage of total viewing duration, total fixation count, and run count, suggesting that gelotophobes had greater difficulty in disengaging their attention from negative to neutral words. Non-gelotophobes' attentional bias, however, towards negative ridicule neutral words (RID-NEU) and negative contempt neutral words (CONT-NEU) was greater than that of gelotophobes, suggesting that non-gelotophobes were more able to shift attention from negative to neutral words. Moreover, gelotophobes paid significantly more attention to RID than CONT, suggesting that gelotophobes displayed a longer and stronger attentional bias towards RID (containing the “laugh” character). Interestingly, there was no difference for PLE between gelotophobes and non-gelotophobes. The present study contributes to our understanding of the attentional bias of gelotophobes and non-gelotophobes towards emotion words. |
Michael J. Lee; James J. DiCarlo How well do rudimentary plasticity rules predict adult visual object learning? Journal Article In: PLoS Computational Biology, vol. 19, no. 12, pp. 1–37, 2023. @article{Lee2023a, A core problem in visual object learning is using a finite number of images of a new object to accurately identify that object in future, novel images. One longstanding, conceptual hypothesis asserts that this core problem is solved by adult brains through two connected mechanisms: 1) the re-representation of incoming retinal images as points in a fixed, multidimensional neural space, and 2) the optimization of linear decision boundaries in that space, via simple plasticity rules applied to a single downstream layer. Though this scheme is biologically plausible, the extent to which it explains learning behavior in humans has been unclear-in part because of a historical lack of image-computable models of the putative neural space, and in part because of a lack of measurements of human learning behaviors in difficult, naturalistic settings. Here, we addressed these gaps by 1) drawing from contemporary, image-computable models of the primate ventral visual stream to create a large set of testable learning models (n = 2,408 models), and 2) using online psychophysics to measure human learning trajectories over a varied set of tasks involving novel 3D objects (n = 371,000 trials), which we then used to develop (and publicly release) empirical benchmarks for comparing learning models to humans. We evaluated each learning model on these benchmarks, and found those based on deep, high-level representations from neural networks were surprisingly aligned with human behavior. While no tested model explained the entirety of replicable human behavior, these results establish that rudimentary plasticity rules, when combined with appropriate visual representations, have high explanatory power in predicting human behavior with respect to this core object learning problem. |
Crystal Lee; Andrew Jessop; Amy Bidgood; Michelle S. Peter; Julian M. Pine; Caroline F. Rowland; Samantha Durrant How executive functioning, sentence processing, and vocabulary are related at 3 years of age Journal Article In: Journal of Experimental Child Psychology, vol. 233, pp. 1–21, 2023. @article{Lee2023, There is a wealth of evidence demonstrating that executive function (EF) abilities are positively associated with language development during the preschool years, such that children with good executive functions also have larger vocabularies. However, why this is the case remains to be discovered. In this study, we focused on the hypothesis that sentence processing abilities mediate the association between EF skills and receptive vocabulary knowledge, in that the speed of language acquisition is at least partially dependent on a child's processing ability, which is itself dependent on executive control. We tested this hypothesis in longitudinal data from a cohort of 3- and 4-year-old children at three age points (37, 43, and 49 months). We found evidence, consistent with previous research, for a significant association between three EF skills (cognitive flexibility, working memory [as measured by the Backward Digit Span], and inhibition) and receptive vocabulary knowledge across this age range. However, only one of the tested sentence processing abilities (the ability to maintain multiple possible referents in mind) significantly mediated this relationship and only for one of the tested EFs (inhibition). The results suggest that children who are better able to inhibit incorrect responses are also better able to maintain multiple possible referents in mind while a sentence unfolds, a sophisticated sentence processing ability that may facilitate vocabulary learning from complex input. |
Thibaut Le Naour; Michael Papinutto; Muriel Lobier; Jean-Pierre Bresciani Controlling the trajectory of a moving object substantially shortens the latency of motor responses to visual stimuli Journal Article In: iScience, vol. 26, no. 6, pp. 1–14, 2023. @article{LeNaour2023, Motor responses to visual stimuli have shorter latencies for controlling than for initiating movement. The shorter latencies observed for movement control are notably believed to reflect the involvement of forward models when controlling moving limbs. We assessed whether controlling a moving limb is a “requisite” to observe shortened response latencies. The latency of button-press responses to a visual stimulus was compared between conditions involving or not involving the control of a moving object, but never involving any actual control of a body segment. When the motor response controlled a moving object, response latencies were significantly shorter and less variable, probably reflecting a faster sensorimotor processing (as assessed fitting a LATER model to our data). These results suggest that when the task at hand entails a control component, the sensorimotor processing of visual information is hastened, and this even if the task does not require to actually control a moving limb. |
Jochen Laubrock; Alexander Krutz; Jonathan Nübel; Sebastian Spethmann Gaze patterns reflect and predict expertise in dynamic echocardiographic imaging Journal Article In: Journal of Medical Imaging, vol. 10, no. S1, pp. 1–20, 2023. @article{Laubrock2023, Purpose: Echocardiography is the most important modality in cardiac imaging. Rapid valid visual assessment is a critical skill for image interpretation. However, it is unclear how skilled viewers assess echocardiographic images. Therefore, guidance and implicit advice are needed for learners to achieve valid image interpretation. Approach: Using a signal detection approach, we compared 15 certified experts with 15 medi- cal students in their diagnostic decision-making and viewing behavior. To quantify attention allocation, we recorded eye movements while viewing dynamic echocardiographic imaging loops of patients with reduced ejection fraction and healthy controls. Participants evaluated left ventricular ejection fraction and image quality (as diagnostic and visual control tasks, respectively). Results: Experts were much better at discriminating between patients and healthy controls (d0 of 2.58, versus 0.98 for novices). Eye tracking revealed that experts fixated diagnostically relevant areas earlier and more often, whereas novices were distracted by visually salient task-irrelevant stimuli. We show that expertise status can be almost perfectly classified either based on judg- ments or purely on eye movements and that an expertise score derived from viewing behavior predicts diagnostic quality. Conclusions: Judgments and eye tracking revealed significant differences between echocardi- ography experts and novices that can be used to derive numerical expertise scores. Experts have implicitly learned to ignore the salient motion cue presented by the mitral valve and to focus on the diagnostically more relevant left ventricle. These findings have implications for echocardi- ography training, objective characterization of echocardiographic expertise, and the design of user-friendly interfaces for echocardiography. |
Katja Langer; Valerie L. Jentsch; Oliver T. Wolf Rapid effects of acute stress on cognitive emotion regulation Journal Article In: Psychoneuroendocrinology, vol. 151, pp. 1–10, 2023. @article{Langer2023, Acute stress has been shown to either enhance or impair emotion regulation (ER) performances. Besides sex, strategy use and stimulus intensity, another moderating factor appears to be timing of the ER task relative to stress exposure. Whereas somewhat delayed increases in the stress hormone cortisol have been shown to improve ER performances, rapid sympathetic nervous system (SNS) actions might oppose such effects via cognitive regulatory impairments. Here, we thus investigated rapid effects of acute stress on two ER strategies: reappraisal and distraction. N = 80 healthy participants (40 men & 40 women) were exposed to the Socially Evaluated Cold-Pressor Test or a control condition immediately prior to an ER paradigm which required them to deliberately downregulate emotional responses towards high intensity negative pictures. Subjective ratings and pupil dilation served as ER outcomes measures. Increases in salivary cortisol and cardiovascular activity (index of SNS activation) verified successful induction of acute stress. Unexpectedly, stress reduced subjective emotional arousal when distracting from negative pictures in men indicating regulatory improvements. However, this beneficial effect was particularly pronounced in the second half of the ER paradigm and fully mediated by already rising cortisol levels. In contrast, cardiovascular responses to stress were linked to decreased subjective regulatory performances of reappraisal and distraction in women. However, no detrimental effects of stress on ER occurred at the group level. Yet, our findings provide initial evidence for rapid, opposing effects of the two stress systems on the cognitive control of negative emotions that are critically moderated by sex. |
Elke B. Lange; Lauren K. Fink Eye blinking, musical processing, and subjective states—A methods account Journal Article In: Psychophysiology, vol. 60, no. 10, pp. 1–20, 2023. @article{Lange2023, Affective sciences often make use of self-reports to assess subjective states. Seeking a more implicit measure for states and emotions, our study explored spontaneous eye blinking during music listening. However, blinking is understudied in the context of research on subjective states. Therefore, a second goal was to explore different ways of analyzing blink activity recorded from infra-red eye trackers, using two additional data sets from earlier studies differing in blinking and viewing instructions. We first replicate the effect of increased blink rates during music listening in comparison with silence and show that the effect is not related to changes in self-reported valence, arousal, or to specific musical features. Interestingly, but in contrast, felt absorption reduced participants' blinking. The instruction to inhibit blinking did not change results. From a methodological perspective, we make suggestions about how to define blinks from data loss periods recorded by eye trackers and report a data-driven outlier rejection procedure and its efficiency for subject-mean analyses, as well as trial-based analyses. We ran a variety of mixed effects models that differed in how trials without blinking were treated. The main results largely converged across accounts. The broad consistency of results across different experiments, outlier treatments, and statistical models demonstrates the reliability of the reported effects. As recordings of data loss periods come for free when interested in eye movements or pupillometry, we encourage researchers to pay attention to blink activity and contribute to the further understanding of the relation between blinking, subjective states, and cognitive processing. |
E. Landová; I. Štolhoferová; B. Vobrubová; J. Polák; K. Sedláčková; M. Janovcová; S. Rádlová; D. Frynta In: Scientific Reports, vol. 13, no. 1, pp. 1–13, 2023. @article{Landova2023, Spiders are among the animals evoking the highest fear and disgust and such a complex response might have been formed throughout human evolution. Ironically, most spiders do not present a serious threat, so the evolutionary explanation remains questionable. We suggest that other chelicerates, such as scorpions, have been potentially important in the formation and fixation of the spider-like category. In this eye-tracking study, we focused on the attentional, behavioral, and emotional response to images of spiders, scorpions, snakes, and crabs used as task-irrelevant distractors. Results show that spider-fearful subjects were selectively distracted by images of spiders and crabs. Interestingly, these stimuli were not rated as eliciting high fear contrary to the other animals. We hypothesize that spider-fearful participants might have mistaken crabs for spiders based on their shared physical characteristics. In contrast, subjects with no fear of spiders were the most distracted by snakes and scorpions which supports the view that scorpions as well as snakes are prioritized evolutionary relevant stimuli. We also found that the reaction time increased systematically with increasing subjective fear of spiders only when using spiders (and crabs to some extent) but not snakes and scorpions as distractors. The maximal pupil response covered not only the attentional and cognitive response but was also tightly correlated with the fear ratings of the picture stimuli. However, participants' fear of spiders did not affect individual reactions to scorpions measured by the maximal pupil response. We conclude that scorpions are evolutionary fear-relevant stimuli, however, the generalization between scorpions and spiders was not supported in spider-fearful participants. This result might be important for a better understanding of the evolution of spider phobia. |
Yuxiang Lan; Qunyue Liu; Zhipeng Zhu Exploring landscape design intensity effects on visual preferences and eye fixations in urban forests: Insights from eye tracking technology Journal Article In: Forests, vol. 14, no. 8, pp. 1–16, 2023. @article{Lan2023, Individuals' preferences for urban forest scenes are an essential factor in the design process. This study explores the connection between landscape design intensity, visual preferences, and eye fixations in urban forest scenes. Five pictures representing different urban forest scenes (plaza, lawn, garden path, pond, and rockery) were selected as stimuli, representing the original landscape design intensity. Three additional levels of design intensity (low, moderate, and high) were created by modifying the landscape elements of the original picture. A group of 50 participants was randomly assigned to observe the four levels of design intensity pictures within each type of landscape using eye-tracking technology. They also rated their preferences for each scene. In total, 250 participants took part in the study, with five groups observing five types of urban forest scenes. The results indicate that landscape design intensity has a positive impact on visual preferences, with moderate design intensity showing the strongest effect. However, the influence of design intensity and preferences also depends on the specific landscape scene. The fixation data did not show a significant relationship with design intensity but were associated with the type of landscape scene. In conclusion, this study suggests that moderate design intensity is recommended for urban forest design. However, it also highlights the importance of considering the specific landscape scene type. The research provides valuable insights into urban forest design and contributes to the understanding of eye-tracking technology in landscape perception studies. |
Charlene L. M. Lam; Tom J. Barry; Jenny Yiend; Tatia M. C. Lee The role of consciousness in threat extinction learning Journal Article In: Consciousness and Cognition, vol. 116, pp. 1–12, 2023. @article{Lam2023, Extinction learning is regarded as a core mechanism underlying exposure therapy. The extent to which learned threats can be extinguished without conscious awareness is a controversial and on-going debate. We investigated whether implicit vs. explicit exposure to a threatened stimulus can modulate defence responses measured using pupillometry. Healthy participants underwent a threat conditioning paradigm in which one of the conditioned stimuli (CS) was perceptually suppressed using continuous flash suppression (CFS). Participants' pupillary responses, CS pleasantness ratings, and trial-by-trial awareness of the CS were recorded. During Extinction, participants' pupils dilated more in the trials in which they were unaware of the CS than in those in which they were aware of it (Cohen's d = 0.57). After reinstatement, the percentage of fear recovery was greater for the CFS-suppressed CS than the CS with full awareness. The current study suggests that the modulation of fear responses by extinction with reduced visual awareness is weaker compared to extinction with full perceptual awareness. |
Rosa Lafer-Sousa; Karen Wang; Reza Azadi; Emily Lopez; Simon Bohn; Arash Afraz Behavioral detectability of optogenetic stimulation of inferior temporal cortex varies with the size of concurrently viewed objects Journal Article In: Current Research in Neurobiology, vol. 4, pp. 1–7, 2023. @article{LaferSousa2023, We have previously demonstrated that macaque monkeys can behaviorally detect a subtle optogenetic impulse delivered to their inferior temporal (IT) cortex. We have also shown that the ability to detect the cortical stimulation impulse varies depending on some characteristics of the visual images viewed at the time of brain stimulation, revealing the visual nature of the perceptual events induced by stimulation of the IT cortex. Here we systematically studied the effect of the size of viewed objects on behavioral detectability of optogenetic stimulation of the central IT cortex. Surprisingly, we found that behavioral detection of the same optogenetic impulse highly varies with the size of the viewed object images. Reduction of the object size in four steps from 8 to 1 degree of visual angle significantly decreased detection performance. These results show that identical stimulation impulses delivered to the same neural population induce variable perceptual events depending on the mere size of the objects viewed at the time of brain stimulation. |
Yuna Kwak; Nina M. Hanning; Marisa Carrasco Presaccadic attention sharpens visual acuity Journal Article In: Scientific Reports, vol. 13, no. 1, pp. 1–11, 2023. @article{Kwak2023, Visual perception is limited by spatial resolution, the ability to discriminate fine details. Spatial resolution not only declines with eccentricity but also differs for polar angle locations around the visual field, also known as ‘performance fields'. To compensate for poor peripheral resolution, we make rapid eye movements—saccades—to bring peripheral objects into high-acuity foveal vision. Already before saccade onset, visual attention shifts to the saccade target location and prioritizes visual processing. This presaccadic shift of attention improves performance in many visual tasks, but whether it changes resolution is unknown. Here, we investigated whether presaccadic attention sharpens peripheral spatial resolution; and if so, whether such effect interacts with performance fields asymmetries. We measured acuity thresholds in an orientation discrimination task during fixation and saccade preparation around the visual field. The results revealed that presaccadic attention sharpens acuity, which can facilitate a smooth transition from peripheral to foveal representation. This acuity enhancement is similar across the four cardinal locations; thus, the typically robust effect of presaccadic attention does not change polar angle differences in resolution. |
Nawras Kurzom; Ilaria Lorenzi; Avi Mendelsohn Increasing the complexity of isolated musical chords benefits concurrent associative memory formation Journal Article In: Scientific Reports, vol. 13, no. 1, pp. 1–12, 2023. @article{Kurzom2023, The effects of background music on learning and memory are inconsistent, partially due to the intrinsic complexity and diversity of music, as well as variability in music perception and preference. By stripping down musical harmony to its building blocks, namely discrete chords, we explored their effects on memory formation of unfamiliar word-image associations. Chords, defined as two or more simultaneously played notes, differ in the number of tones and inter-tone intervals, yielding varying degrees of harmonic complexity, which translate into a continuum of consonance to dissonance percepts. In the current study, participants heard four different types of musical chords (major, minor, medium complex, and high complex chords) while they learned new word-image pairs of a foreign language. One day later, their memory for the word-image pairs was tested, along with a chord rating session, in which they were required to assess the musical chords in terms of perceived valence, tension, and the extent to which the chords grabbed their attention. We found that musical chords containing dissonant elements were associated with higher memory performance for the word-image pairs compared with consonant chords. Moreover, tension positively mediated the relationship between roughness (a key feature of complexity) and memory, while valence negatively mediated this relationship. The reported findings are discussed in light of the effects that basic musical features have on tension and attention, in turn affecting cognitive processes of associative learning. |
Jan W. Kurzawski; Augustin Burchell; Darshan Thapa; Jonathan Winawer; Najib J. Majaj; Denis G. Pelli The Bouma law accounts for crowding in 50 observers Journal Article In: Journal of Vision, vol. 23, no. 8, pp. 1–34, 2023. @article{Kurzawski2023, Crowding is the failure to recognize an object due to surrounding clutter. Our visual crowding survey measured 13 crowding distances (or “critical spacings”) twice in each of 50 observers. The survey includes three eccentricities (0, 5, and 10 deg), four cardinal meridians, two orientations (radial and tangential), and two fonts (Sloan and Pelli). The survey also tested foveal acuity, twice. Remarkably, fitting a two-parameter model—the well-known Bouma law, where crowding distance grows linearly with eccentricity—explains 82% of the variance for all 13 × 50 measured log crowding distances, cross-validated. An enhanced Bouma law, with factors for meridian, crowding orientation, target kind, and observer, explains 94% of the variance, again cross-validated. These additional factors reveal several asymmetries, consistent with previous reports, which can be expressed as crowding-distance ratios: 0.62 horizontal:vertical, 0.79 lower:upper, 0.78 right:left, 0.55 tangential:radial, and 0.78 Sloan-font:Pelli-font. Across our observers, peripheral crowding is independent of foveal crowding and acuity. Evaluation of the Bouma factor, b (the slope of the Bouma law), as a biomarker of visual health would be easier if there were a way to compare results across crowding studies that use different methods.We define a standardized Bouma factor b' that corrects for differences from Bouma's 25 choice alternatives, 75% threshold criterion, and linearly symmetric flanker placement. For radial crowding on the right meridian, the standardized Bouma factor b' is 0.24 for this study, 0.35 for Bouma (1970), and 0.30 for the geometric mean across five representative modern studies, including this one, showing good agreement across labs, including Bouma's. Simulations, confirmed by data, show that peeking can skew estimates of crowding (e.g., greatly decreasing the mean or doubling the SD of log b). Using gaze tracking to prevent peeking, individual differences are robust, as evidenced by the much larger 0.08 SD of log b across observers than the mere 0.03 test–retest SD of log b measured in half an hour. The ease of measurement of crowding enhances its promise as a biomarker for dyslexia and visual health. |
Jens Kürten; Tim Raettig; Julian Gutzeit; Lynn Huestegge In: Psychological Research, vol. 87, no. 2, pp. 410–424, 2023. @article{Kuerten2023a, Previous research has shown that the simultaneous execution of two actions (instead of only one) is not necessarily more difficult but can actually be easier (less error-prone), in particular when executing one action requires the simultaneous inhibition of another action. Corresponding inhibitory demands are particularly challenging when the to-be-inhibited action is highly prepotent (i.e., characterized by a strong urge to be executed). Here, we study a range of important potential sources of such prepotency. Building on a previously established paradigm to elicit dual-action benefits, participants responded to stimuli with single actions (either manual button press or saccade) or dual actions (button press and saccade). Crucially, we compared blocks in which these response demands were randomly intermixed (mixed blocks) with pure blocks involving only one type of response demand. The results highlight the impact of global (action-inherent) sources of action prepotency, as reflected in more pronounced inhibitory failures in saccade vs. manual control, but also more local (transient) sources of influence, as reflected in a greater probability of inhibition failures following trials that required the to-be-inhibited type of action. In addition, sequential analyses revealed that inhibitory control (including its failure) is exerted at the level of response modality representations, not at the level of fully specified response representations. In sum, the study highlights important preconditions and mechanisms underlying the observation of dual-action benefits. |
Jens Kürten; Tim Raettig; Julian Gutzeit; Lynn Huestegge Preparing for simultaneous action and inaction: Temporal dynamics and target levels of inhibitory control Journal Article In: Journal of Experimental Psychology: Human Perception and Performance, vol. 49, no. 7, pp. 1068–1082, 2023. @article{Kuerten2023, When a single action is required, along with the simultaneous inhibition of another action, this typically results in frequent false-positive executions of the latter (inhibition failures). The absence of inhibitory demands in dual-action trials can render performance less error-prone (and sometimes faster) than in single-action trials. In the present study, we investigated the temporal dynamics of inhibitory control difficulties by varying the preparation time (for simultaneous action execution and inhibition). In two experiments, participants responded to a single peripheral visual target either with an eye movement toward it (Single Saccade), with a spatially corresponding button press (Single Manual), or with both responses simultaneously (Dual Action) as indicated by a color cue. Preparation time was manipulated via the cue-stimulus interval within blocks (Experiment 1) and between blocks (Experiment 2). Overall, responses were faster with longer (vs. shorter) preparation time. Crucially, however, our results reveal the exact dynamics of how inhibition failures (and thus dual-action benefits) in both response modalities substantially decrease with longer preparation, even though the cue did not contain information regarding the fully specified response that needed to be inhibited (i.e., its direction). These results highlight the role of sufficient preparation time not only for efficient action execution but also for concurrent inhibitory performance. The study contradicts the idea that inhibition can only be exerted globally or on the level of a fully specified response. Instead, it may also be directed at effector system representations or all associated responses, suggesting a highly flexible targeting of inhibitory control in cognition. |
Mrinmayi Kulkarni; Allison E. Nickel; Greta N. Minor; Deborah E. Hannula; Mrinmayi Kulkarni; Allison E. Nickel; Greta N. Minor; Deborah E. Hannula Control of memory retrieval alters memory-based eye movements Journal Article In: Journal of Experimental Psychology: Learning, Memory, and Cognition, pp. 1–22, 2023. @article{Kulkarni2023, Past work has shown that eye movements are affected by long-term memory across different tasks and instructional manipulations. In the current study, we tested whether these memory-based eye movements persist when memory retrieval is under intentional control. Participants encoded multiple scenes with six objects (three faces; three tools). Next, they completed a memory regulation and visual search task, while undergoing eye tracking. Here, scene cues were presented and participants either retrieved the encoded associate, suppressed it, or substituted it with a specific object from the other encoded category. Following a delay, a search display consisting of six dots intermixed with the six encoded objects was presented. Participants' task was to fixate one remaining dot after five had disappeared. Incidental viewing of the objects was of interest. Results revealed that performance in a final recognition phase was impaired for suppressed pairs, but only when the associate was a tool. During the search task, incidental associate viewing was lower when participants attempted to control retrieval, whereas one object from the nonassociate category was most viewed in the substitute condition. Additionally, viewing patterns in the search phase were related to final recognition performance, but the direction of this association differed between conditions. Overall, these results suggest that eye movements are attracted to information retrieved from long-term memory and held active (the associate in the retrieve condition, or an object from the other category in the sub- stitute condition). Furthermore, the level of viewing may index the strength of the representation of retrieved information. |
Justin B. Kueser; Ryan Peters; Arielle Borovsky The role of semantic similarity in verb learning events: Vocabulary-related changes across early development Journal Article In: Journal of Experimental Child Psychology, vol. 226, pp. 1–19, 2023. @article{Kueser2023, Verb meaning is challenging for children to learn across varied events. This study examined how the taxonomic semantic similarity of the nouns in novel verb learning events in a progressive alignment learning condition differed from the taxonomic dissimilarity of nouns in a dissimilar learning condition in supporting near (similar) and far (dissimilar) verb generalization to novel objects in an eye-tracking task. A total of 48 children in two age groups (23 girls; younger: 21–24 months |
Alina Krug; Lisa Valentina Eberhardt; Anke Huckauf Transient attention does not alter the eccentricity effect in estimation of duration Journal Article In: Attention, Perception, & Psychophysics, pp. 1–12, 2023. @article{Krug2023, Previous research investigating the influence of stimulus eccentricity on perceived duration showed an increasing duration underestimation with increasing eccentricity. Based on studies showing that precueing the stimulus location prolongs perceived duration, one might assume that this eccentricity effect is influenced by spatial attention. In the present study, we assessed the influence of transient covert attention on the eccentricity effect in duration estimation in two experiments, one online and one in a laboratory setting. In a duration estimation task, participants judged whether a comparison stimulus presented near or far from fixation with a varying duration was shorter or longer than a standard stimulus presented foveally with a constant duration. To manipulate transient covert attention, either a transient luminance cue was used (valid cue) to direct attention to the position of the subsequent peripheral comparison stimulus or all positions were marked by luminance (neutral cue). Results of both experiments yielded a greater underestimation of duration for the far than for the near stimulus, replicating the eccentricity effect. Although cueing was effective (i.e., shorter response latencies for validly cued stimuli), cueing did not alter the eccentricity effect on estimation of duration. This indicates that cueing leads to covert attentional shifts but does not account for the eccentricity effect in perceived duration. |
Philipp Kreyenmeier; Anna Schroeger; Rouwen Cañal-Bruland; Markus Raab; Miriam Spering Rapid audiovisual integration guides predictive actions Journal Article In: eNeuro, vol. 10, no. 8, pp. 1–10, 2023. @article{Kreyenmeier2023, Natural movements, such as catching a ball or capturing prey, typically involve multiple senses. Yet, laboratory studies on human movements commonly focus solely on vision and ignore sound. Here, we ask how visual and auditory signals are integrated to guide interceptive movements. Human observers tracked the brief launch of a simulated baseball, randomly paired with batting sounds of varying intensities, and made a quick pointing movement at the ball. Movement end points revealed systematic overestimation of target speed when the ball launch was paired with a loud versus a quiet sound, although sound was never informative. This effect was modulated by the availability of visual information; sounds biased interception when the visual presentation duration of the ball was short. Amplitude of the first catch-up saccade, occurring;125 ms after target launch, revealed early integration of audiovisual information for trajectory estimation. This sound-induced bias was reversed during later predictive saccades when more visual information was available. Our findings sug-gest that auditory and visual signals are integrated to guide interception and that this integration process must occur early at a neural site that receives auditory and visual signals within an ultrashort time span. |
Isabel Kreis; Lei Zhang; Matthias Mittner; Leonard Syla; Claus Lamm; Gerit Pfuhl In: Cognitive, Affective, & Behavioral Neuroscience, vol. 23, no. 3, pp. 727–741, 2023. @article{Kreis2023, Aberrant belief updating due to misestimation of uncertainty and an increased perception of the world as volatile (i.e., unstable) has been found in autism and psychotic disorders. Pupil dilation tracks events that warrant belief updating, likely reflecting the adjustment of neural gain. However, whether subclinical autistic or psychotic symptoms affect this adjustment and how they relate to learning in volatile environments remains to be unraveled. We investigated the relationship between behavioral and pupillometric markers of subjective volatility (i.e., experience of the world as unstable), autistic traits, and psychotic-like experiences in 52 neurotypical adults with a probabilistic reversal learning task. Computational modeling revealed that participants with higher psychotic-like experience scores overestimated volatility in low-volatile task periods. This was not the case for participants scoring high on autistic-like traits, who instead showed a diminished adaptation of choice-switching behavior in response to risk. Pupillometric data indicated that individuals with higher autistic- or psychotic-like trait and experience scores differentiated less between events that warrant belief updating and those that do not when volatility was high. These findings are in line with misestimation of uncertainty accounts of psychosis and autism spectrum disorders and indicate that aberrancies are already present at the subclinical level. |
Linda Krauze; Mara Delesa-Velina; Tatjana Pladere; Gunta Krumina Why 2D layout in 3D images matters: Evidence from visual search and eyetracking Journal Article In: Journal of Eye Movement Research, vol. 16, no. 1, pp. 1–12, 2023. @article{Krauze2023, Precise perception of three-dimensional (3D) images is crucial for a rewarding experience when using novel displays. However, the capability of the human visual system to perceive binocular disparities varies across the visual field meaning that depth perception might be affected by the two-dimensional (2D) layout of items on the screen. Nevertheless, potential difficulties in perceiving 3D images during free viewing have received only a little attention so far, limiting opportunities to enhance visual effectiveness of information presentation. The aim of this study was to elucidate how the 2D layout of items in 3D images impacts visual search and distribution of maintaining attention based on the analysis of the viewer's gaze. Participants were searching for a target which was projected one plane closer to the viewer compared to distractors on a multi-plane display. The 2D layout of items was manipulated by changing the item distance from the center of the display plane from 2° to 8°. As a result, the targets were identified correctly when the items were displayed close to the center of the display plane, however, the number of errors grew with an increase in distance. Moreover, correct responses were given more often when subjects paid more attention to targets compared to other items on the screen. However, a more balanced distribution of attention over time across all items was characteristic of the incorrectly completed trials. Thus, our results suggest that items should be displayed close to each other in a 2D layout to facilitate precise perception of 3D images and considering distribution of attention maintenance based on eye-tracking might be useful in the objective assessment of user experience for novel displays |
Anika Krause; Christian H. Poth Maintaining eye fixation relieves pressure of cognitive action control Journal Article In: iScience, vol. 26, no. 9, pp. 1–16, 2023. @article{Krause2023, Cognitive control enables humans to behave guided by their current goals and intentions. Cognitive control in one task generally suffers when humans try to engage in another task on top. However, we discovered an additional task that supports conflict resolution. In two experiments, participants performed a spatial cognitive control task. For different blocks of trials, they either received no instruction regarding eye movements or were asked to maintain the eyes fixated on a stimulus. The additional eye fixation task did not reduce task performance, but selectively ameliorated the adverse effects of cognitive conflicts on reaction times (Experiment 1). Likewise, in urgent situations, the additional task reduced performance impairments due to stimulus-driven processing overpowering cognitive control (Experiment 2). These findings suggest that maintaining eye fixation locks attentional resources that would otherwise induce spatial cognitive conflicts. This reveals an attentional disinhibition that boosts goal-directed action by relieving pressure from cognitive control. |
Frauke Kraus; Sarah Tune; Jonas Obleser; Björn Herrmann Neural α oscillations and pupil size differentially index cognitive demand under competing audiovisual task conditions Journal Article In: Journal of Neuroscience, vol. 43, no. 23, pp. 4352–4364, 2023. @article{Kraus2023a, Cognitive demand is thought to modulate two often used, but rarely combined, measures: pupil size and neural α (8–12 Hz) oscillatory power. However, it is unclear whether these two measures capture cognitive demand in a similar way under complex audiovisual-task conditions. Here we recorded pupil size and neural α power (using electroencephalography), while human participants of both sexes concurrently performed a visual multiple object-tracking task and an auditory gap detection task. Difficulties of the two tasks were manipulated independent of each other. Participants' performance decreased in accuracy and speed with increasing cognitive demand. Pupil size increased with increasing difficulty for both the auditory and the visual task. In contrast, α power showed diverging neural dynamics: parietal α power decreased with increasing difficulty in the visual task, but not with increasing difficulty in the auditory task. Furthermore, independent of task difficulty, within-participant trial-by-trial fluctuations in pupil size were negatively correlated with α power. Difficulty-induced changes in pupil size and α power, however, did not correlate, which is consistent with their different cognitive-demand sensitivities. Overall, the current study demonstrates that the dynamics of the neurophysiological indices of cognitive demand and associated effort are multifaceted and potentially modality-dependent under complex audiovisual-task conditions. |
Frauke Kraus; Jonas Obleser; Björn Herrmann Pupil size sensitivity to listening demand depends on motivational state Journal Article In: eNeuro, vol. 10, no. 12, pp. 1–12, 2023. @article{Kraus2023, Motivation plays a role when a listener needs to understand speech under acoustically demanding conditions. Previous work has demonstrated pupil-linked arousal being sensitive to both listening demands and motivational state during listening. It is less clear how motivational state affects the temporal evolution of the pupil size and its relation to subsequent behavior. We used an auditory gap detection task (N = 33) to study the joint impact of listening demand and motivational state on the pupil size response and examine its temporal evolution. Task difficulty and a listener's motivational state were orthogonally manipulated through changes in gap duration and monetary reward prospect. We show that participants' performance decreased with task difficulty, but that reward prospect enhanced performance under hard listening conditions. Pupil size increased with both increased task difficulty and higher reward prospect, and this reward prospect effect was largest under difficult listening conditions. Moreover, pupil size time courses differed between detected and missed gaps, suggesting that the pupil response indicates upcoming behavior. Larger pre-gap pupil size was further associated with faster response times on a trial-by-trial within-participant level. Our results reiterate the utility of pupil size as an objective and temporally sensitive measure in audiology. However, such assessments of cognitive resource recruitment need to consider the individual's motivational state. |
Sofia Krasovskaya; Árni Kristjánsson; W. Joseph MacInnes Microsaccade rate activity during the preparation of pro- and antisaccades Journal Article In: Attention, Perception, & Psychophysics, vol. 85, no. 7, pp. 2257–2276, 2023. @article{Krasovskaya2023, Microsaccades belong to the category of fixational micromovements and may be crucial for image stability on the retina. Eye movement paradigms typically require fixational control, but this does not eliminate all oculomotor activity. The antisaccade task requires a planned eye movement in the direction opposite of an onset, allowing separation of planning and execution. We build on previous studies of microsaccades in the antisaccade task using a combination of fixed and mixed pro- and antisaccade blocks. We hypothesized that microsaccade rates may be reduced prior to the execution of antisaccades as compared with regular saccades (prosaccades). In two experiments, we measured microsaccades in four conditions across three trial blocks: one block each of fixed prosaccade and antisaccade trials, and a mixed block where both saccade types were randomized. We anticipated that microsaccade rates would be higher prior to antisaccades than prosaccades due to the need to preemptively suppress reflexive saccades during antisaccade generation. In Experiment 1, with monocular eye tracking, there was an interaction between the effects of saccade and block type on microsaccade rates, suggesting lower rates on antisaccade trials, but only within mixed blocks. In Experiment 2, eye tracking was binocular, revealing suppressed microsaccade rates on antisaccade trials. A cluster permutation analysis of the microsaccade rate over the course of a trial did not reveal any particular critical time for this difference in microsaccade rates. Our findings suggest that microsaccade rates reflect the degree of suppression of the oculomotor system during the antisaccade task. |
Kenji W. Koyano; Elena M. Esch; Julie J. Hong; Elena N. Waidmann; Haitao Wu; David A. Leopold Progressive neuronal plasticity in primate visual cortex during stimulus familiarization Journal Article In: Science Advances, vol. 9, no. 12, pp. 1–12, 2023. @article{Koyano2023, The primate brain is equipped to learn and remember newly encountered visual stimuli such as faces and objects. In the macaque inferior temporal (IT) cortex, neurons mark the familiarity of a visual stimulus through response modification, often involving a decrease in spiking rate. Here, we investigate the emergence of this neural plasticity by longitudinally tracking IT neurons during several weeks of familiarization with face images. We found that most neurons in the anterior medial (AM) face patch exhibited a gradual decline in their late-phase visual responses to multiple stimuli. Individual neurons varied from days to weeks in their rates of plasticity, with time constants determined by the number of days of exposure rather than the cumulative number of presentations. We postulate that the sequential recruitment of neurons with experience-modified responses may provide an internal and graded measure of familiarity strength, which is a key mnemonic component of visual recognition. |
Svetlana Kovalenko; Anton Mamonov; Vladislav Kuznetsov; Alexandr Bulygin; Irina Shoshina; Ivan Brak; Alexey Kashevnik OperatorEYEVP: Operator dataset for fatigue detection based on eye movements, heart rate data, and video information Journal Article In: Sensors, vol. 23, no. 13, pp. 1–35, 2023. @article{Kovalenko2023, Detection of fatigue is extremely important in the development of different kinds of preventive systems (such as driver monitoring or operator monitoring for accident prevention). The presence of fatigue for this task should be determined with physiological and objective behavioral indicators. To develop an effective model of fatigue detection, it is important to record a dataset with people in a state of fatigue as well as in a normal state. We carried out data collection using an eye tracker, a video camera, a stage camera, and a heart rate monitor to record a different kind of signal to analyze them. In our proposed dataset, 10 participants took part in the experiment and recorded data 3 times a day for 8 days. They performed different types of activity (choice reaction time, reading, correction test Landolt rings, playing Tetris), imitating everyday tasks. Our dataset is useful for studying fatigue and finding indicators of its manifestation. We have analyzed datasets that have public access to find the best for this task. Each of them contains data of eye movements and other types of data. We evaluated each of them to determine their suitability for fatigue studies, but none of them fully fit the fatigue detection task. We evaluated the recorded dataset by calculating the correspondences between eye-tracking data and CRT (choice reaction time) that show the presence of fatigue. |
Hannes M. Körner; Franz Faul; Antje Nuthmann In: Attention, Perception, & Psychophysics, vol. 85, no. 6, pp. 1868–1887, 2023. @article{Koerner2023, The presence of a weapon in a scene has been found to attract observers' attention and to impair their memory of the person holding the weapon. Here, we examined the role of attention in this weapon focus effect (WFE) under different viewing conditions. German participants viewed stimuli in which a man committed a robbery while holding a gun or a cell phone. The stimuli were based on material used in a recent U.S. study reporting large memory effects. Recording eye movements allowed us to test whether observers' attention in the gun condition shifted away from the perpetrator towards the gun, compared with the phone condition. When using videos (Experiment 1), weapon presence did not appear to modulate the viewing time for the perpetrator, whereas the evidence concerning the critical object remained inconclusive. When using slide shows (Experiment 2), the gun attracted more gaze than the phone, replicating previous research. However, the attentional shift towards the weapon did not come at a cost of viewing time on the perpetrator. In both experiments, observers focused their attention predominantly on the depicted people and much less on the gun or phone. The presence of a weapon did not cause participants to recall fewer details about the perpetrator's appearance in either experiment. This null effect was replicated in an online study using the original videos and testing more participants. The results seem at odds with the attention-shift explanation of the WFE. Moreover, the results indicate that the WFE is not a universal phenomenon. |
Živa Korda; Sonja Walcher; Christof Körner; Mathias Benedek Effects of internally directed cognition on smooth pursuit eye movements: A systematic examination of perceptual decoupling Journal Article In: Attention, Perception, & Psychophysics, vol. 85, no. 4, pp. 1159–1178, 2023. @article{Korda2023, Eye behavior differs between internally and externally directed cognition and thus is indicative of an internal versus external attention focus. Recent work implicated perceptual decoupling (i.e., eye behavior becoming less determined by the sensory environment) as one of the key mechanisms involved in these attention-related eye movement differences. However, it is not yet understood how perceptual decoupling depends on the characteristics of the internal task. Therefore, we systematically examined effects of varying internal task demands on smooth pursuit eye movements. Specifically, we evaluated effects of the internal workload (control vs. low vs. high) and of internal task (arithmetic vs. visuospatial). The results of multilevel modelling showed that effects of perceptual decoupling were stronger for higher workload, and more pronounced for the visuospatial modality. Effects also followed a characteristic time-course relative to internal operations. The findings provide further support of the perceptual decoupling mechanism by showing that it is sensitive to the degree of interference between external and internal information. |
Damian Koevoet; Christoph Strauch; Marnix Naber; Stefan Van Stigchel The costs of paying overt and covert attention assessed with pupillometry Journal Article In: Psychological Science, vol. 34, no. 8, pp. 887–898, 2023. @article{Koevoet2023a, Attention can be shifted with or without an accompanying saccade (i.e., overtly or covertly, respectively). Thus far, it is unknown how cognitively costly these shifts are, yet such quantification is necessary to understand how and when attention is deployed overtly or covertly. In our first experiment (N = 24 adults), we used pupillometry to show that shifting attention overtly is more costly than shifting attention covertly, likely because planning saccades is more complex. We pose that these differential costs will, in part, determine whether attention is shifted overtly or covertly in a given context. A subsequent experiment (N = 24 adults) showed that relatively complex oblique saccades are more costly than relatively simple saccades in horizontal or vertical directions. This provides a possible explanation for the cardinal-direction bias of saccades. The utility of a cost perspective as presented here is vital to furthering our understanding of the multitude of decisions involved in processing and interacting with the external world efficiently. |
Damian Koevoet; Marnix Naber; Christoph Strauch; Rosyl S. Somai; Stefan Van der Stigchel Differential aspects of attention predict the depth of visual working memory encoding: Evidence from pupillometry Journal Article In: Journal of Vision, vol. 23, no. 6, pp. 1–11, 2023. @article{Koevoet2023, What determines how much one encodes into visual working memory? Traditionally, encoding depth is considered to be indexed by spatiotemporal properties of gaze, such as gaze position and dwell time. Although these properties inform about where and how long one looks, they do not necessarily inform about the current arousal state or how strongly attention is deployed to facilitate encoding. Here, we found that two types of pupillary dynamics predict how much information is encoded during a copy task. The task involved encoding a spatial pattern of multiple items for later reproduction. Results showed that smaller baseline pupil sizes preceding and stronger pupil orienting responses during encoding predicted that more information was encoded into visual working memory. Additionally, we show that pupil size reflects not only how much but also how precisely material is encoded. We argue that a smaller pupil size preceding encoding is related to increased exploitation, whereas larger pupil constrictions signal stronger attentional (re)orienting to the to-be-encoded pattern. Our findings support the notion that the depth of visual working memory encoding is the integrative outcome of differential aspects of attention: how alert one is, how much attention one deploys, and how long it is deployed. Together, these factors determine how much information is encoded into visual working memory. |
John Chi Wa Ko; Mandy M. Cheng; Wendy J. Green In: European Accounting Review, pp. 2–28, 2023. @article{Ko2023, Using eye-tracking technology, we examine whether the information processing patterns of nonprofessional investors with a directional investment preference are affected by performance information presented based on either a focus on stakeholders (stakeholder format) or on strategic goals (strategic theme format). We find that when a company's financial performance has declined but nonfinancial performance has improved, a strategic theme (stakeholder) format causes investors in a long investment position to focus on negative financial information to a lesser (greater) extent than those in a short investment position. These results indicate that a strategic theme format encourages biased investors to draw on favorable nonfinancial information to support their position, whereas a stakeholder format causes them to closely scrutinize unfavorable financial information. We also find that the level of bias in investors' earnings forecasts is lower when information is presented in a strategic theme format than in a stakeholder format; however, a supplementary experiment finds that this result is reversed when a company's financial performance has improved but its nonfinancial performance has declined. Our results have implications for external report preparers, standard setters, and analysts. |
Emily J. Knight; Edward G. Freedman; Evan J. Myers; Alaina S. Berruti; Leona A. Oakes; Cody Zhewei Cao; Sophie Molholm; John J. Foxe Severely attenuated visual feedback processing in children on the autism spectrum Journal Article In: Journal of Neuroscience, vol. 43, no. 13, pp. 2424–2438, 2023. @article{Knight2023, Individuals on the autism spectrum often exhibit atypicality in their sensory perception, but the neural underpinnings of these perceptual differences remain incompletely understood. One proposed mechanism is an imbalance in higher-order feedback re-entrant inputs to early sensory cortices during sensory perception, leading to increased propensity to focus on local object features over global context. We explored this theory by measuring visual evoked potentials during contour integration as considerable work has revealed that these processes are largely driven by feedback inputs from higher-order ventral visual stream regions. We tested the hypothesis that autistic individuals would have attenuated evoked responses to illusory contours compared with neurotypical controls. Electrophysiology was acquired while 29 autistic and 31 neurotypical children (7-17 years old, inclusive of both males and females) passively viewed a random series of Kanizsa figure stimuli, each consisting of four inducers that were aligned either at random rotational angles or such that contour integration would form an illusory square. Autistic children demonstrated attenuated automatic contour integration over lateral occipital regions relative to neurotypical controls. The data are discussed in terms of the role of predictive feedback processes on perception of global stimulus features and the notion that weakened “priors” may play a role in the visual processing anomalies seen in autism. |
Marina Klimovich; Simon P. Tiffin-Richards; Tobias Richter In: Journal of Research in Reading, vol. 46, no. 2, pp. 123–142, 2023. @article{Klimovich2023, Background: Commercial speed-reading training programs are typically marketed with the promise to dramatically increase reading speed without impairing comprehension. From the perspective of reading psychology, it seems quite unlikely that speed-reading training can indeed have such effects. However, research on the effectiveness of modern speed-reading training programs on reading performance in typical readers is sparse. The present study had two goals. First, we sought to extend prior research on speed-reading by assessing the effects of a speed-reading application on reading performance in a pre-training and post-training design with a control group. Second, we aimed to identify the mechanism underlying speed-reading training programs. Methods: We assessed reading speed, comprehension and eye movements of 30 German-speaking undergraduates (Mage = 22.77 years |
Michaela Klímová; Ilona M. Bloem; Sam Ling Attention preserves the selectivity of feature-tuned normalization Journal Article In: Journal of neurophysiology, vol. 130, no. 4, pp. 990–998, 2023. @article{Klimova2023, Attention and divisive normalization both contribute to making visual processing more efficient. Attention selectively increases the neural gain of relevant information in the early visual cortex, resulting in stronger perceived salience for attended regions or features. Divisive normalization improves processing efficiency by suppressing responses to homogeneous inputs and highlighting salient boundaries, facilitating sparse coding of inputs. Theoretical and empirical research suggest a tight link between attention and normalization, wherein attending to a stimulus results in a release from normalization, thereby allowing for an increase in neural response gain. In the present study, we address whether attention alters the qualitative properties of normalization. Specifically, we examine how attention influences the feature-tuned nature of normalization, whereby suppression is stronger between visual stimuli whose orientation contents are similar, and weaker when the orientations are different. Ten human observers viewed stimuli that varied in orientation content while we acquired fMRI BOLD responses under two attentional states: attending toward or attending away from the stimulus. Our results indicate that attention does not alter the specificity of feature-tuned normalization. Instead, attention seems to enhance visuocortical responses evenly, regardless of the degree of orientation similarity within the stimulus. Since visuocortical responses exhibit adaptation to statistical regularities in natural scenes, we conclude that while attention can selectively increase the gain of responses to attended items, it does not appear to alter the ecologically relevant correspondence between orientation differences and strength of tuned normalization.NEW & NOTEWORTHY The magnitude of visuocortical BOLD responses scales with orientation differences in visual stimuli, with the strongest response suppression for collinear stimuli and least suppression for orthogonal, in a way that appears to match natural scene statistics. We examined the effects of attention on this feature-tuned property of suppression and found that while attending to a stimulus increases the overall gain of visuocortical responses, the qualitative properties of feature-tuning remain unchanged, suggesting attention preserves tuned normalization properties. |
Lena Klever; Marie Christin Beyvers; Katja Fiehler; Pascal Mamassian; Jutta Billino Cross-modal metacognition: Visual and tactile confidence share a common scale Journal Article In: Journal of Vision, vol. 23, no. 5, pp. 1–16, 2023. @article{Klever2023, Humans can judge the quality of their perceptual decisions—an ability known as perceptual confidence. Previous work suggested that confidence can be evaluated on an abstract scale that can be sensory modality-independent or even domain-general. However, evidence is still scarce on whether confidence judgments can be directly made across visual and tactile decisions. Here, we investigated in a sample of 56 adults whether visual and tactile confidence share a common scale by measuring visual contrast and vibrotactile discrimination thresholds in a confidence-forced choice paradigm. Confidence judgments were made about the correctness of the perceptual decision between two trials involving either the same or different modalities. To estimate confidence efficiency, we compared discrimination thresholds obtained from all trials to those from trials judged to be relatively more confident. We found evidence for metaperception because higher confidence was associated with better perceptual performance in both modalities. Importantly, participants were able to judge their confidence across modalities without any costs in metaperceptual sensitivity and only minor changes in response times compared to unimodal confidence judgments. In addition, we were able to predict cross-modal confidence well from unimodal judgments. In conclusion, our findings show that perceptual confidence is computed on an abstract scale and that it can assess the quality of our decisions across sensory modalities. |
Devi S. Klein; Miguel A. Lago; Craig K. Abbey; Miguel P. Eckstein A 2d synthesized image improves the 3d search for foveated visual systems Journal Article In: IEEE Transactions on Medical Imaging, vol. 42, no. 8, pp. 2176–2188, 2023. @article{Klein2023, Current medical imaging increasingly relies on 3D volumetric data making it difficult for radiologists to thoroughly search all regions of the volume. In some applications (e.g., Digital Breast Tomosynthesis), the volumetric data is typically paired with a synthesized 2D image (2D-S) generated from the corresponding 3D volume. We investigate how this image pairing affects the search for spatially large and small signals. Observers searched for these signals in 3D volumes, 2D-S images, and while viewing both. We hypothesize that lower spatial acuity in the observers' visual periphery hinders the search for the small signals in the 3D images. However, the inclusion of the 2D-S guides eye movements to suspicious locations, improving the observer's ability to find the signals in 3D. Behavioral results show that the 2D-S, used as an adjunct to the volumetric data, improves the localization and detection of the small (but not large) signal compared to 3D alone. There is a concomitant reduction in search errors as well. To understand this process at a computational level, we implement a Foveated Search Model (FSM) that executes human eye movements and then processes points in the image with varying spatial detail based on their eccentricity from fixations. The FSM predicts human performance for both signals and captures the reduction in search errors when the 2D-S supplements the 3D search. Our experimental and modeling results delineate the utility of 2D-S in 3D search - reduce the detrimental impact of low-resolution peripheral processing by guiding attention to regions of interest, effectively reducing errors. |
Nathalie Klein Selle; Kristina Suchotzki; Yoni Pertzov; Matthias Gamer Orienting versus inhibition: The theory behind the ocular-based Concealed Information Test Journal Article In: Psychophysiology, vol. 60, no. 3, pp. 1–13, 2023. @article{KleinSelle2023, When trying to conceal one's knowledge, various ocular changes occur. However, which cognitive mechanisms drive these changes? Do orienting or inhibition—two processes previously associated with autonomic changes—play a role? To answer this question, we used a Concealed Information Test (CIT) in which participants were either motivated to conceal (orienting + inhibition) or reveal (orienting only) their knowledge. While pupil size increased in both motivational conditions, the fixation and blink CIT effects were confined to the conceal condition. These results were mirrored in autonomic changes, with skin conductance increasing in both conditions while heart rate decreased solely under motivation to conceal. Thus, different cognitive mechanisms seem to drive ocular responses. Pupil size appears to be linked to the orienting of attention (akin to skin conductance changes), while fixations and blinks rather seem to reflect arousal inhibition (comparable to heart rate changes). This knowledge strengthens CIT theory and illuminates the relationship between ocular and autonomic activity. |
Janina Klautke; Celia Foster; W. Pieter Medendorp; Tobias Heed Dynamic spatial coding in parietal cortex mediates tactile-motor transformation Journal Article In: Nature Communications, vol. 14, no. 1, pp. 1–18, 2023. @article{Klautke2023, Movements towards touch on the body require integrating tactile location and body posture information. Tactile processing and movement planning both rely on posterior parietal cortex (PPC) but their interplay is not understood. Here, human participants received tactile stimuli on their crossed and uncrossed feet, dissociating stimulus location relative to anatomy versus external space. Participants pointed to the touch or the equivalent location on the other foot, which dissociates sensory and motor locations. Multi-voxel pattern analysis of concurrently recorded fMRI signals revealed that tactile location was coded anatomically in anterior PPC but spatially in posterior PPC during sensory processing. After movement instructions were specified, PPC exclusively represented the movement goal in space, in regions associated with visuo-motor planning and with regional overlap for sensory, rule-related, and movement coding. Thus, PPC flexibly updates its spatial codes to accommodate rule-based transformation of sensory input to generate movement to environment and own body alike. |
Clare Kirtley; Christopher Murray; Phillip B. Vaughan; Benjamin W. Tatler Navigating the narrative: An eye-tracking study of readers' strategies when reading comic page layouts Journal Article In: Applied Cognitive Psychology, vol. 37, no. 1, pp. 52–70, 2023. @article{Kirtley2023, In multimedia stimuli (e.g., comics), the reader must follow a narrative in which text and image both contribute information, and artists may use more irregular layouts which must still be followed correctly. While previous work has found that the external structure (outlines) of panels is a major contributor to navigation decisions in comics, other studies have shown that panel content can affect reading order. The present studies use eye-tracking to investigate these contributions further. In Experiment 1, the reading behaviors on six layout variations were compared. The influence of the external structure was replicated, but an effect of text location was also found for one layout type. Experiment 2 focused on variations of this particular layout, manipulating the location of text within critical panels. Panel content was a consistent effect for all variations. While most navigation decisions are made using the external structure, content becomes key when resolving ambiguous layouts. |
Matthew Kimble; Olivia Cappello; Kevin Fleming Hypervigilance and depression as predictors of eye tracking to ambiguous pictures in trauma survivors Journal Article In: International Journal of Psychophysiology, vol. 187, pp. 27–33, 2023. @article{Kimble2023, Hypervigilance, attentional bias, and negative views of the world play a significant role in post trauma symptomatology and can be associated with both clinical depression and posttraumatic stress. However, both theory and research suggest there may be discernible differences in attentional patterns between these two outcomes. While depression may be associated with a general negativity bias, posttraumatic stress may be specifically associated with visual scanning, hypervigilance, and threat detection. In this study, seventy-seven community trauma survivors completed self-assessments for hypervigilance, depression, and posttraumatic cognitions and then had their eyes tracked while looking at a series of thirty neutral but ambiguous and complex pictures on a computer screen. Mean age of the sample was 36.3 with 52 % of the sample identifying as female. We found that hypervigilance scores and negative views of the world predicted both the number of fixations and area of the picture covered. These factors did not predict pupil size. These findings suggest that there are discernable gaze patterns after trauma associated with posttraumatic stress but not depression. Specifically, ambiguous pictures generate more fixations and scanning that is associated with vigilance but not depression. |
June Hee Kim; Christine Yin; Elisha P. Merriam; Zvi N. Roth Pupil size is sensitive to low-level stimulus features, independent of arousal-related modulation Journal Article In: eNeuro, vol. 10, no. 10, pp. 1–12, 2023. @article{Kim2023c, Similar to a camera aperture, pupil size adjusts to the surrounding luminance. Unlike a camera, pupil size is additionally modulated both by stimulus properties and by cognitive processes, including attention and arousal, though the interdependence of these factors is unclear. We hypothesized that different stimulus properties interact to jointly modulate pupil size while remaining independent from the impact of arousal. We measured pupil responses from human observers to equiluminant stimuli during a demanding rapid serial visual presentation (RSVP) task at fixation and tested how response amplitude depends on contrast, spatial frequency, and reward level. We found that under constant luminance, unattended stimuli evoke responses that are separable from changes caused by general arousal or attention. We further uncovered a double-dissociation between task-related responses and stimulus-evoked responses, suggesting that different sources of pupil size modulation are independent of one another. Our results shed light on neural pathways underlying pupillary response. |
Jiae Kim; Jiyeon Lee; Sang Beom Jun; Jee Eun Sung Pupillometry as a window to detect cognitive aging in the brain Journal Article In: Biomedical Engineering Letters, pp. 91–101, 2023. @article{Kim2023b, This study investigated whether there are aging-related differences in pupil dilation (pupillometry) while the cognitive load is manipulated using digit- and word-span tasks. A group of 17 younger and 15 cognitively healthy older adults performed digit- and word-span tasks. Each task comprised three levels of cognitive loads with 10 trials for each level. For each task, the recall accuracy and the slope of pupil dilation were calculated and analyzed. The raw signal of measured pupil size was low-pass filtered and interpolated to eliminate blinking artifacts and spike noises. Two-way ANOVA was used for statistical analyses. For the recall accuracy, the significant group differences emerged as the span increases in digit-span (5- vs. 7-digit) and word-span (4- vs. 5-word) tasks, while the group differences were not significant on 3-digit- and 3-word-span tasks with lower cognitive load. In digit-span tasks, there was no aging-related difference in the slope of pupil dilation. However, in word-span tasks, the slope of pupil dilation differed significantly between two groups as cognitive load increased, indicating that older adults presented a higher pupil dilation slope than younger adults especially under the conditions with higher cognitive load. The current study found significant aging effects in the pupil dilations under the more cognitive demanding span tasks when the types of span tasks varied (e.g., digit vs. word). The manipulations successfully elicited differential aging effects, given that the aging effects became most salient under word-span tasks with greater cognitive load especially under the maximum length. |
Hyung Cho Kim; Claire M. Kaplan; Samiha Islam; Allegra S. Anderson; Megan E. Piper; Daniel E. Bradford; John J. Curtin; Kathryn A. DeYoung; Jason F. Smith; Andrew S. Fox; Alexander J. Shackman Acute nicotine abstinence amplifies subjective withdrawal symptoms and threat-evoked fear and anxiety, but not extended amygdala reactivity Journal Article In: PLoS ONE, vol. 18, pp. 1–31, 2023. @article{Kim2023a, Tobacco smoking imposes a staggering burden on public health, underscoring the urgency of developing a deeper understanding of the processes that maintain addiction. Clinical and experience-sampling data highlight the importance of anxious withdrawal symptoms, but the underlying neurobiology has remained elusive. Mechanistic work in animals implicates the central extended amygdala (EAc)—including the central nucleus of the amygdala and the neighboring bed nucleus of the stria terminalis—but the translational relevance of these discoveries remains unexplored. Here we leveraged a randomized trial design, well-established threat-anticipation paradigm, and multidimensional battery of assessments to understand the consequences of 24-hour nicotine abstinence. The threat-anticipation paradigm had the expected consequences, amplifying subjective distress and arousal, and recruiting the canonical threat-anticipation network. Abstinence increased smoking urges and withdrawal symptoms, and potentiated threat-evoked distress, but had negligible consequences for EAc threat reactivity, raising questions about the translational relevance of prominent animal and human models of addiction. These observations provide a framework for conceptualizing nicotine abstinence and withdrawal, with implications for basic, translational, and clinical science. |
Haena Kim; Brian A. Anderson Primary rewards and aversive outcomes have comparable effects on attentional bias Journal Article In: Behavioral Neuroscience, vol. 137, no. 2, pp. 89–94, 2023. @article{Kim2023, Attention is biased toward stimuli previously associated with reward. The same is true for aversive conditioning; stimuli previously associated with an aversive outcome also bias attention, suggesting that motivational salience guides attention. Most research that supports this conclusion has manipulated monetary gain—a secondary reinforcer—for reward learning, and electric shocks—a primary punisher—for aversive conditioning, making it difficult to directly compare their influence on attention. Therefore, in the present study, we matched for reinforcer dimensions by using primary taste as reinforcers/punishers and assessed their influence on attention. In a training phase, participants learned to associate three colors with sweet juice (reward), salt water (aversive), and no outcome (neutral), respectively. The two primary reinforcers were equated for valence based on choices made in a prior decision-making task. In a later test phase, these three colors were used for targets and distractors in a task in which participants oriented to a shapedefined target. An attentional bias in favor of the aversively conditioned and reward-associated colors was evident when comparing to the neutral color. Importantly, a direct comparison of rewarded and aversive stimuli revealed no significant differences. These results suggest that when matched for reinforcer dimensions and valence, reward and aversive outcomes bias attention in a similar manner and their effects are comparable, providing further evidence in support of the motivational salience account of learningdependent attention. |
Anastasia Kerr-German; A. Caglar Tas; Aaron T. Buss A multi-method approach to addressing the toddler data desert in attention research Journal Article In: Cognitive Development, vol. 65, pp. 1–14, 2023. @article{KerrGerman2023, Visual attention skills undergo robust development change during infancy and continue to co-develop with other cognitive processes in early childhood. Despite this, this is a general disconnect between measures of the earliest foundations of attention during infancy and later development of attention in relation to executive functioning during the toddler years. To examine associations between these different measures of attention, the current study administered an oculomotor task (infant orienting with attention, IOWA) and a manual response (Flanker) task with a group of toddlers. We collected simultaneous neural recordings (using functional near-infrared spectroscopy), eye-tracking, and behavioral responses in 2.5- and 3.5-year-olds to examine the neural and behavioral associations between these skills. Results revealed that oculomotor facilitation in the IOWA task was negatively associated with accuracy on neutral trials in the Flanker task. Second, conflict scores between the two tasks were positively associated. At the neural level, however, the tasks showed distinct patterns of activation. Left frontal cortex was engaged during the Flanker task whereas right frontal and parietal cortex was engaged during the IOWA task. Activation during the IOWA task differed based on how well children could control oculomotor behavior during the task. Children with high levels of stimulus reactivity activated parietal cortex more strongly, but children with more controlled oculomotor behavior activated frontal cortex more strongly. |
Devin H. Kehoe; Lukas Schießer; Hassaan Malik; Mazyar Fallah Motion distractors perturb saccade programming later in time than static distractors Journal Article In: Current Research in Neurobiology, vol. 4, pp. 1–17, 2023. @article{Kehoe2023, The mechanism that reweights oculomotor vectors based on visual features is unclear. However, the latency of oculomotor visual activations gives insight into their antecedent featural processing. We compared the oculomotor processing time course of grayscale, task-irrelevant static and motion distractors during target selection by continuously measuring a battery of human saccadic behavioral metrics as a function of time after distractor onset. The motion direction was towards or away from the target and the motion speed was fast or slow. We compared static and motion distractors and observed that both distractors elicited curved saccades and shifted endpoints at short latencies (∼25 ms). After 50 ms, saccade trajectory biasing elicited by motion distractors lagged static distractor trajectory biasing by 10 ms. There were no such latency differences between distractor motion directions or motion speeds. This pattern suggests that additional processing of motion stimuli occurred prior to the propagation of visual information into the oculomotor system. We examined the interaction of distractor processing time (DPT) with two additional factors: saccadic reaction time (SRT) and saccadic amplitude. Shorter SRTs were associated with shorter DPT latencies of biased saccade trajectories. Both SRT and saccadic amplitude were associated with the magnitude of saccade trajectory biases. |
Brandon Keehn; Girija Kadlaskar; Rebecca McNally Keehn Elevated and accelerated: Locus coeruleus activity and visual search abilities in autistic children Journal Article In: Cortex, vol. 169, pp. 118–129, 2023. @article{Keehn2023, Background: Autistic individuals excel at visual search, however, the neural mechanism(s) underlying this advantage remain unclear. The locus coeruleus-norepinephrine (LC-NE) system, which plays a critical role in sensory perception and selective attention, has been shown to function in a persistently elevated state in individuals on the spectrum. However, the relationship between elevated tonic LC-NE activity and accelerated search in autism has not been explored. Objective: To examine the relationship between visual search abilities and resting pupil diameter (an indirect measure of tonic LC-NE activation) in autistic and neurotypical children. Methods: Participants were 24 school-aged autistic children and 24 age- and IQ-matched neurotypical children aged 8–15 years. Children completed two tasks: a resting eye-tracking task and a visual search paradigm. For the resting eye-tracking task, pupil diameter was monitored while participants fixated a central crosshair. For the visual search paradigm, participants were instructed to find the target (vertical line) embedded within an array of tilted (10°) distractor lines. The target was present on 50% of trials, and displayed within set sizes of 18, 24, and 36 items. Results: Consistent with previous studies, autistic children had significantly larger resting pupil size and searched faster and more efficiently compared to their neurotypical peers. Eye-tracking findings revealed that accelerated search was associated with fewer, not shorter, fixations in the autism group. Autistic children also showed reduced leftward search bias. Larger resting pupil size, indicative of increased tonic activation of the LC-NE system, was associated with greater search efficiency, longer fixation durations, and reduced leftward bias. Finally, within both groups reduced leftward bias was associated with increased autism symptomatology. Discussion: Together, these findings add to the existing body of research highlighting superior search in autism, suggest that elevated tonic LC-NE activity may contribute to more efficient search, and link non-social visual-spatial processing strengths to autism symptoms. |
Noa Katabi; Hadas Simon; Sharon Yakim; Inbal Ravreby; Tal Ohad; Yaara Yeshurun Deeper than you think: Partisanship-dependent brain responses in early sensory and motor brain regions Journal Article In: Journal of Neuroscience, vol. 43, no. 6, pp. 1027–1037, 2023. @article{Katabi2023, Recent political polarization has illustrated how individuals with opposing political views often experience ongoing events in markedly different ways. In this study, we explored the neural mechanisms underpinning this phenomenon. We conducted fMRI scanning of 34 right- and left-wing participants (45% females) watching political videos (e.g., campaign ads and political speeches) just before the elections in Israel. As expected, we observed significant differences between left- and right-wing participants in their interpretation of the videos' content. Furthermore, neuroimaging results revealed partisanship-dependent differences in activation and synchronization in higher-order regions. Surprisingly, such differences were also revealed in early sensory, motor, and somatosensory regions. We found that the political content synchronized the responses of primary visual and auditory cortices in a partisanship-dependent manner. Moreover, right-wing (and not left-wing) individuals' sensorimotor cortex was involved in processing right-wing (and not left-wing) political content. These differences were pronounced to the extent that we could predict political orientation from the early brain-response alone. Importantly, no such differences were found with respect to neutral content. Therefore, these results uncover more fundamental neural mechanisms underlying processes of political polarization. |
Omid Kardan; Andrew J. Stier; Elliot A. Layden; Kyoung Whan Choe; Muxuan Lyu; Xihan Zhang; Sian L. Beilock; Monica D. Rosenberg; Marc G. Berman Improvements in task performance after practice are associated with scale-free dynamics of brain activity Journal Article In: Network Neuroscience, vol. 7, no. 3, pp. 1129–1152, 2023. @article{Kardan2023, Although practicing a task generally benefits later performance on that same task, there are individual differences in practice effects. One avenue to model such differences comes from research showing that brain networks extract functional advantages from operating in the vicinity of criticality, a state in which brain network activity is more scale-free. We hypothesized that higher scale-free signal from fMRI data, measured with the Hurst exponent (H), indicates closer proximity to critical states. We tested whether individuals with higher H during repeated task performance would show greater practice effects. In Study 1, participants performed a dual-n-back task (DNB) twice during MRI (n = 56). In Study 2, we used two runs of n-back task (NBK) data from the Human Connectome Project sample (n = 599). In Study 3, participants performed a word completion task (CAST) across six runs (n = 44). In all three studies, multivariate analysis was used to test whether higher H was related to greater practicerelated performance improvement. Supporting our hypothesis, we found patterns of higher H that reliably correlated with greater performance improvement across participants in all three studies. However, the predictive brain regions were distinct, suggesting that the specific spatial H↑ patterns are not task-general. |
Tinghu Kang; Tinghao Tang; Peizhi Zhang; Shu Luo; Huanhuan Qi Metacognitive prompts and numerical ordinality in solving word problems: An eye-tracking study Journal Article In: British Journal of Educational Psychology, vol. 93, no. 3, pp. 862–877, 2023. @article{Kang2023a, Background: The ability to translate concrete manipulatives into abstract mathematical formulas can aid in the solving of mathematical word problems among students, and metacognitive prompts play a significant role in enhancing this process. Aims: Based on the concept of semantic congruence, we explored the effects of metacognitive prompts and numerical ordinality on information searching and cognitive processing, throughout the process of solving mathematical word problems among primary school students in China. Sample: Participants included 73 primary school students (38 boys and 35 girls) with normal or corrected visual acuity. Methods: This study was based on a 2 (prompt information: no-prompt, metacognitive-prompt) × 2 (number attribute: cardinal number, ordinal number) mixed experimental design. We analysed multiple eye-movement indices, such as fixation duration, saccadic amplitude, and pupil size, since they pertained to the areas of interest. Results: When solving both types of problems, pupil sizes were significantly smaller under the metacognitive-prompt condition compared with the no-prompt condition, and shorter dwell time for specific sentences, conditional on metacognitive prompts, indicated the optimization of the presented algorithm. Additionally, the levels of fixation durations and saccadic amplitudes were significantly higher when solving ordinal number word problems compared with solving ordinal number problems, indicating that primary school students were less efficient in reading and faced increased levels of difficulty when solving ordinal number problems. Conclusions: The results indicate that for Chinese upper-grade primary school students, cognitive load was lower in the metacognitive prompting condition and when solving cardinal problems, and higher when solving ordinal problems. |
Tinghu Kang; Shu Luo; Ping Wang; Tinghao Tang Influence of figure information on attention distribution in Chinese landscape painting Journal Article In: Heliyon, vol. 9, no. 4, pp. 1–10, 2023. @article{Kang2023, Chinese landscape painting is a complex form of visual art. More researchers pay more attention to the creation process and expressed intention of landscape painting. However, the appreciation of works of visual art is often related to cognitive processing, and it is influenced by the content of the works. This study hypothesized that the information of the figure in landscape paintings could guide the allocation of attention and affect cognitive processing. To test this hypothesis, the vertical landscape paintings of the Song and Ming Dynasties were used as experimental materials in the experiment, and the eye-movement technology was applied to record and compare the differences of the eye-movement indexes of landscape paintings with and without figures. The results showed that the dwell time of landscape painting with figure was significantly longer than that of landscape painting without figure, and the dwell time of the interest area of the figure was significantly longer than that of the interest area without figure. However, the first three fixation duration of the interest area with figures is significantly less than that of the interest area without figure, and there was no difference in the saccade counts and the distribution of fixation points between different landscape paintings. It suggested that the figure in the landscape painting can attract peoples' attention, but it does not have attention priority. Meanwhile, peoples tend to holistic processing when they viewing the vertical landscape paintings, and it is not influenced by the information of figure. |
Sunjeev K. Kamboj; Matthew Peniket; Louise Simeonov In: PLoS ONE, vol. 18, no. 3 March, pp. 1–21, 2023. @article{Kamboj2023, Background The vagus nerve (VN) is a neural nexus between the brain and body, enabling bidirectional regulation of mental functioning and peripheral physiology. Some limited correlational findings suggest an association between VN activation and a particular form of self-regulation: compassionate responding. Interventions that are geared towards strengthening self-compassion in particular, can serve as an antidote to toxic shame and self-criticism and improve psychological health. Objective We describe a protocol for examining the role of VN activation on ‘state' self-compassion, self-criticism, and related outcomes. By combining transcutaneous vagus nerve stimulation (tVNS) with a brief imagery-based self-compassion intervention, we aim to preliminarily test additivity versus synergy between these distinct bottom-up and top-down methods for putatively regulating vagal activity. We also test whether the effects of VN stimulation accumulate with daily stimulation and daily compassionate imagery practice. Methods Using a randomized 2 x 2 factorial (stimulation x imagery condition) design, healthy volunteers (n = 120) receive active (tragus) or sham (earlobe) tVNS plus standardized (audio-recorded) self-compassionate or sham mental imagery instructions. These interventions are delivered in a university-based psychological laboratory in two sessions, one week apart, as well as being self-administered between sessions by participants at home. Prestimulation, peri-stimulation and post-imagery measures of state self-compassion, self-criticism and related self-report outcomes are assessed in two lab sessions, separated by a week (Days 1 and 8). Heart rate variability is used as a physiological metric of vagal activity and an eye-tracking task assesses attentional bias to compassionate faces during the two lab sessions. On Days 2–7, participants continue their randomly assigned stimulation and imagery tasks at home, and complete state measures at the end of each remote session. Discussion Demonstrating modulation of compassionate responding using tVNS would support a causal link between VN activation and compassion. This would provide a basis for future studies of bioelectronic approaches to augmenting therapeutic contemplative techniques. |
Oren Kadosh; Yoram S. Bonneh Fixation-related visual mismatch negativity Journal Article In: Journal of Vision, vol. 23, no. 3, pp. 1–12, 2023. @article{Kadosh2023, Vision under natural conditions could be studied by combining electroencephalogram (EEG) and eye tracking as well as using saccades as triggers for the onset of the fixation-related potentials (FRPs) and for the oculomotor inhibition (OMI) that follows every saccade. The result of this analysis is thought to be equivalent to the event-related response following a peripheral preview. Previous studies that measured responses to visual deviants in a sequence of flashed stimuli found an increased negativity in the occipital N1 component (visual mismatch negativity [vMMN]), and prolonged saccadic inhibition for unexpected events. The aim of the current study was to develop an oddball paradigm in constrained natural-viewing and determine whether a similar mismatched FRP and prolonged OMI for deviance could be found. To this end, we developed a visual oddball paradigm on a static display to generate expectancy and surprise across successive saccades. Observers (n = 26) inspected, one after the other, seven small patterns of E and an inverted E arranged on the screen along a horizontal path, with one frequent (standard) and one rare (deviant), looking for a superimposed tiny dot target in each 5-second trial. Our results show a significantly larger FRP-N1 negativity for the deviant, compared with the standard and prolonged OMI of the following saccade, as previously found for transient oddballs. Our results show, for the first time, prolonged OMI and stronger fixation-related N1 to a task-irrelevant visual mismatch (vMMN) in natural, but task-guided viewing. These two signals combined could serve as markers of prediction error in free viewing. |
Rebecca L. Johnson; Megan Wootten; Abigail I. Spear; Ashley Smolensky The relationship between personality traits and the processing of emotion words: Evidence from eye-movements in sentence reading Journal Article In: Journal of Psycholinguistic Research, vol. 52, no. 5, pp. 1497–1523, 2023. @article{Johnson2023b, Previous research shows that processing times on emotion words (both negative and positive) are faster than on non-emotional neutral words. In the current study, we explored how personality traits (the Big Five and the trait emotional intelligence factors) may further influence the processing of emotion versus non-emotion words by conducting two experiments where participants silently read sentences while their eye movements were recorded. The results replicated the facilitative emotion effect and showed that those with higher agreeableness scores had stronger emotion effects on positive words and those with higher extraversion scores, higher openness scores, higher agreeableness scores, lower sociability scores, and higher emotionality scores had stronger emotion effects on negative words. Furthermore, some personality traits also led to different ways that readers approach text, for example, through more risky reading strategies. |
Philippa Anne Johnson; Tessel Blom; Simon Gaal; Daniel Feuerriegel; Stefan Bode; Hinze Hogendoorn Position representations of moving objects align with real-time position in the early visual response Journal Article In: eLife, vol. 12, pp. 1–21, 2023. @article{Johnson2023, When interacting with the dynamic world, the brain receives outdated sensory information, due to the time required for neural transmission and processing. In motion perception, the brain may overcome these fundamental delays through predictively encoding the position of moving objects using information from their past trajectories. In the present study, we evaluated this proposition using multivariate analysis of high temporal resolution electroencephalographic data. We tracked neural position representations of moving objects at different stages of visual processing, relative to the real-time position of the object. During early stimulus-evoked activity, position representations of moving objects were activated substantially earlier than the equivalent activity evoked by unpredictable flashes, aligning the earliest representations of moving stimuli with their real-time positions. These findings indicate that the predictability of straight trajectories enables full compensation for the neural delays accumulated early in stimulus processing, but that delays still accumulate across later stages of cortical processing. |
Jia Jin; Ailian Wang; Cuicui Wang; Qingguo Ma How do consumers perceive and process online overall vs. individual text-based reviews? Behavioral and eye-tracking evidence Journal Article In: Information and Management, vol. 60, no. 5, pp. 1–13, 2023. @article{Jin2023a, Building on the Heuristic-Systematic model, we use a survey and two eye-tracking experiments to investigate consumers' perceived usefulness of overall and individual text-based reviews (OTRs vs. ITRs) for search vs. experience products, and the information processing features. Results indicate that OTRs show higher usefulness than ITRs, regardless of product type. ITRs are perceived to be more useful for experience products than for search products. Furthermore, two eye-tracking studies confirm these results from a physiological standpoint and reveal the attentional allocation during information processing. OTRs affect subjects' processing of ITRs information differently in purchase search and experience products. |
Jia Jin; Chenchen Lin; Fenghua Wang; Ting Xu; Wuke Zhang A study of cognitive effort involved in the framing effect of summary descriptions of online product reviews for search vs. experience products Journal Article In: Electronic Commerce Research, vol. 23, no. 2, pp. 785–806, 2023. @article{Jin2023b, Few studies have focused on summary descriptions of online product reviews regarding purchase decisions, and there is a gap between individual product reviews and summary descriptions of online product reviews. The current study applied eye-tracking to explore how the product type moderates the framing effect of summary descriptions of product reviews on e-consumers' purchase decisions. The results showed that product type moderated the framing effect of summary reviews on e-consumers' purchase intention. Specifically, for search products, compared with a negative frame, a positive frame increased e-consumers' attention to function attributes and led to higher purchase intention. However, with experience products, e-consumers' attention and purchase intention did not vary across framing messages. Referring to information asymmetry theory and signal theory, we posit that the cognitive effort involved in summary review information is high for search products and low for experience products since summary reviews are a more useful signal in reducing information asymmetry for search products than for experience products. The theoretical and practical implications are also discussed. |
Michael Jigo; Daniel Tavdy; Marc M. Himmelberg; Marisa Carrasco Cortical magnification eliminates differences in contrast sensitivity across but not around the visual field Journal Article In: eLife, vol. 12, pp. 1–23, 2023. @article{Jigo2023, Human visual performance changes dramatically both across (eccentricity) and around (polar angle) the visual field. Performance is better at the fovea, decreases with eccentricity, and is better along the horizontal than vertical meridian and along the lower than the upper vertical meridian. However, all neurophysiological and virtually all behavioral studies of cortical magnification have investigated eccentricity effects without considering polar angle. Most performance differences due to eccentricity are eliminated when stimulus size is cortically magnified (M-scaled) to equate the size of its cortical representation in primary visual cortex (V1). But does cortical magnification underlie performance differences around the visual field? Here, to assess contrast sensitivity, human adult observers performed an orientation discrimination task with constant stimulus size at different locations as well as when stimulus size was M-scaled according to stimulus eccentricity and polar angle location. We found that although M-scaling stimulus size eliminates differences across eccentricity, it does not eliminate differences around the polar angle. This finding indicates that limits in contrast sensitivity across eccentricity and around the visual field are mediated by different anatomical and computational constraints. |
Lan Jiang; Chunliang Yang; Zhongling Pi; Yangping Li; Shaohang Liu; Xinfa Yi Individuals with high metacognitive ability are better at divergent and convergent thinking Journal Article In: Journal of Intelligence, vol. 11, no. 8, pp. 1–20, 2023. @article{Jiang2023, Is metacognitive ability a predictor of creative performance? Previous studies have produced conflicting findings. To clarify whether this relationship exists, the current study used eye tracking techniques and vocal thinking reports to explore creativity differences in individuals with different levels of metacognitive ability. One hundred and twelve participants completed the Metacognitive Ability scale, and were divided into two groups (with thirty participants in each group) based on their metacognition scores (the highest and lowest 27% of metacognitive ability scores). Then, participants in both groups completed two creative thinking tasks (AUT and CCRAT) while their eye behaviors were recorded by eye tracking. The results showed that participants with high metacognitive ability were better at divergent thinking, as evidenced by greater fixation and saccade counts, as well as smaller saccade amplitudes in the AUT task. In addition, Bayesian analyses provide anecdotal evidence that participants with high metacognitive ability tended to be better at convergent thinking. Furthermore, eye tracking results demonstrated that they exhibited longer fixation duration and more fixation count on the materials in the CCRAT task. These findings reflect an important role of metacognition in creative thinking, especially in divergent thinking. |
Yu-Cin Cin Jian Reading behavior in science comics and its relations with comprehension performance and reading attitudes: An eye-tracker study Journal Article In: Research in Science Education, vol. 53, no. 129, pp. 689–706, 2023. @article{Jian2023, One of the ways to acquire scientific knowledge is by reading science comics. This study aims to investigate the attitudes (e.g., reading habits, interest, motivation) of university students toward reading science comics, and how they read science comics for acquiring scientific knowledge reflected by an eye tracker. Sixty-five undergraduates were invited to complete an attitudes and habits questionnaire of reading comics, after which they read a science comic where their reading processes were recorded by an eye tracker; finally, they completed a reading comprehension test. The results showed that most undergraduates had a positive attitude for reading comics, and were more likely to learn science by reading comics rather than texts. In addition, the analysis results of the linear mixed-effect models indicated that fixation with regard to re-reading durations could promote post-reading comprehension. The readers who particularly re-read the important information in relation to the boxed-in texts and graphics for a longer period scored higher in the post-test (e.g., the cause and variation processes of cancer). The analysis of variance also indicated that readers who exhibited a good test performance allocated more re-reading time on informational texts and diagrams. This meant they were more intentional and selective in re-reading the core and concept-intensive information; however, concerning the reader who performed poorly in their test, this reading pattern was unapparent. Therefore, those who exhibited a better grasp of the knowledge in the science comics were likely to fully process the areas that presented relevant information concerning important science concepts. |
Yanfang Jia; Sanjun Sun Man or machine? Comparing the difficulty of human translation versus neural machine translation post-editing Journal Article In: Perspectives: Studies in Translation Theory and Practice, vol. 31, no. 5, pp. 950–968, 2023. @article{Jia2023a, This study aims to compare neural machine translation (NMT) post-editing and human translation in terms of task difficulty while considering source text (ST) complexity and machine translation (MT) quality levels, two factors that have been rarely examined in previous comparison studies. Data were obtained from 60 trainee translators concerning the perceived and objective difficulties of post-editing and human translation tasks and the participants' performance. It was found that (1) the difficulty of the NMT post-editing task, compared to human translation, was significantly influenced by both NMT quality and ST complexity; the difficulty of the post-editing task was significantly lower than that of the human translation task only in the case of high-quality NMT paired with complex ST, while the results were mixed for other interactions between NMT quality and ST complexity levels; (2) no strong correlations were found between the participants' perceived difficulty and the measurements of objective difficulty and task performance for both post-editing and human translation tasks. Practical and research implications were discussed. |
Juan Jia; Ziyu Wei; Heben Cheng; Xiaolu Wang Translation directionality and translator anxiety: Evidence from eye movements in L1-L2 translation Journal Article In: Frontiers in Psychology, vol. 14, pp. 1–12, 2023. @article{Jia2023, While considerable research on the impact of anxiety on second language learning has been carried out in international contexts, the impact of anxiety on the translator's undertaking L2 translation, a sort of anxiety arising from the translation directionality, as well as the structure of cognitive mechanism for translational anxiety, remain under-explored. Adopting the eye-tracking and key-logging approach to data collection, this study implemented an eye-tracking experiment with EFL learners at a Chinese university to probe into how the participants responded to L1 and L2 translation-tasks and the mechanism involved in these processes. It is found that translation directionality does have a great impact on the processing of translation, which causes the change of cognitive load and then leads to the change of levels in translator anxiety. The finding further confirms the key premises of the Processing Proficiency Model and the Revised Hierarchical Model with attendant implications for translation processes. |
Yi-Ting Jhang; Chi-Wen Liang The effect of uncertainty on attentional bias in subclinical worriers: Evidence from reaction time and eye-tracking Journal Article In: Journal of Behavior Therapy and Experimental Psychiatry, vol. 81, pp. 1–7, 2023. @article{Jhang2023, Background and objectives: High-worry individuals have been assumed to show attentional bias towards threat, particularly under high uncertainty. This study experimentally investigated the effect of uncertainty on attentional bias in subclinical worriers. Methods: A visual dot-probe task combined with eye-tracking was used to assess participants' attentional bias towards blurred and unfiltered stimuli. Fifty high-worry and 47 low-worry participants were randomly assigned to either the high- or low-uncertainty threat condition. Aversive noise bursts were delivered either unpredictably (the high-uncertainty threat condition) or predictably (the low-uncertainty threat condition) during the visual dot-probe task. Results: In the low-uncertainty threat condition, high-worry participants exhibited enhanced attentional engagement towards blurred pictures compared to low-worry participants. They also had shorter initial fixation latencies on blurred pictures than on unfiltered pictures. In the high-uncertainty threat condition, high-worry participants demonstrated more difficulty in disengaging from threatening pictures compared to low-worry participants. Limitation: First, this study used a nonclinical sample. Second, the power was limited with regard to the analysis of eye-movement data. Third, anxiety and worry induced by noise bursts were measured using subjective rating scales only. Fourth, some picture characteristics, such as luminosity and complexity, were not controlled. Finally, uncertainty related to delivery of noise bursts and pictures were both manipulated dichotomously. Conclusion: This study highlights the importance of uncertainty in the maintenance of attentional bias towards threat-related pictures in high-worry individuals. |
Woojae Jeong; Seolmin Kim; JeongJun Park; Joonyeol Lee In: Communications Biology, vol. 6, no. 1, pp. 1–13, 2023. @article{Jeong2023, Humans integrate multiple sources of information for action-taking, using the reliability of each source to allocate weight to the data. This reliability-weighted information integration is a crucial property of Bayesian inference. In this study, participants were asked to perform a smooth pursuit eye movement task in which we independently manipulated the reliability of pursuit target motion and the direction-of-motion cue. Through an analysis of pursuit initiation and multivariate electroencephalography activity, we found neural and behavioral evidence of Bayesian information integration: more attraction toward the cue direction was generated when the target motion was weak and unreliable. Furthermore, using mathematical modeling, we found that the neural signature of Bayesian information integration had extra-retinal origins, although most of the multivariate electroencephalography activity patterns during pursuit were best correlated with the retinal velocity errors accumulated over time. Our results demonstrated neural implementation of Bayesian inference in human oculomotor behavior. |
Valerie L. Jentsch; Oliver T. Wolf; Tobias Otto; Christian J. Merz The impact of physical exercise on the consolidation of fear extinction memories Journal Article In: Psychophysiology, vol. 60, no. 11, pp. 1–19, 2023. @article{Jentsch2023, Based on the mechanisms of fear extinction, exposure therapy is the most common treatment for anxiety disorders. However, extinguished fear responses can reemerge even after successful treatment. Novel interventions enhancing exposure therapy efficacy are therefore critically needed. Physical exercise improves learning and memory and was also shown to enhance extinction processes. This study tested whether physical exercise following fear extinction training improves the consolidation of extinction memories. Sixty healthy men underwent a differential fearconditioning paradigm with fear acquisition training on day 1 and fear extinction training followed by an exercise or resting control intervention on day 2. On day 3, retrieval and reinstatement were tested including two additional but perceptually similar stimuli to explore the generalization of exercise effects. Exercise significantly increased heart rate, salivary alpha amylase, and cortisol, indicating successful exercise manipulation. Contrary to our expectations, exercise did not enhance but rather impaired extinction memory retrieval on the next day, evidenced by significantly stronger differential skin conductance responses (SCRs) and pupil dilation (PD). Importantly, although conditioned fear responses were successfully acquired, they did not fully extinguish, explaining why exercise might have boosted the consolidation of the original fear memory trace instead. Additionally, stronger differential SCRs and PD toward the novel stimuli suggest that the memory enhancing effects of exercise also generalized to perceptually similar stimuli. Together, these findings indicate that physical exercise can facilitate both the long-term retrievability and generalization of extinction memories, but presumably only when extinction was successful in the first place. |
Patrick Jendritza; Frederike J. Klein; Pascal Fries Multi-area recordings and optogenetics in the awake, behaving marmoset Journal Article In: Nature Communications, vol. 14, no. 1, pp. 1–16, 2023. @article{Jendritza2023, The common marmoset has emerged as a key model in neuroscience. Marmosets are small in size, show great potential for genetic modification and exhibit complex behaviors. Thus, it is necessary to develop technology that enables monitoring and manipulation of the underlying neural circuits. Here, we describe a novel approach to record and optogenetically manipulate neural activity in awake, behaving marmosets. Our design utilizes a light-weight, 3D printed titanium chamber that can house several high-density silicon probes for semi-chronic recordings, while enabling simultaneous optogenetic stimulation. We demonstrate the application of our method in male marmosets by recording multi- and single-unit data from areas V1 and V6 with 192 channels simultaneously, and show that optogenetic activation of excitatory neurons in area V6 can influence behavior in a detection task. This method may enable future studies to investigate the neural basis of perception and behavior in the marmoset. |
Ariel N. James; Colleen J. Minnihan; Duane G. Watson Language experience predicts eye movements during online auditory comprehension Journal Article In: Journal of Cognition, vol. 6, no. 1, pp. 1–29, 2023. @article{James2023, Experience-based theories of language processing suggest that listeners use the properties of their previous linguistic input to constrain comprehension in real time (e.g. MacDonald & Christiansen, 2002; Smith & Levy, 2013; Stanovich & West, 1989; Mishra, Pandey, Singh, & Huettig, 2012). This project investigates the prediction that individual differences in experience will predict differences in sentence comprehension. Participants completed a visual world eye-tracking task following Altmann and Kamide (1999) which manipulates whether the verb licenses the anticipation of a specific referent in the scene (e.g. The boy will eat/move the cake). Within this paradigm, we ask (1) are there reliable individual differences in language-mediated eye movements during this task? If so, (2) do individual differences in language experience correlate with these differences, and (3) can this relationship be explained by other, more general cognitive abilities? Study 1 finds evidence that language experience predicts an overall facilitation in fixating the target, and Study 2 replicates this effect and finds that it remains when controlling for working memory, inhibitory control, phonological ability, and perceptual speed. |
Nidhi Jain; Aria Wang; Margaret M. Henderson; Ruogu Lin; Jacob S. Prince; Michael J. Tarr; Leila Wehbe Selectivity for food in human ventral visual cortex Journal Article In: Communications Biology, vol. 6, no. 1, pp. 1–14, 2023. @article{Jain2023, Visual cortex contains regions of selectivity for domains of ecological importance. Food is an evolutionarily critical category whose visual heterogeneity may make the identification of selectivity more challenging. We investigate neural responsiveness to food using natural images combined with large-scale human fMRI. Leveraging the improved sensitivity of modern designs and statistical analyses, we identify two food-selective regions in the ventral visual cortex. Our results are robust across 8 subjects from the Natural Scenes Dataset (NSD), multiple independent image sets and multiple analysis methods. We then test our findings of food selectivity in an fMRI “localizer” using grayscale food images. These independent results confirm the existence of food selectivity in ventral visual cortex and help illuminate why earlier studies may have failed to do so. Our identification of food-selective regions stands alongside prior findings of functional selectivity and adds to our understanding of the organization of knowledge within the human visual system. |
Sagi Jaffe-Dax; Christine E. Potter; Tiffany S. Leung; Lauren L. Emberson; Casey Lew-Williams The influence of memory on visual perception in infants, children, and adults Journal Article In: Cognitive Science, vol. 47, no. 11, pp. 1–20, 2023. @article{JaffeDax2023, Perception is not an independent, in-the-moment event. Instead, perceiving involves integrating prior expectations with current observations. How does this ability develop from infancy through adulthood? We examined how prior visual experience shapes visual perception in infants, children, and adults. Using an identical task across age groups, we exposed participants to pairs of colorful stimuli and implicitly measured their ability to discriminate relative saturation levels. Results showed that adult participants were biased by previously experienced exemplars, and exhibited weakened in-the-moment discrimination between different levels of saturation. In contrast, infants and children showed less influence of memory in their perception, and they actually outperformed adults in discriminating between current levels of saturation. Our findings suggest that as humans develop, their perception relies more on prior experience and less on current observation. |
Fumiaki Iwane; Debadatta Dash; Roberto F. Salamanca-Giron; William Hayward; Marlene Bönstrup; Ethan R. Buch; Leonardo G. Cohen Combined low-frequency brain oscillatory activity and behavior predict future errors in human motor skill Journal Article In: Current Biology, vol. 33, no. 15, pp. 3145–3154, 2023. @article{Iwane2023, Human skills are composed of sequences of individual actions performed with utmost precision. When occasional errors occur, they may have serious consequences, for example, when pilots are manually landing a plane. In such cases, the ability to predict an error before it occurs would clearly be advantageous. Here, we asked whether it is possible to predict future errors in a keyboard procedural human motor skill. We report that prolonged keypress transition times (KTTs), reflecting slower speed, and anomalous delta-band oscillatory activity in cingulate-entorhinal-precuneus brain regions precede upcoming errors in skill. Combined anomalous low-frequency activity and prolonged KTTs predicted up to 70% of future errors. Decoding strength (posterior probability of error) increased progressively approaching the errors. We conclude that it is possible to predict future individual errors in skill sequential performance. |
Spencer Ivy; Taren Rohovit; Jeanine Stefanucci; Dustin Stokes; Megan Mills; Trafton Drew Visual expertise is more than meets the eye: An examination of holistic visual processing in radiologists and architects Journal Article In: Journal of Medical Imaging, vol. 10, no. 1, pp. 1–15, 2023. @article{Ivy2023, Purpose: One of the dominant behavioral markers of visual-expert search strategy, holistic visual processing (HVP), suggests that experts process information from a larger region of space in conjunction with a more focused gaze pattern to improve search speed and accuracy. To date, extant literature suggests that visual search expertise is domain specific, including HVP and its associated behaviors. Approach: The current study is the first to use eye tracking to directly measure the HVP strategies of two expert groups, radiologists and architects, in comparison to one another and a novice control. Results: In doing so, we replicated and extended this prior research: visual expertise is domain specific. However, our eye-tracking data indicate that contrary to this prior work, HVP strategies are transferable across domains. Yet, despite the transfer of HVP strategies, there is neither reduced search time nor greater accuracy in visual search outside of an expert's domain. Conclusions: Therefore, our data suggest that HVP behaviors are a particular form of visual search mechanism that, outside of an expert's native search-ecology, are not necessarily con- ducive to more general visual search success. It is in addition to explicit knowledge of an expert's domain, how to search, and where to search, that HVP strategies are their most effective for visual search success. |
Roxane J. Itier; Amie J. Durston In: Scientific Reports, vol. 13, no. 1, pp. 1–15, 2023. @article{Itier2023, Decoding others' facial expressions is critical for social functioning. To clarify the neural correlates of expression perception depending on where we look on the face, three combined gaze-contingent ERP experiments were analyzed using robust mass-univariate statistics. Regardless of task, fixation location impacted face processing from 50 to 350 ms, maximally around 120 ms, reflecting retinotopic mapping around C2 and P1 components. Fixation location also impacted majorly the N170-P2 interval while weak effects were seen at the face-sensitive N170 peak. Results question the widespread assumption that faces are processed holistically into an indecomposable perceptual whole around the N170. Rather, face processing is a complex and view-dependent process that continues well beyond the N170. Expression and fixation location interacted weakly during the P1-N170 interval, supporting a role for the mouth and left eye in fearful and happy expression decoding. Expression effects were weakest at the N170 peak but strongest around P2, especially for fear, reflecting task-independent affective processing. Results suggest N170 reflects a transition between processes rather than the maximum of a holistic face processing stage. Focus on this peak should be replaced by data-driven analyses of the epoch using robust statistics to fully unravel the early visual processing of faces and their affective content. |
Stefano Ioannucci; Valentine Chirokoff; Bixente Dilharreguy; Valéry Ozenne; Sandra Chanraud; Alexandre Zénon In: Communications Biology, vol. 6, no. 1, pp. 1–12, 2023. @article{Ioannucci2023, Cognitive fatigue is defined by a reduced capacity to perform mental tasks. Despite its pervasiveness, the underlying neural mechanisms remain elusive. Specifically, it is unclear whether prolonged effort affects performance through alterations in over-worked task-relevant neuronal assemblies. Our paradigm based on repeated passive visual stimulation discerns fatigue effects from the influence of motivation, skill and boredom. We induced performance loss and observed parallel alterations in the neural blueprint of the task, by mirroring behavioral performance with multivariate neuroimaging techniques (MVPA) that afford a subject-specific approach. Crucially, functional areas that responded the most to repeated stimulation were also the most affected. Finally, univariate analysis revealed clusters displaying significant disruption within the extrastriate visual cortex. In sum, here we show that repeated stimulation impacts the implicated brain areas' activity and causes tangible behavioral repercussions, providing evidence that cognitive fatigue can result from local, functional, disruptions in the neural signal induced by protracted recruitment. |
Bashirah Ibrahim; Lin Ding Students' sensemaking of synthesis physics problems: An exploration of their eye fixations Journal Article In: International Journal of Science Education, vol. 45, no. 9, pp. 734–753, 2023. @article{Ibrahim2023, We investigate students' eye movements when they solve sequential and simultaneous synthesis physics problems. In sequential synthesis problems, multiple events occur chronologically, whereas in simultaneous synthesis problems, multiple events take place concurrently. We captured students' eye fixations on each problem diagram and recorded their verbal descriptions of problem-solving approaches. Results indicate that for sequential synthesis tasks, students fixated heavily and frequently on regions of a diagram where information is unknown or on empty space related to future events. Further, most students could invoke all relevant principles and intermediate variables to solve the sequential problems. However, for simultaneous synthesis tasks, students prioritised aspects of the diagram where information is given in the problem statement. Moreover, they mostly invoked only one fundamental principle to solve the problems by either using the values given in the statement or identifying one relevant intermediate variable. These findings may be explained by the differences in the spatiotemporal occurrence of the multiple events in the two types of synthesis problem. The chronological events in sequential synthesis tasks seem to support students' sensemaking, but the concurrent events of simultaneous synthesis tasks do not. |
Aoife M. L. Hunter; Roger S. Anderson; Tony Redmond; David F. Garway-Heath; Pádraig J. Mulholland Investigating the spatiotemporal summation of perimetric stimuli in dry age-related macular degeneration Journal Article In: Translational Vision Science & Technology, vol. 12, no. 11, pp. 1–17, 2023. @article{Hunter2023, Purpose: To measure achromatic spatial, temporal, and spatiotemporal summation in dry age-related macular degeneration (AMD) compared to healthy controls under conditions of photopic gaze-contingent perimetry. Methods: Twenty participants with dry AMD (mean age, 74.6 years) and 20 healthy controls (mean age, 67.8 years) performed custom, gaze-contingent perimetry tests. An area-modulation test generated localized estimates of Ricco's area (RA) at 2.5° and 5° eccentricities along the 0°, 90°, 180°, and 270° meridians. Contrast thresholds were measured at the same test locations for stimuli of six durations (3.7–190.4 ms) with a Goldmann III stimulus (GIII, 0.43°) and RA-scaled stimuli. The upper limit (critical duration) of complete temporal summation (using the GIII stimulus) and spatiotempo-ral summation (using the RA stimuli) was estimated using iterative two-phase regression analysis. Results: Median (interquartile range [IQR]) RA estimates were significantly larger in AMD participants (2.5°: 0.21 [0.09–0.41] deg2; 5°: 0.32 [0.15–0.65 deg2 ]) compared to healthy controls (2.5°: 0.08 [0.05–0.13] deg2; 5°: 0.15 [0.08–0.22] deg2 ) at all test locations (all P < 0.05). No significant difference in median critical duration was found in AMD participants with the GIII stimulus (19.6 [9.9–30.4] ms) and RA-scaled stimuli (22.9 [13.9–40.3] ms) compared to healthy controls (GIII: 17.0 [11.3–24.0] ms; RA-scaled: 22.4 [14.3–33.1] ms) at all test locations (all P > 0.05). Conclusions: Spatial summation is altered in dry AMD, without commensurate changes in temporal summation. Translational Relevance: The sensitivity of perimetry to AMD may be improved by utilizing stimuli that probe alterations in spatial summation in the disease. |
Shao-Chin Hung; Marisa Carrasco Microsaccades as a long-term oculomotor correlate in visual perceptual learning Journal Article In: Psychonomic Bulletin & Review, vol. 30, no. 1, pp. 235–249, 2023. @article{Hung2023a, Human perceptual learning, experience-induced gains in sensory discrimination, typically yields long-term performance improvements. Recent research revealed long-lasting transfer at the untrained location enabled by feature-based attention (FBA), reminiscent of its global effect (Hung & Carrasco, Scientific Reports,11(1), 13914, (2021)). Visual Perceptual Learning (VPL) is typically studied while observers maintain fixation, but the role of fixational eye movements is unknown. Microsaccades – the largest of fixational eye movements – provide a continuous, online, physiological measure from the oculomotor system that reveals dynamic processing, which is unavailable from behavioral measures alone. We investigated whether and how microsaccades change after training in an orientation discrimination task. For human observers trained with or without FBA, microsaccade rates were significantly reduced during the response window in both trained and untrained locations and orientations. Critically, consistent with long-term training benefits, this microsaccade-rate reduction persisted over a year. Furthermore, microsaccades were biased toward the target location prior to stimulus onset and were more suppressed for incorrect than correct trials after observers' responses. These findings reveal that fixational eye movements and VPL are tightly coupled and that learning-induced microsaccade changes are long lasting. Thus, microsaccades reflect functional dynamics of the oculomotor system during information encoding, maintenance and readout, and may serve as a reliable long-term physiological correlate in VPL. |
Shao-Chin Hung; Antoine Barbot; Marisa Carrasco Visual perceptual learning modulates microsaccade rate and directionality Journal Article In: Scientific Reports, vol. 13, no. 1, pp. 1–13, 2023. @article{Hung2023, Microsaccades, incessant “fixational eye movements” (< 1°), are an important window into cognitive functions. Yet, its role in visual perceptual learning (VPL)–improvements in visual discrimination due to practice–remains practically unexplored. Here we investigated whether and how microsaccades change in VPL. Human observers performed a Landolt acuity task for 5 consecutive days and were assigned to the Neutral or Attention group. On each trial, two peripheral Landolt squares were presented briefly along a diagonal. Observers reported the gap side of the target stimulus. Training improved acuity and modified the microsaccade rate; with training, the rate decreased during the fixation period but increased during the response cue. Furthermore, microsaccade direction during the response cue was biased toward the target location, and training enhanced and sped up this bias. Finally, the microsaccade rate during a task-free fixation period correlated with observers' initial acuity threshold, indicating that the fewer the microsaccades during fixation the better the individual visual acuity. All these results, which were similar for both the Neutral and Attention groups and at both trained and untrained locations, suggest that microsaccades could serve as a physiological marker reflecting functional dynamics in human perceptual learning. |
Falk Huettig; Cesko C. Voeten; Esther Pascual; Junying Liang; Florian Hintz Do autistic children differ in language-mediated prediction? Journal Article In: Cognition, vol. 239, pp. 1–7, 2023. @article{Huettig2023, Prediction appears to be an important characteristic of the human mind. It has also been suggested that prediction is a core difference of autistic1 children. Past research exploring language-mediated anticipatory eye movements in autistic children, however, has been somewhat contradictory, with some studies finding normal anticipatory processing in autistic children with low levels of autistic traits but others observing weaker prediction effects in autistic children with less receptive language skills. Here we investigated language-mediated anticipatory eye movements in young children who differed in the severity of their level of autistic traits and were in professional institutional care in Hangzhou, China. We chose the same spoken sentences (translated into Mandarin Chinese) and visual stimuli as a previous study which observed robust prediction effects in young children (Mani & Huettig, 2012) and included a control group of typically-developing children. Typically developing but not autistic children showed robust prediction effects. Most interestingly, autistic children with lower communication, motor, and (adaptive) behavior scores exhibited both less predictive and non-predictive visual attention behavior. Our results raise the possibility that differences in language-mediated anticipatory eye movements in autistic children with higher levels of autistic traits may be differences in visual attention in disguise, a hypothesis that needs further investigation. |
Lynn Huestegge; Aleks Pieczykolan; Iring Koch A Gestalt account of human behavior is supported by evidence from switching between single and dual actions Journal Article In: Scientific Reports, vol. 13, no. 1, pp. 1–14, 2023. @article{Huestegge2023, The question of how behavior is represented in the mind lies at the core of psychology as the science of mind and behavior. While a long-standing research tradition has established two opposing fundamental views of perceptual representation, Structuralism and Gestalt psychology, we test both accounts with respect to action representation: Are multiple actions (characterizing human behavior in general) represented as the sum of their component actions (Structuralist view) or holistically (Gestalt view)? Using a single-/dual-response switch paradigm, we analyzed switches between dual ([A + B]) and single ([A], [B]) responses across different effector systems and revealed comparable performance in partial repetitions and full switches of behavioral requirements (e.g., in [A + B] → [A] vs. [B] → [A], or [A] → [A + B] vs. [B] → [A + B]), but only when the presence of dimensional overlap between responses allows for Gestalt formation. This evidence for a Gestalt view of behavior in our paradigm challenges some fundamental assumptions in current (tacitly Structuralist) action control theories (in particular the idea that all actions are represented compositionally with reference to their components), provides a novel explanatory angle for understanding complex, highly synchronized human behavior (e.g., dance), and delimitates the degree to which complex behavior can be analyzed in terms of its basic components. |
Christoph Huber-Huber; David Melcher Saccade execution increases the preview effect with faces: An EEG and eye-tracking coregistration study Journal Article In: Attention, Perception, & Psychophysics, pp. 1–17, 2023. @article{HuberHuber2023, Under naturalistic viewing conditions, humans conduct about three to four saccadic eye movements per second. These dynamics imply that in real life, humans rarely see something completely new; there is usually a preview of the upcoming foveal input from extrafoveal regions of the visual field. In line with results from the field of reading research, we have shown with EEG and eye-tracking coregistration that an extrafoveal preview also affects postsaccadic visual object processing and facilitates discrimination. Here, we ask whether this preview effect in the fixation-locked N170, and in manual responses to the postsaccadic target face (tilt discrimination), requires saccade execution. Participants performed a gaze-contingent experiment in which extrafoveal face images could change their orientation during a saccade directed to them. In a control block, participants maintained stable gaze throughout the experiment and the extrafoveal face reappeared foveally after a simulated saccade latency. Compared with this no-saccade condition, the neural and the behavioral preview effects were much larger in the saccade condition. We also found shorter first fixation durations after an invalid preview, which is in contrast to reading studies. We interpret the increased preview effect under saccade execution as the result of the additional sensorimotor processes that come with gaze behavior compared with visual perception under stable fixation. In addition, our findings call into question whether EEG studies with fixed gaze capture key properties and dynamics of active, natural vision. |
Qian Huangfu; Hong Li; Yuanyuan Ban; Jiamei He An eye-tracking study on the effects of displayed teacher enthusiasm on students' learning procedural knowledge of Chemistry in video lectures Journal Article In: Journal of Chemical Education, pp. 1–11, 2023. @article{Huangfu2023, Teacher enthusiasm is known to affect students' learning in traditional classroom environments, but it is unclear how displayed teacher enthusiasm can optimize learning of chemistry procedural knowledge in multimedia learning environments. In this context, the present study used eye-tracking technology and quantitative analysis to examine how displayed teacher enthusiasm in video lectures affects students' positive emotions, visual attention, cognitive load, and learning outcomes. Measures were collected from 128 eighth-grade middle school students. An EyeLink 1000 Plus eye-tracker was used to capture the students' eye movements. The percentage of total fixation duration, percentage of fixation count, mean pupil size, and blink rate were used as metrics to analyze the eye-gaze data. The results showed that an enthusiastic teacher positively affected students' positive emotions, reduced students' cognitive load, and made students more concentrated on the learning-content area. Additionally, the higher level of displayed teacher enthusiasm improved learners' learning outcomes. |
Zhibang Huang; Zhimei Niu; Sheng Li Reactivation-induced memory integration prevents proactive interference in perceptual learning Journal Article In: Journal of Vision, vol. 23, no. 5, pp. 1–15, 2023. @article{Huang2023h, We acquire perceptual skills through experience to adapt ourselves to the changing environment. Accomplishing an effective skill acquisition is a main purpose of perceptual learning research. Given the often observed learning effect specificity, multiple perceptual learnings with shared parameters could serve to improve the generalization of the learning effect. However, the interference between the overlapping memory traces of different learnings may impede this effort. Here, we trained human participants on an orientation discrimination task.We observed a proactive interference effect that the first training blocked the second training at its untrained location. This was a more pronounced effect than the well-known location specificity in perceptual learning.We introduced a short reactivation of the first training before the second training and successfully eliminated the proactive interference when the second training was inside the reconsolidation time window of the reactivated first training. Interestingly, we found that practicing an irrelevant task at the location of the second training immediately after the reactivation of the first training could also restore the effect of the second training but in a smaller magnitude, even if the second training was conducted outside of the reconsolidation window. We proposed a two-level mechanism of reactivation-induced memory integration to account for these results. The reactivation-based procedure could integrate either the previously trained and untrained locations or the two trainings at these locations, depending on the activated representations during the reconsolidation process. The findings provide us with new insight into the roles of long-term memory mechanisms in perceptual learning. |
Yiru Huang; Zitian Liu; Mingqin Wang; Le Gao; Yanyan Wu; Jingyi Hu; Zhenyu Zhang; Fang-Fang Yan; Daming Deng; Chang-Bing Huang; Minbin Yu Cortical reorganization after optical alignment in strabismic patients outside of critical period Journal Article In: Investigative Ophthalmology & Visual Science, vol. 64, no. 11, pp. 1–13, 2023. @article{Huang2023f, PURPOSE. To measure visual crowding, an essential bottleneck on object recognition and reliable psychophysical index of cortex organization, in older children and adults with horizontal concomitant strabismus before and after strabismus surgery. METHODS. Using real-time eye tracking to ensure gaze-contingent display, we examined the peripheral visual crowding effects in older children and adults with horizontal concomitant strabismus but without amblyopia before and after strabismus surgery. Patients were asked to discriminate the orientation of the central tumbling E target letter with flankers arranged along the radial or tangential axis in the nasal or temporal hemifield at different eccentricities (5° or 10°). The critical spacing value, which is the minimum space between the target and the flankers required for correct discrimination, was obtained for comparisons before and after strabismus surgery. RESULTS. Twelve individuals with exotropia (6 males, 21.75 ± 7.29 years, mean ± SD) and 15 individuals with esotropia (6 males, 24.13 ± 5.96 years) participated in this study. We found that strabismic individuals showed significantly larger critical spacing with nasotemporal asymmetry along the radial axis that related to the strabismus pattern, with exotropes exhibiting stronger temporal field crowding and esotropes exhibiting stronger nasal field crowding before surgical alignment. After surgery, the critical spacing was reduced and rebalanced between the nasal and temporal hemifields. Furthermore, the postoperative recovery of stereopsis was associated with the extent of nasotemporal balance of critical spacing. CONCLUSIONS. We find that optical realignment (i.e., strabismus surgery) can normalize the enlarged visual crowding effects, a reliable psychophysical index of cortical organization, in the peripheral visual field of older children and adults with strabismus and rebalance the nasotemporal asymmetry of crowding, promoting the recovery of postoperative stereopsis. Our results indicated a potential of experience-dependent cortical organization after axial alignment even for individuals who are out of the critical period of visual development, illuminating the capacity and limitations of optics on sensory plasticity and emphasizing the importance of ocular correction for clinical practice. |
Yiru Huang; Zitian Liu; Zidong Chen; Zongyi Zhan; Le Gao; Jingyi Hu; Yanyan Wu; Fang-Fang Yan; Daming Deng; Chang-Bing Huang; Minbin Yu Visual crowding reveals field- and axis-specific cortical miswiring after long-term axial misalignment in strabismic patients without amblyopia Journal Article In: Investigative Ophthalmology & Visual Science, vol. 64, no. 1, pp. 1–11, 2023. @article{Huang2023, PURPOSE. Inspired by physiological and neuroimaging findings that revealed squint- induced modification of cortical volume and visual receptive field in early visual areas, we hypothesized that strabismic eyes without amblyopia manifest an increase in critical spacing of visual crowding, an essential bottleneck on object recognition and reliable psychophysical index of cortical organization. METHODS. We used real-time eye tracking to ensure gaze-contingent display and examined visual crowding in patients with horizontal concomitant strabismus (both esotropia and exotropia) but without amblyopia and age-matched normal controls. RESULTS. Nineteen patients with exotropia (12 men, mean ± SD = 22.89 ± 7.82 years), matched normal controls (7 men, mean ± SD = 23.07 ± 1.07 years) participated in this 21 patients with esotropia (10 men, mean ± SD = 23.48 ± 6.95 years), and 14 age- study. We found that patients with strabismus without amblyopia showed significantly larger critical spacing with nasotemporal asymmetry in only the radial axis that related to the strabismus pattern, with exotropia exhibiting stronger temporal hemifield crowding and esotropia exhibiting stronger nasal hemifield crowding, in both the deviated and fixating eyes. Moreover, the magnitude of crowding change was related to the duration and degree of strabismic deviation. CONCLUSIONS. Using visual crowding as a psychophysical index of cortical organization, our study demonstrated significantly greater peripheral visual crowding with nasotemporal asymmetry in only the radial axis in patients with strabismus without amblyopia, indicating the existence of hemifield- and axis-specific miswiring of cortical processing in object recognition induced by long-term adaptation to ocular misalignment. |
Ling Huang; Jingyi Wang; Qionghua He; Chu Li; Yueling Sun; Carol A. Seger; Xilin Zhang A source for category-induced global effects of feature-based attention in human prefrontal cortex Journal Article In: Cell Reports, vol. 42, no. 9, pp. 1–20, 2023. @article{Huang2023d, Global effects of feature-based attention (FBA) are generally limited to stimuli sharing the same or similar features, as hypothesized in the “feature-similarity gain model.” Visual perception, however, often reflects categories acquired via experience/learning; whether the global-FBA effect can be induced by the categorized features remains unclear. Here, human subjects were trained to classify motion directions into two discrete categories and perform a classical motion-based attention task. We found a category-induced global-FBA effect in both the middle temporal area (MT+) and frontoparietal areas, where attention to a motion direction globally spread to unattended motion directions within the same category, but not to those in a different category. Effective connectivity analysis showed that the category-induced global-FBA effect in MT+ was derived by feedback from the inferior frontal junction (IFJ). Altogether, our study reveals a category-induced global-FBA effect and identifies a source for this effect in human prefrontal cortex, implying that FBA is of greater ecological significance than previously thought. |
Jiawen Huang; Isabel Velarde; Wei Ji Ma; Christopher Baldassano Schema-based predictive eye movements support sequential memory encoding Journal Article In: eLife, vol. 12, pp. 1–19, 2023. @article{Huang2023b, When forming a memory of an experience that is unfolding over time, we can use our schematic knowledge about the world (constructed based on many prior episodes) to predict what will transpire. We developed a novel paradigm to study how the development of a complex schema influences predictive processes during perception and impacts sequential memory. Participants learned to play a novel board game (“4-in-a-row”) across six training sessions, and repeatedly performed a memory test in which they watched and recalled sequences of moves from the game. We found that participants gradually became better at remembering sequences from the game as their schema developed, driven by improved accuracy for schema-consistent moves. Eye tracking revealed that increased predictive eye movements during encoding, which were most prevalent in expert players, were associated with better memory. Our results identify prediction as a mechanism by which schematic knowledge can improve episodic memory. |
Jeff Huang; Donald Brien; Brian C. Coe; Giulia Longoni; Donald J. Mabbott; Douglas P. Munoz; E. Ann Yeh Delayed oculomotor response associates with optic neuritis in youth with demyelinating disorders Journal Article In: Multiple Sclerosis and Related Disorders, vol. 79, pp. 1–9, 2023. @article{Huang2023a, Introduction: Impairment in visual and cognitive functions occur in youth with demyelinating disorders such as multiple sclerosis, neuromyelitis optica spectrum disorder, and myelin oligodendrocyte glycoprotein antibody-associated disease. Quantitative behavioral assessment using eye-tracking and pupillometry can provide functional metrics for important prognostic and clinically relevant information at the bedside. Methods: Children and adolescents diagnosed with demyelinating disorders and healthy, age-matched controls completed an interleaved pro- and anti-saccade task using video-based eye-tracking and underwent spectral-domain optical coherence tomography examination for evaluation of retinal nerve fiber layer and ganglion cell inner plexiform layer thickness. Low-contrast visual acuity and Symbol Digit Modalities Test were performed for visual and cognitive functional assessments. We assessed saccade and pupil parameters including saccade reaction time, direction error rate, pupil response latency, peak constriction time, and peak constriction and dilation velocities. Generalized Estimating Equations were used to examine the association of eye-tracking parameters with optic neuritis history, structural metrics, and visual and cognitive scores. Results: The study included 36 demyelinating disorders patients, aged 8–18 yrs. (75% F; median = 15.22 yrs. |
Jie Hu; Arkady Konovalov; Christian C. Ruff A unified neural account of contextual and individual differences in altruism Journal Article In: eLife, vol. 12, pp. 1–36, 2023. @article{Hu2023, Altruism is critical for cooperation and productivity in human societies but is known to vary strongly across contexts and individuals. The origin of these differences is largely unknown, but may in principle reflect variations in different neurocognitive processes that temporally unfold during altruistic decision making (ranging from initial perceptual processing via value computations to final integrative choice mechanisms). Here, we elucidate the neural origins of individual and contextual differences in altruism by examining altruistic choices in different inequality contexts with computational modeling and electroencephalography (EEG). Our results show that across all contexts and individuals, wealth distribution choices recruit a similar late decision process evident in model-predicted evidence accumulation signals over parietal regions. Contextual and individual differences in behavior related instead to initial processing of stimulus-locked inequality-related value information in centroparietal and centrofrontal sensors, as well as to gamma-band synchronization of these value-related signals with parietal response-locked evidence-accumulation signals. Our findings suggest separable biological bases for individual and contextual differences in altruism that relate to differences in the initial processing of choice-relevant information. |
Scott S. Hsieh; David A. Cook; Akitoshi Inoue; Hao Gong; Parvathy Sudhir Pillai; Matthew P. Johnson; Shuai Leng; Lifeng Yu; Jeff L. Fidler; David R. Holmes Iii; Rickey E. Carter; Cynthia H. Mccollough; Joel G. Fletcher Understanding reader variability: A 25-radiologist study on liver metastasis detection at CT Journal Article In: Radiology, vol. 306, no. 2, pp. 1–10, 2023. @article{Hsieh2023, Background: Substantial interreader variability exists for common tasks in CT imaging, such as detection of hepatic metastases. This variability can undermine patient care by leading to misdiagnosis. Purpose: To determine the impact of interreader variability associated with (a) reader experience, (b) image navigation patterns (eg, eye movements, workstation interactions), and (c) eye gaze time at missed liver metastases on contrast-enhanced abdominal CT images. Materials and Methods: In a single-center prospective observational trial at an academic institution between December 2020 and February 2021, readers were recruited to examine 40 contrast-enhanced abdominal CT studies (eight normal, 32 containing 91 liver metastases). Readers circumscribed hepatic metastases and reported confidence. The workstation tracked image navigation and eye movements. Performance was quantified by using the area under the jackknife alternative free-response receiver operator charac- teristic (JAFROC-1) curve and per-metastasis sensitivity and was associated with reader experience and image navigation variables. Differences in area under JAFROC curve were assessed with the Kruskal-Wallis test followed by the Dunn test, and effects of image navigation were assessed by using the Wilcoxon signed-rank test. Results: Twenty-five readers (median age, 38 years; IQR, 31–45 years; 19 men) were recruited and included nine subspecialized abdominal radiologists, five nonabdominal staff radiologists, and 11 senior residents or fellows. Reader experience explained differences in area under the JAFROC curve, with abdominal radiologists demonstrating greater area under the JAFROC curve (mean, 0.77; 95% CI: 0.75, 0.79) than trainees (mean, 0.71; 95% CI: 0.69, 0.73) (P = .02) or nonabdominal subspecialists (mean, 0.69; 95% CI: 0.60, 0.78) (P = .03). Sensitivity was similar within the reader experience groups (P = .96). Image navigation variables that were associated with higher sensitivity included longer interpretation time (P = .003) and greater use of coronal images (P < .001). The eye gaze time was at least 0.5 and 2.0 seconds for 71% (266 of 377) and 40% (149 of 377) of missed metastases, respectively. Conclusion: Abdominal radiologists demonstrated better discrimination for the detection of liver metastases on abdominal contrast-enhanced CT images. Missed metastases frequently received at least a brief eye gaze. Higher sensitivity was associated with longer interpretation time and greater use of liver display windows and coronal images. |
Monja Hoven; Alejandro Hirmas; Jan Engelmann; Ruth Holst The role of attention in decision-making under risk in gambling disorder: An eye-tracking study Journal Article In: Addictive Behaviors, vol. 138, pp. 1–10, 2023. @article{Hoven2023, Gambling disorder (GD) is a behavioural addiction characterized by impairments in decision-making, favouring risk- and reward-prone choices. One explanatory factor for this behaviour is a deviation in attentional processes, as increasing evidence indicates that GD patients show an attentional bias toward gambling stimuli. However, previous attentional studies have not directly investigated attention during risky decision-making. 26 patients with GD and 29 healthy matched controls (HC) completed a mixed gambles task combined with eye-tracking to investigate attentional biases for potential gains versus losses during decision-making under risk. Results indicate that compared to HC, GD patients gambled more and were less loss averse. GD patients did not show a direct attentional bias towards gains (or relative to losses). Using a recent (neuro)economics model that considers average attention and trial-wise deviations in average attention, we conducted fine-grained exploratory analyses of the attentional data. Results indicate that the average attention for gains in GD patients moderated the effect of gain value on gambling choices, whereas this was not the case for HC. GD patients with high average attention for gains started gambling at less high gain values. A similar trend-level effect was found for losses, where GD patients with high average attention for losses stopped gambling at lower loss values. This study gives more insight into how attentional processes in GD play a role in gambling behaviour, which could have implications for the development of future treatments focusing on attentional training or for the development of interventions that increase the salience of losses. |
Holger Hopp; Sarah Schimke; Freya Gastmann; David Öwerdieck; Gregory J. Poarch Processing to learn noncanonical word orders: Exploring linguistic and cognitive predictors of reanalysis in early L2 sentence comprehension Journal Article In: Studies in Second Language Acquisition, pp. 1–24, 2023. @article{Hopp2023, To test the contributions of processing to L2 syntax learning, this study explores (cross-) linguistic and cognitive predictors of sentence reanalysis in the L2 comprehension of relative clauses among low-intermediate L1 German adolescent learners of L2 English. Specifically, we test the degree to which L2 comprehension is affected by L2 proficiency, reanalysis ability in a related, earlier-acquired L2 structure (questions), reanalysis ability of relative clauses in the L1, cognitive control, and cognitive capacity. In visual-world eye-tracking experiments, 141 adolescent German-speaking L2 learners of English selected target pictures for auditorily presented questions and relative clauses in the L1 and in the L2. The results showed a strong subject preference for L2 relative clauses. Learners' L2 proficiency and their processing of object questions in the L2 predicted reanalysis for object relatives in eye movements, reaction times, and comprehension accuracy. In contrast, there was no evidence that cognitive control or working memory systematically affected the processing of object relatives. These findings suggest that linguistic processing outweighs cognitive processing in accounting for individual differences in low-intermediate L2 acquisition of complex grammar. Specifically, learners recruit shared processing mechanisms and routines across grammatical structures to pave a way in the acquisition of syntax. |
Alex J. Hoogerbrugge; Christoph Strauch; Tanja C. W. Nijboer; Stefan Van Stigchel Don't hide the instruction manual: A dynamic trade-off between using internal and external templates during visual search Journal Article In: Journal of Vision, vol. 23, no. 7, pp. 1–14, 2023. @article{Hoogerbrugge2023, Visual search is typically studied by requiring participants to memorize a template initially, for which they subsequently search in a crowded display. Search in daily life, however, often involves templates that remain accessible externally, and may therefore be (re)attended for just-in-time encoding or to refresh internal template representations. Here, we show that participants indeed use external templates during search when given the chance. This behavior was observed during both simple and complex search, scaled with task difficulty, and was associated with improved performance. Furthermore, we show that participants used external sampling not only to offload memory, but also as a means of verifying whether the template was remembered correctly at the end of trials.We conclude that the external world may not only provide the challenge (e.g., distractors), but may dynamically ease search. These results argue for extensions of state-of-the-art models of search, because external sampling seems to be used frequently, in at least two ways and is actually beneficial for task performance. Our findings support a model of visual working memory that emphasizes a resource-efficient trade-off between storing and (re)attending external information. |
Liu Hong-Zhi; Yang Xing-Lan; Li Qiu-Yue; Wei Zi-Han Preference of dimension-based difference in intertemporal choice: Eye-tracking evidence Journal Article In: Acta Psychologica Sinica, vol. 55, no. 4, pp. 612–625, 2023. @article{HongZhi2023, In the field of intertemporal choice, considerable empirical evidence from behavioral and process data supports the use of dimension-based models. The existing dimension-based models provide qualitative explanations for an individual's intertemporal choice and focus on “which dimension is the greater difference dimension”, but ignore the preference of dimension-based difference (i.e., “how much different of the difference between the two dimensions”). In the present study, we used eye-tracking technology to examine the relationship between the preference of dimension-based difference and the information searching process. The results in the two experiments consistently revealed that response time, gaze transition entropy (a measure of visual scanning efficiency), and stationary gaze entropy (a measure of the level of even distribution across different areas of interest) could negatively predict the preference of dimension-based difference. Our findings highlighted the correlation between the preference of dimension-based difference and the information searching process, providing further process evidence for dimension-based intertemporal models. |
Marc M. Himmelberg; Ekin Tünçok; Jesse Gomez; Kalanit Grill-Spector; Marisa Carrasco; Jonathan Winawer Comparing retinotopic maps of children and adults reveals a late-stage change in how V1 samples the visual field Journal Article In: Nature Communications, vol. 14, no. 1, pp. 1–15, 2023. @article{Himmelberg2023, Adult visual performance differs with angular location –it is better for stimuli along the horizontal than vertical, and lower than upper vertical meridian of the visual field. These perceptual asymmetries are paralleled by asymmetries in cortical surface area in primary visual cortex (V1). Children, unlike adults, have similar visual performance at the lower and upper vertical meridian. Do children have similar V1 surface area representing the upper and lower vertical meridian? Using MRI, we measure the surface area of retinotopic maps (V1-V3) in children and adults. Many features of the maps are similar between groups, including greater V1 surface area for the horizontal than vertical meridian. However, unlike adults, children have a similar amount of V1 surface area representing the lower and upper vertical meridian. These data reveal a late-stage change in V1 organization that may relate to the emergence of the visual performance asymmetry along the vertical meridian by adulthood. |