EyeLink Cognitive Publications
All EyeLink cognitive and perception research publications up until 2023 (with some early 2024s) are listed below by year. You can search the publications using keywords such as Visual Search, Scene Perception, Face Processing, etc. You can also search for individual author names. If we missed any EyeLink cognitive or perception articles, please email us!
2019 |
Warren R. G. James; Josephine Reuther; Ellen Angus; Alasdair D. F. Clarke; Amelia R. Hunt Inefficient eye movements: Gamification improves task execution, but not fixation strategy Journal Article In: Vision, vol. 3, pp. 48, 2019. @article{James2019, Decisions about where to fixate are highly variable and often inefficient. In the current study, we investigated whether such decisions would improve with increased motivation. Participants had to detect a discrimination target, which would appear in one of two boxes, but only after they chose a location to fixate. The distance between boxes determines which location to fixate to maximise the probability of being able to see the target: participants should fixate between the two boxes when they are close together, and on one of the two boxes when they are far apart. We “gamified” this task, giving participants easy-to-track rewards that were contingent on discrimination accuracy. Their decisions and performance were compared to previous results that were gathered in the absence of this additional motivation. We used a Bayesian beta regression model to estimate the size of the effect and associated variance. The results demonstrate that discrimination accuracy does indeed improve in the presence of performance-related rewards. However, there was no difference in eye movement strategy between the two groups, suggesting this improvement in accuracy was not due to the participants making more optimal eye movement decisions. Instead, the motivation encouraged participants to expend more effort on other aspects of the task, such as paying more attention to the boxes and making fewer response errors. |
Anna Ivic Jasper; Seiji Tanabe; Adam Kohn Predicting perceptual decisions using visual cortical population responses and choice history Journal Article In: Journal of Neuroscience, vol. 39, no. 34, pp. 6714–6727, 2019. @article{Jasper2019, Our understanding ofthe neural basis ofperceptual decision making has been built in part on relating co-fluctuations ofsingle neuron responses to perceptual decisions on a trial-by-trial basis. The strength of this relationship is often compared across neurons or brain areas, recorded in different sessions, animals, or variants ofa task.Wesought to extend our understanding ofperceptual decision making in three ways. First, we measured neuronal activity simultaneously in early [primary visual cortex ( V1)] and midlevel (V4) visual cortex while macaque monkeys performed a fine orientation discrimination perceptual task. This allowed a direct comparison ofchoice signals in these two areas, including their dynamics. Second, we asked how our ability to predict animals' decisions would be improved by considering small simultaneously-recorded neuronal populations rather than individual units. Finally, we asked whether predictions would be improved by taking into account the animals' choice and reward histories, which can strongly influence decision making. We found that responses ofindividual V4 neurons were weakly predictive ofdecisions, but only in a briefepoch between stimulus offset and the indication of choice. In V1, few neurons showed significant decision-related activity. Analysis of neuronal population responses revealed robust choice-related information in V4 and substantially weaker signals in V1. Including choice- and reward-history informa- tion improved performance further, particularly when the recorded populations contained little decision-related information. Our work shows the power ofusing neuronal populations and decision history when relating neuronal responses to the perceptual decisions they are thought to underlie. |
Woojae Jeong; Seolmin Kim; Yee-Joon Kim; Joonyeol Lee Motion direction representation in multivariate electroencephalography activity for smooth pursuit eye movements Journal Article In: NeuroImage, vol. 202, pp. 116160, 2019. @article{Jeong2019, Visually-guided smooth pursuit eye movements are composed of initial open-loop and later steady-state periods. Feedforward sensory information dominates the motor behavior during the open-loop pursuit, and a more complex feedback loop regulates the steady-state pursuit. To understand the neural representations of motion direction during open-loop and steady-state smooth pursuits, we recorded electroencephalography (EEG) responses from human observers while they tracked random-dot kinematograms as pursuit targets. We estimated population direction tuning curves from multivariate EEG activity using an inverted encoding model. We found significant direction tuning curves as early as about 60 ms from stimulus onset. Direction tuning responses were generalized to later times during the open-loop smooth pursuit, but they became more dynamic during the later steady-state pursuit. The encoding quality of retinal motion direction information estimated from the early direction tuning curves was predictive of trial-by-trial variation in initial pursuit directions. These results suggest that the movement directions of open-loop smooth pursuit are guided by the representation of the retinal motion present in the multivariate EEG activity. |
Jianrong Jia; Fang Fang; Huan Luo Selective spatial attention involves two alpha-band components associated with distinct spatiotemporal and functional characteristics Journal Article In: NeuroImage, vol. 199, pp. 228–236, 2019. @article{Jia2019, Attention is crucial for efficiently coordinating resources over multiple objects in a visual scene. Recently, a growing number of studies suggest that attention is implemented through a temporal organization process during which resources are dynamically allocated over a multitude of objects, yet the associated neural evidence, particularly in low-level sensory areas, is still limited. Here we used EEG recordings in combination with a temporal response function (TRF) approach to examine the spatiotemporal characteristics of neuronal impulse response in covert selective attention. We demonstrate two distinct alpha-band components – one in post-central parietal area and one in contralateral occipital area – that are involved in coordinating neural representations of attended and unattended stimuli. Specifically, consistent with previous findings, the central alpha-band component showed enhanced activities for unattended versus attended stimuli within the first 200 ms temporal lag of TRF response, suggesting its inhibitory function in attention. In contrast, the contralateral occipital component displayed relatively earlier activation for the attended than unattended one in the TRF response. Furthermore, the central component but not the occipital component was correlated with attentional behavioral performance. Finally, the parietal area exerted directional influences on the occipital activity through alpha-band rhythm. Taken together, spatial attention involves two hierarchically organized alpha-band components that are associated with distinct spatiotemporal characteristics and presumably play different functions. |
Han-Gue Gue Jo; Thilo Kellermann; Conrad Baumann; Junji Ito; Barbara Schulte Holthausen; Frank Schneider; Sonja Grün; Ute Habel Distinct modes of top-down cognitive processing in the ventral visual cortex Journal Article In: NeuroImage, vol. 193, pp. 201–213, 2019. @article{Jo2019, Top-down cognitive control leads to changes in the sensory processing of the brain. In visual perception such changes can take place in the ventral visual cortex altering the functional asymmetry in forward and backward connections. Here we used fixation-related evoked responses of EEG measurement and dynamic causal modeling to examine hierarchical forward-backward asymmetry, while twenty-six healthy adults performed cognitive tasks that require different types of top-down cognitive control (memorizing or searching visual objects embedded in a natural scene image). The generative model revealed an enhanced asymmetry toward forward connections during memorizing, whereas enhanced backward connections were found during searching. This task-dependent modulation of forward and backward connections suggests two distinct modes of top-down cognitive processing in cortical networks. The alteration in forward-backward asymmetry might underlie the functional role in the cognitive control of visual information processing. |
Donatas Jonikaitis; Saurabh Dhawan; Heiner Deubel Saccade selection and inhibition: Motor and attentional components Journal Article In: Journal of Neurophysiology, vol. 121, pp. 1368–1380, 2019. @article{Jonikaitis2019, Motor responses are fundamentally spatial in their function and neural organization. However, studies of inhibitory motor control, focused on global stopping of all actions, have ignored whether inhibitory control can be exercised selectively for specific actions. We used a new approach to elicit and measure motor inhibition by asking human participants to either look at (select) or avoid looking at (inhibit) a location in space. We found that instructing a location to be avoided resulted in an inhibitory bias specific to that location. When compared with the facilitatory bias observed in the Look task, it differed significantly in both its spatiotemporal dynamics and its modulation of attentional processing. While action selection was evident in oculomotor system and interacted with attentional processing , action inhibition was evident mainly in the oculomotor system. Our findings suggest that action inhibition is implemented by spatially specific mechanisms that are separate from action selection. |
Deborah Kaiser; Gitta A. Jacob; Linda Zutphen; Nicolette Siep; Andreas Sprenger; Brunna Tuschen-Caffier; Alena Senft; Arnoud Arntz; Gregor Domes Biased attention to facial expressions of ambiguous emotions in borderline personality disorder: An eye-tracking study Journal Article In: Journal of Personality Disorders, vol. 33, no. 5, pp. 671–690, 2019. @article{Kaiser2019, Preliminary evidence suggests that biased attention could be crucial in fostering the emotion recognition abnormalities in borderline personality disorder (BPD). We compared BPD patients to Cluster-C personality disorder (CC) patients and non-patients (NP) regarding emotion recognition in ambiguous faces and their visual attention allocation to the eyes. The role of comorbid posttraumatic stress disorder (PTSD) in BPD regarding emotion recognition and visual attention was explored. BPD patients fixated the eyes of angry/happy, sad/happy, and fearful/sad blends longer than non-patients. This visual attention pattern was mainly driven by BPD patients with PTSD. This subgroup also demonstrated longer fixations than CC patients and a trend towards longer fixations than BPD patients without PTSD for the angry/happy and fearful/sad blends. Emotion recognition was not altered in BPD. Biased visual attention towards the eyes of ambiguous facial expressions in BPD might be due to trauma-related attentional bias rather than to impairments in facial emotion recognition. |
Lea Kampermann; Niklas Wilming; Arjen Alink; Christian Büchel; Selim Onat Fixation-pattern similarity analysis reveals adaptive changes in face-viewing strategies following aversive learning Journal Article In: eLife, vol. 8, pp. 1–24, 2019. @article{Kampermann2019, Animals can effortlessly adapt their behavior by generalizing from past aversive experiences, allowing to avoid harm in novel situations. We studied how visual information was sampled by eye-movements during this process called fear generalization, using faces organized along a circular two-dimensional perceptual continuum. During learning, one face was conditioned to predict a harmful event, whereas the most dissimilar face stayed neutral. This introduced an adversity gradient along one specific dimension, while the other, unspecific dimension was defined solely by perceptual similarity. Aversive learning changed scanning patterns selectively along the adversity-related dimension, but not the orthogonal dimension. This effect was mainly located within the eye region of faces. Our results provide evidence for adaptive changes in viewing strategies of faces following aversive learning. This is compatible with the view that these changes serve to sample information in a way that allows discriminating between safe and adverse for a better threat prediction. |
Kei Kanari; Hirohiko Kaneko Effect of visual attention and horizontal vergence in three-dimensional space on occurrence of optokinetic nystagmus Journal Article In: Journal of Eye Movement Research, vol. 12, no. 1, pp. 1–12, 2019. @article{Kanari2019, OKN corresponding to the motion of the fixating area occurs when a stimulus has two areas separated in depth containing motion in different directions. However, when attention and vergence are separately directed to areas with different motions and depths, it remains unclear which property of attention and vergence is prioritized to initiate OKN. In this study, we investigated whether OKN corresponding to motion in the attending or fixating area occurred when two motions with different directions were presented in the central and peripheral visual fields separated in depth. Results show that OKN corresponding to attended motion occurred when observers maintained vergence on the peripheral stimulus and attended to the central stimulus. However, OKN corresponding to each motion in the attending area and in the fixating area occurred when observers maintained vergence on the central stimulus and attended to the peripheral stimulus. The accuracy rate of the attentional task was the lowest in this condition. These results support the idea that motion in the attended area is essential for occurrence of OKN, and vergence and retinal position affect the strength of attention. |
Noga Larry; Merav Yarkoni; Adi Lixenberg; Mati Joshua Cerebellar climbing fibers encode expected reward size Journal Article In: eLife, vol. 8, pp. 1–16, 2019. @article{Larry2019, Climbing fiber inputs to the cerebellum encode error signals that instruct learning. Recently, evidence has accumulated to suggest that the cerebellum is also involved in the processing of reward. To study how rewarding events are encoded, we recorded the activity of climbing fibers when monkeys were engaged in an eye movement task. At the beginning of each trial, the monkeys were cued to the size of the reward that would be delivered upon successful completion of the trial. Climbing fiber activity increased when the monkeys were presented with a cue indicating a large reward size. Reward size did not modulate activity at reward delivery or during eye movements. Comparison between climbing fiber and simple spike activity indicated different interactions for coding of movement and reward. These results indicate that climbing fibers encode the expected reward size and suggest a general role of the cerebellum in associative learning beyond error correction. |
Rebekka Lencer; Li Yao; James L. Reilly; Sarah K. Keedy; Jennifer E. McDowell; Matcheri S. Keshavan; Godfrey D. Pearlson; Carol A. Tamminga; Elliot S. Gershon; Brett A. Clementz; Su Lui; John A. Sweeney Alterations in intrinsic fronto-thalamo-parietal connectivity are associated with cognitive control deficits in psychotic disorders Journal Article In: Human Brain Mapping, vol. 40, no. 1, pp. 163–174, 2019. @article{Lencer2019, Despite a growing number of reports about alterations in intrinsic/resting brain activity observed in patients with psychotic disorders, their relevance to well-established cognitive control deficits in this patient group is not well understood. Totally 88 clinically stabilized patients with a psychotic disorder and 50 healthy controls participated in a resting-state magnetic resonance imaging study (rs-MRI) and performed an antisaccade task in the laboratory to assess voluntary inhibitory control ability. Deficits on this task are a well-established biomarker across psychotic disorders as we found in the present patient sample. First, regional cerebral function was evaluated by measuring the amplitude of low frequency fluctuations (ALFF) in rs-MRI BOLD signals. We found reduced ALFF in patients in regions known to be relevant to antisaccade task performance including bilateral frontal eye fields (FEF), supplementary eye fields (SEF) and thalamus. Second, areas with ALFF alterations were used as seed areas in whole-brain functional connectivity (FC) analysis. Altered FC was observed in a fronto-thalamo-parietal network that was associated with inhibition error rate in patients but not in controls. In contrast, faster time to generate a correct antisaccade was associated with FC in FEF and SEF in controls but this effect was not seen in patients. These findings establish a behavioral relevance of resting-state fMRI findings in psychotic disorders, and extend previous reports of alterations in fronto-thalamo-parietal network activation during antisaccade performance seen in task-based fMRI studies. |
Laura Leuchs; Max Schneider; Victor I. Spoormaker Measuring the conditioned response: A comparison of pupillometry, skin conductance, and startle electromyography Journal Article In: Psychophysiology, vol. 56, no. 1, pp. e13283, 2019. @article{Leuchs2019, In human fear conditioning studies, different physiological readouts can be used to track conditioned responding during fear learning. Commonly employed readouts such as skin conductance responses (SCR) or startle responses have in recent years been complemented by pupillary readouts, but to date it is unknown how pupillary readouts relate to other measures of the conditioned response. To examine differences and communalities among pupil responses, SCR, and startle responses, we simultaneously recorded pupil diameter, skin conductance, and startle electromyography in 47 healthy subjects during fear acquisition, extinction, and a recall test on 2 consecutive days. The different measures correlated only weakly, displaying most prominent differences in their response patterns during fear acquisition. Whereas SCR and startle responses habituated, pupillary measures did not. Instead, they increased in response to fear conditioned stimuli and most closely followed ratings of unconditioned stimulus (US) expectancy. Moreover, we observed that startle-induced pupil responses showed stimulus discrimination during fear acquisition, suggesting a fear potentiation of the auditory pupil reflex. We conclude that different physiological outcome measures of the conditioned response inform about different cognitive-affective processes during fear learning, with pupil responses being least affected by physiological habituation and most closely following US expectancy. |
Chi Yui Leung; Hitoshi Mikami; Lisa Yoshikawa Positive psychology broadens readers' attentional scope during L2 reading: Evidence from eye movements Journal Article In: Frontiers in Psychology, vol. 10, pp. 2245, 2019. @article{Leung2019, While positive psychology has drawn increasing interests among researchers in the second language (L2) acquisition literature recently, little is known with respect to the relationship between positive psychology and mental processes during L2 reading. To bridge the gap, the present study investigated whether and how positive psychology (self-efficacy) influences word reading strategies during L2 sentence reading. Based on previous studies, eye-movement patterns with first-fixation locations closer to the beginning of a word can be characterized as an attempt to process the word with a local strategy, whereas first-fixation locations farther away from the beginning and closer to the center of a word can be considered as an attempt to use a global strategy. Eye movements of a group of Japanese learners of English (N = 59) were monitored, and L2 reading self-efficacy was used to assess the participants' positive belief toward their L2 reading skills. Based on Fredrickson's (1998) broaden-and-build theory, we predicted an effect of L2 reading self-efficacy on participants' first-fixation locations. Results from mixed-effects regression showed that while reading strategies depended in part on other factors such as L2 reading proficiency and word properties, L2 self-efficacy influenced reading strategy. The present data suggest that while more self-efficacious L2 readers prefer a more efficient global strategy, attempting to read the word as a whole word, less self-efficacious L2 readers tend to employ a local strategy, focusing more on sublexical information. These findings lend support to the broaden-and-build theory in the context of L2 processing. The present study has implications for how positive psychology works along with L2 proficiency in the development of strategic selection during reading. |
Koryna Lewandowska; Adam Gcagol; Barbara Sikora-Wachowicz; Tadeusz Marek; Magdalena Fcafrowicz Saying “yes” when you want to say “no” - pupil dilation reflects evidence accumulation in a visual working memory recognition task Journal Article In: International Journal of Psychophysiology, vol. 139, pp. 18–32, 2019. @article{Lewandowska2019, A number of studies have shown that the pupil dilates during stimuli recognition and decision-making. Yet, little is known about the interaction between recognition memory and decision processes. Here, we investigated the possible link between pupil response and decision-related factors during a visual recognition task. Forty-eight volunteers took part in the study. The experimental task was based on the Deese–Roediger–McDermott paradigm designed to study false recognitions. Participants were shown different sets of two meaningless objects. After seeing each set, they were asked to determine whether the subsequent probe (positive, lure or negative) was already presented. We had found that the pupil dilated more and slower, and the reaction time was extended, when the upcoming choice was against individual response bias. Such a result indicates that recognition and rejection in memory tasks could be seen as two behavioral alternatives supported by evidence accumulation, in line with decision-making models. This interpretation was upheld with the drift-diffusion modelling based on pupil data. A similar pattern was observed for errors - larger pupil sizes before incorrect responses were accompanied by longer reaction times. Furthermore, before correct reactions, especially in participants differentiating more accurately between the old and new stimuli, pupil dilation was increasing faster, indicating swifter evidence accumulation. Taking into account the link between cognitive pupillary reflex and norepinephrine release, we conclude that similarly to decision making, reactions in memory tasks may partly depend on the locus coeruleus activity, which is the principal site for norepinephrine synthesis. |
Amelia K. Lewis; Melanie A. Porter; Tracey A. Williams; Samantha Bzishvili; Kathryn N. North; Jonathan M. Payne Attention to faces in social context in children with neurofibromatosis type 1 Journal Article In: Developmental Medicine and Child Neurology, vol. 61, no. 2, pp. 174–180, 2019. @article{Lewis2019, Aim: To examine visual attention to faces within social scenes in children with neurofibromatosis type 1 (NF1) and typically developing peers. Method: Using eye-tracking technology we investigated the time taken to fixate on a face and the percentage of time spent attending to faces relative to the rest of the screen within social scenes in 24 children with NF1 (17 females, seven males; mean age 10y 4mo [SD 1y 9mo]). Results were compared with those of 24 age-matched typically developing controls (11 females, 13 males; mean age 10y 3mo [SD 2y]). Results: There was no significant between-group differences in time taken to initially fixate on a face (p=0.617); however, children with NF1 spent less time attending to faces within scenes than controls (p=0.048). Decreased attention to faces was associated with elevated autism traits in children with NF1. Interpretation: Children with NF1 spend less time attending to faces than typically developing children when presented in social scenes. Our findings contribute to a growing body of literature suggesting that abnormal face processing is a key aspect of the social-cognitive phenotype of NF1 and appears to be related to autism spectrum disorder traits. Clinicians should consider the impact of reduced attention to faces when designing and implementing treatment programmes for social dysfunction in this population. |
Jie Li; Lauri Oksama; Jukka Hyönä Model of Multiple Identity Tracking (MOMIT) 2.0: Resolving the serial vs. parallel controversy in tracking Journal Article In: Cognition, vol. 182, pp. 260–274, 2019. @article{Li2019b, The present study investigated whether during tracking of multiple moving objects with distinct identities only one identity is tracked at each moment (serial tracking) or whether multiple identities can be tracked simultaneously (parallel tracking). By adopting the gaze-contingent display change technique, we manipulated in real time the presence/absence of object identities during tracking. The data on performance accuracy revealed a serial tracking pattern for facial images and a parallel pattern for color discs: when tracking faces, the presence/absence of only the currently foveated identity impacted the performance, whereas when tracking colors, the presence of multiple identities across the visual field led to improved tracking performance. This pattern is consistent with the identifiability of the different types of objects in the visual field. The eye movements during MIT showed a bias towards visiting and dwelling on individual targets when facial identities were present and towards visiting the blank areas between targets when color identities were present. Nevertheless, the eye visits were predominately on individual targets regardless of the type of objects and the presence of object identities. The eye visits to targets were beneficial for target tracking, particularly in face tracking. We propose the Model of Multiple Identity Tracking (MOMIT) 2.0 which accounts for the results and reconcile the serial vs. parallel controversy. The model suggests that observers cooperatively use attention, eye movements, perception, and working memory for dynamic tracking. Tracking appears more serial when high-resolution information needs to be sampled and maintained for discriminating the targets, whereas it appears more parallel when low-resolution information is sufficient. |
Anna E. Hughes; John A. Greenwood; Nonie J. Finlayson; D. Samuel Schwarzkopf Population receptive field estimates for motion-defined stimuli Journal Article In: NeuroImage, vol. 199, pp. 245–260, 2019. @article{Hughes2019, The processing of motion changes throughout the visual hierarchy, from spatially restricted ‘local motion' in early visual cortex to more complex large-field ‘global motion' at later stages. Here we used functional magnetic resonance imaging (fMRI) to examine spatially selective responses in these areas related to the processing of random-dot stimuli defined by differences in motion. We used population receptive field (pRF) analyses to map retinotopic cortex using bar stimuli comprising coherently moving dots. In the first experiment, we used three separate background conditions: no background dots (dot-defined bar-only), dots moving coherently in the opposite direction to the bar (kinetic boundary) and dots moving incoherently in random directions (global motion). Clear retinotopic maps were obtained for the bar-only and kinetic-boundary conditions across visual areas V1–V3 and in higher dorsal areas. For the global-motion condition, retinotopic maps were much weaker in early areas and became clear only in higher areas, consistent with the emergence of global-motion processing throughout the visual hierarchy. However, in a second experiment we demonstrate that this pattern is not specific to motion-defined stimuli, with very similar results for a transparent-motion stimulus and a bar defined by a static low-level property (dot size) that should have driven responses particularly in V1. We further exclude explanations based on stimulus visibility by demonstrating that the observed differences in pRF properties do not follow the ability of observers to localise or attend to these bar elements. Rather, our findings indicate that dorsal extrastriate retinotopic maps may primarily be determined by the visibility of the neural responses to the bar relative to the background response (i.e. neural signal-to-noise ratios) and suggests that claims about stimulus selectivity from pRF experiments must be interpreted with caution. |
Yueh-Nu Hung; Hui-Yu Kuo; Shih-Chieh Liao Seeing what they see: Elementary EFL students reading science texts Journal Article In: RELC Journal, pp. 1–15, 2019. @article{Hung2019, Science texts use various text features and multiple representations to communicate meaning to their readers. English science texts are challenging for elementary-level English as a foreign language (EFL) learners in Taiwan because they are familiar with reading language-controlled texts from textbooks. Teaching students to make use of various text features and visual representations will help them achieve a more successful science text reading experience. In this study, 27 Grade 6 Taiwanese students were instructed in science text reading strategies that included understanding text features, creating imagery, and using visual representations. Before and after the instruction, they took an English reading and writing test. Their eye movements during science text reading were recorded before and after the instruction to more fully understand their visual attention while reading English science texts. Eye movement performances such as number of fixations, mean fixation duration, and saccade size were examined. The findings showed that although the participants' English reading and writing performance improved in the post-test, they focussed more on the written language than the visuals in both tests. More visual representation reading strategies should therefore be taught to help young EFL students read and learn from science texts. |
Cecília Hustá; Edwin S. Dalmaijer; Artem V. Belopolsky; Sebastiaan Mathôt The pupillary light response reflects visual working memory content Journal Article In: Journal of Experimental Psychology: Human Perception and Performance, vol. 45, no. 11, pp. 1522–1528, 2019. @article{Husta2019, Recent studies have shown that the pupillary light response (PLR) is modulated by higher cognitive functions, presumably through activity in visual sensory brain areas. Here we use the PLR to test the involvement of sensory areas in visual working memory (VWM). In two experiments, participants memorized either bright or dark stimuli. We found that pupils were smaller when a prestimulus cue indicated that a bright stimulus should be memorized; this reflects a covert shift of attention during encoding of items into VWM. Crucially, we obtained the same result with a poststimulus cue, which shows that internal shifts of attention within VWM affect pupil size as well. Strikingly, the effect of VWM content on pupil size was most pronounced immediately after the poststimulus cue, and then dissipated. This suggests that a shift of attention within VWM momentarily activates an “active” memory representation, but that this representation quickly transforms into a “hidden” state that does not rely on sensory areas. |
Shariq N. Iqbal; Lun Yin; Caroline B. Drucker; Qian Kuang; Jean-François Gariépy; Michael L. Platt; John M. Pearson Latent goal models for dynamic strategic interaction Journal Article In: PLoS Computational Biology, vol. 15, no. 3, pp. e1006895, 2019. @article{Iqbal2019, Understanding the principles by which agents interact with both complex environments and each other is a key goal of decision neuroscience. However, most previous studies have used experimental paradigms in which choices are discrete (and few), play is static, and optimal solutions are known. Yet in natural environments, interactions between agents typically involve continuous action spaces, ongoing dynamics, and no known optimal solution. Here, we seek to bridge this divide by using a "penalty shot" task in which pairs of monkeys competed against each other in a competitive, real-time video game. We modeled monkeys' strategies as driven by stochastically evolving goals, onscreen positions that served as set points for a control model that produced observed joystick movements. We fit this goal-based dynamical system model using approximate Bayesian inference methods, using neural networks to parameterize players' goals as a dynamic mixture of Gaussian components. Our model is conceptually simple, constructed of interpretable components, and capable of generating synthetic data that capture the complexity of real player dynamics. We further characterized players' strategies using the number of change points on each trial. We found that this complexity varied more across sessions than within sessions, and that more complex strategies benefited offensive players but not defensive players. Together, our experimental paradigm and model offer a powerful combination of tools for the study of realistic social dynamics in the laboratory setting. |
Silvia L. Isabella; Charline Urbain; J. Allan Cheyne; Douglas Cheyne Pupillary responses and reaction times index different cognitive processes in a combined Go/Switch incidental learning task Journal Article In: Neuropsychologia, vol. 127, pp. 48–56, 2019. @article{Isabella2019, In previous studies we have provided evidence that performance in speeded response tasks with infrequent target stimuli reflects both automatic and controlled cognitive processes, based on differences in reaction time (RT) and task-related brain responses (Cheyne et al. 2012, Isabella et al. 2015). Here we test the hypothesis that such shifts in cognitive control may be influenced by changes in cognitive load related to stimulus predictability, and that these changes can be indexed by task-evoked pupillary responses (TEPR). We manipulated stimulus predictability using fixed stimulus sequences that were unknown to the participants in a Go/Switch task (re-quiring a switch response on 25% of trials) while monitoring TEPR as a measure of cognitive load in 12 healthy adults. Results showed significant improvement in performance (reduced RT, increased efficiency) for repeated sequences compared to occasional deviant sequences (10% probability) indicating that incidental learning of the predictable sequences facilitated performance. All behavioral measures varied between Switch and Go trials (RT, efficiency), however mean TEPR amplitude (mTEPR) and latency to maximum pupil dilation were particularly sensitive to Go/Switch. Results were consistent with the hypothesis that mTEPR indexes cognitive load, whereas TEPR latency indexes time to response selection, independent from response execution. The present study provides evidence that incidental pattern learning during response inhibition tasks may modulate several cognitive processes including cognitive load, effort, response selection and execution, which can in turn have differential effects on measures of performance. In particular, we demonstrate that reaction time may not be indicative of underlying cognitive load. |
Bernard I. Issa; Kara Morgan-Short Effects of external and internal attentional manipulations on second language grammar development: An eye-tracking study Journal Article In: Studies in Second Language Acquisition, vol. 41, no. 2, pp. 389–417, 2019. @article{Issa2019, The role of attention has been central to theoretical and empirical inquiries in second language (L2) acquisition. The current eye-tracking study examined how external and internal attentional manipulations (Chun, Golomb, &Turk-Browne, 2011) promote L2 grammatical development. Participants (n = 55) were exposed to Spanish direct-object pronouns under external or internal attentional manipulations, which were implemented through textual input enhancement or structured input practice, respectively. Results for both manipulations indicated that (a) learner attentional allocation to the form was affected; (b) L2 gains were evidenced, although only the internal manipulation led to above-chance performance; and (c) L2 gains were related to attention allocated to the form under the external manipulation and to a lesser extent the internal manipulation. Overall, findings may inform theoretical perspectives on attention and elucidate cognitive processes related to L2 instruction. |
Philip A. Kragel; Marianne C. Reddan; Kevin S. LaBar; Tor D. Wager Emotion schemas are embedded in the human visual system Journal Article In: Science Advances, vol. 5, no. 7, pp. eaaw4358, 2019. @article{Kragel2019, Theorists have suggested that emotions are canonical responses to situations ancestrally linked to survival. If so, then emotions may be afforded by features of the sensory environment. However, few computational models describe how combinations of stimulus features evoke different emotions. Here, we develop a convolutional neural network that accurately decodes images into 11 distinct emotion categories. We validate the model using more than 25,000 images and movies and show that image content is sufficient to predict the category and valence of human emotion ratings. In two functional magnetic resonance imaging studies, we demonstrate that patterns of human visual cortex activity encode emotion category–related model output and can decode multiple categories of emotional experience. These results suggest that rich, category-specific visual features can be reliably mapped to distinct emotions, and they are coded in distributed representations within the human visual system. |
Milosz Krala; Bianca Kemenade; Benjamin Straube; Tilo Kircher; Frank Bremmer Predictive coding in a multisensory path integration task: An fMRI study Journal Article In: Journal of vision, vol. 19, no. 11, pp. 1–15, 2019. @article{Krala2019, During self-motion through an environment, our sensory systems are confronted with a constant flow of information from different modalities. To successfully navigate, self-induced sensory signals have to be dissociated from externally induced sensory signals. Previous studies have suggested that the processing of self-induced sensory information is modulated by means of predictive coding mechanisms. However, the neural correlates of processing self-induced sensory information from different modalities during self-motion are largely unknown. Here, we asked if and how the processing of visually simulated self-motion and/or associated auditory stimuli is modulated by self-controlled action. Participants were asked to actively reproduce a previously observed simulated self-displacement (path integration). Blood oxygen level-dependent (BOLD) activation during this path integration was compared with BOLD activation during a condition in which we passively replayed the exact sensory stimulus that had been produced by the participants in previous trials. We found supramodal BOLD suppression in parietal and frontal regions. Remarkably, BOLD contrast in sensory areas was enhanced in a modality-specific manner. We conclude that the effect of action on sensory processing is strictly dependent on the respective behavioral task and its relevance. |
Kristina Krasich; Adam T. Biggs; James R. Brockmole Attention capture during visual search: The consequences of distractor appeal, familiarity, and frequency Journal Article In: Visual Cognition, vol. 27, no. 3-4, pp. 260–278, 2019. @article{Krasich2019, Visual distractions can lure our attention and impede our everyday performance, especially if they are highly meaningful and appealing to the observer. The current research assessed how semantically rich, personally relevant distractors (i.e., cartoon characters), either appealing or neutral, capture attention and whether the frequency with which we encounter these distractors can impact the effects. Participants were slower to identify a target letter in the presence of a neutral distractor relative to an appealing distractor, reflecting covert attentional capture. However, this effect reversed when appealing distractors appeared less frequently than neutral distractors. Collectively, the evidence suggests that the amount of capture observed overall likely depends on the interplay between a distractor's semantic salience (i.e., the amount of meaningful knowledge an observer has about the distractor), its affective salience (i.e., how the observer feels about the distractor), and how frequently it is encountered. |
Lisa M. Kroell; Bernhard Schlagbauer; Artyom Zinchenko; Hermann J. Müller; Thomas Geyer Behavioural evidence for a single memory system in contextual cueing Journal Article In: Visual Cognition, vol. 27, no. 5-8, pp. 551–562, 2019. @article{Kroell2019, If a target is repeatedly encountered within a stable search array, target detection is accelerated over time. Nonetheless, participants fail to identify repeated search layouts in recognition tests. This dissociation has motivated the assumption that search and recognition performances are driven by two distinct memory components. Search facilitations are supported by an unconscious system, rendering memory traces inaccessible for report. The opposite is true for the conscious system: intentional learning of search layouts should result in lasting recognition. At the same time, explicitly acquired memory representations should be unable to generate search advantages in the absence of awareness. To test these assumptions, we introduced an intentional learning task in which participants memorized a set of “explicit” displays. During search, explicit displays appeared alongside repeated, yet not previously studied (“implicit”) and new configurations. Explicit displays elicited lower reaction times, fewer fixations, and a more efficient scan path compared to implicit arrays. Using a statistically powerful recognition test, we demonstrate above-chance recognition of explicit and implicit displays. We consequently suggest that all information is stored in a single memory system, with the strength of representations varying from weak to high. Across the continuum, contents are accessible for retrieval during search and recognition. |
Eva Krueger; Andrea Schneider; Ben Sawyer; Alain Chavaillaz; Andreas Sonderegger; Rudolf Groner; Peter Hancock Microsaccades distinguish looking from seeing Journal Article In: Journal of Eye Movement Research, vol. 12, no. 6, pp. 1–14, 2019. @article{Krueger2019, Understanding our visual world requires both looking and seeing. Dissociation of these processes can result in the phenomenon of inattentional blindness or ‘looking without seeing‘. Concomitant errors in applied settings can be serious, and even deadly. Current visual data analysis cannot differentiate between just ‘looking‘ and actual processing of visual information, i.e., ‘seeing‘. Differentiation may be possible through the examination of microsaccades; the involuntary, small- magnitude saccadic eye movements that occur during processed visual fixation. Recent work has suggested that microsaccades are post-attentional biosignals, potentially modulated by task. Specifically, microsaccade rates decrease with increased mental task demand, and increase with growing visual task difficulty. Such findings imply that there are fundamental differences in microsaccadic activity between visual and nonvisual tasks. To evaluate this proposition, we used a high-speed eye tracker to record participants in looking for differences between two images or, doing mental arithmetic, or both tasks in combination. Results showed that microsaccade rate was significantly increased in conditions that require high visual attention, and decreased in conditions that require less visual attention. The results support microsaccadic rate reflecting visual attention, and level of visual information processing. A measure that reflects to what extent and how an operator is processing visual information represents a critical step for the application of sophisticated visual assessment to real world tasks. |
Louisa Kulke Neural mechanisms of overt attention shifts to emotional faces Journal Article In: Neuroscience, vol. 418, pp. 59–68, 2019. @article{Kulke2019, Emotional faces draw attention and eye-movements towards them. However, the neural mechanisms of attention have mainly been investigated during fixation, which is uncommon in everyday life where people move their eyes to shift attention to faces. Therefore, the current study combined eye-tracking and Electroencephalography (EEG) to measure neural mechanisms of overt attention shifts to faces with happy, neutral and angry expressions, allowing participants to move their eyes freely towards the stimuli. Saccade latencies towards peripheral faces did not differ depending on expression and early neural response (P1) amplitudes and latencies were unaffected. However, the later occurring Early Posterior Negativity (EPN) was significantly larger for emotional than for neutral faces. This response appears after saccades towards the faces. Therefore, emotion modulations only occurred after an overt shift of gaze towards the stimulus had already been completed. Visual saliency rather than emotional content may therefore drive early saccades, while later top-down processes reflect emotion processing. |
Satwant Kumar; Ivo D. Popivanov; Rufin Vogels Transformation of visual representations across ventral stream body-selective patches Journal Article In: Cerebral Cortex, vol. 29, no. 1, pp. 215–229, 2019. @article{Kumar2019a, Although the neural processing of visual images of bodies is critical for survival, it is much less well understood than face processing. Functional imaging studies demonstrated body selective regions in primate inferior temporal cortex. To advance our understanding of how the visual brain represents bodies, we compared the representation of animate and inanimate objects in two such body patches with fMRI-guided single unit recordings in rhesus monkeys. We found that the middle Superior Temporal Sulcus body patch (MSB) distinguishes to a greater extent bodies from non-bodies than the anterior Superior Temporal Sulcus body patch (ASB). Importantly, ASB carried more viewpoint-tolerant information about body posture and body identity than MSB, while MSB showed greater orientation selectivity. Combined with previous work on faces, this suggests that an increase in view-tolerant representations, coupled with a refined individuation, along the visual hierarchy is a general property of information processing within the inferior temporal cortex. |
Satwant Kumar; Rufin Vogels Body patches in inferior temporal cortex encode categories with different temporal dynamics Journal Article In: Journal of Cognitive Neuroscience, vol. 31, no. 11, pp. 1699–1709, 2019. @article{Kumar2019, An unresolved question in cognitive neuroscience is how representations of object categories at different levels (basic and superordinate) develop during the course of the neural response within an area. To address this, we decoded categories of different levels from the spiking responses of populations of neurons recorded in two fMRI-defined body patches in the macaque STS. Recordings of the two patches were made in thesameanimals with thesamestimuli. Support vector machine classifiers were trained at brief response epochs and tested at the same or different epochs, thus assessing whether category representations change during the course of the response. In agreement with hierarchical processing within the body patch network, the posterior body patch mid STS body (MSB) showed an earlier onset of categorization compared with the anterior body patch anterior STS body (ASB), irrespective of the categorization level. Decoding of the superordinate body versus nonbody categories was less dynamic in MSB than in ASB, with ASB showing a biphasic temporal pattern. Decoding of the ordinate-level category human versus monkey bodies showed similar temporal patterns in both patches. The decoding onset of superordinate categorizations involving bodies was as early as for basic-level categorization, suggesting that previously reported differences between the onset of basic and superordinate categorizations may depend on the area. The qualitative difference between areas in their dynamics of category representation may hinder the interpretation of decoding dynamics based on EEG or MEG, methods that may mix signals of different areas. |
Nayoung Kwon; Patrick Sturt Proximity and same case marking do not increase attraction effect in comprehension: Evidence from eye-tracking experiments in Korean Journal Article In: Frontiers in Psychology, vol. 10, pp. 1320, 2019. @article{Kwon2019, Previous studies have suggested that during the on-line sentence processing, relevant memory representations are directly accessed based on cues at retrieval (McElree et al., 2003). Under this hypothesis, retrieval cues activate any memory representation with matching features, leading to the so-called attraction effect. This predicts that attraction effects would be modulated by memory representation of a distractor. Here, we investigated this possibility, focusing on two factors (i.e., proximity to the retrieval point and the number of matching features) that would affect representation of a distractor in three Korean eye-tracking experiments. We predicted that if memory representation of a distractor decays over time, a distractor close to a retrieval point would lead to stronger attraction effects. We also predicted that a distractor would be more likely to lead to interference when it shares a higher number of matching features with the retrieval cues of a dependency, relative to the target of the dependency, due to multiple direct accesses based on multiple matching cues. However, the results did not show evidence that proximity of a distractor to the retrieval point enhanced attraction effects. Likewise, there was no evidence that a greater number of matching cues of a distractor alone would trigger more mis-retrieval, in contrast to a previous finding that a greater number of mismatching cues of a licit antecedent in addition to a greater number of matching cues of a distractor did so (Parker and Phillips, 2017). On the other hand, the results suggested that a distractor marked with nominative case was more likely to be mis-retrieved as the subject of a verb, compared to a distractor marked with a dative case, suggesting that the subject grammatical role is a critical cue for a subject-verb agreement. These results are best compatible with the hypothesis that retrieval cues are weighted, possibly depending on the nature of the dependency that is currently processed. |
Alexandra Hoffmann; Ulrich Ettinger; Casandra I. Montoro; Gustavo A. Reyes del Paso; Stefan Duschek Cerebral blood flow responses during prosaccade and antisaccade preparation in major depression Journal Article In: European Archives of Psychiatry and Clinical Neuroscience, vol. 269, no. 7, pp. 813–822, 2019. @article{Hoffmann2019a, While impairments in executive functions have been well established in major depressive disorder (MDD), specific deficits in proactive control have scarcely been studied so far. Proactive control refers to cognitive processes during anticipation of a behaviorally relevant event that facilitate readiness to react. In this study, cerebral blood flow responses were investigated in MDD patients during a precued antisaccade task requiring preparatory attention and proactive inhibition. Using functional transcranial Doppler sonography, blood flow velocities in the middle cerebral arteries of both hemispheres were recorded in 40 MDD patients and 40 healthy controls. In the task, a target appeared left or right of the fixation point 5 s after a cuing stimulus; subjects had to move their gaze to the target (prosaccade) or its mirror image position (antisaccade). Video-based eye-tracking was applied for ocular recording. A right dominant blood flow increase arose during prosaccade and antisaccade preparation, which was smaller in MDD patients than controls. Patients exhibited a higher error rate than controls for antisac- cades but not prosaccades. The smaller blood flow response may reflect blunted anticipatory activation of the dorsolateral prefrontal and inferior parietal cortices in MDD. The patients' increased antisaccade error rate suggests deficient inhibitory control. The findings support the notion of impairments in proactive control in MDD, which are clinically relevant as they may contribute to the deficits in cognition and behavioral regulation that characterize the disorder. |
Mareike A. Hoffmann; Aleks Pieczykolan; Iring Koch; Lynn Huestegge Motor sources of dual-task interference: Evidence for effector-based prioritization in dual-task control Journal Article In: Journal of Experimental Psychology: Human Perception and Performance, vol. 45, no. 10, pp. 1355–1374, 2019. @article{Hoffmann2019, Dual tasking is known to yield performance costs. Corresponding research has often focused on early or central task processing stages, that is, on features related to stimulus processing or response selection. Here, we demonstrate the important role of the final (late) stage of task processing by studying effects of effector system combinations. We used pairwise combinations of tasks requiring oculomotor, manual, vocal, and pedal responses, triggered by visual/auditory stimuli. Across task combinations, we compared dual-task costs among effector systems (e.g., oculomotor, vocal, and pedal) under controlled conditions, that is, when combined with the same “context effector” (e.g., manual) in the other task. The dual-task cost pattern was strongly determined by the particular combination of effector systems in line with the assumption of an ordinal effector-based prioritization pattern (oculomotor > pedal > vocal > manual), and could not be explained by classic “first-come, first-served” accounts of central processing. Stimulus modality and its mapping to effector systems affected reaction times (RTs), but the impact on the general prioritization scheme was negligible, suggesting a more substantial influence of output (compared with input) system characteristics on dual-task capacity scheduling. The results call for a distinct effector system weighting mechanism in models of dual-task control. |
Margit Höfler; Katrin Liebergesell; Iain D. Gilchrist; Sebastian A. Bauch; Anja Ischebeck; Christof Körner Post-search IOR: Searching for inhibition of return after search Journal Article In: Acta Psychologica, vol. 197, pp. 32–38, 2019. @article{Hoefler2019, Previous research has indicated that Inhibition of return (IOR)supports visual search by discouraging the re-inspection of recently inspected items during search. However, it is not clear whether IOR persists after a search is completed or whether this depends on the presence of a further search in the same display. To investigate this issue, we had participants search consecutively twice in the same display (Experiment 1). Immediately after the end of the first search and after the end of the second search we probed an item which had been recently inspected or not in the previous search. The results showed that IOR as measured by the saccadic latency to the probed items was absent after the end of each of the two successive searches. In Experiment 2, we measured both saccadic latencies and manual responses in a single-search paradigm. We found that IOR during and after the search was present for saccadic responses but absent for manual responses. This suggests that IOR during and after a visual search depends on the modality of the response and the number of required searches. |
Andrew Hollingworth; Michi Matsukura Feature-based guidance of attention during post-saccadic selection Journal Article In: Attention, Perception, and Psychophysics, vol. 81, no. 6, pp. 1822–1835, 2019. @article{Hollingworth2019, Current models of trans-saccadic perception propose that, after a saccade, the saccade target object must be localized among objects near the landing position. However, the nature of the attentional mechanisms supporting this process is currently under debate. In the present study, we tested whether surface properties of the saccade target object automatically bias post-saccadic selection using a variant of the visual search task. Participants executed a saccade to a shape-singleton target in a circular array. During this primary saccade, the array sometimes rotated so that the eyes landed between the target and an adjacent distractor, requiring gaze correction. In addition, each object in the array had an incidental color value. On Switch trials, the target and adjacent distractor switched colors. The accuracy and latency of gaze correction to the target (measures that provide a direct index of target localization) were compared with a control condition in which no color switch occurred (No-switch trials). Gaze correction to the target was substantially impaired in the Switch condition. This result was obtained even when participants had substantial incentive to avoid encoding the color of the saccade target. In addition, similar effects were observed when the roles of the two feature dimensions (color and shape) were reversed. The results indicate that saccade target features are automatically encoded before a saccade, are retained in visual working memory across the saccade, and instantiate a feature-based selection operation when the eyes land, biasing attention toward objects that match target features. |
Linus Holm; Gustaf Wadenholt; Paul Schrater Episodic curiosity for avoiding asteroids: Per-trial information gain for choice outcomes drive information seeking Journal Article In: Scientific Reports, vol. 9, pp. 11265, 2019. @article{Holm2019, Humans often appear to desire information for its own sake, but it is presently unclear what drives this desire. The important role that resolving uncertainty plays in stimulating information seeking has suggested a tight coupling between the intrinsic motivation to gather information and performance gains, construed as a drive for long-term learning. Using an asteroid-avoidance game that allows us to study learning and information seeking at an experimental time-scale, we show that the incentive for information-seeking can be separated from a long-term learning outcome, with information-seeking best predicted by per-trial outcome uncertainty. Specifically, participants were more willing to take time penalties to receive feedback on trials with increasing uncertainty in the outcome of their choices. We found strong group and individual level support for a linear relationship between feedback request rate and information gain as determined by per-trial outcome uncertainty. This information better reflects filling in the gaps of the episodic record of choice outcomes than long-term skill acquisition or assessment. Our results suggest that this easy to compute quantity can drive information-seeking, potentially allowing simple organisms to intelligently gather information for a diverse episodic record of the environment without having to anticipate the impact on future performance. |
Simon Hong; Satoko Amemori; Emily Chung; Daniel J. Gibson; Ken-ichi Amemori; Ann M. Graybiel Predominant striatal input to the lateral habenula in macaques comes from striosomes Journal Article In: Current Biology, vol. 29, no. 1, pp. 51–61, 2019. @article{Hong2019, Striosomes, neurochemically specialized modules in the striatum, are thought to be nodes in circuits extending, via basal ganglia pathways, from mood-related neocortical regions to dopamine-containing neurons of the substantia nigra. Yet striosomes have remained beyond the reach of electrophysiological methods to identify them, especially in non-human primates. Such work is needed for translational as well as for basic science. Here we introduce a method to identify striosomes on-line in awake, behaving macaques. We combined electrical microstimulation of the striatum with simultaneous electrophysiological recording in the lateral habenula (LHb) followed by immunohistochemistry. We demonstrate that striosomes provide the predominant striatal input to the macaque pallido-habenular circuit, which is known to function in relation to reinforcement signaling. Further, our experiments suggest that striosomes from different striatal regions may convergently influence the lateral habenula. This work now opens the way to defining the functions of striosomes in behaving primates in relation to mood, motivation, and action. |
Marilyn Horta; Maryam Ziaei; Tian Lin; Eric C. Porges; Håkan Fischer; David Feifel; R. Nathan Spreng; Natalie C. Ebner Oxytocin alters patterns of brain activity and amygdalar connectivity by age during dynamic facial emotion identification Journal Article In: Neurobiology of Aging, vol. 78, pp. 42–51, 2019. @article{Horta2019, Aging is associated with increased difficulty in facial emotion identification, possibly due to age-related network change. The neuropeptide oxytocin (OT) facilitates emotion identification, but this is understudied in aging. To determine the effects of OT on dynamic facial emotion identification across adulthood, 46 young and 48 older participants self-administered intranasal OT or a placebo in a randomized, double-blind procedure. Older participants were slower and less accurate in identifying emotions. Although there was no behavioral treatment effect, partial least squares analysis supported treatment effects on brain patterns during emotion identification that varied by age and emotion. For young participants, OT altered the processing of sadness and happiness, whereas for older participants, OT only affected the processing of sadness (15.3% covariance |
Abigail N. Hoskin; Aaron M. Bornstein; Kenneth A. Norman; Jonathan D. Cohen Refresh my memory: Episodic memory reinstatements intrude on working memory maintenance Journal Article In: Cognitive, Affective and Behavioral Neuroscience, vol. 19, no. 2, pp. 338–354, 2019. @article{Hoskin2019, A fundamental question in memory research is how different forms of memory interact. Previous research has shown that people rely on working memory (WM) in short-term recognition tasks; a common view is that episodic memory (EM) only influences performance on these tasks when WM maintenance is disrupted. However, retrieval of memories from EM has been widely observed during brief periods of quiescence, raising the possibility that EM retrievals during maintenance—critically, before a response can be prepared—might affect short-term recognition memory performance even in the absence of distraction. We hypothesized that this influence would be mediated by the lingering presence of reactivated EM content in WM. We obtained support for this hypothesis in three experiments, showing that delay-period EM reactivation introduces incidentally associated information (context) into WM, and that these retrieved associations negatively impact subsequent recognition, leading to substitution errors (Experiment 1) and slowing of accurate responses (Experiment 2). FMRI pattern analysis showed that slowing is mediated by the content of EM reinstatement (Experiment 3). These results expose a previously hidden influence of EM on WM, raising new questions about the adaptive nature of their interaction. |
Juan Hou; Lumeng Sui; Xinxin Jiang; Chengyang Han; Qiang Chen Facial attractiveness of chinese college students with different sexual orientation and sex roles Journal Article In: Frontiers in Human Neuroscience, vol. 13, pp. 132, 2019. @article{Hou2019, Facial attractiveness refers to a positive and joyful emotional experience induced by the face of a target person and the extent to which other people are driven to be close to their wishes. Since the 1970s, face attractiveness has gradually emerged in western psychological research, but most of the studies were confined to heterosexuals. More recently, some scholars have pointed out that sexual orientation may affect the judgment of facial attractiveness of individuals. Based on previous literature, this study proposed to explore the different facial attractiveness of individuals with different sexual orientations and sexual roles. Participants in this study were divided into two types (according to sexual orientation and sexual role) by the Sex Role Inventory for College Students (CSRI). Also, the eye-tracking technique was used to record the path of eye movements, where face images were manipulated by sexual dimorphism clues. The results showed that (1) compared to heterosexual men, homosexual men were significantly more likely to choose masculine faces as more attractive faces in paired faces; (2) male homosexuals are likely to have the feminization bias, and female homosexuals are likely to have the masculinization bias; and (3) the masculine faces are more attractive than feminine faces to participants whose sex role is feminine type and androgynous type. |
Tzu-Yu Hsu; Hsin-Chien Lee; Timothy Joseph Lane; Marcus Missal Temporal preparation, impulsivity and short-term memory in depression Journal Article In: Frontiers in Behavioral Neuroscience, vol. 13, pp. 258, 2019. @article{Hsu2019a, Patient suffering of major depressive disorder (MDD) often complain that subjective time seems to “drag” with respect to physical time. This may point toward a generalized dysfunction of temporal processing in MDD. In the present study, we investigated temporal preparation in MDD. “Temporal preparation” refers to an increased readiness to act before an expected event; consequently, reaction time should be reduced. MDD patients and age-matched controls were required to make a saccadic eye movement between a central and an eccentric visual target after a variable duration preparatory period. We found that MDD patients produced a larger number of premature saccades, saccades initiated prior to the appearance of the expected stimulus. These saccades were not temporally controlled; instead, they seemed to reflect reduced inhibitory control causing oculomotor impulsivity. In contrast, the latency of visually guided saccades was strongly influenced by temporal preparation in controls; significantly less so, in MDD patients. This observed reduced temporal preparation in MDD was associated with a faster decay of short-term temporal memory. Moreover, in patients producing a lot of premature responses, temporal preparation to early imperative stimuli was increased. In conclusion, reduced temporal preparation and short-term temporal memory in the oculomotor domain supports the hypothesis that temporal processing was altered in MDD patients. Moreover, oculomotor impulsivity interacted with temporal preparation. These observed deficits could reflect other underlying aspects of abnormal time experience in MDD. |
Xiaofei Hu; Rumi Hisakata; Hirohiko Kaneko Effects of spatial frequency and attention on pupillary response Journal Article In: Journal of the Optical Society of America A, vol. 36, no. 10, pp. 1699–1708, 2019. @article{Hu2019, Research has shown that the pupil responds differently depending on the spatial frequency ofthe gazing stimulus. In this study, we examined the effects ofspatial- and object-based attention on pupillary response as a function of spatial frequency using grating stimuli and filtered natural images by manipulating the participants' attentional state. Furthermore, we aimed to obtain the pupillary response to spatial frequency accurately by reducing the contamination ofunintended spatial frequency components in the stimulus by using gratings with a Gabor enve- lope.We revealed that all stimuli could elicit large pupil constriction for an intermediate range (2–8 c/d) ofspatial frequency and that both spatial- and object-based attention modulate the pupillary response function to spatial frequency. These facts mayenhanceHumanComputer Interaction design to use people's attentional state. |
Peishan Huang; Bin Cai; Chen Zhou; Weicai Wang; Xi Wang; Dingguo Gao; Baicheng Bao Contribution of the mandible position to the facial profile perception of a female facial profile: An eye-tracking study Journal Article In: American Journal of Orthodontics and Dentofacial Orthopedics, vol. 156, no. 5, pp. 641–652, 2019. @article{Huang2019, Introduction: Studies concerning the visual attention of laypersons viewing the soft tissue facial profile of men and women with malocclusion are lacking. This study aimed to determine the visual attention to the facial profile of patients with different levels of mandibular protrusion and facial background attractiveness using an eye-tracking device. Methods: The scanning paths of 54 Chinese laypersons (50% female, 50% male, aged 18-23 years) were recorded by an eye-tracking device when they observed composite female facial profile images (n = 24), which were combinations of different degrees of mandibular protrusion (normal, slight, moderate, and severe) and different levels of facial background attractiveness (attractive, average, and unattractive). Dependent variables (fixation duration and first fixation time) were analyzed using repeated-measures factorial analysis of variance. Results: For normal mandibular profiles, the fixation duration of the eyes was significantly higher than that of other facial features (P <0.001). The lower face and nose received the least attention. As the degree of protrusion increased from slight to moderate, more attention was drawn to the lower face accompanied by less attention to eyes in the unattractive group (P <0.05). When protrusion degree increased from moderate to severe, attention shifted from nose to lower face significantly in the attractive group (P <0.05). Attention shift from eyes to lower face was also found in the average group when protrusion degree rose to moderate protrusion from normal profile (P <0.05). A significant interaction between facial attractiveness and mandibular protrusion was found in the lower face duration (P = 0.020). The threshold point (the point of mandibular protrusion degree that evoked attention to the lower face) of the attractive facial background was higher than that of the unattractive background. Once evoked, the effect of mandibular protrusion of the attractive group tended to be stronger than that of the unattractive group, though without statistical difference. Conclusions: Eyes are the most salient area. The increasing degree of mandibular protrusion tends to draw attention to the lower face from other facial features. Background attractiveness can modify this behavior. |
Po Sheng Huang; Cheng Hong Liu; Hsuan-Chih Chen Examining the applicability of representational change theory for remote associates problem-solving with eye movement evidence Journal Article In: Thinking Skills and Creativity, vol. 31, pp. 198–208, 2019. @article{Huang2019a, Remote associates problems are a significant measuring tool for the creative process. Scholars have argued that remote associates problems and insight problems share similar core processes. However, there is little empirical evidence for their similarities. The main purpose of this study is to examine the applicability of Representational Change Theory (an insight theory) for remote associates problem-solving. This study manipulated the occurrence position of the keyword of a remote associates problem to alter the constraint relaxation in the problem. The problems were divided into three kinds, namely Keyword-in-Front (KF), Keyword-in-Middle (KM), and Keyword-in-Back (KB) problems. Individuals' eye movements were recorded during problem-solving. The results indicate that the solution rates of KM problems are higher than that of KB problems. Further, when individuals solved KF or KB problems, they had more regression counts and spent longer dwell time on the fixation region than on the key region. However, more time was spent on the key region as well as more regression counts when one was solving KM problems than the other two problems. The results of this study support the applicability of Representational Change Theory in the solving process of remote associates problems. |
Yanfang Xia; Angelina Gurkina; Dominik R. Bach Pavlovian-to-instrumental transfer after human threat conditioning Journal Article In: Learning and Memory, vol. 26, no. 5, pp. 167–175, 2019. @article{Xia2019, Threat conditioning is a common associative learning model with translational relevance. How threat-conditioned cues impact on formally unrelated instrumental behavior in humans is not well known. Such an effect is known as Pavlovian-to-instrumental transfer (PIT). While PIT with aversive primary Pavlovian reinforcers is established in nonhuman animals, this is less clear in humans, where secondary reinforcers or instructed instrumental responses are most often investigated. We modified an existing human PIT procedure to include primary reinforcers. Participants first learned to obtain (or avoid losing) appetitive instrumental reinforcement (chocolate) by appropriate approach or avoidance actions. They either had to act (Go) or to with hold an action (NoGo),and in theGocondition either to approach a reward target to collect it or to withdraw fromthe reward target to avoid losing it. Then they learned to associate screen color (CS) with aversive Pavlovian reinforcement (electric shock US). In the transfer phase, we conducted the instrumental task during the presence of Pavlovian CS. In a first experiment, we show that the aversive Pavlovian CS+, compared to CS−, increased response rate in Go-Withdraw trials, i.e., induce condi- tioned facilitation of avoidance responses. This finding was confirmed in a second and independent experiment with an in- creased number of Go-Withdraw trials. Notably, we observed no appreciable conditioned suppression of approach responses. Effect size to distinguish CS+/CS− in Go-Withdraw trials was d=0.42 in the confirmation sample. This would require n=37 participants to demonstrate threat learning with 80% power. Thus, the effect size is on a practically useful scale although smaller than for model-based analysis of autonomic measures. In summary, our results indicate conditioned facilitation of formally unrelated instrumental avoidance behavior in humans and provide a novel behavioral threat learning measure that requires only key presses. |
Qiang Xing; Zheyi Lu; Jing Hu The effect of working memory updating ability on spatial insight problem solving: Evidence from behavior and eye movement studies Journal Article In: Frontiers in Psychology, vol. 10, pp. 927, 2019. @article{Xing2019, It still remains uncertain whether working memory updating ability influences spatial insight problem solving and whether working memory updating ability plays a role in the representation restructuring phase. The current study explored the correlation of working memory updating ability and spatial insight problem solving by behavior and eye movement experiments, and the results showed that high working memory updating ability individuals spend significant shorter time to solve spatial insight problem than low working memory updating ability individuals. For participants with high or low working memory updating ability, the underlying mechanism of spatial insight problem solving is sudden rather than incremental, which demonstrated that the working memory updating ability didn't influence the representation restructuring phase. Working memory updating ability influences spatial problem solving, and it works critically in the problem space search phase, while the restructuring phase is sudden and immediate, which is not influenced by working memory updating ability. The representation restructuring tends to be spontaneous. |
Kitty Z. Xu; Jeffrey D. Mayse; Susan M. Courtney Evidence for selective adjustments of inhibitory control in a variant of the stop signal task Journal Article In: Quarterly Journal of Experimental Psychology, vol. 72, no. 4, pp. 818–831, 2019. @article{Xu2019a, The ability to inhibit actions inappropriate for the context is essential for meeting the shifting demands of complex environments. The stop signal task (SST) has been used in many previous studies to examine the interactions between go and stop responses in a cognitively demanding task involving attention, conflict resolution, and motor plan selection. The current study uses a variant of the SST, in which the continue signal instructs participants to proceed with the go response they were preparing. Reaction times (RTs) on continue trials were bimodally distributed, suggesting that an aspect of inhibition was involved in at least some of the trials. We investigated whether the cognitive processes delaying the generation of a behavioural response on continue trials are the same as for stop trials. We found improvement of stop signal reaction times (SSRTs) following stop trials, but the decrease in continue signal reaction times (CSRTs) was not significant. No improvement in either SSRT or CSRT was found following continue trials, suggesting that activation of the processes delaying the response on continue trials is insufficient to drive subsequent adjustments in SSRT or CSRT. In addition, go RTs only slowed following stop trials. These effects may suggest the presence of a selective learning process, which requires that the initial inhibition captured by SSRT and CSRT be combined with recognition of the stop signal specifically to affect subsequent performance. |
Xiaolei Xu; Jialin Li; Zhuo Chen; Keith M. Kendrick; Benjamin Becker In: Psychoneuroendocrinology, vol. 108, pp. 62–69, 2019. @article{Xu2019b, The neuropeptide oxytocin (OXT) may facilitate attention to social stimuli by influencing early stage bottom-up processing although findings in relation to different emotional expressions are inconsistent and its influence on top-down cognitive processing mechanisms unclear. In the current double-blind placebo (PLC) controlled between-subject design study we therefore recruited 71 male subjects (OXT = 34 |
Yaoda Xu; Maryam Vaziri-Pashkam Task modulation of the 2-pathway characterization of occipitotemporal and posterior parietal visual object representations Journal Article In: Neuropsychologia, vol. 132, pp. 107140, 2019. @article{Xu2019, Recent studies have reported the existence of rich non-spatial visual object representations in both human and monkey posterior parietal cortex (PPC), similar to those found in occipito-temporal cortex (OTC). Despite this similarity, we recently showed that visual object representation still differ between OTC and PPC in two aspects. In one study, by manipulating whether object shape or color was task relevant, we showed that visual object representations were under greater top-down attention and task control in PPC than in OTC (Vaziri-Pashkam & Xu, 2017, J Neurosci). In another study, using a bottom-up data driven approach, we showed that there exists a large separation between PPC and OTC regions in the representational space, with OTC regions lining up hierarchically along an OTC pathway and PPC regions lining up hierarchically along an orthogonal PPC pathway (Vaziri-Pashkam & Xu, 2019, Cereb Cortex). To understand the interaction of goal-driven visual processing and the two-pathway structure in the representational space, here we performed a set of new analyses of the data from the three experiments of Vaziri-Pashkam and Xu (2017) and directly compared the two-pathway separation of OTC and PPC regions when object shapes were attended and task relevant and when they were not. We found that in all three experiments the correlation of visual object representational structure between superior IPS (a key PPC visual region) and lateral and ventral occipito-temporal regions (higher OTC visual regions) became greater when object shapes were attended than when they were not. This modified the two-pathway structure, with PPC regions moving closer to higher OTC regions and a compression of the PPC pathway towards the OTC pathway in the representational space when shapes were attended. Consistent with this observation, the correlation between neural and behavioral measures of visual representational structure was also higher in superior IPS when shapes were attended than when they were not. By comparing representational structures across experiments and tasks, we further showed that attention to object shape resulted in the formation of more similar object representations in superior IPS across experiments than between the two tasks within the same experiment despite noise and stimulus differences across the experiments. Overall, these results demonstrated that, despite the separation of the OTC and PPC pathways in the representational space, the visual representational structure of PPC is flexible and can be modulated by the task demand. This reaffirms the adaptive nature of visual processing in PPC and further distinguishes it from the more invariant nature of visual processing in OTC. |
Ting Yan; Hui Hui Zhou Synchronization between frontal eye field and area V4 during free-gaze visual search Journal Article In: Zoological research, vol. 40, no. 5, pp. 394–403, 2019. @article{Yan2019d, Information flow between the prefrontal and visual cortices is critical for visual behaviors such as visual search. To investigate its mechanisms, we simultaneously recorded spike and local field potential (LFP) signals in the frontal eye field (FEF) and area V4 while monkeys performed a free-gaze visual search task. During free-gaze search, spike-LFP coherence between FEF and V4 was enhanced in the theta rhythm (4-8 Hz) but suppressed in the alpha rhythm (8-13 Hz). Cross-frequency couplings during the Cue period before the search phase were related to monkey performance, with higher FEF theta-V4 gamma coupling and lower FEF alpha-V4 gamma coupling associated with faster search. Finally, feature-based attention during search enhanced spike-LFP coherence between FEF and V4 in the gamma and beta rhythms, whereas overt spatial attention reduced coherence at frequencies up to 30 Hz. These results suggest that oscillatory coupling may play an important role in mediating interactions between the prefrontal and visual cortices during visual search. |
Amit Yashar; Xiuyun Wu; Jiageng Chen; Marisa Carrasco Crowding and binding: Not all feature dimensions behave in the same way Journal Article In: Psychological Science, vol. 30, no. 10, pp. 1533–1546, 2019. @article{Yashar2019, Humans often fail to identify a target because of nearby flankers. The nature and stages at which this crowding occurs are unclear, and whether crowding operates via a common mechanism across visual dimensions is unknown. Using a dual-estimation report (N = 42), we quantitatively assessed the processing of features alone and in conjunction with another feature both within and between dimensions. Under crowding, observers misreported colors and orientations (i.e., reported a flanker value instead of the target's value) but averaged the target's and flankers' spatial frequencies (SFs). Interestingly, whereas orientation and color errors were independent, orientation and SF errors were interdependent. These qualitative differences of errors across dimensions revealed a tight link between crowding and feature binding, which is contingent on the type of feature dimension. These results and a computational model suggest that crowding and misbinding are due to pooling across a joint coding of orientations and SFs but not of colors. |
Mar Yebra; Ana Galarza-Vallejo; Vanesa Soto-Leon; Javier J. Gonzalez-Rosa; Archy O. Berker; Sven Bestmann; Antonio Oliviero; Marijn C. W. Kroes; Bryan A. Strange Action boosts episodic memory encoding in humans via engagement of a noradrenergic system Journal Article In: Nature Communications, vol. 10, pp. 3534, 2019. @article{Yebra2019, We are constantly interacting with our environment whilst we encode memories. However, how actions influence memory formation remains poorly understood. Goal-directed movement engages the locus coeruleus (LC), the main source of noradrenaline in the brain. Noradrenaline is also known to enhance episodic encoding, suggesting that action could improve memory via LC engagement. Here we demonstrate, across seven experiments, that action (Go-response) enhances episodic encoding for stimuli unrelated to the action itself, compared to action inhibition (NoGo). Functional magnetic resonance imaging, and pupil diameter as a proxy measure for LC-noradrenaline transmission, indicate increased encoding-related LC activity during action. A final experiment, replicated in two independent samples, confirmed a novel prediction derived from these data that emotionally aversive stimuli, which recruit the noradrenergic system, modulate the mnemonic advantage conferred by Go-responses relative to neutral stimuli. We therefore provide converging evidence that action boosts episodic memory encoding via a noradrenergic mechanism. |
Lok-Kin Yeung; Rosanna K. Olsen; Bryan Hong; Valentina Mihajlovic; Maria C. D'Angelo; Arber Kacollja; Jennifer D. Ryan; Morgan D. Barense Object-in-place memory predicted by anterolateral entorhinal cortex and parahippocampal cortex in older adults Journal Article In: Journal of Cognitive Neuroscience, vol. 31, no. 5, pp. 711–729, 2019. @article{Yeung2019, The lateral portion of the entorhinal cortex is one of the first brain regions affected by tau pathology, an important biomarker for Alzheimer disease. Improving our understanding of this region's cognitive role may help identify better cognitive tests for early detection of Alzheimer disease. Based on its functional connections, we tested the idea that the human anterolateral entorhinal cortex (alERC) may play a role in integrating spatial information into object representations. We recently demonstrated that the volume of the alERC was related to processing the spatial relationships of the features within an object [Yeung, L. K., Olsen, R. K., Bild-Enkin, H. E. P., D'Angelo, M. C., Kacollja, A., McQuiggan, D. A., et al. Anterolateral entorhinal cortex volume predicted by altered intra-item configural processing. Journal of Neuroscience, 37, 5527–5538, 2017]. In this study, we investi- gated whether the human alERC might also play a role in processing the spatial relationships between an object and its environment using an eye-tracking task that assessed visual fixations to a critical object within a scene. Guided by rodent work, we measured both object-in-place memory, the association of an object with a given context [Wilson, D. I., Langston, R. F., Schlesiger, M. I., Wagner, M., Watanabe, S., & Ainge, J. A. Lateral entorhinal cortex is critical for novel object-context recog- nition. Hippocampus, 23,352–366, 2013], and object-trace memory, the memory for the former location of objects [Tsao, A., Moser, M. B., & Moser, E. I. Traces of experience in the lateral entorhinal cortex. Current Biology, 23,399–405, 2013]. In a group of older adults with varying stages of brain atrophy and cognitive decline, we found that the volume of the alERC and the volume of the parahippocampal cortex selectively predicted object-in-place memory, but not object-trace memory. These results provide support for the notion that the alERC may integrate spatial information into object representations. |
Man Yi Yim; Xinying Cai; Xiao-Jing Wang Transforming the choice outcome to an action plan in monkey lateral prefrontal cortex: A neural circuit model Journal Article In: Neuron, vol. 103, no. 3, pp. 520–532.e5, 2019. @article{Yim2019, In economic decisions, we make a good-based choice first, then we transform the outcome into an action to obtain the good. To elucidate the network mechanisms for such transformation, we constructed a neural circuit model consisting of modules representing choice, integration of choice with target locations, and the final action plan. We examined three scenarios regarding how the final action plan could emerge in the neural circuit and compared their implications with experimental data. Our model with heterogeneous connectivity predicts the coexistence of three types of neurons with distinct functions, confirmed by analyzing the neural activity in the lateral prefrontal cortex (LPFC) of behaving monkeys. We obtained a much more distinct classification of functional neuron types in the ventral than the dorsal region of LPFC, suggesting that the action plan is initially generated in ventral LPFC. Our model offers a biologically plausible neural circuit architecture that implements good-to-action transformation during economic choice. Yim et al. propose a circuit model that implements good-to-action transformation during economic choice. Heterogeneity in circuit synaptic connections is crucial for the coexistence of distinct functional neuron types, which is confirmed by cluster analysis of neuronal activity in LPFC. |
Stefan Van der Stigchel; Frans S. S. Leijten; Mariska J. Vansteensel; Hendrik Chris Dijkerman; Nick F. Ramsey; Zachary V. Freudenburg Removal of epileptically compromised tissue in the frontal cortex restores oculomotor selection in the antisaccade task Journal Article In: Journal of Neuropsychology, vol. 13, no. 2, pp. 289–304, 2019. @article{VanderStigchel2019, The frontal cortex is heavily involved in oculomotor selection. Here, we investigated the neural correlates of eye movement selection during an antisaccade task in a young epileptic patient in whom the seizure focus included the frontal cortex and affected its function. Before resection surgery, the patient had difficulty in performing correct antisaccades towards the visual field contralateral to the seizure focus. Because the FEF is the only area in the human frontal cortex that is known to have a lateralized oculomotor function in the antisaccade task, this behavioural imbalance between the two visual fields suggests a disruption of FEF functioning by the nearby seizure focus. Electrocorticographic recordings at the seizure focus indeed showed that the seizure focus interfered with correct antisaccade performance. These results were in line with fMRI recordings revealing less task-related frontal activity for the hemisphere of the seizure focus, possibly reflecting diminished top-down engagement of the oculomotor system. Two months after removal of the compromised tissue, the seizures had disappeared, and antisaccade performance was the same for both visual hemifields. We conclude that a seizure focus in the frontal cortex can induce a dysfunction in the selection of eye movements, which is resolved after removal of interfering tissue. |
Joram Driel; Eduard Ort; Johannes J. Fahrenfort; Christian N. L. Olivers Beta and theta oscillations differentially support free versus forced control over multiple-target search Journal Article In: Journal of Neuroscience, vol. 39, no. 9, pp. 1733–1743, 2019. @article{Driel2019, Many important situations require human observers to simultaneously search for more than one object. Despite a long history of research into visual search, the behavioral and neural mechanisms associated with multiple-target search are poorly understood. Here we test the novel theory that the efficiency of looking for multiple targets critically depends on the mode of cognitive control the environment affords to the observer. We used an innovative combination of electroencephalogram (EEG) and eye tracking while participants searched for two targets, within two different contexts: either both targets were present in the search display and observers were free to prioritize either one of them, thus enabling proactive control over selection; or only one of the two targets would be present in each search display, which requires reactive control to reconfigure selection when the wrong target has been prioritized. During proactive control, both univariate and multivariate signals of beta-band (15–35 Hz) power suppression before display onset predicted switches between target selections. This signal originated over midfrontal and sensorimotor regions and has previously been associated with endogenous state changes. In contrast, imposed target selections requiring reactive control elicited prefrontal power enhancements in the delta/theta band (2– 8 Hz), but only after display onset. This signal predicted individual differences in associated oculomotor switch costs, reflecting reactive reconfiguration of target selection. The results provide compelling evidence that multiple target representations are differentially prioritized during visual search, and for the first time reveal distinct neural mechanisms underlying proactive and reactive control over multiple-target search. |
Freek Ede; Sammi R. Chekroud; Anna C. Nobre Human gaze tracks attentional focusing in memorized visual space Journal Article In: Nature Human Behaviour, vol. 3, no. 5, pp. 462–470, 2019. @article{Ede2019, Brain areas that control gaze are also recruited for covert shifts of spatial attention 1–9 . In the external space of perception, there is a natural ecological link between the control of gaze and spatial attention, as information sampled at covertly attended locations can inform where to look next 2,10,11 . Attention can also be directed internally to representations held within the spatial layout of visual working memory 12–16. In such cases, the incentive for using attention to direct gaze disappears, as there are no external targets to scan. Here we investigate whether the oculomotor system of the brain also participates in attention focusing within the internal space of memory. Paradoxically, we reveal this participation through gaze behaviour itself. We demonstrate that selecting an item from visual working memory biases gaze in the direction of the memorized location of that item, despite there being nothing to look at and location memory never explicitly being probed. This retrospective ‘gaze bias' occurs only when an item is not already in the internal focus of attention, and it predicts the performance benefit associated with the focusing of internal attention. We conclude that the oculomotor system also participates in focusing attention within memorized space, leaving traces all the way to the eyes. |
Welmoed Van Ens; Ulrike Schmidt; Iain C. Campbell; Anne Roefs; Jessica Werthmann Test-retest reliability of attention bias for food: Robust eye-tracking and reaction time indices Journal Article In: Appetite, vol. 136, pp. 86–92, 2019. @article{VanEns2019, This study assessed internal reliability and test-retest reliability of attention bias scores for food derived from the dot probe task. A visual dot probe task with food and non-food pictures (presented for 3000 ms) was administered to 53 healthy women on two occasions. Attention bias scores for food were calculated based on manual response latencies (reaction time bias) and concurrent assessment of eye-movements (direction bias and dwell-time bias). Subjective hunger and blood glucose levels were measured on both testing occasions. Dietary restraint and eating disorder symptoms were assessed during the second session. Results showed that direction bias had poor internal and test-retest reliability. Dwell time bias had excellent internal and acceptable test-retest reliability. Reaction time bias had acceptable internal and good test-retest reliability. Exploratory correlational analyses found that hunger, blood glucose, dietary restraint and eating disorder symptoms were not consistently significantly correlated with indices of attention bias for food. Overall, these findings contradict previous studies that reported low reliability of attention bias indices derived from the visual dot probe task. The implications are that a longer stimulus presentation time (i.e. ≥ 3000 ms), the use of eye-tracking and the use of appetizing stimuli can yield reliable attention bias scores for food. However, the interpretation of dot-probe scores of attention bias for food based on a dot probe task with 3000 ms presentation time and the score's relationship to theoretically relevant constructs such as hunger, eating restraint and eating disorder symptoms, require further clarification. |
Mats W. J. Es; Jan-Mathijs Schoffelen Stimulus-induced gamma power predicts the amplitude of the subsequent visual evoked response Journal Article In: NeuroImage, vol. 186, pp. 703–712, 2019. @article{Es2019a, The efficiency of neuronal information transfer in activated brain networks may affect behavioral performance. Gamma-band synchronization has been proposed to be a mechanism that facilitates neuronal processing of behaviorally relevant stimuli. In line with this, it has been shown that strong gamma-band activity in visual cortical areas leads to faster responses to a visual go cue. We investigated whether there are directly observable consequences of trial-by-trial fluctuations in non-invasively observed gamma-band activity on the neuronal response. Specifically, we hypothesized that the amplitude of the visual evoked response to a go cue can be predicted by gamma power in the visual system, in the window preceding the evoked response. Thirty-three human subjects (22 female) performed a visual speeded response task while their magnetoencephalogram (MEG) was recorded. The participants had to respond to a pattern reversal of a concentric moving grating. We estimated single trial stimulus-induced visual cortical gamma power, and correlated this with the estimated single trial amplitude of the most prominent event-related field (ERF) peak within the first 100 ms after the pattern reversal. In parieto-occipital cortical areas, the amplitude of the ERF correlated positively with gamma power, and correlated negatively with reaction times. No effects were observed for the alpha and beta frequency bands, despite clear stimulus onset induced modulation at those frequencies. These results support a mechanistic model, in which gamma-band synchronization enhances the neuronal gain to relevant visual input, thus leading to more efficient downstream processing and to faster responses. |
Jochem Kempen; Gerard M. Loughnane; Daniel P. Newman; Simon P. Kelly; Alexander Thiele; Redmond G. O'Connell; Mark A. Bellgrove Behavioural and neural signatures of perceptual decision-making are modulated by pupil-linked arousal Journal Article In: eLife, vol. 8, pp. 1–27, 2019. @article{Kempen2019, The timing and accuracy of perceptual decision-making is exquisitely sensitive to fluctuations in arousal. Although extensive research has highlighted the role of various neural processing stages in forming decisions, our understanding of how arousal impacts these processes remains limited. Here we isolated electrophysiological signatures of decision-making alongside signals reflecting target selection, attentional engagement and motor output and examined their modulation as a function of tonic and phasic arousal, indexed by baseline and task-evoked pupil diameter, respectively. Reaction times were shorter on trials with lower tonic, and higher phasic arousal. Additionally, these two pupil measures were predictive of a unique set of EEG signatures that together represent multiple information processing steps of decision-making. Finally, behavioural variability associated with fluctuations in tonic and phasic arousal, indicative of neuromodulators acting on multiple timescales, was mediated by its effects on the EEG markers of attentional engagement, sensory processing and the variability in decision processing. |
Rozemarijn S. Kleef; Claudi L. H. Bockting; Evelien Valen; André Aleman; Jan Bernard C. Marsman; Marie José Tol In: BMC Psychiatry, vol. 19, pp. 1–11, 2019. @article{Kleef2019, Background: Major Depressive Disorder (MDD) is a psychiatric disorder with a highly recurrent character, making prevention of relapse an important clinical goal. Preventive Cognitive Therapy (PCT) has been proven effective in preventing relapse, though not for every patient. A better understanding of relapse vulnerability and working mechanisms of preventive treatment may inform effective personalized intervention strategies. Neurocognitive models of MDD suggest that abnormalities in prefrontal control over limbic emotion-processing areas during emotional processing and regulation are important in understanding relapse vulnerability. Whether changes in these neurocognitive abnormalities are induced by PCT and thus play an important role in mediating the risk for recurrent depression, is currently unclear. In the Neurocognitive Working Mechanisms of the Prevention of Relapse In Depression (NEWPRIDE) study, we aim to 1) study neurocognitive factors underpinning the vulnerability for relapse, 2) understand the neurocognitive working mechanisms of PCT, 3) predict longitudinal treatment effects based on pre-treatment neurocognitive characteristics, and 4) validate the pupil dilation response as a marker for prefrontal activity, reflecting emotion regulation capacity and therapy success. Methods: In this randomized controlled trial, 75 remitted recurrent MDD (rrMDD) patients will be included. Detailed clinical and cognitive measurements, fMRI scanning and pupillometry will be performed at baseline and three-month follow-up. In the interval, 50 rrMDD patients will be randomized to eight sessions of PCT and 25 rrMDD patients to a waiting list. At baseline, 25 healthy control participants will be additionally included to objectify cross-sectional residual neurocognitive abnormalities in rrMDD. After 18 months, clinical assessments of relapse status are performed to investigate which therapy induced changes predict relapse in the 50 patients allocated to PCT. Discussion: The present trial is the first to study the neurocognitive vulnerability factors underlying relapse and mediating relapse prevention, their value for predicting PCT success and whether pupil dilation acts as a valuable marker in this regard. Ultimately, a deeper understanding of relapse prevention could contribute to the development of better targeted preventive interventions. Trial registration: Trial registration: Netherlands Trial Register, August 18, 2015, trial number NL5219. |
Chayenne Van Meel; Annelies Baeck; Céline R. Gillebert; Johan Wagemans; Hans P. Op de Beeck The representation of symmetry in multi-voxel response patterns and functional connectivity throughout the ventral visual stream Journal Article In: NeuroImage, vol. 191, pp. 216–224, 2019. @article{VanMeel2019, Several computational models explain how symmetry might be detected and represented in the human brain. However, while there is an abundance of psychophysical studies on symmetry detection and several neural studies showing where and when symmetry is detected in the brain, important questions remain about how this detection happens and how symmetric patterns are represented. We studied the representation of (vertical) symmetry in regions of the ventral visual stream, using multi-voxel pattern analyses (MVPA) and functional connectivity analyses. Our results suggest that neural representations gradually change throughout the ventral visual stream, from very similar part-based representations for symmetrical and asymmetrical stimuli in V1 and V2, over increasingly different representations for symmetrical and asymmetrical stimuli which are nevertheless still part-based in both V3 and V4, to a more holistic representation for symmetrical compared to asymmetrical stimuli in high-level LOC. This change in representations is accompanied by increased communication between left and right retinotopic areas, evidenced by higher interhemispheric functional connectivity during symmetry perception in areas V2 and V4. |
Dirk Moorselaar; Heleen A. Slagter In: Journal of Neuroscience, vol. 39, no. 35, pp. 6953–6967, 2019. @article{Moorselaar2019, It is well known that attention can facilitate performance by top-down biasing processing of task-relevant information in advance. Recent findings from behavioral studies suggest that distractor inhibition is not under similar direct control but strongly dependent on expectations derived from previous experience. Yet, how expectations about distracting information influence distractor inhibition at the neural level remains unclear. The current study addressed this outstanding question in three experiments in which search displays with repeating distractor or target locations across trials allowed human observers (male and female) to learn which location to selectively suppress or boost. Behavioral findings demonstrated that both distractor and target location learning resulted in more efficient search, as indexed by faster response times. Crucially, distractor learning benefits were observed without target location foreknowledge, unaffected by the number of possible target locations, and could not be explained by priming alone. To determine how distractor location expectations facilitated performance, we applied a spatial encoding model to EEG data to reconstruct activity in neural populations tuned to distractor or target locations. Target location learning increased neural tuning to target locations in advance, indicative of preparatory biasing. This sensitivity increased after target presentation. By contrast, distractor expectations did not change preparatory spatial tuning. Instead, distractor expectations reduced distractor-specific processing, as reflected in the disappearance of the Pd event-related potential component, a neural marker of distractor inhibition, and decreased decoding accuracy. These findings suggest that the brain may no longer process expected distractors as distractors, once it has learned they can safely be ignored.SIGNIFICANCE STATEMENT We constantly try hard to ignore conspicuous events that distract us from our current goals. Surprisingly, and in contrast to dominant attention theories, ignoring distracting, but irrelevant, events does not seem to be as flexible as is focusing our attention on those same aspects. Instead, distractor suppression appears to strongly rely on learned, context-dependent expectations. Here, we investigated how learning about upcoming distractors changes distractor processing and directly contrasted the underlying neural dynamics to target learning. We show that, while target learning enhanced anticipatory sensory tuning, distractor learning only modulated reactive suppressive processing. These results suggest that expected distractors may no longer be considered distractors by the brain once it has learned that they can safely be ignored. |
Daan R. Renswoude; Linda Berg; Maartje E. J. Raijmakers; Ingmar Visser Infants' center bias in free viewing of real-world scenes Journal Article In: Vision Research, vol. 154, pp. 44–53, 2019. @article{Renswoude2019, This study examines how salience and a center bias drive infants' first fixation while looking at complex scenes. Adults are known to have a strong center bias, their first point of gaze is nearly always in the center of the scene. The center bias is likely to be a strategic bias, as looking towards the center minimizes the distance to other parts of the scene and important objects are often located at the center. In an experimental design varying salience regions of scenes and start positions we examined infants' (N = 48 |
Daan R. Renswoude; Ingmar Visser; Maartje E. J. Raijmakers; Tawny Tsang; Scott P. Johnson Real-world scene perception in infants: What factors guide attention allocation? Journal Article In: Infancy, vol. 24, pp. 693–717, 2019. @article{Renswoude2019a, The foci of visual attention were modeled as a function of perceptual salience, adult fixation locations, and attentional control mechanisms (measured in separate tasks) in infants (N = 45, 3-to 15-month-olds) as they viewed static real-world scenes. After controlling for the center bias, the results showed that low-level perceptual salience predicts where infants look. In addition, high-level factors also played a role: Infants fix-ated parts of the scenes frequently fixated by adults and this effect was stronger for older than younger infants. In line with this finding, infant fixation durations were longer on regions more frequently fixated by adults, implying longer time taken to process the available information. Fixation durations decreased with age, and this decline interacted with orienting skills such that fixation durations decreased faster with age for infants with high orienting skills, relative to infants with low orienting skills. There was a further interaction between fixa-tion durations and selective attention abilities: Infants with low selective attention skills showed a decrease in fixation durations with age, whereas infants with higher selective attention skills showed a slight increase in fixation durations with age. These findings imply that infants' visual processing of static real-world stimuli develops in accord with attentional control. |
Joanne C. Van Slooten; Sara Jahfari; Jan Theeuwes Spontaneous eye blink rate predicts individual differences in exploration and exploitation during reinforcement learning Journal Article In: Scientific Reports, vol. 9, pp. 17436, 2019. @article{VanSlooten2019, Spontaneous eye blink rate (sEBR) has been linked to striatal dopamine function and to how individuals make value-based choices after a period of reinforcement learning (RL). While sEBR is thought to reflect how individuals learn from the negative outcomes of their choices, this idea has not been tested explicitly. This study assessed how individual differences in sEBR relate to learning by focusing on the cognitive processes that drive RL. Using Bayesian latent mixture modelling to quantify the mapping between RL behaviour and its underlying cognitive processes, we were able to differentiate low and high sEBR individuals at the level of these cognitive processes. Further inspection of these cognitive processes indicated that sEBR uniquely indexed explore-exploit tendencies during RL: lower sEBR predicted exploitative choices for high valued options, whereas higher sEBR predicted exploration of lower value options. This relationship was additionally supported by a network analysis where, notably, no link was observed between sEBR and how individuals learned from negative outcomes. Our findings challenge the notion that sEBR predicts learning from negative outcomes during RL, and suggest that sEBR predicts individual explore-exploit tendencies. These then influence value sensitivity during choices to support successful performance when facing uncertain reward. |
Sonja Well; John P. O'Doherty; Frans Winden Relief from incidental fear evokes exuberant risk taking Journal Article In: PLoS ONE, vol. 14, no. 1, pp. e0211018, 2019. @article{Well2019, Incidental emotions are defined as feelings that are unrelated to a decision task at hand and thereby not normatively relevant for making choices. The precise influence and formal theoretical implications of incidental emotions regarding financial risk taking are still largely unclear. An effect of incidental emotion on decision-making would challenge the main extant formal theoretical economic models because such models do not allow for an effect of incidental emotions. As financial risk taking is pervasive in modern economies, the role of incidental emotions is an important issue. The goal of this experimental study is threefold. First, we examine the impact of incidental fear on the choice between a sure and a risky monetary option. A well-validated method of fear induction, using electric shocks, is employed for that purpose. Based on emotion studies we hypothesize less risk taking under fear and more risk taking when relieved of fear. Our second goal is to investigate the relative performance of the main existing formal theoretical economic models (based on Expected Utility Theory, Prospect Theory, or the Mean-Variance model) in explaining the behavioral data. We also investigate how these models can be adjusted to accommodate any observed influence of incidental emotion. For that reason, we first theoretically model the potential pathways of incidental fear (and the relief thereof) via the valuation of the choice option rewards or risk-assessment. We then estimate the relevant parameters allowing for both additive as well as interactive effects. Our third and final goal is to explore the neural basis of any observed influence of incidental emotions on decision-making by means of a model-based fMRI analysis, using the findings of existing neuroeconomic studies as the basis for our hypotheses. Our results indicate that the relief of fear can give a substantial boost to financial risk taking (suggestive of exuberance). This impact is best captured by Prospect Theory if we allow for an increase in participants' valuation of option outcomes when relieved of fear. Moreover, this impact is manifested at the neural level by the activity of the ventromedial prefrontal cortex (vmPFC), a brain area widely regarded as being central for valuation. |
A. Vasilyev; M. Hansard Spatial distribution of eye-movements after central vision loss is consistent with an optimal visual search strategy Journal Article In: International Journal of Neural Systems, vol. 29, no. 10, pp. 1–20, 2019. @article{Vasilyev2019, The problem of gaze allocation has previously been studied in the framework of eye-movement control models, which require prior knowledge of visibility maps (VMs). These encode the signal-to-noise ratio, at each point in the visual field, which can be used to define an optimal policy of gaze allocation. However, it is not always possible to estimate the VM, in a given experimental setting, as it depends on many factors, including the visual system of the individual observer. Hence, few eye-movement datasets include the corresponding VM estimates. This can be problematic for the analysis of certain clinical conditions, such as Age-related Macular Degeneration (AMD), which are associated with reduced sensitivity in the affected locations of the visual field. The corresponding VMs are highly idiosyncratic, and cannot be modeled by estimates obtained from healthy observers. We propose an algorithm for maximum likelihood VM estimation, working directly from eye-movement sequences. We apply this algorithm to two eye-tracking datasets, based on visual search tasks, obtained from AMD patients. We show that the inferred VMs are spatially consistent with the measured visual field sensitivities. We also show that simulations with the estimated VMs can account for the asymmetric distribution of saccade vectors, which is typical of AMD patients. |
Maryam Vaziri-Pashkam; Yaoda Xu An Information-Driven 2-Pathway Characterization of Occipitotemporal and Posterior Parietal Visual Object Representations Journal Article In: Cerebral Cortex, vol. 29, no. 5, pp. 2034–2050, 2019. @article{VaziriPashkam2019, Recent studies have demonstrated the existence of rich visual representations in both occipitotemporal cortex (OTC) and posterior parietal cortex (PPC). Using fMRI decoding and a bottom-up data-driven approach, we showed that although robust object category representations exist in both OTC and PPC, there is an information-driven 2-pathway separation among these regions in the representational space, with occipitotemporal regions arranging hierarchically along 1 pathway and posterior parietal regions along another pathway. We obtained 10 independent replications of this 2-pathway distinction, accounting for 58-81% of the total variance of the region-wise differences in visual representation. The separation of the PPC regions from higher occipitotemporal regions was not driven by a difference in tolerance to changes in low-level visual features, did not rely on the presence of special object categories, and was present whether or not object category was task relevant. Our information-driven 2-pathway structure differs from the well-known ventral-what and dorsal-where/how characterization of posterior brain regions. Here both pathways contain rich nonspatial visual representations. The separation we see likely reflects a difference in neural coding scheme used by PPC to represent visual information compared with that of OTC. |
Marine Vernet; Chloé Stengel; Romain Quentin; Julià L. Amengual; Antoni Valero-Cabré Entrainment of local synchrony reveals a causal role for high-beta right frontal oscillations in human visual consciousness Journal Article In: Scientific Reports, vol. 9, pp. 14510, 2019. @article{Vernet2019, Prior evidence supports a critical role of oscillatory activity in visual cognition, but are cerebral oscillations simply correlated or causally linked to our ability to consciously acknowledge the presence of a target in our visual field? Here, EEG signals were recorded on humans performing a visual detection task, while they received brief patterns of rhythmic or random transcranial magnetic stimulation (TMS) delivered to the right Frontal Eye Field (FEF) prior to the onset of a lateralized target. TMS entrained oscillations, i.e., increased high-beta power and phase alignment (the latter to a higher extent for rhythmic high-beta patterns than random patterns) while also boosting visual detection sensitivity. Considering post-hoc only those participants in which rhythmic stimulation enhanced visual detection, the magnitude of high-beta entrainment correlated with left visual performance increases. Our study provides evidence in favor of a causal link between high-beta oscillatory activity in the Frontal Eye Field and visual detection. Furthermore, it supports future applications of brain stimulation to manipulate local synchrony and improve or restore impaired visual behaviors. |
Petra Vetter; Stephanie Badde; Elizabeth A. Phelps; Marisa Carrasco Emotional faces guide the eyes in the absence of awareness Journal Article In: eLife, vol. 8, pp. 1–15, 2019. @article{Vetter2019, The ability to act quickly to a threat is a key skill for survival. Under awareness, threat-related emotional information, such as an angry or fearful face, has not only perceptual advantages but also guides rapid actions such as eye movements. Emotional information that is suppressed from awareness still confers perceptual and attentional benefits. However, it is unknown whether suppressed emotional information can directly guide actions, or whether emotional information has to enter awareness to do so. We suppressed emotional faces from awareness using continuous flash suppression and tracked eye gaze position. Under successful suppression, as indicated by objective and subjective measures, gaze moved towards fearful faces, but away from angry faces. Our findings reveal that: (1) threat-related emotional stimuli can guide eye movements in the absence of visual awareness; (2) threat-related emotional face information guides distinct oculomotor actions depending on the type of threat conveyed by the emotional expression. |
Paula Vieweg; Martin Riemer; David Berron; Thomas Wolbers Memory Image Completion: Establishing a task to behaviorally assess pattern completion in humans Journal Article In: Hippocampus, vol. 29, no. 4, pp. 340–351, 2019. @article{Vieweg2019, For memory retrieval, pattern completion is a crucial process that restores memories from partial or degraded cues. Neurocognitive aging models suggest that the aged memory system is biased toward pattern completion, resulting in a behavioral preference for retrieval over encoding of memories. Here, we built on our previously developed behavioral recognition memory paradigm—the Memory Image Completion (MIC) task—a task to specifically target pattern completion. First, we used the original design with concurrent eye-tracking in order to rule out perceptual confounds that could interact with recognition performance. Second, we developed parallel versions of the task to accommodate test settings in clinical environments or longitudinal studies. The results show that older adults have a deficit in pattern completion ability with a concurrent bias toward pattern completion. Importantly, eye-tracking data during encoding could not account for age-related performance differences. At retrieval, spatial viewing patterns for both age groups were more driven by stimulus identity than by response choice, but compared to young adults, older adults' fixation patterns overlapped more between stimuli that they (wrongly) thought had the same identity. This supports the observation that older adults choose responses perceived as similar to a learned stimulus, indicating a bias toward pattern completion. Additionally, two shorter versions of the task yielded comparable results, and no general learning effects were observed for repeated testing. Together, we present evidence that the MIC is a reliable behavioral task that targets pattern completion, that is easily and repeatedly applicable, and that is made freely available online. |
Kasper Vinken; Rufin Vogels A behavioral face preference deficit in a monkey with an incomplete face patch system Journal Article In: NeuroImage, vol. 189, pp. 415–424, 2019. @article{Vinken2019, Primates are experts in face perception and naturally show a preference for faces under free-viewing conditions. The primate ventral stream is characterized by a network of face patches that selectively responds to faces, but it remains uncertain how important such parcellation is for face perception. Here we investigated free-viewing behavior in a female monkey who naturally lacks fMRI-defined posterior and middle lateral face patches. We presented a series of content-rich images of scenes that included faces or other objects to that monkey during a free-viewing task and tested a group of 10 control monkeys on the same task for comparison. We found that, compared to controls, the monkey with missing face patches showed a marked reduction of face viewing preference that was most pronounced for the first few fixations. In addition, her gaze fixation patterns were substantially distinct from those of controls, especially for pictures with a face. These data demonstrate an association between the clustering of neurons in face selective patches and a behavioral bias for faces in natural images. |
Katharina Voigt; Carsten Murawski; Sebastian Speer; Stefan Bode Hard decisions shape the neural coding of preferences Journal Article In: Journal of Neuroscience, vol. 39, no. 4, pp. 718–726, 2019. @article{Voigt2019, Hard decisions between equally valued alternatives can result in preference changes, meaning that subsequent valuations for chosen items increaseanddecrease for rejected items. Previous research suggests that thisphenomenon is aconsequenceofcognitive dissonance reduction after the decision, induced by the mismatch between initial preferences and decision outcomes. In contrast, this functional magnetic resonance imaging and eye-tracking study with male and female human participants found that preferences are already updated online during the process of decision-making. Preference changes were predicted from activity in left dorsolateral prefrontal cortexandprecuneus whilemakinghard decisions. Fixation durations during this phase predicted both choice outcomesandsubsequent preference changes. These preference adjustments became behaviorally relevant only for choices that were rememberedand were in turn associated with hippocampus activity. Our results suggest that preferences evolve dynamically as decisions arise, potentially as a mechanism to prevent stalemate situations in underdetermined decision scenarios. |
Eelke Vries; Daniel Baldauf In: Journal of Cognitive Neuroscience, vol. 31, no. 10, pp. 1573–1588, 2019. @article{Vries2019, We recorded magnetoencephalography using a neural entrainment paradigm with compound face stimuli that allowed for entraining the processing of various parts of a face (eyes, mouth) as well as changes in facial identity. Our magnetic response image-guided magnetoencephalography analyses revealed that different subnodes of the human face processing network were entrained differentially according to their functional specialization. Whereas the occipital face area was most responsive to the rate at which face parts (e.g., the mouth) changed, and face patches in the STS were mostly entrained by rhythmic changes in the eye region, the fusiform face area was the only subregion that was strongly entrained by the rhythmic changes in facial identity. Furthermore, top–down attention to the mouth, eyes, or identity of the face selectively modulated the neural processing in the respective area (i.e., occipital face area, STS, or fusiform face area), resembling behavioral cue validity effects observed in the participants' RT and detection rate data. Our results show the attentional weighting of the visual processing of different aspects and dimensions of a single face object, at various stages of the involved visual processing hierarchy. |
Josefine Waldthaler; Charlotte Krüger-Zechlin; Lena Stock; Zain Deeb; Lars Timmermann New insights into facial emotion recognition in Parkinson's disease with and without mild cognitive impairment from visual scanning patterns Journal Article In: Clinical Parkinsonism and Related Disorders, vol. 1, pp. 102–108, 2019. @article{Waldthaler2019, Background: Recognizing emotional facial expressions is crucial for social interactions. Cognitive impairment and oculomotor abnormalities are common features of Parkinson's disease (PD) which may contribute to the performance in facial emotion recognition (FER) in PD. Objective: The aim of this study was to analyze eye movement behavior during a facial emotion recognition (FER) task with respect to cognitive state in PD patients and healthy controls. Methods: Eye movements of 24 non-demented, non-depressed PD patients (12 with intact cognitive functions and 12 with Mild Cognitive Impairment (MCI) according to MDS task force criteria level 2), and 12 age-, sex and education-matched healthy controls were recorded during visual exploration of 28 emotional (happiness, surprise, disgust, anger, fear and sadness) and neutral faces. Participants were asked to identify the displayed emotion out of a sevenfold multiple choice question. Results: PD-MCI patients showed reduced FER with specific impairment of anger recognition. Although the scanned area of PD patients with intact cognition was significantly restricted, they did not differ in FER from healthy subjects. While healthy subjects and cognitively intact PD patients scanned faces with preference for mouth and eyes, patients with PD-MCI tended to look at the center of the face and spent significantly less time fixating the mouth. Conclusions: Ineffective visual exploration may contribute to impaired emotion recognition in PD. Visual scanning of emotional faces is altered in PD even in the absence of cognitive impairment. The progression to PD-MCI may result in further deterioration of scanning behavior and FER impairment. |
Thomas S. A. Wallis; Christina M. Funke; Alexander S. Ecker; Leon A. Gatys; Felix A. Wichmann; Matthias Bethge Image content is more important than Bouma's law for scene metamers Journal Article In: eLife, vol. 8, pp. 1–43, 2019. @article{Wallis2019, We subjectively perceive our visual field with high fidelity, yet peripheral distortions can go unnoticed and peripheral objects can be difficult to identify (crowding). Prior work showed that humans could not discriminate images synthesised to match the responses of a mid-level ventral visual stream model when information was averaged in receptive fields with a scaling of about half their retinal eccentricity. This result implicated ventral visual area V2, approximated ‘Bouma's Law' of crowding, and has subsequently been interpreted as a link between crowding zones, receptive field scaling, and our perceptual experience. However, this experiment never assessed natural images. We find that humans can easily discriminate real and model-generated images at V2 scaling, requiring scales at least as small as V1 receptive fields to generate metamers. We speculate that explaining why scenes look as they do may require incorporating segmentation and global organisational constraints in addition to local pooling. |
Pascal Wallisch; J. Anthony Movshon Responses of neurons in macaque MT to unikinetic plaids Journal Article In: Journal of Neurophysiology, vol. 122, no. 5, pp. 1937–1945, 2019. @article{Wallisch2019, Response properties of MT neurons are often studied with “bikinetic” plaid stimuli, which consist of two superimposed sine wave gratings moving in different directions. Oculomotor studies using “unikinetic plaids” in which only one of the two superimposed gratings moves suggest that the eyes first move reflexively in the direction of the moving grating and only later converge on the perceived direction of the moving pattern. MT has been implicated as the source of visual signals that drives these responses. We wanted to know whether stationary gratings, which have little effect on MT cells when presented alone, would influence MT responses when paired with a moving grating. We recorded extracellularly from neurons in area MT and measured responses to stationary and moving gratings, and to their sums: bikinetic and unikinetic plaids. As expected, stationary gratings presented alone had a very modest influence on the activity of MT neurons. Responses to moving gratings and bikinetic plaids were similar to those previously reported and revealed cells selective for the motion of plaid patterns and of their components (pattern and component cells). When these neurons were probed with unikinetic plaids, pattern cells shifted their direction preferences in a way that revealed the influence of the static grating. Component cell preferences shifted little or not at all. These results support the notion that pattern-selective neurons in area MT integrate component motions that differ widely in speed, and that they do so in a way that is consistent with an intersection-of-constraints model. |
Amy T. Walsh; David Carmel; Gina M. Grimshaw Reward elicits cognitive control over emotional distraction: Evidence from pupillometry Journal Article In: Cognitive, Affective and Behavioral Neuroscience, vol. 19, no. 3, pp. 537–554, 2019. @article{Walsh2019, Attention is biased toward emotional stimuli, even when they are irrelevant to current goals. Motivation, elicited by performance-contingent reward, reduces behavioural emotional distraction. In emotionally neutral contexts, reward is thought to encourage use of a proactive cognitive control strategy, altering anticipatory attentional settings to more effectively suppress distractors. The current preregistered study investigates whether a similar proactive shift occurs even when distractors are highly arousing emotional images. We monitored pupil area, an online measure of both cognitive and emotional processing, to examine how reward influences the time course of control. Participants (n = 110) identified a target letter flanking an irrelevant central image. Images were meaningless scrambles on 75% of trials; on the remaining 25%, they were intact positive (erotic), negative (mutilation), or neutral images. Half the participants received financial rewards for fast and accurate performance, while the other half received no performance-contingent reward. Emotional distraction was greater than neutral distraction, and both were attenuated by reward. Consistent with behavioural findings, pupil dilation was greater following emotional than neutral distractors, and dilation to intact distractors (regardless of valence) was decreased by reward. Although reward did not enhance tonic pupil dilation (an index of sustained proactive control), exploratory analyses showed that reward altered the time course of control—eliciting a sharp, rapid, increase in dilation immediately preceding stimulus onset (reflecting dynamic use of anticipatory control), that extended until well after stimulus offset. These findings suggest that reward alters the time course of control by encouraging proactive preparation to rapidly disengage from emotional distractors. |
Benchi Wang; Iliana Samara; Jan Theeuwes Statistical regularities bias overt attention Journal Article In: Attention, Perception, and Psychophysics, vol. 81, pp. 1813–1821, 2019. @article{Wang2019a, A previous study employing the additional singleton paradigm showed that a singleton distractor that appeared more often in one specific location interfered less with target search than when it appeared at any other location. These findings suggested that through statistical learning the location that was likely to contain a distractor was suppressed relative to all other locations. Even though feasible, it is also possible that this effect is due to faster disengagement of attention from the high-probability distractor location. The present study tested this hypothesis using a variant of the additional singleton task adapted for eye tracking in which observers made a speeded saccade to a shape singleton and gave a manual response. The singleton distractor was presented more often at one location than all other locations. Consistent with the suppression hypothesis, we found that fewer saccades landed at the high-probability distractor location than any other location. Also, when a target appeared at the high-probability location, saccade latencies towards the target were higher than latencies towards the target when it was presented at other locations. Furthermore, in addition to suppression, we also found evidence for faster disengagement from the high-probability distractor location than the low-probability distractor location; however, this effect was relatively small. The current findings support the notion that through statistical learning plasticity is induced in the spatial priority map of attentional selection so that the high-probability distractor location is suppressed compared to any other location. |
Chao Wang; Hanna Haponenko; Xingze Liu; Hong-jin Sun; Guang Zhao How attentional guidance and response selection boost contextual learning: Evidence from eye movement Journal Article In: Advances in Cognitive Psychology, vol. 15, no. 4, pp. 265–275, 2019. @article{Wang2019b, The contextual cueing effect (CCE) refers to the learned association between predictive configuration and target location, speeding up response times for targets. Previous studies have examined the underlying processes (initial perceptual process, attentional guidance, and response selection) of CCE but have not reached a general consensus on their contributions to CCE. In the present study, we used eye tracking to address this question by analyzing the oculomotor correlates of context-guided learning in visual search and eliminating indefinite response factors during response priming. The results show that both attentional guidance and response selection contribute to contextual learning. |
J. Jessica Wang; Philip Tseng; Chi-Hung Juan; Steven Frisson; Ian A. Apperly Perspective-taking across cultures: Shared biases in Taiwanese and British adults Journal Article In: Royal Society Open Science, vol. 6, pp. 1–15, 2019. @article{Wang2019d, The influential hypothesis by Markus & Kitayama (Markus, Kitayama 1991. Psychol. Rev. 98, 224) postulates that individuals from interdependent cultures place others above self in interpersonal contexts. This led to the prediction and finding that individuals from interdependent cultures are less egocentric than those from independent cultures (Wu, Barr, Gann, Keysar 2013. Front. Hum. Neurosci. 7, 1–7; Wu, Keysar. 2007 Psychol. Sci. 18, 600–606). However, variation in egocentrism can only provide indirect evidence for the Markus and Kitayama hypothesis. The current study sought direct evidence by giving British (independent) and Taiwanese (interdependent) participants two perspective-taking tasks on which an other-focused ‘altercentric' processing bias might be observed. One task assessed the calculation of simple perspectives; the other assessed the use of others' perspectives in communication. Sixty-two Taiwanese and British adults were tested in their native languages at their home institutions of study. Results revealed similar degrees of both altercentric and egocentric interference between the two cultural groups. This is the first evidence that listeners account for a speaker's limited perspective at the cost of their own performance. Furthermore, the shared biases point towards similarities rather than differences in perspective-taking across cultures. |
Lihui Wang; Florian Baumgartner; Falko R. Kaule; Michael Hanke; Stefan Pollmann Individual face- and house-related eye movement patterns distinctively activate FFA and PPA Journal Article In: Nature Communications, vol. 10, pp. 5532, 2019. @article{Wang2019e, We investigated if the fusiform face area (FFA) and the parahippocampal place area (PPA) contain a representation of fixation sequences that are typically used when looking at faces or houses. Here, we instructed observers to follow a dot presented on a uniform background. The dot's movements represented gaze paths acquired separately from observers looking at face or house pictures. Even when gaze dispersion differen ces were controlled, face- and house-associated gaze patterns could be discriminated by fMRI multivariate pattern analysis in FFA and PPA, more so for the current observer's own gazes than for another observer's gaze. The discrimination of the observer's own gaze patterns was not observed in early visual areas (V1 – V4) or superior parietal lobule and frontal eye fields. These findings indicate a link between perception and action—the complex gaze patterns that are used to explore faces and houses—in the FFA and PPA. |
Liping Wang; Marie Amalric; Wen Fang; Xinjian Jiang; Christophe Pallier; Santiago Figueira; Mariano Sigman; Stanislas Dehaene Representation of spatial sequences using nested rules in human prefrontal cortex Journal Article In: NeuroImage, vol. 186, pp. 245–255, 2019. @article{Wang2019f, Memory for spatial sequences does not depend solely on the number of locations to be stored, but also on the presence of spatial regularities. Here, we show that the human brain quickly stores spatial sequences by detecting geometrical regularities at multiple time scales and encoding them in a format akin to a programming language. We measured gaze-anticipation behavior while spatial sequences of variable regularity were repeated. Participants' behavior suggested that they quickly discovered the most compact description of each sequence in a language comprising nested rules, and used these rules to compress the sequence in memory and predict the next items. Activity in dorsal inferior prefrontal cortex correlated with the amount of compression, while right dorsolateral prefrontal cortex encoded the presence of embedded structures. Sequence learning was accompanied by a progressive differentiation of multi-voxel activity patterns in these regions. We propose that humans are endowed with a simple “language of geometry” which recruits a dorsal prefrontal circuit for geometrical rules, distinct from but close to areas involved in natural language processing. |
Maya Zhe Wang; Benjamin Y. Hayden Monkeys are curious about counterfactual outcomes Journal Article In: Cognition, vol. 189, pp. 1–10, 2019. @article{Wang2019g, Many non-human animals show exploratory behaviors. It remains unclear whether any possess human-like curiosity. We previously proposed three criteria for applying the term curiosity to animal behavior: (1) the subject is willing to sacrifice reward to obtain information, (2) the information provides no immediate instrumental or strategic benefit, and (3) the amount the subject is willing to pay depends systematically on the amount of information available. In previous work on information-seeking in animals, information generally predicts upcoming rewards, and animals' decisions may therefore be a byproduct of reinforcement processes. Here we get around this potential confound by taking advantage of macaques' ability to reason counterfactually (that is, about outcomes that could have occurred had the subject chosen differently). Specifically, macaques sacrificed fluid reward to obtain information about counterfactual outcomes. Moreover, their willingness to pay scaled with the information (Shannon entropy) offered by the counterfactual option. These results demonstrate the existence of human-like curiosity in non-human primates according to our criteria, which circumvent several confounds associated with less stringent criteria. |
Shuo Wang; Nand Chandravadia; Adam N. Mamelak; Ueli Rutishauser Simultaneous eye tracking and single-neuron recordings in human epilepsy patients Journal Article In: Journal of Visualized Experiments, no. 148, pp. 1–7, 2019. @article{Wang2019h, Intracranial recordings from patients with intractable epilepsy provide a unique opportunity to study the activity of individual human neurons during active behavior. An important tool for quantifying behavior is eye tracking, which is an indispensable tool for studying visual attention. However, eye tracking is challenging to use concurrently with invasive electrophysiology and this approach has consequently been little used. Here, we present a proven experimental protocol to conduct single-neuron recordings with simultaneous eye tracking in humans. We describe how the systems are connected and the optimal settings to record neurons and eye movements. To illustrate the utility of this method, we summarize results that were made possible by this setup. This data shows how using eye tracking in a memory-guided visual search task allowed us to describe a new class of neurons called target neurons, whose response was reflective of top-down attention to the current search target. Lastly, we discuss the significance and solutions to potential problems of this setup. Together, our protocol and results suggest that single-neuron recordings with simultaneous eye tracking in humans are an effective method to study human brain function. It provides a key missing link between animal neurophysiology and human cognitive neuroscience. |
Shuo Wang; Adam N. Mamelak; Ralph Adolphs; Ueli Rutishauser Abstract goal representation in visual search by neurons in the human pre-supplementary motor area Journal Article In: Brain, vol. 142, no. 11, pp. 3530–3549, 2019. @article{Wang2019i, The medial frontal cortex is important for goal-directed behaviours such as visual search. The pre-supplementary motor area (pre- SMA) plays a critical role in linking higher-level goals to actions, but little is known about the responses of individual cells in this area in humans. Pre-SMA dysfunction is thought to be a critical factor in the cognitive deficits that are observed in diseases such as Parkinson's disease and schizophrenia, making it important to develop a better mechanistic understanding of the pre-SMA's role in cognition. We simultaneously recorded single neurons in the human pre-SMA and eye movements while subjects performed goaldirected visual search tasks. We characterized two groups of neurons in the pre-SMA. First, 40% of neurons changed their firing rate whenever a fixation landed on the search target. These neurons responded to targets in an abstract manner across several conditions and tasks. Responses were invariant to motor output (i.e. button press or not), and to different ways of defining the search target (by instruction or pop-out). Second, ∼50% of neurons changed their response as a function of fixation order. Together, our results show that human pre-SMA neurons carry abstract signals during visual search that indicate whether a goal was reached in an action- and cue-independent manner. This suggests that the pre-SMA contributes to goal-directed behaviour by flexibly signalling goal detection and time elapsed since start of the search, and this process occurs regardless of task. These observations provide insights into how pre-SMA dysfunction might impact cognitive function. |
Zepeng Wang; Wan Zhang; Hongting Zhou Perception-guided multi-channel visual feature fusion for image retargeting Journal Article In: Signal Processing: Image Communication, vol. 79, pp. 63–70, 2019. @article{Wang2019m, Image retargeting aims to arbitrarily change the aspect ratio of images with minimal visual artifacts, that is, preserving salient regions within the image. Conventional approaches have achieved impressive performance, however, only low-level features are exploited. Besides, these approaches do not take human visual system into account. To solve these problems, we propose a perception-guided multi-channel visual feature fusion method for image retargeting, where human visual perception is well encoded. Specifically, we first construct a series of graphlets which represent salient regions that might attract human attention, where both low-level and high-level features are utilized to describe graphlets. Considering that only a few regions can attract human attention when observing the image, we engineer a sparsity-constraint algorithm to select these regions, which will be further concatenated to form human gaze shifting paths (GSPs). Subsequently, we design a statistic-based CNN architecture to extract the deep representation of GSPs. Afterward, a probabilistic model is built to learn the priors of GSPs and the learned probabilistic model will guide image retargeting. A test image whose distribution is similar to the learned probabilistic model is deemed as the aesthetic image and thus should be shrunk slightly. Comprehensive experiments demonstrate the effectiveness and robustness of the proposed method. |
Kayleigh L. Warrington; Fang Xie; Jingxin Wang; Kevin B. Paterson Aging effects on the visual span for alphabetic stimuli Journal Article In: Experimental Aging Research, vol. 45, no. 5, pp. 387–399, 2019. @article{Warrington2019a, Background: The visual span (i.e., an estimate of the number of letters that can be recognized reliably on a single glance) is widely considered to impose an important sensory limitation on reading speed. With the present research, we investigated adult age differences in the visual span for alphabetic stimuli (i.e., Latin alphabetic letters), as aging effects on span size may make an important contribution to slower reading speeds in older adulthood. Method: A trigram task, in which sets of three letters were displayed randomly at specified locations to the right and left of a central fixation point, was used to estimate the size of the visual span for young (18–30 years) and older (65+years) adults while an eye tracker was used to ensure accurate central fixation during stimulus presentation. Participants also completed tests of visual acuity and visual crowding. Results: There were clear age differences in the size of the visual span. The older adults produced visual spans which were on average 1.2 letters smaller than the spans of young adults. However, both young and older adults produced spans smaller than those previously reported. In addition, span size correlated with measures of both visual acuity and measures of visual crowding. Conclusion: The findings show that the size of the visual span is smaller for older compared to young adults. The age-related reduction in span size is relatively small but may make a significant contribution to reduced parafoveal processing during natural reading so may play a role in the greater difficulty experienced by older adult readers. Moreover, these results highlight the importance of carefully controlling fixation location in visual span experiments. |
Noriya Watanabe; Jamil P. Bhanji; Hideki Ohira; Mauricio R. Delgado Reward-driven arousal impacts preparation to perform a task via amygdala-caudate mechanisms Journal Article In: Cerebral Cortex, vol. 29, no. 7, pp. 3010–3022, 2019. @article{Watanabe2019a, Preparing for a challenging task can increase physiological arousal, in particular when potential incentives are large (e.g., a solo musical performance in front of an audience). Here, we examine how potential reward and its influence on arousal, measured by pupil dynamics, are represented in the brain while preparing for a challenging task. We further ask how neural representations during preparation relate to actual performance. Trials resulting in performance failure were characterized by increased pupil dilation as a function of increasing reward magnitude during preparation. Such failure trials were also associated with activation of the right amygdala representing pupil dilation, and the left caudate representing reward magnitude. Notably, increases in functional connectivity between amygdala and caudate preceded performance failure. These findings highlight increased connectivity between neural regions representing reward and arousal in circumstances where reward-driven arousal impairs performance. |
Noriya Watanabe; Jamil P. Bhanji; Hiroki C. Tanabe; Mauricio R. Delgado Ventromedial prefrontal cortex contributes to performance success by controlling reward-driven arousal representation in amygdala Journal Article In: NeuroImage, vol. 202, pp. 116136, 2019. @article{Watanabe2019, When preparing for a challenging task, potential rewards can cause physiological arousal that may impair performance. In this case, it is important to control reward-driven arousal while preparing for task execution. We recently examined neural representations of physiological arousal and potential reward magnitude during preparation, and found that performance failure was explained by relatively increased reward representation in the left caudate nucleus and arousal representation in the right amygdala (Watanabe, et al., 2019). Here we examine how prefrontal cortex influences the amygdala and caudate to control reward-driven arousal. Ventromedial prefrontal cortex (VMPFC) exhibited activity that was negatively correlated with trial-wise physiological arousal change, which identified this region as a potential modulator of amygdala and caudate. Next we tested the VMPFC - amygdala - caudate effective network using dynamic causal modeling (Friston et al., 2003). Post-hoc Bayesian model selection (Friston and Penny, 2011) identified a model that best fit data, in which amygdala activation was suppressively controlled by the VMPFC only in success trials. Furthermore, fixed connectivity strength from VMPFC to amygdala explained individual task performance. These findings highlight the role of effective connectivity from VMPFC to amygdala in order to control arousal during preparation for successful performance. |
Kira Wegner-Clemens; Johannes Rennig; John F. Magnotti; Michael S. Beauchamp Using principal component analysis to characterize eye movement fixation patterns during face viewing Journal Article In: Journal of vision, vol. 19, no. 13, pp. 1–15, 2019. @article{WegnerClemens2019, Human faces contain dozens of visual features, but viewers preferentially fixate just two of them: the eyes and the mouth. Face-viewing behavior is usually studied by manually drawing regions of interest (ROIs) on the eyes, mouth, and other facial features. ROI analyses are problematic as they require arbitrary experimenter decisions about the location and number of ROIs, and they discard data because all fixations within each ROI are treated identically and fixations outside of any ROI are ignored. We introduce a data-driven method that uses principal component analysis (PCA) to characterize human face-viewing behavior. All fixations are entered into a PCA, and the resulting eigenimages provide a quantitative measure of variability in face-viewing behavior. In fixation data from 41 participants viewing four face exemplars under three stimulus and task conditions, the first principal component (PC1) separated the eye and mouth regions of the face. PC1 scores varied widely across participants, revealing large individual differences in preference for eye or mouth fixation, and PC1 scores varied by condition, revealing the importance of behavioral task in determining fixation location. Linear mixed effects modeling of the PC1 scores demonstrated that task condition accounted for 41% of the variance, individual differences accounted for 28% of the variance, and stimulus exemplar for less than 1% of the variance. Fixation eigenimages provide a useful tool for investigating the relative importance of the different factors that drive human face-viewing behavior. |
Shannon E. Weissman; Alexander Lithopoulos; Jennifer R. Tomasone; Amy E. Latimer-Cheung Exploring gaze behaviors toward images of physically active individuals with a physical disability Journal Article In: Psychology of Sport & Exercise, vol. 45, pp. 1–9, 2019. @article{Weissman2019, Objectives: The study had two main objectives: (1) to characterize able-bodied adults' gaze behaviors when viewing images of people with and without physical disabilities and in turn, (2) to examine whether portraying a person with a disability as physically active (shown participating in physical activity [i.e, sport/exercise]) versus inactive (not engaging in physical activity) affects gaze behavior. The study also had an exploratory objective: to examine the specific physical traits able-bodied adults gaze at when viewing active versus inactive people with physical disabilities. Design: Within-subjects cross-sectional design consisting of 63 men and women without self-reported disabilities (Mage = 21.22 ± 2.52 years). Method: Participants viewed a series of 48 images for 5 s each. Images featured an able-bodied or disabled, active or inactive model. Eye movements were recorded while viewing each image. Differences in gaze behavior were assessed using a series of repeated measures multivariate factorial ANOVAs with Bonferroni-corrected pairwise comparisons to decompose interactions. Results: Participants gazed significantly more at images of individuals with physical disabilities than images of able-bodied individuals. Furthermore, participants gazed significantly less at images portraying active versus inactive individuals with physical disabilities. A greater proportion of gaze behavior was directed toward the assistive device when the person with a disability was portrayed as active versus inactive. Conclusions: This study demonstrated that able-bodied adults may gaze less at images of individuals with physical disabilities who are depicted as active versus inactive. Further research is needed to examine how these gaze patterns translate to live social situations. |
Stephanie Wermelinger; Anja Gampe; Moritz M. Daum The dynamics of the interrelation of perception and action across the life span Journal Article In: Psychological Research, vol. 83, no. 1, pp. 116–131, 2019. @article{Wermelinger2019, Successful social interaction relies on the interaction partners' perception, anticipation and understanding of their respective actions. The perception of a particular action and the capability to produce this action share a common representational ground. So far, no study has explored the interrelation between action perception and production across the life span using the same tasks and the same measurement techniques. This study was designed to fill this gap. Participants between 3 and 80 years (N = 214) observed two multistep actions of different familiarities and then reproduced the according actions. Using eye tracking, we measured participants' action perception via their prediction of action goals during observation. To capture subtler perceptual processes, we additionally analysed the dynamics and recurrent patterns within participants' gaze behaviour. Action production was assessed via the accuracy of the participants' reproduction of the observed actions. No age-related differences were found for the perception of the familiar action, where participants of all ages could rely on previous experience. In the unfamiliar action, where participants had less experience, action goals were predicted more frequently with increasing age. The recurrence in participants' gaze behaviour was related to both, age and action production: gaze behaviour was more recurrent (i.e. less flexible) in very young and very old participants, and lower levels of recurrence (i.e. greater flexibility) were related to higher scores in action production across participants. Incorporating a life-span perspective, this study illustrates the dynamic nature of developmental differences in the associations of action production with action perception. |
Stephanie Wermelinger; Anja Gampe; Moritz M. Daum Higher levels of motor competence are associated with reduced interference in action perception across the lifespan Journal Article In: Psychological Research, vol. 83, no. 3, pp. 432–444, 2019. @article{Wermelinger2019a, Action perception and action production are tightly linked and elicit bi-directional influences on each other when performed simultaneously. In this study, we investigated whether age-related differences in manual fine-motor competence and/or age affect the (interfering) influence of action production on simultaneous action perception. In a cross-sectional eye-tracking study, participants of a broad age range (N = 181, 20–80 years) observed a manual grasp-and-transport action while performing an additional motor or cognitive distractor task. Action perception was measured via participants' frequency of anticipatory gaze shifts towards the action goal. Manual fine-motor competence was assessed with the Motor Performance Series. The interference effect in action perception was greater in the motor than the cognitive distractor task. Furthermore, manual fine-motor competence and age in years were both associated with this interference. The better the participants' manual fine-motor competence and the younger they were, the smaller the interference effect. However, when both influencing factors (age and fine-motor competence) were taken into account, a model including only age-related differences in manual fine-motor competence best fit with our data. These results add to the existing literature that motor competence and its age-related differences influence the interference effects between action perception and production. |
Jessica Werthmann; Mima Simic; Anna Konstantellou; Phoebe Mansfield; Daniela Mercado; Welmoed Ens; Ulrike Schmidt Same, same but different: Attention bias for food cues in adults and adolescents with anorexia nervosa Journal Article In: International Journal of Eating Disorders, vol. 52, no. 6, pp. 681–690, 2019. @article{Werthmann2019, Objective: Attention processing for food may be biased in people with Anorexia Nervosa (AN). However, previous studies have had inconsistent results. This is likely to be due to indirect assessment of attention, which does not inform on the underlying attention processes, and/or the heterogeneity of participants across studies, testing either adults or adolescents with AN, that is, people at very different developmental and illness stages. Method: Eye-tracking was employed as a direct assessment of attention during a visual probe task with food versus non-food pictures. Attention bias for food was measured in 39 adults and 34 adolescents with AN and in 53 adults and 31 adolescents without AN. Results: All participants had a direction bias for food, specifically for high-calorie food. However, adults with AN subsequently avoided maintaining attention on food versus non-food cues, compared to adults without AN. Adolescents with or without AN demonstrated increased attention maintenance on food versus non-food cues, and, contrary to our hypothesis, did not differ in their attention bias for food cues. Accordingly, adults with AN differed significantly from adolescents with AN in attention maintenance for food cues: while adolescents with AN showed significantly increased attention maintenance on food stimuli, adults avoided maintaining attention on food cues. Discussion: Adults with AN may apply attention strategies to facilitate restrictive eating. This strategy is absent in adolescents with AN. This difference in food-related attention bias between adolescents and adults with AN suggests that attention biases develop over time as the illness progresses. |
Jacob A. Westerberg; Michele A. Cox; Kacie Dougherty; Alexander Maier V1 microcircuit dynamics: Altered signal propagation suggests intracortical origins for adaptation in response to visual repetition Journal Article In: Journal of Neurophysiology, vol. 121, no. 5, pp. 1938–1952, 2019. @article{Westerberg2019, Repetitive visual stimulation profoundly changes sensory processing in the primary visual cortex (V1). We show how the associated adaptive changes are linked to an altered flow of synaptic activation across the V1 laminar microcircuit. Using repeated visual stimulation, we recorded layer-specific responses in V1 of two fixating monkeys. We found that repetition-related spiking suppression was most pronounced outside granular V1 layers that receive the main retinogeniculate input. This repetition-related response suppression was robust to alternating stimuli between the eyes, in line with the notion that repetition-related adaptation is predominantly of cortical origin. Most importantly, current source density (CSD) analysis, which provides an estimate of local net depolarization, revealed that synaptic processing during repeated stimulation was most profoundly affected within supragranular layers, which harbor the bulk of corticocortical connections. Direct comparison of the temporal evolution of laminar CSD and spiking activity showed that stimulus repetition first affected supragranular synaptic currents, which translated into a reduction of stimulus-evoked spiking across layers. Together, these results suggest that repetition induces an altered state of intracortical processing that underpins visual adaptation. |
J. Kael White; Ethan S. Bromberg-Martin; Sarah R. Heilbronner; Kaining Zhang; Julia Pai; Suzanne N. Haber; Ilya E. Monosov A neural network for information seeking Journal Article In: Nature Communications, vol. 10, pp. 5168, 2019. @article{White2019a, Humans and other animals often show a strong desire to know the uncertain rewards their future has in store, even when they cannot use this information to influence the outcome. However, it is unknown how the brain predicts opportunities to gain information and motivates this information-seeking behavior. Here we show that neurons in a network of interconnected subregions of primate anterior cingulate cortex and basal ganglia predict the moment of gaining information about uncertain rewards. Spontaneous increases in their information prediction signals are followed by gaze shifts toward objects associated with resolving uncertainty, and pharmacologically disrupting this network reduces the motivation to seek information. These findings demonstrate a cortico-basal ganglia mechanism responsible for motivating actions to resolve uncertainty by seeking knowledge about the future. |
Imme C. Zillekens; Marie Luise Brandi; Juha M. Lahnakoski; Atesh Koul; Valeria Manera; Cristina Becchio; Leonhard Schilbach Increased functional coupling of the left amygdala and medial prefrontal cortex during the perception of communicative point-light stimuli Journal Article In: Social Cognitive and Affective Neuroscience, vol. 14, no. 1, pp. 97–107, 2019. @article{Zillekens2019, Interpersonal predictive coding (IPPC) describes the behavioral phenomenon whereby seeing a communicative rather than an individual action helps to discern a masked second agent. As little is known, yet, about the neural correlates of IPPC, we conducted a functional magnetic resonance imaging study in a group of 27 healthy participants using point-light displays of moving agents embedded in distractors. We discovered that seeing communicative compared to individual actions was associated with higher activation of right superior frontal gyrus, whereas the reversed contrast elicited increased neural activation in an action observation network that was activated during all trials. Our findings, therefore, potentially indicate the formation of action predictions and a reduced demand for executive control in response to communicative actions. Further, in a regression analysis, we revealed that increased perceptual sensitivity was associated with a deactivation of the left amygdala during the perceptual task. A consecutive psychophysiological interaction analysis showed increased connectivity of the amygdala with medial prefrontal cortex in the context of communicative compared to individual actions. Thus, whereas increased amygdala signaling might interfere with task-relevant processes, increased co-activation of the amygdala and the medial prefrontal cortex in a communicative context might represent the integration of mentalizing computations. |
Eirini Zormpa; Antje S. Meyer; Laurel E. Brehm Slow naming of pictures facilitates memory for their names Journal Article In: Psychonomic Bulletin & Review, vol. 26, no. 5, pp. 1675–1682, 2019. @article{Zormpa2019, Speakers remember their own utterances better than those of their interlocutors, suggesting that language production is beneficial to memory. This may be partly explained by a generation effect: The act of generating a word is known to lead to a memory advantage (Slamecka & Graf, 1978). In earlier work, we showed a generation effect for recognition of images (Zormpa, Brehm, Hoedemaker, & Meyer, 2019). Here, we tested whether the recognition of their names would also benefit from name generation. Testing whether picture naming improves memory for words was our primary aim, as it serves to clarify whether the representations affected by generation are visual or conceptual/lexical. A secondary aim was to assess the influence of processing time on memory. Fifty-one participants named pictures in three conditions: after hearing the picture name (identity condition), backward speech, or an unrelated word. A day later, recognition memory was tested in a yes/no task. Memory in the backward speech and unrelated conditions, which required generation, was superior to memory in the identity condition, which did not require generation. The time taken by participants for naming was a good predictor of memory, such that words that took longer to be retrieved were remembered better. Importantly, that was the case only when generation was required: In the no-generation (identity) condition, processing time was not related to recognition memory performance. This work has shown that generation affects conceptual/lexical representations, making an important contribution to the understanding of the relationship between memory and language. |