EyeLink Usability / Applied Publications
All EyeLink usability and applied research publications up until 2024 (with some early 2025s) are listed below by year. You can search the publications using keywords such as Driving, Sport, Workload, etc. You can also search for individual author names. If we missed any EyeLink usability or applied article, please email us!
2025 |
Yunxian Pan; Jie Xu Human-machine plan conflict and conflict resolution in a visual search task Journal Article In: International Journal of Human-Computer Studies, vol. 193, pp. 1–12, 2025. @article{Pan2025,With rapid technological development, humans are more likely to cooperatively work with intelligence systems in everyday life and work. Similar to interpersonal teamwork, the effectiveness of human-machine teams is affected by conflicts. Some human-machine conflict scenarios occur when neither the human nor the system was at fault, for example, when the human and the system formulated different but equally effective plans to achieve the same goal. In this study, we conducted two experiments to explore the effects of human-machine plan conflict and the different conflict resolution approaches (human adapting to the system, system adapting to the human, and transparency design) in a computer-aided visual search task. The results of the first experiment showed that when conflicts occurred, the participants reported higher mental load during the task, performed worse, and provided lower subjective evaluations towards the aid. The second experiment showed that all three conflict resolution approaches were effective in maintaining task performance, however, only the transparency design and the human adapting to the system approaches were effective in reducing mental load and improving subjective evaluations. The results highlighted the need to design appropriate human-machine conflict resolution strategies to optimize system performance and user experience. |
Dries Cavents; July De Wilde; Jelena Vranjes Towards a multimodal approach for analysing interpreter's management of rapport challenge in onsite and video remote interpreting Journal Article In: Journal of Pragmatics, vol. 235, pp. 220–237, 2025. @article{Cavents2025,Recently, interpreters' management of rapport is increasingly being investigated. Yet little attention has been directed towards the role of the interpreter's non-verbal behaviour when managing rapport and to the influence of video mediated forms of interpreting on the use of non-verbal behaviour. Therefore, this study proposes a multimodal micro-interactional framework for analysing interpreters' management of rapport challenge in both onsite (OSI) and video remote interpreting (VRI) interaction. The paper introduces a multimodal coding scheme based on Spencer-Oatey's Rapport Management Theory (2008), which is then applied to a dataset of video recorded interpreter-mediated interactions to examine how interpreters employ verbal, paraverbal, and non-verbal resources to multimodally address rapport challenge. Data were collected from simulated interactions involving professional public service interpreters and role-players adopting the role of primary participants in a reception centre for asylum seekers. The findings reveal that in OSI interpreters use a wide range of non-verbal resources when conveying rapport challenges, whereas VRI imposes constraints on non-verbal communication, often necessitating more disruptive verbal strategies to manage rapport. The study underscores the importance of a multimodal approach to interpreting research, highlighting how non-verbal behaviours significantly contribute to the management of interpersonal relations in interpreter-mediated talk. |
Jack Dempsey; Anna Tsiola; Nigel Bosch; Kiel Christianson; Mallory Stites Eye-movement indices of reading while debugging Python source code Journal Article In: Journal of Cognitive Psychology, vol. 37, no. 2, pp. 89–107, 2025. @article{Dempsey2025,Unlike text reading, the eye-movement behaviours associated with reading Python, a computer programming language, are largely understudied through a psycholinguistic lens. A general understanding of the eye movements involved in reading while troubleshooting Python, and how these behaviours compare to proofreading text, is critical for developing educational interventions and interactive tools for helping programmers debug their code. These data may also highlight to what extent humans use their underlying text reading ability when reading source code. The current work provides a profile of global reading behaviours associated with reading Python source code for debugging purposes. To this end, we recorded experienced programmers' eye movements while they determined whether 21 different Python functions would produce the desired output, an incorrect output, or an error message. Some reading behaviours seem to mirror those found in text reading (e.g. effects of stimulus complexity), while others may be specific to reading code. Results suggest that semantic errors that produce undesired outputs in programming source code may influence early stages of processing, likely due to the largely top-down strategy employed by experienced programmers when reading source code. The findings are framed to invigorate discussion and further exploration into psycholinguistic analysis of human source code reading. |
Gregory J. DiGirolamo; Federico Sorcini; Zachary Zaniewski; Jonathan B. Kruskal; Max P. Rosen In: Radiology, vol. 314, no. 2, pp. 1–7, 2025. @article{DiGirolamo2025,Background: Diagnostic error rates for detecting small lung nodules on chest CT scans remain high at 50%, despite advances in imaging technology and radiologist training. These failure rates may stem from limitations in conscious recognition processes. However, successful visual processes may be detecting the nodule independent of the radiologist's report. Purpose: To investigate visual processing in radiologists during the assessment of chest nodules to determine if radiologists have successful non- conscious processes that detect lung nodules on chest CT scans even when not consciously recognized or considered, as evidenced by changes in how long they look (dwell time) and pupil size to missed nodules. Materials and Methods: This prospective study, conducted from August 2014 to September 2023, compared six experienced radiologists with six medically naive control participants. Participants viewed 18 chest CT scans (nine abnormal with 16 nodules, nine normal) to detect lung nodules. High-speed video eye tracking measured gaze duration and pupil size (indicating physiological arousal) at missed nodule locations and the same locations on normal CT scans. The reference standard was the known presence or absence of nodules (as determined by a four-radiologist consensus panel) on abnormal and normal CT scans, respectively. Primary outcome measures were detection rates of nodules, and dwell time and pupil size at nodule locations versus normal tissue. Paired t tests were used for statistical analysis. Results: Twelve participants (six radiologists with an average of 9.3 years of radiologic experience and six controls with no radiologic experience) performed the evaluations. Radiologists missed on average 59% (9.5 of 16) of these lung nodules. For the missed nodules, radiologists exhibited longer dwell times (mean, 228 msec vs 175 msec; P = .005) and larger pupil size (mean, 1446 pixels vs 1349 pixels; P = .04.) than for normal tissue. Control participants showed no differences in dwell time (mean, 197 msec vs 180 msec; P = .64) or pupil size (mean, 1426 pixels vs 1714 pixels; P = .23) for missed nodules versus normal tissue locations. Conclusion: Radiologists' non-conscious processes during visual assessment of CT scans can detect lung nodules on chest CT scans even when conscious recognition fails, as evidenced by increased dwell time and larger pupil size. This successful non-conscious detection is a result of general radiology training. |
Lara Fontana; Javier Albayay; Letizia Zurlo; Viola Ciliberto; Massimiliano Zampini Olfactory modulation of visual attention and preference towards congruent food products: An eye tracking study Journal Article In: Food Quality and Preference, vol. 124, pp. 1–11, 2025. @article{Fontana2025,In multisensory environments, odours often accompany visual stimuli, directing attention towards congruent objects. While previous research shows that people fixate longer on objects that match a recently smelled odour, it remains unclear whether odours directly influence product choices. Since odours persist in real-world settings, we investigated the effects of repeated odour exposure on visual attention and product choice, accounting for potential olfactory habituation. In a within-participant design, 30 participants completed a task where either a lemon odour (experimental condition) or clean air (control) was paired with congruent lemon-based food images, which varied to prevent visual habituation. We measured eye movements and choice preferences for these food products. Results revealed that participants exhibited longer gaze durations and more frequent fixations on food products congruent with the lemon odour. Repeated odour exposure had no effect on gaze patterns, as participants consistently focused on odour-congruent products throughout the experiment. The intensity and pleasantness of the lemon odour remained stable over time, suggesting no olfactory habituation occurred with this food-related odour. Despite this stable visual attention and odour intensity and pleasantness, participants began to diversify their product choices, selecting fewer odour-congruent items over time. These findings suggest that while odours continue to direct attention towards matching products, repeated exposure may reduce their influence on product choice, highlighting the complex role of olfactory stimuli in decision-making. The study provides insights into how odours interact with visual cues and influence consumer behaviour in prolonged exposure scenarios. |
Qian Huangfu; Qianmei He; Sisi Luo; Weilin Huang; Yahua Yang Does teacher enthusiasm facilitate students' chemistry learning in video lectures regardless of students' prior chemistry knowledge levels? Journal Article In: Journal of Computer Assisted Learning, vol. 41, no. 1, pp. 1–14, 2025. @article{Huangfu2025,Background: Video lectures which include the teachers' presence have become increasingly common. As teacher enthusiasm is a nonverbal cue in video lectures, more and more studies are focusing on this topic. However, little research has been carried out on the interactions between teacher enthusiasm and prior knowledge when learning from video lectures. Objectives: We tested whether prior chemistry knowledge moderated the impact of teacher enthusiasm on students' chemistry learning during video lectures. Methods: One hundred and forty-two Grade 7 (low-prior chemistry knowledge) and Grade 9 (high-prior chemistry knowledge) Chinese students engaged with this research. Each group of students was randomised into viewing a video lecture with either a low or high degree of teacher enthusiasm. Outcomes were assessed by attention allocation, learning performance, cognitive load, learning satisfaction and student engagement. Results and Conclusions: Our findings revealed significant benefits of teacher enthusiasm and also showed that prior chemistry knowledge could moderate the impact of teacher enthusiasm on students' attention and cognitive outcomes (cognitive load and transfer). Visual attention mediates the effects on transfer. For students with low prior knowledge, there is more focus on the learning content, lower extraneous cognitive load, and higher transfer scores when watching videos with high levels of teacher enthusiasm; however, students with high prior knowledge do not show these differences. In addition, high prior chemistry knowledge had a significant beneficial impact on the motivational outcomes of the students (satisfaction and engagement). Implications: The results suggest that teacher enthusiasm in a video lecture may affect students' chemistry learning, and students' prior chemistry knowledge should be considered when choosing whether to display teacher enthusiasm. |
Gianna Jeyarajan; Lian Buwadi; Azar Ayaz; Lindsay S. Nagamatsu; Denait Haile; Liye Zou; Matthew Heath Passive and active exercise do not mitigate mental fatigue during a sustained vigilance task Journal Article In: Experimental Brain Research, vol. 243, no. 1, pp. 1–13, 2025. @article{Jeyarajan2025,Executive function (EF) is improved following a single bout of exercise and impaired when an individual experiences mental fatigue (MF). These performance outcomes have been linked to a bi-directional change in cerebral blood flow (CBF). Here, we sought to determine whether MF-induced by a sustained vigilance task (i.e., psychomotor vigilance task: PVT) is mitigated when preceded by a single bout of exercise. Participants completed 20-min single bouts of active exercise (cycle ergometry involving volitional muscle activation), passive exercise (cycle ergometry involving a mechanical flywheel) and a non-exercise control intervention. EF was assessed pre- and post-intervention via the antisaccade task. Following each intervention, a 20-min PVT was completed to induce and assess MF, and transcranial Doppler ultrasound of middle cerebral artery velocity (MCAv) was used to estimate intervention- and PVT-based changes in CBF. Active and passive exercise provided a post-intervention reduction in antisaccade reaction times; that is, exercise benefitted EF. Notably, however, frequentist and Bayesian statistics indicated the EF benefit did not mitigate MF during the PVT. As well, although exercise (active and passive) and the PVT respectively increased and decreased CBF, these changes were not correlated with behavioral measures of EF or MF. Accordingly, a postexercise EF benefit does not mitigate MF during a sustained vigilance task and a bi-directional change in CBF does not serve as a primary mechanism associated with EF and MF changes. Such results provide a framework for future work to explore how different exercise types, intensities and durations may impact MF. |
Yu Cin Jian; Leo Yuk Ting Cheung Prediction of text-and-diagram reading comprehension by eye-movement indicators: A longitudinal study in elementary schools Journal Article In: European Journal of Psychology of Education, vol. 40, no. 1, pp. 1–25, 2025. @article{Jian2025,Eye-movement technology has been often used to examine reading processes, but research has seldom examined the relationship between the reading process and comprehension performance, and whether the relationships are similar or different across grades. To investigate this, we conducted a 3-year longitudinal study starting at grade 4, with 175 effect samples to track the development data of eye movements on text-and-diagram reading. A series of temporal and spatial eye-movement predictors were identified to predict reading comprehension in various grades. The result of a hierarchical regression model established that total fixation duration measures (reflects processing level) and mean fixation duration (reflects decoding efficiency) were relatively better predictors of the post-reading tests at grades 5 and 6. That is, the readers made more mental efforts and had better decoding ability, which predict better post-reading test scores. Meanwhile, in grades 5 and 6, rereading total fixation duration on both the main text and diagrams consistently predicted the post-reading tests, indicating that the readers' self-regulated study time on re-processing some specific information is important for reading comprehension. Besides, a longitudinal structural equation modeling (SEM) revealed that the readers' fixation durations and text-and-diagram regression count in the lower fourth grade could significantly predict the same indicators in the following 2 years. In summary, this study identified the critical eye-movement indicators for predicting reading-test performance, and these predictions were more effective for the readers in upper grades than for those in the lower grades. |
Zheng Liang; Riman Ga; Han Bai; Qingbai Zhao; Guixian Wang; Qing Lai; Shi Chen; Quanlei Yu; Zhijin Zhou Teaching expectancy improves video-based learning: Evidence from eye-movement synchronization Journal Article In: British Journal of Educational Technology, vol. 56, pp. 231–249, 2025. @article{Liang2025,Abstract: Video-based learning (VBL) is popular, yet students tend to learn video material passively. Instilling teaching expectancy is a strategy to promote active processing by learners, but it is unclear how effective it will be in improving VBL. This study examined the role of teaching expectancy on VBL by comparing the learning outcomes and metacognitive monitoring of 94 learners with different expectancies (teaching, test or no expectancy). Results showed that the teaching expectancy group had better learning outcomes and no significant difference in the metacognitive monitoring of three groups. We further explored the visual behaviour patterns of learners with different expectancies by using the indicator of eye-movement synchronization. It was found that synchronization was significantly lower in both the teaching and test expectancy groups than in the no expectancy group, and the test expectancy group was significantly lower than the teaching expectancy group. This result suggests that both teaching and test expectancy enhance the active processing of VBL. However, by sliding window analysis, we found that the teaching expectancy group used a flexible and planned attention allocation. Our findings confirmed the effectiveness of teaching expectancy in VBL. Also, this study provided evidence for the applicability of eye-tracking techniques to assess VBL. |
Xingyang Lv; Zixin Yuan; Fang Wan; Tian Lan; Gila Oren Do tourists experience suffering when they touch the wailing wall? Journal Article In: Tourism Management, vol. 106, pp. 1–21, 2025. @article{Lv2025,Tactile engagement is a critical aspect of tourist experiences. Embodied cognition theory suggests a direct correlation between physical sensations and psychological perceptions. For example, touching the textured stones at the Wailing Wall, a revered religious site in Jerusalem, can evoke intense emotions in tourists. This study explores the impact of rough tactile sensations on dark experiences through six studies. We used content analysis, on-site surveys, eye movement experiments, and scenario experiments to validate these effects. Our findings emphasize the pivotal role of rough tactile sensations in shaping profound emotions and individual experiences while uncovering alternative routes for developing sensory strategies to enrich dark tourism experiences. |
Stanford Martinez; Carolina Ramirez-Tamayo; Syed Hasib Akhter Faruqui; Kal Clark; Adel Alaeddini; Nicholas Czarnek; Aarushi Aggarwal; Sahra Emamzadeh; Jeffrey R. Mock; Edward J. Golob Discrimination of radiologists' experience level using eye-tracking technology and machine learning: Case study Journal Article In: JMIR Formative Research, vol. 9, pp. 1–16, 2025. @article{Martinez2025,Background: Perception-related errors comprise most diagnostic mistakes in radiology. To mitigate this problem, radiologists use personalized and high-dimensional visual search strategies, otherwise known as search patterns. Qualitative descriptions of these search patterns, which involve the physician verbalizing or annotating the order he or she analyzes the image, can be unreliable due to discrepancies in what is reported versus the actual visual patterns. This discrepancy can interfere with quality improvement interventions and negatively impact patient care. Objective: The objective of this study is to provide an alternative method for distinguishing between radiologists by means of captured eye-tracking data such that the raw gaze (or processed fixation data) can be used to discriminate users based on subconscious behavior in visual inspection. Methods: We present a novel discretized feature encoding based on spatiotemporal binning of fixation data for efficient geometric alignment and temporal ordering of eye movement when reading chest x-rays. The encoded features of the eye-fixation data are used by machine learning classifiers to discriminate between faculty and trainee radiologists. A clinical trial case study was conducted using metrics such as the area under the curve, accuracy, F1-score, sensitivity, and specificity to evaluate the discriminability between the 2 groups regarding their level of experience. The classification performance was then compared with state-of-the-art methodologies. In addition, a repeatability experiment using a separate dataset, experimental protocol, and eye tracker was performed with 8 participants to evaluate the robustness of the proposed approach. Results: The numerical results from both experiments demonstrate that classifiers using the proposed feature encoding methods outperform the current state-of-the-art in differentiating between radiologists in terms of experience level. An average performance gain of 6.9% is observed compared with traditional features while classifying experience levels of radiologists. This gain in accuracy is also substantial across different eye tracker–collected datasets, with improvements of 6.41% using the Tobii eye tracker and 7.29% using the EyeLink eye tracker. These results signify the potential impact of the proposed method for identifying radiologists' level of expertise and those who would benefit from additional training. Conclusions: The effectiveness of the proposed spatiotemporal discretization approach, validated across diverse datasets and various classification metrics, underscores its potential for objective evaluation, informing targeted interventions and training strategies in radiology. This research advances reliable assessment tools, addressing challenges in perception-related errors to enhance patient care outcomes. |
Kate Matsunaga; Kleanthis Avramidis; Mark S. Borchert; Shrikanth Narayanan; Melinda Y. Chang Method for assessing visual saliency in children with cerebral/cortical visual impairment using generative artificial intelligence Journal Article In: Frontiers in Human Neuroscience, vol. 18, pp. 1–9, 2025. @article{Matsunaga2025,Cerebral/cortical visual impairment (CVI) is a leading cause of pediatric visual impairment in the United States and other developed countries, and is increasingly diagnosed in developing nations due to improved care and survival of children who are born premature or have other risk factors for CVI. Despite this, there is currently no objective, standardized method to quantify the diverse visual impairments seen in children with CVI who are young and developmentally delayed. We propose a method that combines eye tracking and an image-based generative artificial intelligence (AI) model (SegCLIP) to assess higher- and lower-level visual characteristics in children with CVI. We will recruit 40 CVI participants (aged 12 months to 12 years) and 40 age-matched controls, who will watch a series of images on a monitor while eye gaze position is recorded using eye tracking. SegCLIP will be prompted to generate saliency maps for each of the images in the experimental protocol. The saliency maps (12 total) will highlight areas of interest that pertain to specific visual features, allowing for analysis of a range of individual visual characteristics. Eye tracking fixation maps will then be compared to the saliency maps to calculate fixation saliency values, which will be assigned based on the intensity of the pixel corresponding to the location of the fixation in the saliency map. Fixation saliency values will be compared between CVI and control participants. Fixation saliency values will also be correlated to corresponding scores on a functional vision assessment, the CVI Range-CR. We expect that fixation saliency values on visual characteristics that require higher-level processing will be significantly lower in CVI participants compared to controls, whereas fixation saliency values on lower-level visual characteristics will be similar or higher in CVI participants. Furthermore, we anticipate that fixation saliency values will be significantly correlated to scores on corresponding items on the CVI Range-CR. Together, these findings would suggest that AI-enabled saliency analysis using eye tracking can objectively quantify abnormalities of lower- and higher-order visual processing in children with CVI. This novel technique has the potential to guide individualized interventions and serve as an outcome measure in future clinical trials. |
2024 |
Jasenia Hartman; Jenny Saffran; Ruth Litovsky Word learning in deaf adults who use cochlear implants: The role of talker variability and attention to the mouth Journal Article In: Ear & Hearing, vol. 45, no. 2, pp. 337–350, 2024. @article{Hartman2024,OBJECTIVES: Although cochlear implants (CIs) facilitate spoken language acquisition, many CI listeners experience difficulty learning new words. Studies have shown 29that highly variable stimulus input and audiovisual cues improve speech perception in CI listeners. However, less is known whether these two factors improve perception in a word learning context. Furthermore, few studies have examined how CI listeners direct their gaze to efficiently capture visual information available on a talker's face. The purpose of this study was two-fold: (1) to examine whether talker variability could improve word learning in CI listeners and (2) to examine how CI listeners direct their gaze while viewing a talker speak. DESIGN: Eighteen adults with CIs and 10 adults with normal hearing (NH) learned eight novel word-object pairs spoken by a single talker or six different talkers (multiple talkers). The word learning task comprised of nonsense words following the phonotactic rules of English. Learning was probed using a novel talker in a two-alternative forced-choice eye gaze task. Learners' eye movements to the mouth and the target object (accuracy) were tracked over time. RESULTS: Both groups performed near ceiling during the test phase, regardless of whether they learned from the same talker or different talkers. However, compared to listeners with NH, CI listeners directed their gaze significantly more to the talker's mouth while learning the words. CONCLUSIONS: Unlike NH listeners who can successfully learn words without focusing on the talker's mouth, CI listeners tended to direct their gaze to the talker's mouth, which may facilitate learning. This finding is consistent with the hypothesis that CI listeners use a visual processing strategy that efficiently captures redundant audiovisual speech cues available at the mouth. Due to ceiling effects, however, it is unclear whether talker variability facilitated word learning for adult CI listeners, an issue that should be addressed in future work using more difficult listening conditions. |
Moritz Held; Jochem W. Rieger; Jelmer P. Borst Multitasking while driving: Central bottleneck or problem state interference? Journal Article In: Human Factors, vol. 66, no. 5, pp. 1564–1582, 2024. @article{Held2024,Objective: The objective of this work was to investigate if visuospatial attention and working memory load interact at a central control resource or at a task-specific, information processing resource during driving. Background: In previous multitasking driving experiments, interactions between different cognitive concepts (e.g., attention and working memory) have been found. These interactions have been attributed to a central bottleneck or to the so-called problem-state bottleneck, related to working memory usage. Method: We developed two different cognitive models in the cognitive architecture ACT-R, which implement the central vs. problem-state bottleneck. The models performed a driving task, during which we varied visuospatial attention and working memory load. We evaluated the model by conducting an experiment with human participants and compared the behavioral data to the model's behavior. Results: The problem-state-bottleneck model could account for decreased driving performance due to working memory load as well as increased visuospatial attentional demands as compared to the central-bottleneck model, which could not account for effects of increased working memory load. Conclusion: The interaction between working memory and visuospatial attention in our dual tasking experiment can be best characterized by a bottleneck in the working memory. The model results suggest that as working memory load becomes higher, drivers manage to perform fewer control actions, which leads to decreasing driving performance. Application: Predictions about the effect of different mental loads can be used to quantify the contribution of each subtask allowing for precise assessments of the current overall mental load, which automated driving systems may adapt to. |
Scott S. Hsieh; Akitoshi Inoue; Mariana Yalon; David A. Cook; Hao Gong; Parvathy Sudhir Pillai; Matthew P. Johnson; Jeff L. Fidler; Shuai Leng; Lifeng Yu; Rickey E. Carter; David R. Holmes; Cynthia H. McCollough; Joel G. Fletcher Targeted training reduces search errors but not classification errors for hepatic metastasis detection at contrast-enhanced CT Journal Article In: Academic Radiology, vol. 31, no. 2, pp. 448–456, 2024. @article{Hsieh2024,Rationale and Objectives: Methods are needed to improve the detection of hepatic metastases. Errors occur in both lesion detection (search) and decisions of benign versus malignant (classification). Our purpose was to evaluate a training program to reduce search errors and classification errors in the detection of hepatic metastases in contrast-enhanced abdominal computed tomography (CT). Materials and Methods: After Institutional Review Board approval, we conducted a single-group prospective pretest-posttest study. Pretest and posttest were identical and consisted of interpreting 40 contrast-enhanced abdominal CT exams containing 91 liver metastases under eye tracking. Between pretest and posttest, readers completed search training with eye-tracker feedback and coaching to increase interpretation time, use liver windows, and use coronal reformations. They also completed classification training with part-task practice, rating lesions as benign or malignant. The primary outcome was metastases missed due to search errors (<2 seconds gaze under eye tracker) and classification errors (>2 seconds). Jackknife free-response receiver operator characteristic (JAFROC) analysis was also conducted. Results: A total of 31 radiologist readers (8 abdominal subspecialists, 8 nonabdominal subspecialists, 15 senior residents/fellows) participated. Search errors were reduced (pretest 11%, posttest 8%, difference 3% [95% confidence interval, 0.3%-5.1%] |
Qian Huangfu; Hong Li; Yuanyuan Ban; Jiamei He An eye-tracking study on the effects of displayed teacher enthusiasm on students' learning procedural knowledge of chemistry in video lectures Journal Article In: Journal of Chemical Education, vol. 101, no. 2, pp. 259–269, 2024. @article{Huangfu2024,Teacher enthusiasm is known to affect students' learning in traditional classroom environments, but it is unclear how displayed teacher enthusiasm can optimize learning of chemistry procedural knowledge in multimedia learning environments. In this context, the present study used eye-tracking technology and quantitative analysis to examine how displayed teacher enthusiasm in video lectures affects students' positive emotions, visual attention, cognitive load, and learning outcomes. Measures were collected from 128 eighth-grade middle school students. An EyeLink 1000 Plus eye-tracker was used to capture the students' eye movements. The percentage of total fixation duration, percentage of fixation count, mean pupil size, and blink rate were used as metrics to analyze the eye-gaze data. The results showed that an enthusiastic teacher positively affected students' positive emotions, reduced students' cognitive load, and made students more concentrated on the learning-content area. Additionally, the higher level of displayed teacher enthusiasm improved learners' learning outcomes. |
John Chi Wa Ko; Mandy M. Cheng; Wendy J. Green In: European Accounting Review, vol. 33, no. 4, pp. 2–28, 2024. @article{Ko2024,Using eye-tracking technology, we examine whether the information processing patterns of nonprofessional investors with a directional investment preference are affected by performance information presented based on either a focus on stakeholders (stakeholder format) or on strategic goals (strategic theme format). We find that when a company's financial performance has declined but nonfinancial performance has improved, a strategic theme (stakeholder) format causes investors in a long investment position to focus on negative financial information to a lesser (greater) extent than those in a short investment position. These results indicate that a strategic theme format encourages biased investors to draw on favorable nonfinancial information to support their position, whereas a stakeholder format causes them to closely scrutinize unfavorable financial information. We also find that the level of bias in investors' earnings forecasts is lower when information is presented in a strategic theme format than in a stakeholder format; however, a supplementary experiment finds that this result is reversed when a company's financial performance has improved but its nonfinancial performance has declined. Our results have implications for external report preparers, standard setters, and analysts. |
Aylin Koçak; Nicolas Dirix; Wouter Duyck; Maaike Schellaert; Eva Derous Older and younger job seekers' attention towards metastereotypes in job ads Journal Article In: PLoS ONE, vol. 19, no. 10, pp. 1–23, 2024. @article{Kocak2024,Building on social identity theory and cognitive models on information processing, the present paper considered whether and how stereotyped information in job ads impairs older/ younger job seekers' job attraction. Two eye-tracking experiments with older (Study 1) and younger job seekers (Study 2) investigated effects of negatively metastereotyped personality requirements (i.e., traits) on job attraction and whether attention to and memory for negative information mediated these effects. Within-participants analyses showed for both older and younger job seekers that job attraction was lower when ads included negative metastereotypes and that more attention was allocated towards these negative metastereotypes. Older, but not younger job seekers, also better recalled these negative metastereotypes compared to not negative metastereotypes. The effect of metastereotypes on job attraction was not mediated by attention or recall of information. Organizations should therefore avoid negative metastereotypes in job ads that may capture older/younger job seekers' attention and lower job attraction. |
Aleksandra Koprowska; Dorothea Wendt; Maja Serman; Torsten Dau; Jeremy Marozeau The effect of auditory training on listening effort in hearing-aid users: Insights from a pupillometry study Journal Article In: International Journal of Audiology, vol. 64, no. 1, pp. 59–69, 2024. @article{Koprowska2024,Objective: The study investigated how auditory training affects effort exerted by hearing-impaired listeners in speech-in-noise task. Design: Pupillometry was used to characterise listening effort during a hearing in noise test (HINT) before and after phoneme-in-noise identification training. Half of the study participants completed the training, while the other half formed an active control group. Study sample: Twenty 63-to-79 years old experienced hearing-aid users. Results: Higher peak pupil dilations (PPDs) were obtained at the end of the study compared to the beginning in both groups of the participants. The analysis of pupil dilation in an extended time window revealed, however, that the magnitude of pupillary response increased more in the training than in the control group. The effect of training on effort was observed in pupil responses even when no improvement in HINT was found. Conclusion: The results demonstrate that using a listening effort metric adds additional insights into the effectiveness of auditory training compared to the situation when only speech-in-noise performance is considered. Trends observed in pupil responses suggested increased effort—both after the training and the placebo intervention—most likely reflecting the effect of the individual's motivation. |
Dimitrios Liaskos; Vassilios Krassanakis In: Multimodal Technologies and Interaction, vol. 8, no. 6, pp. 1–18, 2024. @article{Liaskos2024,In the present study, a new eye-tracking dataset (OnMapGaze) and a graph-based metric (GraphGazeD) for modeling visual perception differences are introduced. The dataset includes both experimental and analyzed gaze data collected during the observation of different cartographic backgrounds used in five online map services, including Google Maps, Wikimedia, Bing Maps, ESRI, and OSM, at three different zoom levels (12z, 14z, and 16z). The computation of the new metric is based on the utilization of aggregated gaze behavior data. Our dataset aims to serve as an objective ground truth for feeding artificial intelligence (AI) algorithms and developing computational models for predicting visual behavior during map reading. Both the OnMapGaze dataset and the source code for computing the GraphGazeD metric are freely distributed to the scientific community. |
Dongyu Liu; Xinyu Zhang; Jon D. Elhai; Christian Montag; Haibo Yang The attention allocation of individuals with problematic smartphone use during different cognitive reappraisal phases Journal Article In: Cognitive Therapy and Research, pp. 1–13, 2024. @article{Liu2024c,Background: To understand the potential mechanisms by which cognitive reappraisal (CR) improves problematic smartphone use (PSU), this study aims to explore the attention allocation of individuals with PSU during different CR phases when exposed to smartphone-related stimuli. Methods: Fifty participants were recruited for the formal experiment, with 25 participants in the PSU group and 25 in the control group. Eye tracking was used to assess attention allocation by calculating fixation proportions on the smartphone area of interest (S-AOI; smartphone salient area) in smartphone-related stimuli during the cue reactivity, CR, and post-CR phases. Network analysis was employed to examine the connections among phases for both groups to explore the relationships in attention allocation across these phases. Results: (1) Both groups presented higher fixation proportions toward the S-AOI in the latter part of the cue reactivity phase. (2) During the CR phase, both groups presented lower early fixation proportions on the S-AOI than did the cue reactivity phase and the rest of the CR phase. (3) In the post-CR phase, the significant difference in fixation proportions toward the S-AOI between the PSU and the control groups disappeared. (4) Network analysis revealed greater global strength in the PSU group than in the control group. Conclusions: There are specific attentional patterns toward smartphone-related stimuli during the CR process, and the attentional allocation patterns of the PSU group improved after using CR. Additionally, the PSU group's attentional allocation patterns appeared more interconnected across different phases. |
Chenya Ma; Hang Zhou; Ling Wang; Yushi Jiang Who posts the advertisement: The influence of advertising authorship on in-feed advertising effectiveness Journal Article In: Journal of Consumer Behaviour, vol. 23, pp. 3030–3045, 2024. @article{Ma2024,Advertisers typically publish in-feed ads with two types of authorship: brand or influencer, yet little is known about the effectiveness of in-feed ads between these two authors. In this study, we investigated the interactions and mechanisms of ad authorship (brand vs. influencer) and brand type (luxury vs. mass) on advertising effectiveness, and tested the moderating effect of upward social comparison based on the stereotype content model. A pilot study, by coding the secondary data from Most Liked WeChat Moment Ads, found that a greater proportion of luxury (vs. mass) brands were authored by brands (vs. influencers). Study 1 used eye tracking technique to identify the interactive effect of ad authorship and brand type on visual attention. Study 2 further identified perceived competence and warmth as mediators. Study 3 verified the moderating effect of upward social comparison on the above effects. This paper contributes to the theoretical literature on in-feed advertising by showing the interactive effect of advertising authorship and brand types on advertising effectiveness. It also offers valuable insights for luxury or mass brands on strategically leveraging the brand itself or influencer for advertising. |
Tetsuya Sato; Austin Jackson; Yusuke Yamani Number of interrupting events influences response time in multitasking, but not trust in automation Journal Article In: International Journal of Aerospace Psychology, vol. 34, no. 4, pp. 208–224, 2024. @article{Sato2024,Objective: The present study examined how the number of interrupting events (interruption load) influences the effect of task load on human-automation trust and resource allocation in a low-fidelity flight simulation environment. Background: Trust is one critical factor that influences successful human-automation interaction. In the previous research, operators reported lower trust scores and made fewer fixation toward an automated system, which assisted a task, when competing task in the same workspace demanded more attention from the operator. However, it is unclear whether human-automation trust is influenced by frequent shift of attention away from a task assisted by an automated signaling system. Methods: Participants concurrently performed a tracking task, a system monitoring task, and a communication task. An automated signaling system was employed to assist the system monitoring task with 70% reliability. Task load was manipulated by the difficulty of the tracking task while interruption load was manipulated by the varying the frequency of auditory messages in the communication task. Results: Results demonstrated an effect of task load on human-automation trust and resource allocation, replicating previous findings. Further, participants responded faster to an auditory message that occurred less frequently when performing a tracking task at the low difficulty level but automation trust did not vary. Conclusion: While operators reported higher trust levels to imperfect automation under lower task load, number of interrupting events does not influence their trust. |
Mustafa Shirzad; James Van Riesen; Nikan Behboodpour; Matthew Heath 10-min exposure to a 2.5% hypercapnic environment increases cerebral blood blow but does not impact executive function Journal Article In: Life Sciences in Space Research, vol. 40, pp. 143–150, 2024. @article{Shirzad2024,Space travel and exploration are associated with increased ambient CO2 (i.e., a hypercapnic environment). Some work reported that the physiological changes (e.g., increased cerebral blood flow [CBF]) associated with a chronic hypercapnic environment contributes to a “space fog” that adversely impacts cognition and psychomotor performance, whereas other work reported no change or a positive change. Here, we employed the antisaccade task to evaluate whether transient exposure to a hypercapnic environment influences top-down executive function (EF). Antisaccades require a goal-directed eye movement mirror-symmetrical to a target and are an ideal tool for identifying subtle EF changes. Healthy young adults (aged 19–25 years) performed blocks of antisaccade trials prior to (i.e., pre-intervention), during (i.e., concurrent) and after (i.e., post-intervention) 10-min of breathing factional inspired CO2 (FiCO2) of 2.5% (i.e., hypercapnic condition) and during a normocapnic (i.e., control) condition. In both conditions, CBF, ventilatory and cardiorespiratory responses were measured. Results showed that the hypercapnic condition increased CBF, ventilation and end-tidal CO2 and thus demonstrated an expected physiological adaptation to increased FiCO2. Notably, however, null hypothesis and equivalence tests indicated that concurrent and post-intervention antisaccade reaction times were refractory to the hypercapnic environment; that is, transient exposure to a FiCO2 of 2.5% did not produce a real-time or lingering influence on an oculomotor-based measure of EF. Accordingly, results provide a framework that – in part – establishes the FiCO2 percentage and timeline by which high-level EF can be maintained. Future work will explore CBF and EF dynamics during chronic hypercapnic exposure as more direct proxy for the challenges of space flight and exploration. |
Ielka Van Der Sluis; Hanna Mellema A recipe for success: The design, use, and effectiveness of multimodal online baking instructions Journal Article In: Multimodality & Society, pp. 1–70, 2024. @article{Sluis2024,This paper presents three studies on the design, use and effectiveness of multimodal online baking blogs that present cookie recipes in two forms: illustrated step-by-step Instructions with Pictures and printable text-only Recipe Cards. Firstly, a corpus study describes how authors combine text and pictures in 15 blogs. Secondly, an eye-tracking study was conducted to explore how 12 participants read and evaluate baking blogs and the Instructions with Pictures in them. Finally, a user study was conducted to explore how 4 teams of participants execute and evaluate either an Instruction with Pictures or a Recipe Card of a typical baking blog. Questionnaire data on the readers' and users' judgments of the comprehensibility, design and their (expected) performance of the instructions, as well as eye-tracker data and videos capturing the reading and baking practices were collected and analysed. Thus, the triangulation of exploratory studies displays how different research methodologies inform the relevance and evaluation of particular characteristics of multimodal presentations given the readers' and users' judgments as well as through objective measurements that provide complementary insights on multimodal baking instructions in terms of multimodal information presen- tation, reading strategies and situated use. wibble99 |
Agnieszka Szarkowska; Valentina Ragni; David Orrego-Carmona; Sharon Black; Sonia Szkriba; Jan-Louis Louis Kruger; Krzysztof Krejtz; Breno Silva The impact of video and subtitle speed on subtitle reading: An eye-tracking replication study Journal Article In: Journal of Audiovisual Translation, vol. 7, no. 1, pp. 1–23, 2024. @article{Szarkowska2024,We present results of a direct replication of Liao et al.'s (2021) study on how subtitle speed and the presence of concurrent video impact subtitle reading among British and Polish viewers. Our goal was to assess the generalisability of the original study's findings on a cohort of Australian English. The study explored both subtitle-level and word-level effects, considering the presence or absence of concurrent video and three subtitle speeds: 12 characters per second, 20 cps, and 28 cps. Overall, most of the original results were replicated, confirming that the presence of video and the speed of the subtitles have a measurable impact on processing across different viewer groups. Additionally, differences in how native and non-native speakers process subtitles emerged, in particular related to wrap-up, word frequency and word length effects. The paper describes the replication in detail, presents the findings, and discusses some of their implications. Lay summary In our study we were interested in the effects that the presence of video and various subtitle speeds have on how viewers watch subtitled videos and how they understand them. We also wanted to know if the previous results obtained in a study by Liao et al. (2021) in Australia hold true for other viewers living in different locations. With this goal in mind, we repeated Liao et al.'s (2021) study on British and Polish viewers. The study explored both subtitle-level and word-level effects, considering the presence or absence of video and three subtitle speeds: 12 characters per second, 20 cps, and 28 cps. Overall, most of the original results were confirmed, showing that the presence of video and the speed of the subtitles have an impact on processing across different viewer groups. Additionally, differences in how native and non-native speakers process subtitles emerged, in particular related to well-known linguistic effects from reading studies, such as wrap-up, word frequency and word length effects. The paper describes the replication in detail, presents the findings, and discusses some of their implications. |
Agnieszka Szarkowska; Valentina Ragni; Sonia Szkriba; Sharon Black; David Orrego-Carmona; Jan Louis Kruger In: PLoS ONE, vol. 19, no. 10, pp. 1–29, 2024. @article{Szarkowska2024a,Every day, millions of viewers worldwide engage with subtitled content, and an increasing number choose to watch without sound. In this mixed-methods study, we examine the impact of sound presence or absence on the viewing experience of both first-language (L1) and second-language (L2) viewers when they watch subtitled videos. We explore this novel phenomenon through comprehension and recall post-tests, self-reported cognitive load, immersion, and enjoyment measures, as well as gaze pattern analysis using eye tracking. We also investigate viewers' motivations for opting for audiovisual content without sound and explore how the absence of sound impacts their viewing experience, using in-depth, semi-structured interviews. Our goal is to ascertain whether these effects are consistent among L2 and L1 speakers from different language varieties. To achieve this, we tested L1-British English, L1-Australian English and L2-English (L1-Polish) language speakers (n = 168) while they watched English-language audiovisual material with English subtitles with and without sound. The findings show that when watching videos without sound, viewers experienced increased cognitive load, along with reduced comprehension, immersion and overall enjoyment. Examination of participants' gaze revealed that the absence of sound significantly affected the viewing experience, increasing the need for subtitles and thus increasing the viewers' propensity to process them more thoroughly. The absence of sound emerged as a global constraint that made reading more effortful. Triangulating data from multiple sources made it possible to tap into some of the metacognitive strategies employed by viewers to maintain comprehension in the absence of sound. We discuss the implications within the context of the growing trend of watching subtitled videos without sound, emphasising its potential impact on cognitive processes and the viewing experience. |
Jiahui Wang Mind wandering in videos that integrate instructor's visuals: An eye tracking study Journal Article In: Innovations in Education and Teaching International, vol. 61, no. 5, pp. 972–987, 2024. @article{Wang2024m,With an increasing number of videos integrating instructor's visuals on screen, we know little about the impacts of this design on mind wandering. The study aims to investigate a) how instructor visibility impacts mind wandering; b) the relationship between mind wandering and retention performance; c) how visual behaviour during video-watching influences mind wandering. Each participant watched a video with or without instructor visibility, while their visual behaviour was recorded by an eye tracker. Retention performance was measured at the completion of the video. Mind wandering was inferred via global self-report measure and objective eye tracking measure. Both measures of mind wandering indicated the instructor visible video resulted in less mind wandering. Findings suggested mind wandering impaired retention performance. Additionally, visual attention to the instructor was associated with less mind wandering. |
Jiahui Wang Does working memory capacity influence learning from video and attentional processing of the instructor's visuals? Journal Article In: Behaviour & Information Technology, vol. 43, no. 1, pp. 95–109, 2024. @article{Wang2024c,Existing evidence suggested learners with differences in attention and cognition might respond to the same media in differential ways. The current study focused on one format of video design–instructor visibility and explored the moderating effects of working memory capacity on learning from such video design and if learners with high and low working memory capacity attended to the instructor's visuals differently. Participants watched a video either with or without the instructor's visuals on the screen, while their visual attention was recorded simultaneously. After the video, participants responded to a learning test that measured retention and transfer. Although the results did not show working memory capacity moderated the instructor visibility effects on learning or influenced learners' visual attention to the instructor's visuals, the findings did indicate working memory capacity was a positive predictor of retention performance regardless of the video design. Discussions and implications of the findings were provided. |
Pengchao Wang; Wei Mu; Gege Zhan; Aiping Wang; Zuoting Song; Tao Fang; Xueze Zhang; Junkongshuai Wang; Lan Niu; Jianxiong Bin; Lihua Zhang; Jie Jia; Xiaoyang Kang Preference detection of the humanoid robot face based on EEG and eye movement Journal Article In: Neural Computing and Applications, vol. 36, no. 19, pp. 11603–11621, 2024. @article{Wang2024f,The face of a humanoid robot can affect the user experience, and the detection of face preference is particularly important. Preference detection belongs to a branch of emotion recognition that has received much attention from researchers. Most of the previous preference detection studies have been conducted based on a single modality. In this paper, we detect face preferences of humanoid robots based on electroencephalogram (EEG) signals and eye movement signals for single modality, canonical correlation analysis fusion modality, and bimodal deep autoencoder (BDAE) fusion modality, respectively. We validated the theory of frontal asymmetry by analyzing the preference patterns of EEG and found that participants had higher alpha wave energy for preference faces. In addition, hidden preferences extracted by EEG signals were better classified than preferences from participants' subjective feedback, and also, the classification performance of eye movement data was improved. Finally, experimental results showed that BDAE multimodal fusion using frontal alpha and beta power spectral densities and eye movement information as features performed best, with the highest average accuracy of 83.13% for the SVM and 71.09% for the KNN. |
Aengus Ward; Shiyu He Medieval reading in the twenty-first century? Journal Article In: Digital Scholarship in the Humanities, vol. 39, no. 4, pp. 1134–1155, 2024. @article{Ward2024,Reading practices in medieval manuscripts have often been the subject of critical analysis in the past. Recent technological developments have extended the range of analytical possibilities; one such development is that of eye tracking. In the present article, we outline the results of an experiment using eye tracking technologies which were carried out recently in Spain. The analysis points to particular trends in the ways in which modern readers interact with medieval textual forms and we use this analysis to point to future possibilities in the use of eye tracking to broaden and deepen our understanding of the workings of the medieval page. |
Xinyong Zhang Evaluating target expansion for eye pointing tasks Journal Article In: Interacting with Computers, vol. 36, no. 4, pp. 209–223, 2024. @article{Zhang2024k,The idea of target expansion was proposed two decades ago for manual target acquisition, but it is not feasible to implement this idea in traditional user interfaces as the interactive system cannot know exactly which target is the desired one and should be expanded among several candidates. With the increasing maturity of eye tracking technology, gaze input has moved from an academically promising technique to an input method with built-in support in Windows 10; and target expansion has already become very feasible in the context of gaze input, as the user's eye gaze is inherently an indicator of the desired target due to the natural eye-hand coordination in everyday tasks. However, a comprehensive evaluation is still lacking. In this study, two experiments were conducted, each with a different group of subjects, to investigate the effects of target expansion under different expansion feedback styles (visible vs. invisible), expansion factors, as well as different target appearances (i.e., circular vs. rectangular). The experimental results indicated that (1) the index of difficulty in eye pointing tasks (IDeye) does not depend on the initial size of the target, but on its final size, and that the corresponding human performance can be accurately predicted using the IDeye model instead of Fitts' law; and that (2) the visible expansion style could disrupt the user's fixations, making the measured human performance less efficient to some extent, but overall the theoretical predictions using the IDeye model were almost the same as the baselines. Following the experimental results, this study also provided some practical suggestions for UI design. |
Tiansheng Xia; Yingqi Yan; Jiayue Guo Color in web-advertising: The effect of color hue contrast on web satisfaction and advertising memory Journal Article In: Current Psychology, vol. 43, no. 16, pp. 14645–14658, 2024. @article{Xia2024b,There has been a growth in e-commerce, presenting consumers with varied forms of advertising. A key goal of web advertising is to leave a lasting impression on the user, and web satisfaction is an important measure of the quality and usability of a web page after an ad is placed on it. This experiment manipulated participants' purpose in web browsing (free browsing versus goal oriented) and the color combination of the web background and the vertical-ad background (high or low hue contrast) to predict users' satisfaction with the web page and the degree of ad recall. The psychological mechanisms of this effect were also explored using an eye-tracking device to record and analyze eye movements. The participants were 120 university students, 64.2% of whom were female and 35.8% of whom were male. During free browsing, participants could simulate the daily use of a browser to browse the web and were given 120 s to do so, and in the task-oriented browsing condition, participants were told in advance that they had to summarize the headlines of each news item one at a time within 120 s. The results showed that, in the free-viewing task, the hue contrast between the ad–web background colors negatively affected web satisfaction and ad memory whereas there was no significant difference in this effect in the goal-oriented task. Furthermore, in the free-viewing task, the level of attentional intrusion mediated the effect of ad–web hue contrast on the degree of ad recall; color harmony mediated the effect of hue contrast on the user's evaluation of web satisfaction. These results can act as a new reference for web design research and marketing practice. |
Jordan C. Abramowitz; Matthew J. Goupell; Kristina DeRoy Milvae Cochlear–implant simulated signal degradation exacerbates listening effort in older listeners Journal Article In: Ear & Hearing, vol. 45, no. 2, pp. 441–450, 2024. @article{Abramowitz2024,Objectives: Individuals with cochlear implants (CIs) often report that listening requires high levels of effort. Listening effort can increase with decreasing spectral resolution, which occurs when listening with a CI, and can also increase with age. What is not clear is whether these factors interact; older CI listeners potentially experience even higher listening effort with greater signal degradation than younger CI listeners. This study used pupillometry as a physiological index of listening effort to examine whether age, spectral resolution, and their interaction affect listening effort in a simulation of CI listening. Design: Fifteen younger normal-hearing listeners (ages 18 to 31 years) and 15 older normal-hearing listeners (ages 65 to 75 years) participated in this experiment; they had normal hearing thresholds from 0.25 to 4 kHz. Participants repeated sentences presented in quiet that were either unprocessed or vocoded, simulating CI listening. Stimuli frequency spectra were limited to below 4 kHz (to control for effects of age-related high-frequency hearing loss), and spectral resolution was decreased by decreasing the number of vocoder channels, with 32-, 16-, and 8-channel conditions. Behavioral speech recognition scores and pupil dilation were recorded during this task. In addition, cognitive measures of working memory and processing speed were obtained to examine if individual differences in these measures predicted changes in pupil dilation. Results: For trials where the sentence was recalled correctly, there was a significant interaction between age and spectral resolution, with significantly greater pupil dilation in the older normal-hearing listeners for the 8- and 32-channel vocoded conditions. Cognitive measures did not predict pupil dilation. Conclusions: There was a significant interaction between age and spectral resolution, such that older listeners appear to exert relatively higher listening effort than younger listeners when the signal is highly degraded, with the largest effects observed in the eight-channel condition. The clinical implication is that older listeners may be at higher risk for increased listening effort with a CI. |
Tarek Alakmeh; David Reich; Lena Jäger; Thomas Fritz Predicting code comprehension: A novel approach to align human gaze with code using deep neural networks Journal Article In: Proceedings of the ACM on Software Engineering, vol. 1, pp. 1982–2004, 2024. @article{Alakmeh2024,The better the code quality and the less complex the code, the easier it is for software developers to comprehend and evolve it. Yet, how do we best detect quality concerns in the code? Existing measures to assess code quality, such as McCabe's cyclomatic complexity, are decades old and neglect the human aspect. Research has shown that considering how a developer reads and experiences the code can be an indicator of its quality. In our research, we built on these insights and designed, trained, and evaluated the first deep neural network that aligns a developer's eye gaze with the code tokens the developer looks at to predict code comprehension and perceived difficulty. To train and analyze our approach, we performed an experiment in which 27 participants worked on a range of 16 short code comprehension tasks while we collected fine-grained gaze data using an eye tracker. The results of our evaluation show that our deep neural sequence model that integrates both the human gaze and the stimulus code, can predict (a) code comprehension and (b) the perceived code difficulty significantly better than current state-of-the-art reference methods. We also show that aligning human gaze with code leads to better performance than models that rely solely on either code or human gaze. We discuss potential applications and propose future work to build better human-inclusive code evaluation systems. |
Robert G. Alexander; Ashwin Venkatakrishnan; Jordi Chanovas; Sophie Ferguson; Stephen L. Macknik; Susana Martinez-Conde Why did Rubens add a parrot to Titian's The Fall of Man? A pictorial manipulation of joint attention Journal Article In: Journal of Vision, vol. 24, no. 4, pp. 1–13, 2024. @article{Alexander2024,Almost 400 years ago, Rubens copied Titian's The Fall of Man, albeit with important changes. Rubens altered Titian's original composition in numerous ways, including by changing the gaze directions of the depicted characters and adding a striking red parrot to the painting. Here, we quantify the impact of Rubens's choices on the viewer's gaze behavior. We displayed digital copies of Rubens's and Titian's artworks—as well as a version of Rubens's painting with the parrot digitally removed—on a computer screen while recording the eye movements produced by observers during free visual exploration of each image. To assess the effects of Rubens's changes to Titian's composition, we directly compared multiple gaze parameters across the different images. We found that participants gazed at Eve's face more frequently in Rubens's painting than in Titian's. In addition, gaze positions were more tightly focused for the former than for the latter, consistent with different allocations of viewer interest. We also investigated how gaze fixation on Eve's face affected the perceptual visibility of the parrot in Rubens's composition and how the parrot's presence versus its absence impacted gaze dynamics. Taken together, our results demonstrate that Rubens's critical deviations from Titian's painting have powerful effects on viewers' oculomotor behavior. |
Zack Carpenter; David DeLiema Linking epistemic stance and problem-solving with self-confidence during play in a puzzle-based video game Journal Article In: Computers & Education, vol. 216, pp. 1–22, 2024. @article{Carpenter2024,Our goal in bridging several fields is to address a gap at the intersection of problem-solving, epistemic stance, and play. Specifically, we investigate how epistemically laminated problem-solving moves connect with self-confidence while students play Baba is You. Our research at this juncture revolves around three research questions: 1. How are problem-solving moves laminated with epistemic stance? 2. How do epistemically laminated problem-solving moves relate to players' self-confidence? 3. How do epistemically laminated problem-solving moves emerge as a dynamic, moment-to-moment interaction between player and game? |
Soazig Casteau; Daniel T. Smith How does contextual information affect aesthetic appreciation and gaze behavior in figurative and abstract artwork? Journal Article In: Journal of Vision, vol. 24, no. 12, pp. 1–15, 2024. @article{Casteau2024,Numerous studies have investigated how providing contextual information with artwork influences gaze behavior, yet the evidence that contextually triggered changes in oculomotor behavior when exploring artworks may be linked to changes in aesthetic experience remains mixed. The aim of this study was to investigate how three levels of contextual information influenced people's aesthetic appreciation and visual exploration of both abstract and figurative art. Participants were presented with an artwork and one of three contextual information levels: a title, title plus information on the aesthetic design of the piece, or title plus information about the semantic meaning of the piece. We measured participants liking, interest and understanding of artworks and recorded exploration duration, fixation count and fixation duration on regions of interest for each piece. Contextual information produced greater aesthetic appreciation and more visual exploration in abstract artworks. In contrast, figurative artworks were highly dependent on liking preferences and less affected by contextual information. Our results suggest that the effect of contextual information on aesthetic ratings arises from an elaboration effect, such that the viewer aesthetic experience is enhanced by additional information, but only when the meaning of an artwork is not obvious. |
Meijun Chen; Yuyi Chen; Ruoxi Qi; Janet Hui Hsiao; Wendy Wing Tak Lam; Qiuyan Liao In: Journal of Environmental Psychology, vol. 100, pp. 102485, 2024. @article{Chen2024d,Promoting sustainable diets is consistently documented to be beneficial to health, the environment, and long-term food security. There remains limited understanding of the effects of activating the goal of sustainable diets for achieving co-benefits on sustainable food choices and the potential mechanisms. This study was a pre-registered online randomized controlled trial combined with eye tracking to compare the effects of three priming interventions: health-benefit priming (HP), environment-benefit priming (EP), and combined-benefit priming (CoP), on sustainable food choice. Sustainable food choices were assessed by a simulated online shopping task. Participants' eye movement data were tracked while they were choosing foods during simulated online shopping. Participants' executive function (EF), environmental values, health values, and social orientation values were also measured. The results showed a significant difference in sustainable food choices among the four groups, with CoP showing a significant increase compared to the control. The eye-tracking data revealed that the attention to sustainable foods with an eco-friendly logo mediated the association between priming and participants' sustainable food choices. Furthermore, priming with the co-benefits of sustainable diets can be more effective for participants with greater delay discounting to increase their sustainable food choices. These findings suggest that priming with co-benefits of sustainable diets can be a promising strategy to support more sustainable food choices particularly for consumers with more difficulty in delaying their immediate awards. |
Sijia Chen; Jan-Louis Kruger Visual processing during computer-assisted consecutive interpreting Journal Article In: Interpreting, vol. 26, no. 2, pp. 231–252, 2024. @article{Chen2024g,This study investigates the visual processing patterns during computer-assisted consecutive interpreting (CACI). In phase I of the proposed CACI workflow, the interpreter listens to the source speech and respeaks it into speech recognition (SR) software. In phase II, the interpreter produces target speech supported by the SR text and its machine translation (MT) output. A group of students performed CACI with their eye movements tracked. In phase I, the participants devoted the majority of their attention to listening and respeaking, with very limited attention distributed to the SR text. However, a positive correlation was found between the percentage of dwell time on the SR text and the quality of respeaking, which suggests that active monitoring could be important. In phase II, the participants devoted more visual attention to the MT text than to the SR text and engaged in deeper and more effortful processing when reading the MT text. We identified a positive correlation between the percentage of dwell time on the MT text and interpreting quality in the L2–L1 direction but not in the L1–L2 direction. These results contribute to our understanding of computer-assisted interpreting and can provide insights for future research and training in this area. |
Dina Abdel Salam El-Dakhs; Suhad Sonbul; Ahmed Masrai An eye-tracking study on the processing of L2 collocations: The effect of congruency, proficiency, and transparency Journal Article In: Journal of Psycholinguistic Research, vol. 53, no. 2, pp. 1–30, 2024. @article{ElDakhs2024,The availability of a first language translation equivalent (i.e., congruency) has repeatedly been shown to influence second-language collocation processing in decontextualized tasks. However, no study to date has examined how L2 speakers process congruent/incongruent collocations on-line in a real-world context. The present study aimed to fill this gap by examining the eye-movement behavior of 31 Arabic-English speakers and 30 native English speakers as they read 20 congruent and 20 incongruent collocations (in addition to 40 control phrases) in short contexts. The study also examined possible modulating effects of proficiency level and transparency on congruency effects. Results showed that non-natives (similar to native speakers) showed a processing advantage for collocations over control phrases. However, there was no effect of congruency (i.e., no difference between congruent and incongruent collocations) for either group, and no modulating effect of proficiency or transparency on congruency. We discuss implications of the findings for theories of L2 lexical processing. |
Jonas Frenkel; Anke Cajar; Ralf Engbert; Rebecca Lazarides Exploring the impact of nonverbal social behavior on learning outcomes in instructional video design Journal Article In: Scientific Reports, vol. 14, no. 1, pp. 1–12, 2024. @article{Frenkel2024,Online education has become increasingly popular in recent years, and video lectures have emerged as a common instructional format. While the importance of instructors' nonverbal social cues such as gaze, facial expression, and gestures for learning progress in face-to-face teaching is well-established, their impact on instructional videos is not fully understood. Most studies on nonverbal social cues in instructional videos focus on isolated cues rather than considering multimodal nonverbal behavior patterns and their effects on the learning progress. This study examines the role of instructors' nonverbal immediacy (a construct capturing multimodal nonverbal behaviors that reduce psychological distance) in video lectures with respect to learners' cognitive, affective, and motivational outcomes. We carried out an eye-tracking experiment with 87 participants (Mage = 24.11 |
Beatriz García-Carrión; Francisco Muñoz-Leiva; Salvador Del Barrio-García; Lucia Porcu The effect of online message congruence, destination-positioning, and emojis on users' cognitive effort and affective evaluation Journal Article In: Journal of Destination Marketing and Management, vol. 31, pp. 1–13, 2024. @article{GarciaCarrion2024,In today's digital world, it is crucial that Destination Management Organizations (DMOs) understand how tourists process and assimilate the information they receive through social media, whether this is posted online by the destination itself or by other users. When it comes to understanding the effectiveness of DMOs' integrated marketing communication (IMC) strategies, it is important to examine the extent to which the congruence between those online messages posted by the destination and those posted by other users (electronic word-of-mouth) influences the effectiveness of the communication. Similarly, it is also of value to understand the degree to which the use of emojis in social media messages may enhance the effect of congruence on IMC effectiveness. The scientific literature has found that tourists' responses to the information published online by the destination will depend on the type of positioning it adopts on its social media. The novelty of the present study work lies in addressing these issues from a neuroscientific perspective, using eye-tracking technology, to study (i) the user's cognitive effort (based on ocular indicators) when processing social media content and (ii) their affective evaluation of that content. A factorial experiment is conducted on a sample of 58 Facebook users. The results point to the important role played by the level of message congruence in users' information-processing and demonstrate the contextualizing effect exerted by emojis. Additionally, this study highlights the need for further research into the cognitive processing of tourism messages relative to different positioning strategies. |
Bing Han; Yiyuan Han; Haoran Li; Xinbo Gao PTC-CapsNet: Capsule network for papillary thyroid carcinoma pathological images classification Journal Article In: Multimedia Tools and Applications, no. 2, pp. 1907–1925, 2024. @article{Han2024,Automatic classification of pathological images is an important task in the thyroid carcinoma histopathological analysis. Currently, histological diagnosis has become a leading field in medical imaging computing, which can reduce the burden of pathologists and the misdiagnosis rate. At present, works on designing convocational neural networks(CNNs) for automatically classifying pathological images are increasing rapidly. However, classification of thyroid carcinoma pathological images remains challenging due to the small differences between benign and malignant observed from pathological images. The existing CNN methods cannot classify the pathological images well. Inspired by the diagnosis process observed by the pathologists and the reasoning ability of CapsNet, we propose a novel capsule network named PTC-CapsNet based on semantic features derived from multi-magnification pathological images for papillary thyroid carcinoma (PTC) pathological images classification. The proposed method is more in line with the diagnostic decision and visual cognitive of pathologist. It can deal with spatial hierarchies between complex pathological features excellently. A new loss function named penalty binary cross-entropy is designed to reduce the false negative rate. Furthermore, an eye movement dataset is established by pathologists to evaluate the performance of models subjectively, while a new metric also is proposed to verify the performance of these methods objectively. The experimental results illustrate the superiority of our method on our PTC pathological images dataset and the BreakHis dataset. |
2023 |
Sourish Chakravarty; Jacob Donoghue; Ayan S. Waite; Meredith Mahnke; Indie C. Garwood; Sebastian Gallo; Earl K. Miller; Emery N. Brown Closed-loop control of anesthetic state in nonhuman primates Journal Article In: PNAS Nexus, vol. 2, no. 10, pp. 1–14, 2023. @article{Chakravarty2023,Research in human volunteers and surgical patients has shown that unconsciousness under general anesthesia can be reliably tracked using real-time electroencephalogram processing. Hence, a closed-loop anesthesia delivery (CLAD) system that maintains precisely specified levels of unconsciousness is feasible and would greatly aid intraoperative patient management. The US Federal Drug Administration has approved no CLAD system for human use due partly to a lack of testing in appropriate animal models. To address this key roadblock, we implement a nonhuman primate (NHP) CLAD system that controls the level of unconsciousness using the anesthetic propofol. The key system components are a local field potential (LFP) recording system; propofol pharmacokinetics and pharmacodynamic models; the control variable (LFP power between 20 and 30 Hz), a programmable infusion system and a linear quadratic integral controller. Our CLAD system accurately controlled the level of unconsciousness along two different 125-min dynamic target trajectories for 18 h and 45 min in nine experiments in two NHPs. System performance measures were comparable or superior to those in previous CLAD reports. We demonstrate that an NHP CLAD system can reliably and accurately control in real-time unconsciousness maintained by anesthesia. Our findings establish critical steps for CLAD systems' design and testing prior to human testing. |
Jacky R. Claydon; Matthew C. Fysh; Jonathan E. Prunty; Filipe Cristino; Reuben Moreton; Markus Bindemann Facial comparison behaviour of forensic facial examiners Journal Article In: Applied Cognitive Psychology, vol. 37, no. 1, pp. 6–25, 2023. @article{Claydon2023,Facial examiners make visual comparisons of face images to establish the identities of persons in police investigations. This study utilised eye-tracking and an individual differences approach to investigate whether these experts exhibit specialist viewing behaviours during identification, by comparing facial examiners with forensic fingerprint analysts and untrained novices across three tasks. These comprised of face matching under unlimited (Experiment 1) and time-restricted viewing (Experiment 2), and with a feature-comparison protocol derived from examiner casework procedures (Experiment 3). Facial examiners exhibited individual differences in facial comparison accuracy and did not consistently outperform fingerprint analysts and novices. Their behaviour was also marked by similarities to the comparison groups in terms of how faces were viewed, as evidenced from eye movements, and how faces were perceived, based on the made feature judgements and identification decisions. These findings further understanding of how facial comparisons are performed and clarify the nature of examiner expertise. |
Tao Deng; Lianfang Jiang; Yi Shi; Jiang Wu; Zhangbi Wu; Shun Yan; Xianshi Zhang; Hongmei Yan Driving visual saliency prediction of dynamic night scenes via a spatio-temporal dual-encoder network Journal Article In: IEEE Transactions on Intelligent Transportation Systems, pp. 1–11, 2023. @article{Deng2023a,Driving at night is more challenging and dangerous than driving during the day. Modeling driver eye movement and attention allocation during night driving can help guide unmanned intelligent vehicles and improve safety during similar situations. However, until now, few studies have modeled a drivers' true fixations and attention allocation in specific night circumstance. Therefore, we collected an eye tracking dataset from 30 experienced drivers while they viewed night driving videos under a hypothetical driving condition, termed Driver Fix- ation Dataset in night (DrFixD(night)). Based on DrFixD(night) which includes multiple drivers' attention allocation, we proposed a spatio-temporal dual-encoder network model, named as STDE- Net, to improve saliency detection in night driving condition. The model includes three modules: i) spatio-temporal dual encoding module, ii) fusion module based on attention mechanism, and iii) decoding module. A convolutional LSTM is employed to learn the time connection of video sequences, and a convolution neural net- work combined pyramid dilated convolution is adopted to extract spatial features in the spatio-temporal dual encoding module. The attention mechanism is exploited to fuse the temporal and spatial features together and selectively highlight the significant features in night traffic scene. We compared the proposed model with other traditional methods and deep learning models, both qualitatively and quantitatively, and found that the proposed model can predict driver's fixation more accurately. Specifically, the proposed model not only predicts the main goals, but also predicts the important sub goals, such as pedestrians, bicycles and so on, showing excellent prediction of dimly lit targets at night. Index |
Rui Fu; Tao Huang; Mingyue Li; Qinyu Sun; Yunxing Chen In: Expert Systems with Applications, vol. 214, pp. 1–12, 2023. @article{Fu2023,The prediction of the driver's focus of attention (DFoA) is becoming essential research for the driver distraction detection and intelligent vehicle. Therefore, this work makes an attempt to predict DFoA. However, traffic driving environment is a complex and dynamic changing scene. The existing methods lack full utilization of driving scene information and ignore the importance of different objects or regions of the driving scene. To alleviate this, we propose a multimodal deep neural network based on anthropomorphic attention mechanism and prior knowledge (MDNN-AAM-PK). Specifically, a more comprehensive information of driving scene (RGB images, semantic images, optical flow images and depth images of successive frames) is as the input of MDNN-AAM-PK. An anthropomorphic attention mechanism is developed to calculate the importance of each pixel in the driving scene. A graph attention network is adopted to learn semantic context features. The convolutional long short-term memory network (ConvLSTM) is used to achieve the transition of fused features in successive frames. Furthermore, a training method based on prior knowledge is designed to improve the efficiency of training and the performance of DFoA prediction. These experiments, including experimental comparison with the state-of-the-art methods, the ablation study of the proposed method, the evaluation on different datasets and the visual assessment experiment in vehicle simulation platform, show that the proposed method can accurately predict DFoA and is better than the state-of-the-art methods. |
Zhibing Gao; Ziang Li; Xiangling Zhuang; Guojie Ma Advantages of graphical nutrition facts label: Faster attention capture and improved healthiness judgement Journal Article In: Ergonomics, vol. 66, no. 5, pp. 627–643, 2023. @article{Gao2023a,Consumers have to rely on the traditional back-of-package nutrition facts label (NFL) to obtain nutrition information in many countries. However, traditional NFLs have been criticised for their poor visualisation and low efficiency. This study redesigned back-of-package NFLs integrated with bar graphs (black or coloured) to visually indicate nutrient reference values (NRVs). Two eye movement studies were performed to evaluate the ergonomic advantages of the graphical NFLs. Our findings suggested that the newly designed NFLs led to faster and better healthiness evaluation performance. The newly designed graphical labels led to a shorter time to first fixation duration and offered a higher percentage of fixation time in the nutrient reference values region compared with that observed using traditional text labels. Nowadays, many chronic diseases are associated with poor eating habits, therefore, the importance of visualisation design to nudge healthier food choices could be paid more attention to by policymakers and food manufacturers. |
Beatriz García-Carrión; Salvador Del Barrio-García; Francisco Muñoz-Leiva; Lucia Porcu In: Journal of Hospitality and Tourism Management, vol. 55, no. August 2022, pp. 78–90, 2023. @article{GarciaCarrion2023,Social networks are a source of competitive advantage for destination management organizations (DMOs) in promoting user-generated content. In the online environment, the generational cohort to which the user belongs significantly determines their motivations, preferences, and behaviors. Against this backdrop, and in context of culinary tourism, the present work aims to: (1) examine the degree of congruence between the messages that tourist receives from DMOs and other tourists through social network comments affects their attention and affective responses; (2) analyze the effect of generational cohort on user responses; (3) investigate the differences in gastronomy-related messages between generational cohorts according to different levels of congruence. An eye-tracking experiment is conducted to manipulate message congruence (high vs. low) and user's generational cohort (Millennials vs. Generation Z). Findings show faster attention-capture and higher cognitive processing in low-congruence gastronomy-related comments in both cohorts, while Generation Z users reported greater attention to culinary visuals. |
Jessica N. Goetz; Mark B. Neider Keep it real, keep it simple: The effects of icon characteristics on visual search Journal Article In: Behaviour & Information Technology, pp. 1–20, 2023. @article{Goetz2023,Previous research examining how icons' concreteness, visual complexity, and distinctiveness influence visual search performance have led to disagreements over which icon characteristic most affects behaviour. These icon characteristics are often poorly defined and interrelated, particularly concreteness. Accordingly, drawing strong inferences about the robustness of concreteness as a factor in search for visual icons is challenging. Here, we operationalised concreteness into three distinct levels: concrete icons were images of real-world objects, photorealistic icons were drawings of the object, and abstract icons were images with no conceptual information. Across two experiments, participants rated each icon on various icon characteristics (e.g. concreteness, visual complexity) to provide a ground truth for these factors and to validate our concreteness manipulation. In a separate study, naive participants performed a visual search task for a target icon. Oculomotor measures were utilised to elucidate how various icon characteristics affected search performance. Although we were unable to fully disassociate concreteness from visual complexity, we found that icons high in concreteness improved search performance, but as visual complexity increased, object identification became slower. This was largely demonstrated through increased verification times for complex targets. The present set of studies indicate that highly concrete and simple icons engender search benefits. |
Sotiris Plainis; Emmanouil Ktistakis; Miltiadis K. Tsilimbaris Presbyopia correction with multifocal contact lenses: Evaluation of silent reading performance using eye movements analysis Journal Article In: Contact Lens and Anterior Eye, vol. 46, no. 4, pp. 1–8, 2023. @article{Plainis2023,Purpose: Many activities of daily living rely on reading, thus is not surprising that complaints from presbyopes originate in reading difficulties rather in visual acuity. Here, the effectiveness of presbyopia correction with multifocal contact lenses (CLs) is evaluated using an eye-fixation based method of silent reading performance. Μethods: Visual performance of thirty presbyopic volunteers (age: 50 ± 5 yrs) was assessed monocularly and binocularly following 15 days of wear of monthly disposable CLs (AIR OPTIX™ plus HydraGlyde™, Alcon Laboratories) with: (a) single vision (SV) lenses – uncorrected for near (b) aspheric multifocal (MF) CLs. LogMAR acuity was measured with ETDRS charts. Reading performance was evaluated using standard IReST paragraphs displayed on a screen (0.4 logMAR print size at 40 cm distance). Eye movements were monitored with an infrared eyetracker (Eye-Link II, SR Research Ltd). Data analysis included computation of reading speed, fixation duration, fixations per word and percentage of regressions. Results: Average reading speed was 250 ± 68 and 235 ± 70 wpm, binocularly and monocularly, with SV CLs, improving statistically significantly to 280 ± 67 (p = 0.002) and 260 ± 59 wpm (p = 0.01), respectively, with MF CLs. Moreover, fixation duration, fixations per word and ex-Gaussian parameter of fixation duration, μ, showed a statistically significant improvement when reading with MF CLs, with fixation duration exhibiting the stronger correlation (r = 0.79, p < 0.001) with improvement in reading speed. The correlation between improvement in VA and reading speed was moderate (r = 0.46 |
Kathryn Nicole Sam; K. Jayasankara Reddy The effect of music and editing style on subjective perception of time when watching videos Journal Article In: Projections, vol. 17, no. 2, pp. 41–61, 2023. @article{Sam2023,Arousal, editing style, and eye movements have been implicated in time perception when watching videos. However, little multimodal research has explored how manipulating both the auditory and visual properties of videos affects temporal processing. This study investigated how editing density and music-induced arousal affect viewers' time perception. Thirty-nine participants watched six videos varying in editing density and music while their eye movements were recorded. They estimated the videos' duration and reported their subjective experience of time passage and emotional involvement. Fast-paced editing was associated with the feeling of time passing faster, a relationship mediated by fixation durations. High-arousal background music was also associated with the feeling of time passing faster. The consequences of this study in terms of a possible auditory driving effect are explored. |
Yuanping Shen; Qin Wang; Hongli Liu; Jianye Luo; Qunyue Liu; Yuxiang Lan Landscape design intensity and its associated complexity of forest landscapes in relation to preference and eye movements Journal Article In: Forests, vol. 14, no. 4, pp. 1–16, 2023. @article{Shen2023b,Understanding how people perceive landscapes is essential for the design of forest landscapes. The study investigates how design intensity affects landscape complexity, preference, and eye movements for urban forest settings. Eight groups of twenty-four pictures, representing lawn, path, and waterscape settings in urban forests, with each type of setting having two groups of pictures and one group having four pictures, were selected. The four pictures in each group were classified into slight, low, medium, and high design intensities. A total of 76 students were randomly assigned to observe one group of pictures within each type of landscape with an eye-tracking apparatus and give ratings of complexity and preference. The results indicate that design intensity was positively associated with subjective landscape complexity but was positively or negatively related to objective landscape complexity in three types of settings. Subjective landscape complexity was found to significantly contribute to visual preference across landscape types, while objective landscape complexity did not contribute to preference. In addition, the marginal effect of medium design intensity on preference was greater than that of low and high design intensity in most cases. Moreover, although some eye movement metrics were significantly related to preference in lawn settings, none were found to be indicative predictors for preference. The findings enrich research in visual preference and assist landscape designers during the design process to effectively arrange landscape design intensity in urban forests. |
Katrine Falcon Soby; Evelyn Arko Milburn; Line Burholt Kristensen; Valentin Vulchanov; Mila Vulchanova In the native speaker's eye: Online processing of anomalous learner syntax Journal Article In: Applied Psycholinguistics, vol. 44, no. 1, pp. 1–28, 2023. @article{Soby2023,How do native speakers process texts with anomalous learner syntax? Second-language learners of Norwegian, and other verb-second (V2) languages, frequently place the verb in third position (e.g.,*Adverbial-Subject-Verb), although it is mandatory for the verb in these languages to appear in second position (Adverbial-Verb-Subject). In an eye-Tracking study, native Norwegian speakers read sentences with either grammatical V2 or ungrammatical verb-Third (V3) word order. Unlike previous eye-Tracking studies of ungrammaticality, which have primarily addressed morphosyntactic anomalies, we exclusively manipulate word order with no morphological or semantic changes. We found that native speakers reacted immediately to ungrammatical V3 word order, indicated by increased fixation durations and more regressions out on the subject, and subsequently on the verb. Participants also recovered quickly, already on the following word. The effects of grammaticality were unaffected by the length of the initial adverbial. The study contributes to future models of sentence processing which should be able to accommodate various types of noisy input, that is, non-standard variation. Together with new studies of processing of other L2 anomalies in Norwegian, the current findings can help language instructors and students prioritize which aspects of grammar to focus on. |
Wenfang Song; Xinze Xie; Wenyue Huang; Qianqian Yu The design of automotive interior for Chinese young consumers based on Kansei engineering and eye-tracking technology Journal Article In: Applied Sciences, vol. 13, no. 19, pp. 1–20, 2023. @article{Song2023,The reasonable CMF (Color, Material and Finishing) design for automotive interiors could bring positive psychophysical and affective responses of customers, providing an important guideline for automobile enterprises making differentiated products. However, current studies mainly focus on an aspect of CMF design or a single style of the automotive interior, and examined the design mainly through human visual perception. There lack systematic studies on the design and evaluation of automobile interior CMF, and more scientific evaluation of the design through human visual and touching perception was required. Therefore, this study systematically designed the automobile interior CMF based on Kansei engineering and eye-tracking technology. The study consists of five steps: (1) Product positioning: the Chinese young consumers, the new energy vehicles, and bridge and seat are the target users, the automotive model and the key interior components. (2) Kansei physiological measurement: nine groups of Kansei words and thirty-three interior samples were selected, and the interior samples were scored by the Kansei words. (3) Kansei data analysis: three design types were determined, i.e., “hard and stately”, “concise and technological” and “comfortable and safe”. Meanwhile, the CMF design elements of the automotive interiors under the three styles were obtained through mathematical methods. (4) Design practice: four CMF samples under each design style (12 samples) were developed. (5) Kansei evaluation: the design themes were conducted using eye-tracking technology, and the optimal sample that mostly satisfy the user's Kansei requirements under each style was obtained. The proposed design process of automotive interior CMF may have great implications in the design of automotive interiors. |
Chaitanya Thammineni; Hemanth Manjunatha; Ehsan T. Esfahani Selective eye-gaze augmentation to enhance imitation learning in Atari games Journal Article In: Neural Computing and Applications, vol. 35, no. 32, pp. 23401–23410, 2023. @article{Thammineni2023,This paper presents the selective use of eye-gaze information in learning human actions in Atari games. Extensive evidence suggests that our eye movements convey a wealth of information about the direction of our attention and mental states and encode the information necessary to complete a task. Based on this evidence, we hypothesize that selective use of eye-gaze, as a clue for attention direction, will enhance the learning from demonstration. For this purpose, we propose a selective eye-gaze augmentation (SEA) network that learns when to use the eye-gaze information. The proposed network architecture consists of three sub-networks: gaze prediction, gating, and action prediction network. Using the prior 4 game frames, a gaze map is predicted by the gaze prediction network, which is used for augmenting the input frame. The gating network will determine whether the predicted gaze map should be used in learning and is fed to the final network to predict the action at the current frame. To validate this approach, we use publicly available Atari Human Eye-Tracking And Demonstration (Atari-HEAD) dataset consists of 20 Atari games with 28 million human demonstrations and 328 million eye-gazes (over game frames) collected from four subjects. We demonstrate the efficacy of selective eye-gaze augmentation compared to the state-of-the-art Attention Guided Imitation Learning (AGIL) and Behavior Cloning (BC). The results indicate that the selective augmentation approach (the SEA network) performs significantly better than the AGIL and BC. Moreover, to demonstrate the significance of selective use of gaze through the gating network, we compare our approach with the random selection of the gaze. Even in this case, the SEA network performs significantly better, validating the advantage of selectively using the gaze in demonstration learning. |
Aditya Upadhyayula; John M. Henderson Spatiotemporal jump detection during continuous film viewing Journal Article In: Journal of Vision, vol. 23, no. 2, pp. 1–17, 2023. @article{Upadhyayula2023,Prior research on film viewing has demonstrated that participants frequently fail to notice spatiotemporal disruptions, such as scene edits in the movies.Whether such insensitivity to spatiotemporal disruptions extends beyond scene edits in film viewing is not well understood. Across three experiments, we created spatiotemporal disruptions by presenting participants with minute long movie clips, and occasionally jumping the movie clips ahead or backward in time. Participants were instructed to press a button when they noticed any disruptions while watching the clips. The results from experiments 1 and 2 indicate that participants failed to notice the disruptions in continuity about 10% to 30% of the time depending on the magnitude of the jump. In addition, detection rates were lower by approximately 10% when the videos jumped ahead in time compared to the backward jumps across all jump magnitudes, suggesting a role of knowledge about the future affects jump detection. An additional analysis used optic flow similarity during these disruptions. Our findings suggest that insensitivity to spatiotemporal disruptions during film viewing is influenced by knowledge about future states. |
Jelena Vranjes; Bart Defrancq To repair or not to repair? Repairs and risk taking in video remote interpreting Journal Article In: Perspectives: Studies in Translation Theory and Practice, pp. 1–22, 2023. @article{Vranjes2023,The importance of video remote interpreting (VRI) for providing interpreting services has drastically increased over the last decade. Empirical research has shown, however, that interpreting through video link may have a significant impact on the interaction and the interpreting performance in dialogue interpreting contexts. The present study contributes to this growing field of research by focusing on interpreters' repair initiations in the context of VRI. Although repairs are an important mechanism for addressing problems in communication, very little research has been devoted to the study of interpreter-initiated repair in dialogue settings. Based on a corpus of video-recorded interpreted interactions (Dutch-Russian), where the interpreter is either present onsite or connected through video link, we analyse interpreters' repair initiations and related risk taking behaviour. More specifically, we examine how interpreters manage a specific type of repair initiations in video remote interpreting, namely postponed repairs. The analysis reveals differences in repair patterns between video remote and onsite interpreting and we propose that these differences result from differential risk management in the two settings. |
Ailian Wang; Jing Pan; Caihong Jiang; Jia Jin Create the best first glance: The cross-cultural effect of image background on purchase intention Journal Article In: Decision Support Systems, vol. 170, pp. 1–12, 2023. @article{Wang2023a,As globalization drives more firms toward cross-border e-commerce (CBEC), a well-designed decision support system becomes crucial to gain a competitive edge in the international market. Product images, a vital aspect of the system interface, play a significant role in shaping users' first impressions, facilitating seller-buyer information interaction, and ultimately enhancing users' decisions making in the system. Across a series of studies, this research investigates the effect of cultural differences (thinking style: holistic vs. analytic) on image background and reveals the underlying mechanism. Results show that online consumers from cultures characterized by holistic thinking style (Chinese sample) are more prone to purchase products presented with contextual backgrounds than those with white backgrounds, while this effect is absent for online consumers from cultures that tend to think in an analytic way (American sample). This effect is also observed when the thinking style is primed within the culture in separate samples from the United States and China. Study 3 employs eye-tracking technology and shows that holistic thinking, compared to analytic thinking, results in an asymmetry in cognitive effort to purchase the same products framed with contextual and white background images. Specifically, contextual (vs. white) background information greatly assists holistic thinking consumers in understanding the product, enabling them to spend less cognitive effort on product information processing. Instead, the cognitive effort that analytic thinking consumers spare in the product information is not affected by the background. Finally, we discuss theoretical contributions and practical insights for CBEC retailers and system designers that the findings indicate. |
Pei Hsuan Hsieh; Po I. Hsu Displaying software installation agreements to motivate users' reading Journal Article In: International Journal of Human-Computer Interaction, vol. 39, no. 20, pp. 4006–4023, 2023. @article{Hsieh2023a,The purpose of this study is to identify an effective display mode that best motivates software users to read the software installation agreements before downloading, thereby enhancing their understanding of intellectual property rights and preventing potential legal issues. This study randomly assigned the participants to enter either an eye-tracking or a computer-based experiment in which one of three display modes was presented. A computer-based pre-test and post-test related to intellectual property rights were given to the participants. The final results showed that the “keyword mode” was the most effective in keeping their attention on the key content. The results of a survey about software installation experiences and attitudes toward reading software installation agreements and the follow-up interviews confirmed the experimental findings. The study's contribution lies in revealing to software providers the most effective reading mode that best enhances the software users' understanding of the moral and legal concepts. |
Jia Jin; Chenchen Lin; Fenghua Wang; Ting Xu; Wuke Zhang A study of cognitive effort involved in the framing effect of summary descriptions of online product reviews for search vs. experience products Journal Article In: Electronic Commerce Research, vol. 23, no. 2, pp. 785–806, 2023. @article{Jin2023b,Few studies have focused on summary descriptions of online product reviews regarding purchase decisions, and there is a gap between individual product reviews and summary descriptions of online product reviews. The current study applied eye-tracking to explore how the product type moderates the framing effect of summary descriptions of product reviews on e-consumers' purchase decisions. The results showed that product type moderated the framing effect of summary reviews on e-consumers' purchase intention. Specifically, for search products, compared with a negative frame, a positive frame increased e-consumers' attention to function attributes and led to higher purchase intention. However, with experience products, e-consumers' attention and purchase intention did not vary across framing messages. Referring to information asymmetry theory and signal theory, we posit that the cognitive effort involved in summary review information is high for search products and low for experience products since summary reviews are a more useful signal in reducing information asymmetry for search products than for experience products. The theoretical and practical implications are also discussed. |
Jia Jin; Ailian Wang; Cuicui Wang; Qingguo Ma How do consumers perceive and process online overall vs. individual text-based reviews? Behavioral and eye-tracking evidence Journal Article In: Information and Management, vol. 60, no. 5, pp. 1–13, 2023. @article{Jin2023a,Building on the Heuristic-Systematic model, we use a survey and two eye-tracking experiments to investigate consumers' perceived usefulness of overall and individual text-based reviews (OTRs vs. ITRs) for search vs. experience products, and the information processing features. Results indicate that OTRs show higher usefulness than ITRs, regardless of product type. ITRs are perceived to be more useful for experience products than for search products. Furthermore, two eye-tracking studies confirm these results from a physiological standpoint and reveal the attentional allocation during information processing. OTRs affect subjects' processing of ITRs information differently in purchase search and experience products. |
Clare Kirtley; Christopher Murray; Phillip B. Vaughan; Benjamin W. Tatler Navigating the narrative: An eye-tracking study of readers' strategies when reading comic page layouts Journal Article In: Applied Cognitive Psychology, vol. 37, no. 1, pp. 52–70, 2023. @article{Kirtley2023,In multimedia stimuli (e.g., comics), the reader must follow a narrative in which text and image both contribute information, and artists may use more irregular layouts which must still be followed correctly. While previous work has found that the external structure (outlines) of panels is a major contributor to navigation decisions in comics, other studies have shown that panel content can affect reading order. The present studies use eye-tracking to investigate these contributions further. In Experiment 1, the reading behaviors on six layout variations were compared. The influence of the external structure was replicated, but an effect of text location was also found for one layout type. Experiment 2 focused on variations of this particular layout, manipulating the location of text within critical panels. Panel content was a consistent effect for all variations. While most navigation decisions are made using the external structure, content becomes key when resolving ambiguous layouts. |
Yongkai Li; Shuai Zhang; Gancheng Zhu; Zehao Huang; Rong Wang; Xiaoting Duan; Zhiguo Wang A CNN-based wearable system for driver drowsiness detection Journal Article In: Sensors, vol. 23, no. 7, 2023. @article{Li2023l,Drowsiness poses a serious challenge to road safety and various in-cabin sensing technologies have been experimented with to monitor driver alertness. Cameras offer a convenient means for contactless sensing, but they may violate user privacy and require complex algorithms to accommodate user (e.g., sunglasses) and environmental (e.g., lighting conditions) constraints. This paper presents a lightweight convolution neural network that measures eye closure based on eye images captured by a wearable glass prototype, which features a hot mirror-based design that allows the camera to be installed on the glass temples. The experimental results showed that the wearable glass prototype, with the neural network in its core, was highly effective in detecting eye blinks. The blink rate derived from the glass output was highly consistent with an industrial gold standard EyeLink eye-tracker. As eye blink characteristics are sensitive measures of driver drowsiness, the glass prototype and the lightweight neural network presented in this paper would provide a computationally efficient yet viable solution for real-world applications. |
Zhihao Yan; Zeyang Yang; Mark D. Griffiths “Danmu” preference, problematic online video watching, loneliness and personality: An eye-tracking study and survey study Journal Article In: BMC Psychiatry, vol. 23, no. 1, pp. 1–13, 2023. @article{Yan2023b,‘Danmu' (i.e., comments that scroll across online videos), has become popular on several Asian online video platforms. Two studies were conducted to investigate the relationships between Danmu preference, problematic online video watching, loneliness and personality. Study 1 collected self-report data on the study variables from 316 participants. Study 2 collected eye-tracking data of Danmu fixation (duration, count, and the percentages) from 87 participants who watched videos. Results show that fixation on Danmu was significantly correlated with problematic online video watching, loneliness, and neuroticism. Self-reported Danmu preference was positively associated with extraversion, openness, problematic online video watching, and loneliness. The studies indicate the potential negative effects of Danmu preference (e.g., problematic watching and loneliness) during online video watching. The study is one of the first empirical investigations of Danmu and problematic online video watching using eye-tracking software. Online video platforms could consider adding more responsible use messaging relating to Danmu in videos. Such messages may help users to develop healthier online video watching habits. |
Ying Xu; Jia-Qiong Xie; Fu-Xing Wang; Rebecca L. Monk; James Gaskin; Jin-Liang Wang The impact of Weibo features on user's information comprehension: The mediating role of cognitive load Journal Article In: Social Science Computer Review, vol. 41, no. 6, pp. 2010–2028, 2023. @article{Xu2023b,Social media, such as Microblogs, have become an important source for people to obtain information. However, we know little about how this would influence our comprehension over online information. Based on the cognitive load theory, this research explores whether and how two important features of Weibo, which are the feedback function and information fragmentation, would increase cognitive load and may in turn hinder users' information comprehension in Weibo. A 2 (feedback or non-feedback) × 2 (strong-interference or weak-interference information) between-participants experimental design was conducted. Our results revealed that the Weibo feedback function and interference information exerted a negative impact over information comprehension via inducing increased cognitive load. Specifically, these results deepened our understanding regarding the impact of Weibo features on online information comprehension and suggest the mechanism by which this occurs. This finding has implications for how to minimize the potential cost of using Weibo and maximize the adaptive development of social media. |
Craig A. Williamson; Jari J. Morganti; Hannah E. Smithson Bright-light distractions and visual performance Journal Article In: Frontiers in Psychology, vol. 14, pp. 1–11, 2023. @article{Williamson2023,Visual distractions pose a significant risk to transportation safety, with laser attacks against aircraft pilots being a common example. This study used a research-grade High Dynamic Range (HDR) display to produce bright-light distractions for 12 volunteer participants performing a combined visual task across central and peripheral visual fields. The visual scene had an average luminance of 10 cd∙m−2 with targets of approximately 0.5° angular size, while the distractions had a maximum luminance of 9,000 cd∙m−2 and were 3.6° in size. The dependent variables were the mean fixation duration during task execution (representative of information processing time), and the critical stimulus duration required to support a target level of performance (representative of task efficiency). The experiment found a statistically significant increase in mean fixation duration, rising from 192 ms without distractions to 205 ms with bright-light distractions (p = 0.023). This indicates a decrease in visibility of the low contrast targets or an increase in cognitive workload that required greater processing time for each fixation in the presence of the bright-light distractions. Mean critical stimulus duration was not significantly affected by the distraction conditions used in this study. Future experiments are suggested to replicate driving and/or piloting tasks and employ bright-light distractions based on real-world data, and we advocate the use of eye-tracking metrics as sensitive measures of changes in performance. |
Zedong Xie; Meng Zhang; Zunping Ma The impact of mental simulation on subsequent tourist experience–dual evidence from eye tracking and self-reported measurement Journal Article In: Current Issues in Tourism, vol. 26, no. 18, pp. 2915–2930, 2023. @article{Xie2023c,Tourism research has always sought to find ways to improve tourists' experience evaluation and create added value for them. However, the academic community has focused on the on-site and post-travel stages of tourists, and neglected the pre-travel stage. This study examines the influence of guided mental simulation of an upcoming tourist experience on subsequent on-site tourist experience and experience evaluation. The research simulated real-world experience with tour videos shot from the first-person perspective, and measured the variables using both eye movements and self-reporting. Multivariate ANOVA and multigroup analysis were then performed on the data. The results showed that a process simulation of tourists having an engagement experience and an outcome simulation of tourists having a sight-seeing experience resulted in a higher engagement level and higher emotional response during the on-site experience, higher evaluation of the experience, and a greater impact of engagement level on their evaluation. This study expands the research on tourists' psychological experience in the pre-travel stage. Results indicate that the period from the moment consumers book or purchase the tourist product to the moment they actually embark on the tourist experience is a valuable marketing window. |
Mo Xiaohong; Xie Zhihao; Luh Ding-Bang A hybrid macro and micro method for consumer emotion and behavior research Journal Article In: IEEE Access, vol. 11, pp. 83430–83445, 2023. @article{Xiaohong2023,To investigate impacts of intelligent and fashion factors of sports bras on consumers' emotions, decision-making and behavior, a quantitative analysis method combing macro affective computing and micro emotion data was proposed. The context where a consumer purchased sports bras was first simulated. In this process, an eye tracker and a multi-channel physiological recorder were utilized to collect physiological signal data from participants in an experimental setting. Then, big data and machine learning were both adopted to macroscopically perform data pre-processing, build a computational model, fulfill relevant prediction and evaluation, analyze correlations in physiological data features, and explore potential values existing in data. Furthermore, highly correlated data features were extracted to investigate micro causalities and identify reasons why consumer behavior and decision-making were supported by data about emotional physiology. The proposed method may provide considerably reliable data support for designers, product service providers, and other practitioners. As an innovative and universal integration approach, it has the potential to be applied in medical science, psychology, management science and other fields. |
2022 |
Jinghui Yin; Jiande Sun; Jing Li; Ke Liu An effective gaze-based authentication method with the spatiotemporal feature of eye movement Journal Article In: Sensors, vol. 22, no. 3002, pp. 1–18, 2022. @article{Yin2022,Eye movement has become a new behavioral feature for biometric authentication. In the eye movement-based authentication methods that use temporal features and artificial design features, the required duration of eye movement recordings are too long to be applied. Therefore, this study aims at using eye movement recordings with shorter duration to realize authentication. And we give out a reasonable eye movement recording duration that should be less than 12 s, referring to the changing pattern of the deviation degree between the gaze point and the stimulus point on the screen. In this study, the temporal motion features of the gaze points and the spatial distribution features of the saccade are using to represent the personal identity. Two datasets are constructed for the experiments, including 5 s and 12 s of eye movement recordings. On the datasets constructed in this paper, the open-set authentication results show that the Equal Error Rate of our proposed methods can reach 10.62% when recording duration is 12 s and 12.48% when recording duration is 5 s. The closed-set authentication results show that the Equal Error Rate of our proposed methods can reach 5.25% when recording duration is 12 s and 7.82% when recording duration is 5 s. It demonstrates that the proposed method provides a reference for the eye movements data-based identity authentication. |
Matthew B. Winn; Katherine H. Teece Effortful listening despite correct responses: The cost of mental repair in sentence recognition by listeners with cochlear implants Journal Article In: Journal of Speech, Language, and Hearing Research, vol. 65, pp. 3966–3980, 2022. @article{Winn2022,Purpose: Speech recognition percent correct scores fail to capture the effort of mentally repairing the perception of speech that was initially misheard. This study measured the effort of listening to stimuli specifically designed to elicit mental repair in adults who use cochlear implants (CIs). Method: CI listeners heard and repeated sentences in which specific words were distorted or masked by noise but recovered based on later context: a signature of mental repair. Changes in pupil dilation were tracked as an index of effort and time-locked with specific landmarks during perception. Results: Effort significantly increases when a listener needs to repair a misperceived word, even if the verbal response is ultimately correct. Mental repair of words in a sentence was accompanied by greater prevalence of errors elsewhere in the same sentence, suggesting that effort spreads to consume resources across time. The cost of mental repair in CI listeners was essentially the same as that observed in listeners with normal hearing in previous work. Conclusions: Listening effort as tracked by pupil dilation is better explained by the mental repair and reconstruction of words rather than the appearance of correct or incorrect perception. Linguistic coherence drives effort more heavily than the mere presence of mistakes, highlighting the importance of testing materials that do not constrain coherence by design. |
Xiaoying Zhang; Ruosong Chang; Xue Sui; Yutong Li Influences of emotion on driving decisions at different risk levels: An eye movement study Journal Article In: Frontiers in Psychology, vol. 13, pp. 1–11, 2022. @article{Zhang2022l,To explore the influences of traffic-related negative emotions on driving decisions, we induced drivers' three emotions (neutral emotion, traffic-related negative emotion, and traffic-unrelated negative emotion) by videos, then the drivers were shown traffic pictures at different risk levels and made decisions about whether to slow down, while their eye movements were recorded. We found that traffic-related negative emotion influenced driving decisions. Compared with neutral emotion, traffic-related negative emotion led to an increase in the number of decelerations, and the higher the risk, the more the number of decelerations. The visual processing time of the risk area was shorter in the traffic-related negative emotional state than that in the neutral emotional state. The less time drivers spend looking at the risk area, the faster they make their driving decisions. The results suggest that traffic-related negative emotions lead drivers to make more conservative decisions. This study supports the rationality of using traffic accident materials to conduct safety education for drivers. This article also discussed the significance of traffic-related negative emotions to social security. |
Anna M. Wright; Jorge A. Salas; Kelly E. Carter; Daniel T. Levin Eye Movement Modeling Examples guide viewer eye movements but do not improve learning Journal Article In: Learning and Instruction, vol. 79, pp. 1–9, 2022. @article{Wright2022,Recent research has tested whether Eye Movement Modeling Examples (EMMEs) can effectively cue attention and improve learning. However, the effects of EMMEs are variable, and the degree to which viewers follow these cues remains unclear. In the current paper, we compared screen-captured instructional videos that included an EMME in the form of a transparent circular overlay depicting the instructor's gaze location with identical videos that lacked this cue. We observed that EMMEs drove viewer saccades to cued locations and resulted in shorter distances between viewer gaze and the EMME, but learning performance and video preference were unaffected by the presence of an EMME. We argue that EMMEs can effectively guide attention, but the range of circumstances under which they improve learning may be limited. |
Victoria I. Nicholls; Jan M. Wiener; Andrew Isaac Meso; Sebastien Miellet The relative contribution of executive functions and aging on attentional control during road crossing Journal Article In: Frontiers in Psychology, vol. 13, pp. 1–9, 2022. @article{Nicholls2022,As we age, many physical, perceptual and cognitive abilities decline, which can critically impact our day-to-day lives. However, the decline of many abilities is concurrent; thus, it is challenging to disentangle the relative contributions of different abilities in the performance deterioration in realistic tasks, such as road crossing, with age. Research into road crossing has shown that aging and a decline in executive functioning (EFs) is associated with altered information sampling and less safe crossing decisions compared to younger adults. However, in these studies declines in age and EFs were confounded. Therefore, it is impossible to disentangle whether age-related declines in EFs impact on visual sampling and road-crossing performance, or whether visual exploration, and road-crossing performance, are impacted by aging independently of a decline in EFs. In this study, we recruited older adults with maintained EFs to isolate the impacts of aging independently of a decline EFs on road crossing abilities. We recorded eye movements of younger adults and older adults while they watched videos of road traffic and were asked to decide when they could cross the road. Overall, our results show that older adults with maintained EFs sample visual information and make similar road crossing decisions to younger adults. Our findings also reveal that both environmental constraints and EF abilities interact with aging to influence how the road-crossing task is performed. Our findings suggest that older pedestrians' safety, and independence in day-to-day life, can be improved through a limitation of scene complexity and a preservation of EF abilities. |
Tarikere T. Niranjan; Narendra K. Ghosalya; Srinagesh Gavirneni Crying wolf and a knowing wink: A behavioral study of order inflation and discounting in supply chains Journal Article In: Production and Operations Management, vol. 31, no. 3, pp. 1071–1088, 2022. @article{Niranjan2022,Two field case studies uncover information discounting in supply chains, which manifests in the form of schedule padding and order inflation. Buyers often exaggerate the urgency and quantity of their needs (“crying wolf”). However, both buyers and suppliers eliminate old, inflated orders from their behavioral ordering/supply system implicitly (“knowing wink”) even though they exist in the hyper-rational ordering system represented by the ERP system. This behavior results in (and from) low credibility of information exchanged between the buyers and suppliers and their subsequent actions, and settles in a suboptimal equilibrium. Eye tracking experiments based on these case studies unpack the psychophysiological mechanisms behind this behavior, specifically, how decision makers consider past UnFilled Orders under different experimental conditions. We find that merely improving the supplier behavior does not help: information discounting reduces only when we sensitize the buyer to the improvement in the supplier behavior. However, this comes with no financial performance improvements; performance improves by further educating the buyers of the optimal target inventory. |
Suhyun Park; Louis Wiliams; Rebecca Chamberlain Global saccadic eye movements characterise artists' visual ttention while drawing Journal Article In: Empirical Studies of the Arts, vol. 40, no. 2, pp. 228–244, 2022. @article{Park2022a,Previous research has shown that artists employ flexible attentional strategies during offline perceptual tasks. The current study explored visual processing online, by tracking the eye movements of artists and non-artists (n=65) while they produced representational drawings of photographic stimuli. The findings revealed that it is possible to differentiate artists from non-artists on the basis of the relative amount of global-to-local saccadic eye movements they make when looking at the target stimulus while drawing, but not in a preparatory free viewing phase. Results indicated that these differences in eye movements are not specifically related to representational drawing ability, and may be a feature of artistic ability more broadly. This eye movement analysis technique may be used in future research to characterise the dynamics of attentional shifts in eye movements while artists are carrying out a range of artistic tasks. |
Zhongling Pi; Jiumin Yang; Weiping Hu; Jianzhong Hong The relation between openness and creativity is moderated by attention to peers' ideas in electronic brainstorming Journal Article In: Interactive Learning Environments, vol. 30, no. 2, pp. 344–352, 2022. @article{Pi2022a,An emerging body of research has focused on students' creativity in group contexts, with the assumption that students could be inspired by peers' ideas. Although students' openness and attention to peers' ideas are claimed to play important roles in their creativity in group settings, there is little empirical research that tests this assumption. This study examined the moderating effect of attention to peers' ideas in the relation between openness and creativity in electronic brainstorming. Participants were 91 undergraduate students who took about 10 min to complete a creative idea generation task during electronic brainstorming. Regression analyses found that students who were characterized by high openness were more creative, but only when they showed more attention to peers' ideas. This suggests that electronic brainstorming can be useful for enhancing the creativity of some students. |
Raheleh Saryazdi; Joanne Nuque; Craig G. Chambers Pragmatic inferences in aging and human-robot communication Journal Article In: Cognition, vol. 223, pp. 1–12, 2022. @article{Saryazdi2022a,Despite the increase in research on older adults' communicative behavior, little work has explored patterns of age-related change in pragmatic inferencing and how these patterns are adapted depending on the situation-specific context. In two eye-tracking experiments, participants followed instructions like “Click on the greenhouse”, which were either played over speakers or spoken live by a co-present robot partner. Implicit inferential processes were measured by exploring the extent to which listeners temporarily (mis)understood the unfolding noun to be a modified phrase referring to a competitor object in the display (green hat). This competitor was accompanied by either another member of the same category or an unrelated item (tan hat vs. dice). Experiment 1 (no robot) showed clear evidence of contrastive inferencing in both younger and older adults (more looks to the green hat when the tan hat was also present). Experiment 2 explored the ability to suppress these contrastive inferences when the robot talker was known to lack any color perception, making descriptions like “green hat” implausible. Younger but not older listeners were able to suppress contrastive inferences in this context, suggesting older adults could not keep the relevant limitations in mind and/or were more likely to spontaneously ascribe human attributes to the robot. Together, the findings enhance our understanding of pragmatic inferencing in aging. |
Mustafa Shirzad; Benjamin Tari; Connor Dalton; James Van Riesen; Michael J. Marsala; Matthew Heath Passive exercise increases cerebral blood flow velocity and supports a postexercise executive function benefit Journal Article In: Psychophysiology, vol. 59, no. 12, pp. 1–15, 2022. @article{Shirzad2022,Executive function entails high-level cognitive control supporting activities of daily living. Literature has shown that a single-bout of exercise involving volitional muscle activation (i.e., active exercise) improves executive function and that an increase in cerebral blood flow (CBF) may contribute to this benefit. It is, however, unknown whether non-volitional exercise (i.e., passive exercise) wherein an individual's limbs are moved via an external force elicits a similar executive function benefit. This is a salient question given that proprioceptive and feedforward drive from passive exercise increases CBF independent of the metabolic demands of active exercise. Here, in a procedural validation participants (n = 2) used a cycle ergometer to complete separate 20-min active and passive (via mechanically driven flywheel) exercise conditions and a non-exercise control condition. Electromyography showed that passive exercise did not increase agonist muscle activation or increase ventilation or gas exchange variables (i.e., V̇O2 and V̇CO2). In a main experiment participants (n = 28) completed the same exercise and control conditions and transcranial Doppler ultrasound showed that active and passive exercise (but not the control condition) increased CBF through the middle cerebral artery (ps <.001); albeit the magnitude was less during passive exercise. Notably, antisaccade reaction times prior to and immediately after each condition showed that active (p <.001) and passive (p =.034) exercise improved an oculomotor-based measure of executive function, whereas no benefit was observed in the control condition (p =.85). Accordingly, results evince that passive exercise ‘boosts' an oculomotor-based measure of executive function and supports convergent evidence that increased CBF mediates this benefit. |
Diksha Shukla; Matthew Heath A single bout of exercise provides a persistent benefit to cognitive flexibility Journal Article In: Research Quarterly for Exercise and Sport, vol. 93, no. 3, pp. 516–527, 2022. @article{Shukla2022,Purpose: A single bout of exercise enhances activity within the cortical networks that support executive function. It is, however, unclear whether exercise improves each core component of executive function and for how long a putative benefit might persist. Method: In Experiment 1, participants completed 20-min of aerobic exercise (via cycle ergometer) and cognitive flexibility—a core component of executive function—was examined pre-exercise, and at immediate, 30- and 60-min post-exercise assessments. Experiment 2 entailed a non-exercise control (i.e., participants sat on the ergometer without exercising) involving the same timeline of cognitive flexibility assessment. Cognitive flexibility was measured via stimulus-driven (SD) and minimally delayed (MD) saccades arranged in an AABB paradigm. SD and MD saccades require a response at target onset and after target offset, respectively, with the latter requiring executive control. Work has shown that reaction times for a SD saccade preceded by a MD saccade are longer than when a SD saccade is preceded by its same task-type, whereas the converse switch does not influence performance (i.e., the unidirectional switch-cost). Results: Experiment 1 showed a unidirectional switch-cost at each assessment; however, the switch-cost magnitude was decreased at immediate and 30-min assessments compared to the pre- and 60-min assessments. In contrast, Experiment 2 did not elicit a change in switch-cost magnitude across the different assessments. Discussion/Conclusion: Thus, a single-bout of exercise benefitted the cognitive flexibility component of executive function in the immediate and 30-min post-exercise assessments. |
Carlos Sillero‐Rejon; Osama Mahmoud; Ricardo M. Tamayo; Alvaro Arturo Clavijo‐Alvarez; Sally Adams; Olivia M. Maynard Standardised packs and larger health warnings: Visual attention and perceptions among Colombian smokers and non-smokers Journal Article In: Addiction, vol. 117, pp. 1737–1747, 2022. @article{Sillero‐Rejon2022,Aims: To measure how cigarette packaging (standardised packaging and branded packag- ing) and health warning size affect visual attention and pack preferences among Colombian smokers and non-smokers. Desig n: To explore visual attention, we used an eye-tracking experiment where non- smokers, weekly smokers and daily smokers were shown cigarette packs varying in warning size (30%-pictorial on top of the text, 30%-pictorial and text side-by-side, 50%, 70%) and packaging (standardised packaging, branded packaging). We used a discrete choice experiment (DCE) to examine the impact of warning size, packaging and brand name on preferences to try, taste perceptions and perceptions of harm. Setting: Eye-tracking laboratory, Universidad Nacional de Colombia, Bogotá, Colombia. Participants: Participants (n = 175) were 18 to 40 years old. Measurements: For the eye-tracking experiment, our primary outcome measure was the number of fixations toward the health warning compared with the branding. For the DCE, outcome measures were preferences to try, taste perceptions and harm perceptions. Findings: We observed greater visual attention to warning labels on standardised versus branded packages (F[3,167] = 22.87, P < 0.001) and when warnings were larger (F[9,161] = 147.17, P < 0.001); as warning size increased, the difference in visual attention to warnings between standardised and branded packaging decreased (F[9,161] = 4.44, P < 0.001). Non-smokers visually attended toward the warnings more than smokers, but as warning size increased these differences decreased (F[6,334] = 2.92 |
Han Tian; Tao Deng; Hongmei Yan Driving as well as on a sunny day? Predicting driver's fixation in rainy weather conditions via a dual-branch visual model Journal Article In: IEEE/CAA Journal of Automatica Sinica, vol. 9, no. 7, pp. 1335–1338, 2022. @article{Tian2022,Considering the lack of rainy driving datasets and the shortage of investigation on saliency prediction models in rainy conditions, we collected an eye tracking dataset from 30 experienced drivers, called DrFixD (rainy). Based on the multiple drivers' attention allocation dataset, we proposed a new model based on the theory of two cortical pathways to predict the salient regions of drivers in rainy weather conditions. |
A. J. Walters; A. Lithopoulos; E. M. Tennant; S. Weissman; A. E. Latimer-Cheung Exploring attention to the Canadian 24-Hour Movement Guidelines for Children and Youth using eye-tracking: A randomized control trial Journal Article In: Public Health Nursing, vol. 39, pp. 982–992, 2022. @article{Walters2022,Background: The Canadian 24-Hour Movement Guidelines for Children and Youth (“Guidelines”) not only pioneered the notion of an integrated movement continuum from sleep to vigorous-intensity physical activity but also introduced a new branded Guideline visual identity. Objectives: This study evaluated youths' (N = 46) attention to and thoughts about the Guidelines and the brand. Design: A cross-sectional between-participants randomized intervention design was used. Sample: Canadian youth between 10 and 17 years of age comprised the study sample. Interventions: Participants were randomly assigned to view either branded Guidelines (n = 26) or unbranded Guidelines (n = 20). Youths' eye-movements (e.g., dwell time, fixation count) were recorded during Guideline viewing. Participants completed a follow-up survey assessing brand perceptions and Guideline cognitions. Results: The branded Guidelines neither drew greater overall attention nor led to more positive brand perceptions or Guideline cognitions compared to the unbranded Guidelines. Conclusions: Exploratory analyses provide valuable, yet preliminary insight into how branding and Guideline content may shape how Guidelines are perceived and acted upon. These findings inform an agenda for future health education resources. |
Andi Wang; Ana Pellicer-Sánchez Incidental vocabulary learning from bilingual subtitled viewing: An eye-tracking study Journal Article In: Language Learning, vol. 72, no. 3, pp. 765–805, 2022. @article{Wang2022a,This study examined the effectiveness of bilingual subtitles relative to captions, subtitles, and no subtitles for incidental vocabulary learning. Learners' processing of novel words in the subtitles and its relationship to learning gains were also explored. While their eye movements were recorded, 112 intermediate to advanced Chinese learners of English watched a documentary in one of 4 conditions: bilingual subtitles, captions, L1 subtitles, and no subtitles. Vocabulary pretests and posttests assessed the participants' knowledge of the target vocabulary for form recognition, meaning recall, and meaning recognition. Results suggested an advantage for bilingual subtitles over captions for meaning recognition and over L1 subtitles for meaning recall. Bilingual subtitles were less effective than captions for form recognition. Participants in the bilingual subtitles group spent more time reading the Chinese translations of the target items than the English target words. The amount of attention to the English target words (but not to the translations) predicted learning gains. |
Jie Wang; Jiaming Shi; Xin Wen; Liang Xu; Ke Zhao; Fuyang Tao; Wenbiao Zhao; Xiuying Qian The effect of signal icon and persuasion strategy on warning design in online fraud Journal Article In: Computers and Security, vol. 121, pp. 1–14, 2022. @article{Wang2022d,The rapid increase in the use of mobile technology and online communication has facilitated more opportunities for social interactions as well as for online fraud. Warnings are one of the last lines of defense in transaction security. Many warnings used in anti-fraud processes are often ineffective due to habituation and the trial-and-error method used in their design. Following psychological theories of persuasion and warning design principles, in this paper, we design fourteen warnings and examine their effectiveness in an eye-tracker experiment (Study 1) and in an online A/B test on the Alipay platform (Study 2). Based on the communication-human information processing (C-HIP) model, Study 1 found that pictorial signal icons and persuasion strategies significantly improved the effectiveness of warnings. Specifically, pictorial signal icons attracted users' attention better than the conventional signal icons, and warnings with authority, social influence, diversion, questioning, and multiple strategies performed better than those without a persuasion strategy. Study 2 showed that our warnings performed better than the original Alipay warnings. The overall case rate was reduced by 33.2%, avoiding at least 30 million yuan in economic losses. Our work contributes to the field of security warning design with both theoretical and practical value and provides an important reference for future research. |
Colleen B. Ward; Jennifer E. Mack The effect of an aphasia ID card on the processing of language produced by a speaker with nonfluent aphasia Journal Article In: Journal of Communication Disorders, vol. 100, pp. 1–14, 2022. @article{Ward2022,Introduction: We tested whether aphasia self-disclosure via an aphasia ID card impacts (1) how non-aphasic listeners initially process language produced by a speaker with aphasia and (2) learning of the speaker's error patterns over time. Methods: In this eye-tracking experiment, 27 young adults followed instructions recorded by a speaker with nonfluent aphasia while viewing a target picture and a distractor. The Card group (n = 14) was shown a simulated aphasia ID card for the speaker and the No Card group (n = 13) was not. The task was divided into Pre-Observation and Post-Observation blocks. Between blocks, participants observed the speaker making semantic paraphasias. Eye-tracking analyses compared the time course of target advantage (reflecting competition from the distractor picture) and workspace advantage (reflecting attention to task) between groups and blocks. Results: Pre-Observation, the Card group had a higher target advantage than the No Card group in the post-response window (i.e., after participants had responded), indicating sustained attention to the speaker's language. Across blocks, there was evidence that the Card group (but not the No Card group) learned that the speaker makes semantic paraphasias. Conclusions: Aphasia ID cards impacted listeners' processing of language produced by a speaker with nonfluent aphasia. Increased patience and attentiveness may underlie both the Card group's sustained attention to the speaker as well as learning of the speaker's error patterns. Further research should address whether these changes impact communication success between PWA and new conversation partners. |
Taylor D. Webb; Matthew G. Wilson; Henrik Odéen; Jan Kubanek Remus: System for remote deep brain interventions Journal Article In: iScience, vol. 25, no. 11, pp. 1–13, 2022. @article{Webb2022a,Transcranial-focused ultrasound brings personalized medicine to the human brain. Ultrasound can modulate neural activity or release drugs in specific neural circuits but this personalized approach requires a system that delivers ultrasound into specified targets flexibly and on command. We developed a remote ultrasound system (Remus) that programmatically targets deep brain regions with high spatiotemporal precision and in a multi-focal manner. We validated these functions by modulating two deep brain nuclei—the left and right lateral geniculate nucleus—in a task-performing nonhuman primate. This flexible system will enable researchers and clinicians to diagnose and treat specific deep brain circuits in a noninvasive yet targeted manner, thus embodying the promise of personalized treatments of brain disorders. |
Sahar Mahdie Klim Al Zaidawi; Martin H. U. Prinzler; Jonas Lührs; Sebastian Maneth An extensive study of user identification via eye movements across multiple datasets Journal Article In: Signal Processing: Image Communication, vol. 108, pp. 1–11, 2022. @article{AlZaidawi2022,Several studies have reported that biometric identification based on eye movement characteristics can be used for authentication. This paper provides an extensive study of user identification via eye movements across multiple datasets based on an improved version of a method originally proposed by George and Routray. We analyzed our method with respect to several factors that affect the identification accuracy, such as the type of stimulus, the Identification by Velocity-Threshold (IVT) parameters (used for segmenting the trajectories into fixation and saccades), adding new features such as higher-order derivatives of eye movements, the inclusion of blink information, template aging, age and gender. We find that three methods namely selecting optimal IVT parameters, adding higher-order derivatives features and including an additional blink classifier have a positive impact on the identification accuracy. When we combine all our methods, we are able to improve the best known accuracy over the BioEye 2015 competition dataset from 86% to 96%. |
Olugbemi Aroke; Sogand Hasanzadeh; Behzad Esmaeili; Michael D. Dodd; Rebecca Brock In: Journal of Construction Engineering and Management, vol. 148, no. 6, pp. 1–16, 2022. @article{Aroke2022,This study investigated the moderating effect of personality traits in the association between worker characteristics (work experience, training, and previous injury exposure) and hazard-identification performance through mechanisms of visual attentional indicators. Through an integrated moderated mediation model, the attentional distribution, search strategy, and hazard-identification performance of participants were examined across 115 fall hazards. Results indicate that individuals with more work experience and safety training were better at hazard identification independent of visual attention and regardless of personality. Furthermore, individual differences in conscientiousness and openness personality dimensions significantly moderated the associations between (1) worker characteristics and visual attention; and (2) visual attention and hazard identification. This study provides empirical evidence for the potentially pivotal role of worker characteristics and dispositional traits with regard to hazard-identification performance on jobsites. These findings can empower safety managers to identify at-risk workers and design personalized intervention strategies to improve the hazard-identification skills of workers. |
Joe Cutting; Paul Cairns Investigating game attention using the Distraction Recognition Paradigm Journal Article In: Behaviour & Information Technology, vol. 41, no. 5, pp. 981–1001, 2022. @article{Cutting2022,Digital games are well known for holding players' attention and stopping them from being distracted by events around them. Being able to quantify how well games hold attention provides a behavioral foundation for measures of game engagement and a link to existing research on attention. We developed a new behavioral measure of how well games hold attention, based on players' post-game recognition of irrelevant distractors which are shown around the game. This is known as the Distractor Recognition Paradigm (DRP). In two studies we show that the DRP is an effective measure of how well self-paced games hold attention. We show that even simple self-paced games can hold players' attention completely and the consistency of attentional focus is moderated by game engagement. We compare the DRP to existing measures of both attention and engagement and consider how practical it is as a measure of game engagement. We find no evidence that eye tracking is a superior measure of attention to distractor recognition. We discuss existing research on attention and consider implications for areas such as motivation to play and serious games. |
Jessica Dawson; Tom Foulsham Your turn to speak? Audiovisual social attention in the lab and in the wild Journal Article In: Visual Cognition, vol. 30, no. 1-2, pp. 116–134, 2022. @article{Dawson2022,In everyday group conversations, we must decide whom to pay attention to and when. This process of dynamic social attention is important for goals both perceptual and social. The present study investigated gaze during a conversation in a realistic group and in a controlled laboratory study where third-party observers watched videos of the same group. In both contexts, we explore how gaze allocation is related to turn-taking in speech. Experimental video clips were edited to either remove the sound, freeze the video, or transition to a blank screen, allowing us to determine how shifts in attention between speakers depend on visual or auditory cues. Gaze behaviour in the real, interactive situation was similar to the fixations made by observers watching a video. Eyetracked participants often fixated the person speaking and shifted gaze in response to changes in speaker, even when sound was removed or the video freeze-framed. These findings suggest we sometimes fixate the location of speakers even when no additional visual information can be gained. Our novel approach offers both a comparison of interactive and third-party viewing and the opportunity for controlled experimental manipulations. This delivers a rich understanding of gaze behaviour and multimodal attention during a conversation following. |
Joost Winter; Jimmy Hu; Bastiaan Petermeijer Ipsilateral and contralateral warnings: Effects on decision-making and eye movements in near-collision scenarios Journal Article In: Journal on Multimodal User Interfaces, vol. 16, pp. 303–317, 2022. @article{Winter2022,Cars are increasingly capable of providing drivers with warnings and advice. However, whether drivers should be provided with ipsilateral warnings (signaling the direction to steer towards) or contralateral warnings (signaling the direction to avoid) is inconclusive. Furthermore, how auditory warnings and visual information from the driving environment together contribute to drivers' responses is relatively unexplored. In this study, 34 participants were presented with animated video clips of traffic situations on a three-lane road, while their eye movements were recorded with an eye-tracker. The videos ended with a near collision in front after 1, 3, or 6 s, while either the left or the right lane was safe to swerve into. Participants were instructed to make safe lane-change decisions by pressing the left or right arrow key. Upon the start of each video, participants heard a warning: Go Left/Right (ipsilateral), Danger Left/Right (contralateral), and nondirectional beeps (Baseline), emitted from the spatially corresponding left and right speakers. The results showed no significant differences in response times and accuracy between ipsilateral and contralateral warnings, although participants rated ipsilateral warnings as more satisfactory. Ipsilateral and contralateral warnings both improved response times in situations in which the left/right hazard was not yet manifest or was poorly visible. Participants fixated on salient and relevant vehicles as quickly as 220 ms after the trial started, with no significant differences between the audio types. In conclusion, directional warnings can aid in making a correct left/right evasive decision while not affecting the visual attention distribution. |
Yke Bauke Eisma; Dirk J. Eijssen; Joost C. F. Winter What attracts the driver's eye? Attention as a function of task and events Journal Article In: Information, vol. 13, pp. 1–15, 2022. @article{Eisma2022,This study explores how drivers of an automated vehicle distribute their attention as a function of environmental events and driving task instructions. Twenty participants were asked to monitor pre-recorded videos of a simulated driving trip while their eye movements were recorded using an eye-tracker. The results showed that eye movements are strongly situation-dependent, with areas of interest (windshield, mirrors, and dashboard) attracting attention when events (e.g., passing vehicles) occurred in those areas. Furthermore, the task instructions provided to participants (i.e., speed monitoring or hazard monitoring) affected their attention distribution in an interpretable manner. It is concluded that eye movements while supervising an automated vehicle are strongly ‘top-down', i.e., based on an expected value. The results are discussed in the context of the development of driver availability monitoring systems. |
Chelsea L. Fitzpatrick; Hyoun S. Kim; Christopher R. Sears; Daniel S. Mcgrath Attentional bias in non–smoking electronic cigarette users: An eye-tracking study Journal Article In: Nicotine and Tobacco Research, vol. 24, pp. 1439–1447, 2022. @article{Fitzpatrick2022,Introduction: This study examined attentional bias (AB) to e-cigarette cues among a sample of non–smoking daily e-cigarette users (n = 27), non–smoking occasional e-cigarette users (n = 32), and control participants (n = 61) who did not smoke or use e-cigarettes. The possibility that e-cigarette users develop a transference of cues to traditional cigarettes was also examined. Methods: AB was assessed using a free-viewing eye-gaze tracking methodology, in which participants viewed 180 pairs of images for 4 seconds (e-cigarette and neutral image, e-cigarette and smoking image, smoking and neutral image). Results: Daily and occasional e-cigarette users attended to pairs of e-cigarette and neutral images equally, whereas non–users attended to neu- tral images significantly more than e-cigarette images. All three groups attended to e-cigarette images significantly more than smoking images, with significantly larger biases for e-cigarette users. There were no between-group differences in attention to pairs of smoking and neutral images. A moderation analysis indicated that for occasional users but not daily users, years of vaping reduced the bias toward neutral images over smoking images. Conclusions: Taken together, the results indicate that the e-cigarette users exhibit heightened attention to e-cigarettes relative to non–users, which may have implications as to how they react to e-cigarette cues in real-world settings. AB for e-cigarettes did not transfer to traditional cig- arette cues, which indicates that further research is required to identify the mechanisms involved in the migration of e-cigarettes to traditional cigarettes. Implications: This study is the first attempt to examine attentional biases for e-cigarette cues among non–smoking current e-cigarette users using eye-gaze tracking. The results contribute to the growing literature on the correlates of problematic e-cigarette use and indicate that daily and occasional e-cigarette use is associated with attentional biases for e-cigarettes. The existence of attentional biases in e-cigarette users may help to explain the high rate of failure to quit e-cigarettes and provides support for the utility of attentional bias modification in the treatment of problematic e-cigarette use. Introduction |
Erin T. Gannon; Michael A. Grubb How filmmakers guide the eye: The effect of average shot length on intersubject attentional synchrony Journal Article In: Psychology of Aesthetics, Creativity, and the Arts, vol. 16, no. 1, pp. 125–134, 2022. @article{Gannon2022,As editing technology has advanced, filmmakers have become increasingly skilled at manipulating overt attention such that eye movements are highly synchronized during film viewing. Average shot length (ASL; film length/number of shots) is a quantitative metric in film studies that may help us understand this perceptual phenomenon. Since shorter shots give viewers less time to voluntarily scan images, we predicted that shorter ASLs would yield greater attentional synchrony across viewers. We recorded participants' eye movements as they viewed clips from commercially produced films with varying ASLs, and in line with our hypothesis, we found that ASL and attentional synchrony were negatively related. These findings were replicated in an independent sample of participants who viewed a different set of clips from the same films used in Experiment 1. Comparing across experiments, we found that within the same films, clips with shorter ASLs synchronized eye movements to a greater extent than did clips with longer ASLs. Studies of film perception have long implied that ASL modulates eye movements across viewers, and this study provides robust empirical evidence to support that claim. |
Mairéad Hogan; Chris Barry; Michael Lang Dissecting optional micro-decisions in online transactions: Perceptions, deceptions, and errors Journal Article In: ACM Transactions on Computer-Human Interaction, vol. 29, no. 6, pp. 1–27, 2022. @article{Hogan2022,Online firms frequently increase profit by selling optional extras. However, opt-in rates tend to be low. In response, questionable design practices have emerged to nudge consumers into inadvertent choices. Many of these design constructs are presented using an opt-out design. Using eye tracking and think-aloud data techniques, this research investigates the impact of the framing and optionality of micro-decisions on user perceptions and error rates. Focusing on opt-out decisions, the study found: up to one in three users make errors in decision-making; there is a higher error rate for rejection-framed opt-out decisions; users widely misinterpret decision framing; and failure to read decision text results in rushed and unsighted decisions, even leading users to automatically construe un-ticked checkboxes as opt-in decisions. In talking afterwards about their experiences, users expressed strong negative emotions, feeling confused, manipulated and resentful. Many suggested they would, in practice, steer away from similar encounters toward more unambiguous and honest sites. These findings might alert managers and developers, tempted to use dark patterns, that such a strategy might backfire over time. |
Luke Hsiao; Brooke Krajancich; Philip Levis; Gordon Wetzstein; Keith Winstein Towards retina-quality VR video streaming: 15 ms Could Save You 80% of Your Bandwidth Journal Article In: Computer Communication Review, vol. 52, no. 1, pp. 10–19, 2022. @article{Hsiao2022a,Virtual reality systems today cannot yet stream immersive, retina-quality virtual reality video over a network. One of the greatest challenges to this goal is the sheer data rates required to transmit retina-quality video frames at high resolutions and frame rates. Recent work has leveraged the decay of visual acuity in human perception in novel gaze-contingent video compression techniques. In this paper, we show that reducing the motion-to-photon latency of a system itself is a key method for improving the compression ratio of gaze-contingent compression. Our key finding is that a client and streaming server system with sub-15ms latency can achieve 5x better compression than traditional techniques while also using simpler software algorithms than previous work. |
Fatemeh Jam; Hamid Reza Azemati; Abdulhamid Ghanbaran; Jamal Esmaily; Reza Ebrahimpour The role of expertise in visual exploration and aesthetic judgment of residential building façades: An eye-tracking study Journal Article In: Psychology of Aesthetics, Creativity, and the Arts, vol. 16, no. 1, pp. 148–163, 2022. @article{Jam2022,The building façade has considerable effects on the aesthetic experience of observers. However, the experience may differ depending on the observers' expertise. This study was conducted to explore the impact of expertise on preference, visual exploration, and cognitive experience during the aesthetic judgment of designed façades. For this purpose, we developed a paradigm in two separate parts: aesthetic judgment (AJ) and eye movement recording (EMR). Thirty-eight participants participated in this experiment in two groups (21 experts/17 nonexperts). The results revealed significant differences between the two groups in terms of the type and number of preferred façades, as well as eye movement indicators. In addition, based on judgment reaction time and fixation duration as proxy measures of cognitive experience, it was found that expertise might be correlated with cognitive load and task demand. The findings indicate the importance of façades for both groups and suggest that their physical attributes could be effectively manipulated to impact aesthetic experiences in relation to architectural designs. |
Lewis T. Jayes; Gemma Fitzsimmons; Mark J. Weal; Johanna K. Kaakinen; Denis Drieghe The impact of hyperlinks, skim reading and perceived importance when reading on the Web Journal Article In: PLoS ONE, vol. 17, no. 2, pp. 1–28, 2022. @article{Jayes2022,It has previously been shown that readers spend a great deal of time skim reading on the Web and that this type of reading can affect comprehension of text. Across two experiments, we examine how hyperlinks influence perceived importance of sentences and how perceived importance in turn affects reading behaviour. In Experiment 1, participants rated the importance of sentences across passages of Wikipedia text. In Experiment 2, a different set of participants read these passages while their eye movements were tracked, with the task being either reading for comprehension or skim reading. Reading times of sentences were analysed in relation to the type of task and the importance ratings from Experiment 1. Results from Experiment 1 show readers rated sentences without hyperlinks as being of less importance than sentences that did feature hyperlinks, and this effect is larger when sentences are lower on the page. It was also found that short sentences with more links were rated as more important, but only when they were presented at the top of the page. Long sentences with more links were rated as more important regardless of their position on the page. In Experiment 2, higher importance scores resulted in longer sentence reading times, measured as fixation durations. When skim reading, however, importance ratings had a lesser impact on online reading behaviour than when reading for comprehension. We suggest readers are less able to establish the importance of a sentence when skim reading, even though importance could have been assessed by information that would be fairly easy to extract (i.e. presence of hyperlinks, length of sentences, and position on the screen). |