CASE STUDY: The Effects of Emotional Films and Subtitle Types on Eye Movement Patterns
Have you ever wondered where your eyes go when watching a subtitled movie? Do you focus mainly on reading the text, or does the emotional intensity of the scene sometimes pull your gaze away from the subtitles? In a study published in Acta Psychologica, researchers Yun-Jhen Lu, I-Chun Kuo, and Ming-Chou Ho set out to answer these questions by investigating how both subtitle availability and film emotions shape our visual processing.
Eye Tracking Emotional Films with Subtitles
The team designed a study testing 225 native Taiwanese Mandarin speakers across 15 different viewing conditions. Participants watched 3.5-minute film clips representing five distinct emotional states—happy, sad, angry, fearful, or neutral—under one of three subtitle conditions:
- Meaningful Subtitles: Written in native Taiwanese Mandarin.
- Meaningless Subtitles: Written in Nepali (a script unreadable to the participants).
- No Subtitles: Video playback without any text.
To record eye movements with pinpoint precision, the researchers used an EyeLink 1000 desktop mount system, sampling gaze at 500 Hz. The EyeLink 1000 enabled the researchers to define a precise Area of Interest (AI) around the subtitle region (3.0° high by 37.6° wide).
Language Comprehension and Emotion Affect Gaze
The eye tracking data revealed two major insights into human attention:
- Language Drives Attention (Top-Down): Viewers logged significantly longer dwell times and higher fixation counts on meaningful Mandarin subtitles than on meaningless Nepali or absent subtitles. This confirms that top-down language comprehension—rather than just text popping up on screen—is the primary engine driving subtitle gaze.
- Emotion Alters Gaze (Emotion Regulation): Film emotion significantly altered how much attention viewers paid to the subtitle space. Viewers spent significantly more time looking at the subtitle area during sad and fearful films compared to happy or neutral films. The authors suggest that when viewing distressing content, audiences implicitly divert their gaze toward the bottom subtitle region as a subtle emotion-regulation strategy
The Takeaway—Subtitle Reading is Complex
By using high-precision EyeLink technology to record gaze while participants watched videos, this research demonstrates that looking at subtitles is not just an automatic reading habit. It is a dynamic cognitive process governed by both language comprehension and emotional regulation.
有关眼动追踪如何帮助您的研究的信息，请查看我们的解决方案和产品页面或联系我们。我们很乐意为您提供帮助！