• Skip to main content
  • Skip to header right navigation
  • Skip to site footer
Fast, Accurate, Reliable Eye Tracking

Fast, Accurate, Reliable Eye Tracking

  • Hardware
    • EyeLink 1000 Plus
    • EyeLink Portable Duo
    • fMRI and MEG Systems
    • EyeLink II
    • Hardware Integration
  • Software
    • Experiment Builder
    • Data Viewer
    • WebLink
    • Software Integration
    • E-Prime Extensions
    • Purchase Licenses
  • Solutions
    • Reading and Language
    • Developmental
    • fMRI and MEG
    • EEG and fNIRS
    • Clinical and Oculomotor
    • Cognitive
    • Usability and Applied
    • Non Human Primate
  • Support
    • Forum
    • Resources
    • Useful Apps
    • Training
  • About
    • About Us
    • EyeLink Publications
    • Events
    • Manufacturing
    • Careers
    • About Eye Tracking
    • Newsletter
  • Blog
  • Contact
  • 简体中文
eye tracking research

Cognitive Load, Working Memory and Pupil Size

Working Memory and Cognitive Load

Estimated reading time: 12 minutes

John Sweller developed cognitive load theory in the late 1980s to explain how a task’s difficulty level can affect our ability to process and store material in long-term memory. Cognitive load theory relies heavily on the concept of “working memory,” a short-term storage system that is limited not only by how much information it can hold, but also for how long. Tasks with a high cognitive load can exhaust working memory capacity and consequently affect performance on any concurrent task that is performed.

In order to measure a task’s “cognitive load,” researchers have traditionally used both subjective ratings of task difficulty and objective measures such as performance on a secondary task. In recent years, researchers have also explored the extent to which changes in pupil size can provide an index of cognitive load.

This blog provides a broad overview of the connectivity between working memory, cognitive load, and pupil size. If you are interested in a particular section, here are the quick jumps:

  • Working Memory
    • Atkinson and Shiffrin (1968)
    • Baddeley and Hitch (1974, 2000)
  • Cognitive Load – Sweller (1988, 1994, 1998)
    • Cognitive Load Source
  • Measures of Cognitive Load
    • Pupil Size and Cognitive Load: Historical Research
    • Pupil Size and Cognitive Load: Recent Research

Working Memory

The term “working memory” was first used by George Miller, Eugene Galanter, and Karl Pribram in 1960 to describe planning behavior. They conceptualized a “working memory” system that can hold a plan, multiple plans, or components of a plan as well as arrange a plan’s execution. A few years later, Richard Atkinson and Richard Shiffrin used the term “working memory” to describe a unitary short-term memory store in their highly influential information-processing paper. Soon after, Alan Baddeley and Hitch developed a multimodal model of immediate temporary memory, calling it “working memory” in order “to stress that its role went beyond simple storage” and to emphasize its involvement in general cognition including language comprehension, learning, and reasoning.

The working memory model remains a useful framework for describing complex cognition and has been used as a building block for theories, including John Sweller’s Cognitive Load theory. Before going into Cognitive Load theory, we take a look at a couple of the early working memory models.

Atkinson and Shiffrin (1968)

Historically, Richard Atkinson and Richard Shiffrin used “working memory” to describe their short-term store in their 1968 paper on information processing (illustrated below). Atkinson and Shiffrin argued that information from the world enters a sensory register for a brief period of time only to decay or be lost unless the information passes on to a short-term store, or perhaps directly to a long-term store – a fairly permanent memory. The short-term store holds a limited amount of information for 15-30 seconds, longer with rehearsal, and acts as a “working memory” necessary for retrieval of content from the long-term store, learning, and other tasks.

Atkinson and Shiffrin (1968) Model of Memory
Atkinson and Shiffrin (1968) Model of Memory

This unitary concept of working memory came under question when patients with a specific short-term memory deficit were shown to be able to learn and live regular lives, rather than suffer profound difficulties with long-term memory retrieval or learning. Alan Baddeley and Graham Hitch argued that in such patients only a portion of short-term memory was damaged (the ability to store verbal/acoustic information). To explain this, and other results that were difficult to accommodate within a model of memory containing a unitary short-term store, Baddeley and Hitch proposed a three-component model of working memory.

Baddeley and Hitch (1974, 2000)

This multi-component model (illustration below) includes a central executive – an attentional control system – supported by two short-term storage systems: the visuo-spatial sketchpad for the manipulation of visual images and a phonological loop for the rehearsal of verbal-acoustic material. Baddeley and Hitch assumed that the brain-damaged patients mentioned above had damage to the phonological loop.

Baddeley and Hitch (1974) – Working Memory
Baddeley and Hitch (1974) – Working Memory

An update of the multi-component working memory model added a fourth component, the episodic buffer (see image below). This new buffer binds information from the phonological loop and the visuospatial sketchpad in working memory as well as long-term memory into a unitary, multi-dimensional representation. As expected, given the nature of working memory, the episodic buffer is capacity-limited and temporary. However, it requires conscious awareness to function, in other words, intention. This model differs from the initial model in this very aspect – the focus is on attention integrating information from the subsystems rather than in the isolation of the phonological loop and the visuospatial sketchpad. According, to Badelley allows for the model to tackle “more complex aspects of executive control in working memory.”

Working Memory - Baddeley 2000
Baddeley (2000) – Working Memory

As evident, even at the inception of working memory, new research resulted in variations of the concept and the number of competing models has only increased with time. However, the general consensus, even across cognitive domains, is that working memory is limited in resources and is involved in retaining and manipulating information for successful task completion.

Cognitive Load – Sweller (1988, 1994, 1998)

John Sweller introduced the term cognitive load to explain the distribution of cognitive resources during learning and problem-solving. The emphasis of cognitive load theory (1988, 1994, 1998) is on the limitations of working memory. Rather than attaching himself to a specific conceptualization of working memory, John Sweller came from the general perspective that this short-term storage is limited in capacity with partially independent sub-components to hold auditory and visual information, familiar concepts from Baddeley and Hitch’s model.

Keep in mind that John Sweller is an educational psychologist. Consequently, his theory, examples, and research are geared toward learning and teaching effectively. Generally, during learning, a person extracts and manipulates information in working memory before storing that information in a schema in long-term memory. Schemas are knowledge structures of everything around us, including math concepts, events, places, objects, music, and people. Thus, creating an effective schema is an end goal.

Cognitive Load Sources

Sweller argues that when learning or problem-solving, cognitive load can come from three sources:

  • Intrinsic Cognitive Load – The material’s inherent complexity, which cannot be changed
  • Extraneous Cognitive Load – Unnecessary load introduced by, for example, poor instruction
  • Germane Cognitive Load – The effort to construct schemas or activities required to learn the material

To produce successful learning outcomes, one must use effective teaching methods (i.e., decrease the extraneous cognitive load) and direct their mental resources to learn the material (i.e., increase germane cognitive load). In essence, learning and transfer to long-term memory will suffer if the cognitive load becomes too high in working memory.

Cognitive Load - Sweller
Cognitive Load – John Sweller, Jeroen van Merrienboer and Fred Paas (1998)

Measures of Cognitive Load

There are a number of ways in which cognitive load can be measured, including subjective self-report scales as well as more objective measures. For these self-report measures, participants rate the mental effort or task difficulty on a continuous scale from, say, very low (1) to very high (9). These ratings are then compared to performance on a task, with the more effortful or difficult task expected to result in poorer performance because of the increased cognitive load.

In contrast, objective measures focus solely on performance or physiological responses. For example, dual-task load measures require a person to perform two tasks simultaneously. The assumption is that when a learning task increases in cognitive load, performance for the second task will drop.

There are also a number of physiological measures that have been used as indicators of cognitive load including pupil diameter, with pupil size increasing as a function of cognitive load level.

In the past, deriving an accurate measure of pupil size was a complex and painstaking task. Nowadays, researchers interested in measuring pupil size (and its relationship with cognitive load) often use video-based eye trackers, which can automatically provide many hundreds of pupil size measurements per second.

Bear in mind that a large number of factors can affect pupil size, including something as simple as light. For an excellent overview of pupillometry and eye-tracking, check out this pupillometry post.

Pupil Size and Cognitive Load: Historical Research

The use of pupil diameter as an index of mental activity pre-dates John Swellers’ cognitive load theory. Eckhard Hess and James Polt suggested in the 1960s that pupil diameter increased with the difficulty of multiplication problems. Although subsequent researchers have criticized Eckhard Hess’ experiments, the fundamental result showing the effect of difficulty level on pupil size has been repeated across research domains. Further, a recent study replicated Eckhard Hess and James Polt’s multiplication experiment, and it is now widely accepted that increased mental effort is associated with increased pupil diameter.

In another paper in the 1960s, Daniel Kahneman and Jackson Beatty showed that the more digits participants were required to store in working memory, the larger their pupil diameters. They also noted that pupil diameter decreased when reporting the number or if the capacity of working memory was exceeded. They concluded, “pupillary diameter provides a very effective index of the momentary load on a subject as he performs a mental task.”

Pupil Size and Cognitive Load: Recent Research

More recently, researchers have provided a validity check of cognitive load measures. Szulewezki and colleagues simultaneously measured subjective ratings of difficulty and pupil size while participants answered multiple-choice and arithmetic questions. They found that both pupil diameter and a self-report measure of mental effort were higher for the more difficult questions as well as incorrectly answered questions, suggesting that both are examining the same concept.

While much research continues to investigate the role of cognitive load on learning, with studies testing the interaction between pupil dilation and typical learning contexts such as doing math questions or looking at diagrams, researchers are also starting to explore the impact of more recent technology. For example, Dami Huh and his colleagues measured pupil size during an entire math video lecture and found that the more difficult parts of the lecture were associated with larger pupil dilations.

In the future, it may even be possible to develop technology that monitors a learner’s eye movements while they engage with learning materials and uses pupil size as an index of cognitive load. With information about where the person is looking and cognitive load, an adaptive system could adjust intrinsic load, reduce extraneous load, and facilitate germane load to enhance online learning. For more information on pupillometry, we have a list of peer-reviewed publications that have used EyeLink eye trackers to measure pupil size.

Contact

If you would like us to feature your EyeLink research, have ideas for posts, or have any questions about our hardware and software, please contact us. We are always happy to help. You can call us (+1-613-271-8686) or click the button below to email:

Get in Touch

References & Image Credits

Atkinson, R. C., & Shiffrin, R. M. (1968). Human memory: A proposed system and its control processes. Psychology of Learning and Motivation, 89–195. https://doi.org/10.1016/s0079-7421(08)60422-3

Baddeley, A. (2010). Working memory. Current Biology, 20(4). https://doi.org/10.1016/j.cub.2009.12.014

Baddeley, A. (2000). The episodic buffer: a new component of working memory? Trends in Cognitive Sciences, 4(11), 417–423. https://doi.org/10.1016/s1364-6613(00)01538-2

Baddeley, A. D., & Hitch, G. (1974). Working memory. Psychology of Learning and Motivation, 8(1), 47–89. https://doi.org/10.1016/s0079-7421(08)60452-1

de Winter, J. C. F., Petermeijer, S. M., Kooijman, L., & Dodou, D. (2021). Replicating five pupillometry studies of Eckhard Hess. International Journal of Psychophysiology, 165, 145–205. https://doi.org/10.1016/j.ijpsycho.2021.03.003

DeLeeuw, K. E., & Mayer, R. E. (2008). A comparison of three measures of cognitive load: Evidence for separable measures of intrinsic, extraneous, and germane load. Journal of Educational Psychology, 100(1), 223–234. https://doi.org/10.1037/0022-0663.100.1.223

Hess, E. H., & Polt, J. M. (1964). Pupil size in relation to mental activity during simple problem-solving. Science, 143(3611), 1190–1192. https://doi.org/10.1126/science.143.3611.1190

Huh, D., Kim, J. H., & Jo, I. H. (2019). A novel method to monitoring changes in cognitive load in video‐based learning. Journal of Computer Assisted Learning, 35(6), 721–730. https://doi.org/10.1111/jcal.12378

Kahneman D, Beatty J. Pupillary diameter and load on memory. Science. 1966; 154:1583–1585. https://doi.org/10.1126/science.154.3756.1583

Karch, J. M., García Valles, J. C., & Sevian, H. (2019). Looking into the black box: Using gaze and pupillometric data to probe how cognitive load changes with mental tasks. Journal of Chemical Education, 96(5), 830–840. https://doi.org/10.1021/acs.jchemed.9b0001

Krejtz, K., Duchowski, A. T., Niedzielska, A., Biele, C., & Krejtz, I. (2018). Eye tracking cognitive load using pupil diameter and microsaccades with fixed gaze. PLOS ONE, 13(9). https://doi.org/10.1371/journal.pone.0203629

Miller, G. A., Galanter, E., & Pribram, K. H. (1960). Plans and the structure of behavior. Henry Holt and Co. https://doi.org/10.1037/10039-000

Paas, F. G., & Van Merriënboer, J. J. (1994). Variability of worked examples and transfer of geometrical problem-solving skills: A cognitive-load approach. Journal of Educational Psychology, 86(1), 122–133. https://doi.org/10.1037/0022-0663.86.1.122

Park, B., & Brünken, R. (2014). The rhythm method: A new method for measuring cognitive load-an experimental dual-task study. Applied Cognitive Psychology, 29(2), 232–243. https://doi.org/10.1002/acp.3100

Shallice, T., & Warrington, E. K. (1970). Independent functioning of verbal memory stores: A neuropsychological study. Quarterly Journal of Experimental Psychology, 22, 261–273. https://doi.org/10.1080/00335557043000203

Sweller, J. (1988). Cognitive load during problem solving: Effects on learning. Cognitive Science, 12(2), 257–285. https://doi.org/10.1207/s15516709cog1202_4

Sweller, J. (1994). Cognitive load theory, learning difficulty, and instructional design. Learning and Instruction, 4(4), 295–312. https://doi.org/10.1016/0959-4752(94)90003-5

Sweller, J., van Merrienboer, J.J.G. & Paas, F.G.W.C. (1998). Cognitive architecture and instructional design. Educational Psychology Review 10, 251–296. https://doi.org/10.1023/A:1022193728205

‌Szulewski, A., Gegenfurtner, A., Howes, D. W., Sivilotti, M. L. A., & van Merriënboer, J. J. G. (2016). Measuring physician cognitive load: validity evidence for a physiologic and a psychometric tool. Advances in Health Sciences Education, 22(4), 951–968. https://doi.org/10.1007/s10459-016-9725-2

Van Gerven, P. W., Paas, F., Van Merriënboer, J. J., & Schmidt, H. G. (2003). Memory load and the cognitive pupillary response in aging. Psychophysiology, 41(2), 167–174. https://doi.org/10.1111/j.1469-8986.2003.00148.x

Zu, T., Hutson, J., Loschky, L. C., & Rebello, N. S. (2020). Using eye movements to measure intrinsic, extraneous, and germane load in a multimedia learning environment. Journal of Educational Psychology, 112(7), 1338–1352. https://doi.org/10.1037/edu0000441

1. Header Photo: Original Image by Gerd Altmann (Pixabay License)

2. Cognitive Load Image: Original Image by Colleen ODell (Pixabay License) Adjust by Ljiljana Velisavljevic

Read More

Previous Post:Reading Profiles of Adults with DyslexiaReading Profile of Adults with Dyslexia
Next Post:How to Tell if Someone is LyingHow to Tell Someone Is Lying

About Ljiljana Velisavljevic

Lily’s first experience with an eye tracker was in the 1990s with the shiny, sleek, and ultra-modern EyeLink I. Now, she spends her time at SR Research creating software icons and marketing material for the EyeLinks, trying in vain to avoid social media, designing and creating content for the website including writing scientific articles, and more. With a PhD in Psychology, specializing in Brain, Behaviour, and Cognition, and an MSc in Educational Psychology, Lily gravitates toward eye-tracking research involving memory, cognition, vision, and education.

Let’s Keep in Touch

  • Twitter
  • Facebook
  • Instagram
  • LinkedIn
  • YouTube
Newsletter
Newsletter Archive
Conferences

Contact

info@sr-research.com

Phone: +1-613-271-8686

Toll Free: +1-866-821-0731

Fax: +1-613-482-4866

Quick Links

Products

Solutions

Support Forum

Legal

Legal Notice

Privacy Policy | Accessibility Policy

EyeLink® eye trackers are intended for research purposes only and should not be used in the treatment or diagnosis of any medical condition.

Featured Blog

How to Tell Someone Is Lying

How to Tell if Someone is Lying


Copyright © 2023 · SR Research Ltd. All Rights Reserved. EyeLink is a registered trademark of SR Research Ltd.