Neural Index of Reinforcement Learning Predicts Improved Stimulus–Response Retention under High Working Memory Load

Rachel Rac-Lubashevsky, Anna Cremer, Anne G.E. Collins, Michael J. Frank, Lars Schwabe

Research output: Contribution to journalArticlepeer-review

3 Scopus citations

Abstract

Human learning and decision-making are supported by multiple systems operating in parallel. Recent studies isolating the contributions of reinforcement learning (RL) and working memory (WM) have revealed a trade-off between the two. An interactive WM/RL computational model predicts that although high WM load slows behavioral acquisition, it also induces larger prediction errors in the RL system that enhance robustness and retention of learned behaviors. Here, we tested this account by parametrically manipulating WM load during RL in conjunction with EEG in both male and female participants and administered two surprise memory tests. We further leveraged single-trial decoding of EEG signatures of RL and WM to determine whether their interaction predicted robust retention. Consistent with the model, behavioral learning was slower for associations acquired under higher load but showed parametrically improved future retention. This paradoxical result was mirrored by EEG indices of RL, which were strengthened under higher WM loads and predictive of more robust future behavioral retention of learned stimulus–response contingencies. We further tested whether stress alters the ability to shift between the two systems strategically to maximize immediate learning versus retention of information and found that induced stress had only a limited effect on this trade-off. The present results offer a deeper understanding of the cooperative interaction between WM and RL and show that relying on WM can benefit the rapid acquisition of choice behavior during learning but impairs retention.

Original languageEnglish
Pages (from-to)3131-3143
Number of pages13
JournalJournal of Neuroscience
Volume43
Issue number17
DOIs
StatePublished - 26 Apr 2023
Externally publishedYes

Keywords

  • EEG
  • reinforcement learning
  • retention
  • stress
  • working memory

ASJC Scopus subject areas

  • General Neuroscience

Fingerprint

Dive into the research topics of 'Neural Index of Reinforcement Learning Predicts Improved Stimulus–Response Retention under High Working Memory Load'. Together they form a unique fingerprint.

Cite this