Tonic dopamine, uncertainty and basal ganglia action selection

Tom Gilbertson (Lead / Corresponding author), Douglas Steele

Research output: Contribution to journalArticlepeer-review

Abstract

To make optimal decisions in uncertain circumstances flexible adaption of behaviour is required; exploring alternatives when the best choice is unknown, exploiting what is known when that is best. Using a computational model of the basal ganglia, we propose that switches between exploratory and exploitative decisions are mediated by the interaction between tonic dopamine and cortical input to the basal ganglia. We show that a biologically detailed action selection circuit model, endowed with dopamine dependant striatal plasticity, can optimally solve the explore–exploit problem, estimating the true underlying state of a noisy Gaussian diffusion process. Critical to the model's performance was a fluctuating level of tonic dopamine which increased under conditions of uncertainty. With an optimal range of tonic dopamine, explore–exploit decisions were mediated by the effects of tonic dopamine on the precision of the model action selection mechanism. Under conditions of uncertain reward pay-out, the model's reduced selectivity allowed disinhibition of multiple alternative actions to be explored at random. Conversely, when uncertainly about reward pay-out was low, enhanced selectivity of the action selection circuit facilitated exploitation of the high value choice. Model performance was at the level of a Kalman filter which provides an optimal solution for the task. These simulations support the idea that this subcortical neural circuit may have evolved to facilitate decision making in non-stationary reward environments. The model generates several experimental predictions with relevance to abnormal decision making in neuropsychiatric and neurological disease.

Original languageEnglish
Pages (from-to)109-124
Number of pages16
JournalNeuroscience
Volume466
Early online date17 May 2021
DOIs
Publication statusPublished - 1 Jul 2021

Keywords

  • action selection
  • basal ganglia
  • decision making
  • dopamine
  • reward prediction error signal

Fingerprint

Dive into the research topics of 'Tonic dopamine, uncertainty and basal ganglia action selection'. Together they form a unique fingerprint.

Cite this