Discrete coding of reward probability and uncertainty by dopamine neurons

Science. 2003 Mar 21;299(5614):1898-902. doi: 10.1126/science.1077349.

Abstract

Uncertainty is critical in the measure of information and in assessing the accuracy of predictions. It is determined by probability P, being maximal at P = 0.5 and decreasing at higher and lower probabilities. Using distinct stimuli to indicate the probability of reward, we found that the phasic activation of dopamine neurons varied monotonically across the full range of probabilities, supporting past claims that this response codes the discrepancy between predicted and actual reward. In contrast, a previously unobserved response covaried with uncertainty and consisted of a gradual increase in activity until the potential time of reward. The coding of uncertainty suggests a possible role for dopamine signals in attention-based learning and risk-taking behavior.

MeSH terms

  • Animals
  • Attention
  • Conditioning, Classical
  • Discrimination, Psychological
  • Dopamine / physiology*
  • Electrophysiology
  • Female
  • Learning
  • Linear Models
  • Macaca fascicularis
  • Mesencephalon / cytology
  • Mesencephalon / physiology*
  • Motivation
  • Neurons / physiology*
  • Photic Stimulation
  • Probability
  • Reinforcement, Psychology
  • Reward*
  • Risk-Taking
  • Uncertainty*

Substances

  • Dopamine