Predictive coding of the statistical parameters of uncertain rewards by orbitofrontal neurons.

Martin O'Neill, Wolfram Schultz
Author Information
  1. Martin O'Neill: Department of Experimental Psychology, University of Oxford, Tinsley Building, Mansfield Road, Oxford, OX1 3TA, UK. Electronic address: oneillmartin007@gmail.com.
  2. Wolfram Schultz: Department of Physiology, Development and Neuroscience, University of Cambridge, Downing Street, Cambridge, CB2 3EG, UK. Electronic address: ws234@cam.ac.uk.

Abstract

Uncertain reward outcomes are characterised by statistical parameters that capture the numerical values of the underlying probability distributions of reward values, including the expected value, risk (variance) and probability. Here we show coding of an integrated expected value signal by single orbitofrontal neurons in response to visual cues predicting uncertain rewards. Separate subpopulations of orbitofrontal neurons predominantly code the prediction of one statistical parameter with few neurons showing combined coding. These signals are likely combined with subjective value signals to inform learning and decision making under conditions of uncertainty.

Keywords

References

  1. J Neurosci. 2008 Nov 5;28(45):11703-11 [PMID: 18987206]
  2. J Neurosci. 2004 Nov 10;24(45):10047-56 [PMID: 15537873]
  3. Nat Neurosci. 2013 Jun;16(6):756-62 [PMID: 23666181]
  4. J Neurosci. 2014 Feb 26;34(9):3279-90 [PMID: 24573287]
  5. Elife. 2016 Oct 27;5: [PMID: 27787196]
  6. J Neurosci. 2009 Jul 15;29(28):8965-76 [PMID: 19605634]
  7. J Neurosci. 2015 Feb 18;35(7):3146-54 [PMID: 25698750]
  8. Curr Biol. 2014 Nov 3;24(21):2491-500 [PMID: 25283778]
  9. J Cogn Neurosci. 2009 Jun;21(6):1162-78 [PMID: 18752411]
  10. Cereb Cortex. 2006 Jul;16(7):1040-55 [PMID: 16207931]
  11. Neuron. 2010 Nov 18;68(4):789-800 [PMID: 21092866]
  12. Nature. 2006 May 11;441(7090):223-6 [PMID: 16633341]
  13. J Neurosci. 2013 Oct 2;33(40):15810-4 [PMID: 24089488]
  14. J Physiol Paris. 2015 Feb-Jun;109(1-3):70-7 [PMID: 24954027]
  15. J Neurophysiol. 2009 Aug;102(2):645-7 [PMID: 19515950]
  16. J Neurophysiol. 2010 Mar;103(3):1158-70 [PMID: 20032233]
  17. Nat Neurosci. 2005 Sep;8(9):1220-7 [PMID: 16116449]
  18. J Neurosci. 2014 Aug 27;34(35):11583-603 [PMID: 25164656]
  19. J Neurosci. 2010 Aug 25;30(34):11447-57 [PMID: 20739566]
  20. J Neurophysiol. 2010 Nov;104(5):2634-53 [PMID: 20739596]
  21. Nature. 2008 Sep 11;455(7210):227-31 [PMID: 18690210]
  22. Nat Neurosci. 2009 Jan;12(1):77-84 [PMID: 19043410]
  23. J Neurosci. 2009 Feb 18;29(7):2231-7 [PMID: 19228976]
  24. Science. 2003 Mar 21;299(5614):1898-902 [PMID: 12649484]
  25. J Neurophysiol. 2009 Feb;101(2):758-72 [PMID: 19052110]
  26. Science. 2004 Jun 18;304(5678):1782-7 [PMID: 15205529]
  27. Proc Natl Acad Sci U S A. 2014 Feb 11;111(6):2343-8 [PMID: 24453218]
  28. Nature. 1999 Jul 15;400(6741):233-8 [PMID: 10421364]
  29. Nat Neurosci. 2011 Oct 30;14(12):1581-9 [PMID: 22037498]
  30. Nat Neurosci. 2016 Jul;19(7):973-80 [PMID: 27273768]

Grants

  1. /Wellcome Trust
  2. 204811/Z/16/Z/Wellcome Trust
  3. G0001354/Medical Research Council
  4. G1000183/Medical Research Council

MeSH Term

Animals
Anticipation, Psychological
Cues
Macaca mulatta
Male
Models, Statistical
Neurons
Prefrontal Cortex
Reward
Saccades
Uncertainty
Visual Perception

Word Cloud

Created with Highcharts 10.0.0valueneuronsstatisticalprobabilitycodingorbitofrontalrewardparametersvaluesexpecteduncertainrewardscombinedsignalsRewardUncertainoutcomescharacterisedcapturenumericalunderlyingdistributionsincludingriskvarianceshowintegratedsignalsingleresponsevisualcuespredictingSeparatesubpopulationspredominantlycodepredictiononeparametershowinglikelysubjectiveinformlearningdecisionmakingconditionsuncertaintyPredictiveExpectedOrbitofrontalcortexRiskValue

Similar Articles

Cited By