Neuronal distortions of reward probability without choice.

Philippe N Tobler, George I Christopoulos, John P O'Doherty, Raymond J Dolan, Wolfram Schultz
Author Information
  1. Philippe N Tobler: Department of Physiology, Development and Neuroscience, University of Cambridge, Cambridge, United Kingdom. pnt21@cam.ac.uk

Abstract

Reward probability crucially determines the value of outcomes. A basic phenomenon, defying explanation by traditional decision theories, is that people often overweigh small and underweigh large probabilities in choices under uncertainty. However, the neuronal basis of such reward probability distortions and their position in the decision process are largely unknown. We assessed individual probability distortions with behavioral pleasantness ratings and brain imaging in the absence of choice. Dorsolateral frontal cortex regions showed experience dependent overweighting of small, and underweighting of large, probabilities whereas ventral frontal regions showed the opposite pattern. These results demonstrate distorted neuronal coding of reward probabilities in the absence of choice, stress the importance of experience with probabilistic outcomes and contrast with linear probability coding in the striatum. Input of the distorted probability estimations to decision-making mechanisms are likely to contribute to well known inconsistencies in preferences formalized in theories of behavioral economics.

References

  1. Nat Neurosci. 1999 Feb;2(2):176-85 [PMID: 10195203]
  2. Nature. 2004 Oct 14;431(7010):859-62 [PMID: 15483614]
  3. Neuropsychologia. 2008 Jan 15;46(1):213-23 [PMID: 17854845]
  4. J Neurosci. 2005 Feb 2;25(5):1203-10 [PMID: 15689557]
  5. J Exp Psychol Gen. 2002 Jun;131(2):287-97 [PMID: 12049245]
  6. Neuron. 2006 Sep 21;51(6):861-70 [PMID: 16982429]
  7. Nat Neurosci. 2004 Apr;7(4):404-10 [PMID: 15004564]
  8. Behav Brain Res. 2003 Nov 30;146(1-2):145-57 [PMID: 14643467]
  9. Neuron. 1998 Dec;21(6):1399-407 [PMID: 9883732]
  10. Philos Trans R Soc Lond B Biol Sci. 1999 Jul 29;354(1387):1215-28 [PMID: 10466147]
  11. Psychol Sci. 2004 Aug;15(8):534-9 [PMID: 15270998]
  12. Neuroimage. 2006 Jun;31(2):790-5 [PMID: 16487726]
  13. J Neurophysiol. 2002 Mar;87(3):1488-98 [PMID: 11877521]
  14. Cereb Cortex. 2005 Jan;15(1):58-63 [PMID: 15217900]
  15. Proc Natl Acad Sci U S A. 2005 Jan 18;102(3):945-8 [PMID: 15634739]
  16. Proc Natl Acad Sci U S A. 2006 Jun 27;103(26):10023-8 [PMID: 16785427]
  17. J Neurosci. 1997 Jun 15;17(12):4829-38 [PMID: 9169541]
  18. Nat Neurosci. 2006 Mar;9(3):429-34 [PMID: 16462737]
  19. J Neurosci. 2006 Sep 13;26(37):9530-7 [PMID: 16971537]
  20. Neuron. 2004 Dec 2;44(5):877-88 [PMID: 15572117]
  21. Brain. 2000 Nov;123 ( Pt 11):2189-202 [PMID: 11050020]
  22. Trends Neurosci. 2000 Oct;23(10):475-83 [PMID: 11006464]
  23. Nature. 2006 May 11;441(7090):223-6 [PMID: 16633341]
  24. Nat Neurosci. 2000 May;3(5):516-20 [PMID: 10769394]
  25. Neuron. 2006 Aug 3;51(3):381-90 [PMID: 16880132]
  26. Brain Cogn. 2004 Jun;55(1):11-29 [PMID: 15134840]
  27. Neuroimage. 2006 Apr 1;30(2):668-77 [PMID: 16321546]
  28. Hum Brain Mapp. 1997;5(5):329-40 [PMID: 20408237]
  29. J Cogn Neurosci. 2004 Apr;16(3):463-78 [PMID: 15072681]
  30. Nat Neurosci. 2006 Sep;9(9):1161-8 [PMID: 16921368]
  31. Cogn Psychol. 1999 Feb;38(1):129-66 [PMID: 10090801]
  32. Philos Trans R Soc Lond B Biol Sci. 1999 Jul 29;354(1387):1307-24 [PMID: 10466153]
  33. J Neurosci. 1996 Jul 1;16(13):4207-21 [PMID: 8753882]
  34. J Neurosci. 2005 May 11;25(19):4806-12 [PMID: 15888656]
  35. Neuron. 2006 Mar 2;49(5):765-75 [PMID: 16504951]
  36. Nature. 1996 Aug 15;382(6592):629-32 [PMID: 8757133]
  37. Eur J Neurosci. 2003 Oct;18(7):2069-81 [PMID: 14622240]
  38. J Neurophysiol. 2007 Feb;97(2):1621-32 [PMID: 17122317]
  39. Science. 2003 Oct 31;302(5646):881-5 [PMID: 14500850]
  40. Nature. 2007 Apr 19;446(7138):912-5 [PMID: 17410125]
  41. Nature. 1996 Jun 20;381(6584):697-9 [PMID: 8649514]
  42. Psychol Rev. 2004 Apr;111(2):430-45 [PMID: 15065916]
  43. Neuron. 2006 Aug 17;51(4):509-20 [PMID: 16908415]
  44. Nat Neurosci. 2007 Dec;10(12):1625-33 [PMID: 17982449]
  45. Brain Cogn. 2004 Jun;55(1):41-53 [PMID: 15134842]
  46. Neuroimage. 2008 Feb 15;39(4):2047-57 [PMID: 18060809]

Grants

  1. 058365/Wellcome Trust
  2. 078865/Wellcome Trust
  3. G0001354/Medical Research Council
  4. /Wellcome Trust
  5. 095495/Wellcome Trust

MeSH Term

Adult
Analysis of Variance
Brain Mapping
Decision Making
Female
Frontal Lobe
Humans
Image Processing, Computer-Assisted
Magnetic Resonance Imaging
Male
Neurons
Oxygen
Photic Stimulation
Probability
Reward

Chemicals

Oxygen

Word Cloud

Created with Highcharts 10.0.0probabilityprobabilitiesrewarddistortionschoiceoutcomesdecisiontheoriessmalllargeneuronalbehavioralabsencefrontalregionsshowedexperiencedistortedcodingRewardcruciallydeterminesvaluebasicphenomenondefyingexplanationtraditionalpeopleoftenoverweighunderweighchoicesuncertaintyHoweverbasispositionprocesslargelyunknownassessedindividualpleasantnessratingsbrainimagingDorsolateralcortexdependentoverweightingunderweightingwhereasventraloppositepatternresultsdemonstratestressimportanceprobabilisticcontrastlinearstriatumInputestimationsdecision-makingmechanismslikelycontributewellknowninconsistenciespreferencesformalizedeconomicsNeuronalwithout

Similar Articles

Cited By (42)