Probability Distortion Depends on Choice Sequence in Rhesus Monkeys.

Simone Ferrari-Toniolo, Philipe M Bujold, Wolfram Schultz
Author Information
  1. Simone Ferrari-Toniolo: Department of Physiology, Development and Neuroscience, University of Cambridge, Cambridge CB2 3DY, United Kingdom simone.ferraritoniolo@gmail.com. ORCID
  2. Philipe M Bujold: Department of Physiology, Development and Neuroscience, University of Cambridge, Cambridge CB2 3DY, United Kingdom. ORCID
  3. Wolfram Schultz: Department of Physiology, Development and Neuroscience, University of Cambridge, Cambridge CB2 3DY, United Kingdom. ORCID

Abstract

Humans and other primates share many decision biases, among them our subjective distortion of objective probabilities. When making choices between uncertain rewards we typically treat probabilities nonlinearly: overvaluing low probabilities of reward and undervaluing high ones. A growing body of evidence, however, points to a more flexible pattern of distortion than the classical inverse-S one, highlighting the effect of experimental conditions in shifting the weight assigned to probabilities, such as task feedback, learning, and attention. Here we investigated the role of sequence structure (the order in which gambles are presented in a choice task) in shaping the probability distortion patterns of rhesus macaques: we presented 2 male monkeys with binary choice sequences of MIXED or REPEATED gambles against safe rewards. Parametric modeling revealed that choices in each sequence type were guided by significantly different patterns of probability distortion: whereas we elicited the classical inverse-S-shaped probability distortion in pseudorandomly MIXED trial sequences of gamble-safe choices, we found the opposite pattern consisting of S-shaped distortion, with REPEATED sequences. We extended these results to binary choices between two gambles, without a safe option, and confirmed the unique influence of the sequence structure in which the animals make choices. Finally, we showed that the value of gambles experienced in the past had a significant impact on the subjective value of future ones, shaping probability distortion on a trial-by-trial basis. Together, our results suggest that differences in choice sequence are sufficient to reverse the direction of probability distortion. Our lives are peppered with uncertain, probabilistic choices. Recent studies showed how such probabilities are subjectively distorted. In the present study, we show that probability distortions in macaque monkeys differ significantly between sequences in which single gambles are repeated (S-shaped distortion), as opposed to being pseudorandomly intermixed with other gambles (inverse-S-shaped distortion). Our findings challenge the idea of fixed probability distortions resulting from inflexible computations, and points to a more instantaneous evaluation of probabilistic information. Past trial outcomes appeared to drive the "gap" between probability distortions in different conditions. Our data suggest that, as in most adaptive systems, probability values are slowly but constantly updated from prior experience, driving measures of probability distortion to either side of the S/inverse-S debate.

Keywords

References

  1. Cogn Psychol. 1999 Feb;38(1):129-66 [PMID: 10090801]
  2. Psychol Sci. 2004 Aug;15(8):534-9 [PMID: 15270998]
  3. J Neurosci. 2008 Nov 5;28(45):11703-11 [PMID: 18987206]
  4. J Neurosci. 2009 Feb 18;29(7):2231-7 [PMID: 19228976]
  5. Proc Natl Acad Sci U S A. 2009 Apr 14;106(15):6088-93 [PMID: 19332799]
  6. Psychol Sci. 2009 Apr;20(4):473-9 [PMID: 19399978]
  7. Trends Cogn Sci. 2009 Dec;13(12):517-23 [PMID: 19836292]
  8. Judgm Decis Mak. 2008 Jun 1;3(5):389-395 [PMID: 19844596]
  9. Cognition. 2010 May;115(2):225-37 [PMID: 20092816]
  10. Cognition. 2013 Jan;126(1):54-71 [PMID: 23021857]
  11. J Exp Psychol Anim Behav Process. 2013 Jan;39(1):24-38 [PMID: 23205915]
  12. J Neurosci. 2015 Feb 18;35(7):3146-54 [PMID: 25698750]
  13. Cognition. 2015 Sep;142:60-80 [PMID: 26022497]
  14. Psychon Bull Rev. 2016 Apr;23(2):593-600 [PMID: 26286883]
  15. Cognition. 2016 Dec;157:126-138 [PMID: 27620961]
  16. Psychol Bull. 2018 Feb;144(2):140-176 [PMID: 29239630]
  17. Neuropsychopharmacology. 2018 May;43(6):1415-1424 [PMID: 29251282]
  18. J Neurosci. 2018 May 2;38(18):4383-4398 [PMID: 29626169]
  19. Nature. 1993 Jul 1;364(6432):56-8 [PMID: 8316296]

Grants

  1. /Wellcome Trust
  2. 204811/Z/16/Z/Wellcome Trust
  3. WT 095495/Wellcome Trust
  4. WT 204811/Wellcome Trust

MeSH Term

Animals
Choice Behavior
Decision Making
Gambling
Macaca mulatta
Male
Photic Stimulation
Probability
Reinforcement Schedule
Reward
Risk-Taking

Word Cloud

Created with Highcharts 10.0.0distortionprobabilitychoicesgamblesprobabilitiessequencechoicesequencesdistortionsprimatesdecisionsubjectivemakinguncertainrewardsrewardonespointspatternclassicalconditionstaskstructurepresentedshapingpatternsmonkeysbinaryMIXEDREPEATEDsafesignificantlydifferentinverse-S-shapedpseudorandomlytrialS-shapedresultsshowedvaluesuggestprobabilisticHumanssharemanybiasesamongobjectivetypicallytreatnonlinearly:overvaluinglowundervaluinghighgrowingbodyevidencehoweverflexibleinverse-Sonehighlightingeffectexperimentalshiftingweightassignedfeedbacklearningattentioninvestigatedroleorderrhesusmacaques:2maleParametricmodelingrevealedtypeguideddistortion:whereaselicitedgamble-safefoundoppositeconsistingextendedtwowithoutoptionconfirmeduniqueinfluenceanimalsmakeFinallyexperiencedpastsignificantimpactfuturetrial-by-trialbasisTogetherdifferencessufficientreversedirectionlivespepperedRecentstudiessubjectivelydistortedpresentstudyshowmacaquediffersinglerepeatedopposedintermixedfindingschallengeideafixedresultinginflexiblecomputationsinstantaneousevaluationinformationPastoutcomesappeareddrive"gap"dataadaptivesystemsvaluesslowlyconstantlyupdatedpriorexperiencedrivingmeasureseithersideS/inverse-SdebateProbabilityDistortionDependsChoiceSequenceRhesusMonkeysriskutility

Similar Articles

Cited By