Both probability and rate of reinforcement can affect the acquisition and maintenance of conditioned responses.

Jorge Mallea, Atara Schulhof, Charles R Gallistel, Peter D Balsam
Author Information
  1. Jorge Mallea: Department of Psychology, Columbia University. ORCID
  2. Atara Schulhof: Department of Psychology, Barnard College.
  3. Charles R Gallistel: Rutgers Center for Cognitive Science, Rutgers University.
  4. Peter D Balsam: Department of Psychology, Columbia University.

Abstract

In Pavlovian conditioning, the strength of a conditioned response is a function of the probability of reinforcement. However, manipulations of probability are often confounded with changes in the rate of reinforcement. Two between-group experiments in mice evaluated the effect of the probability of reinforcement, while controlling the rate of reinforcement, on appetitive conditioning and extinction. Experiment 1 equated the reinforcement rate by manipulating the number of reinforcements received in each reinforced trial in a critical group (one vs. two consecutive rewards). The results of this experiment showed that probability influenced the rate of responses in acquisition, even when controlling the reinforcement rate. Experiment 2 further assessed the role of probability on behavior while controlling the rate of reinforcement during the conditioned stimulus (CS) using a split-trial design, in which the total CS time was held constant but presented in different numbers of discrete trials (e.g., 50% reinforcement with two 12 s CS's vs. 100% reinforcement with a 24 s average CS duration). This experiment confirmed that probability influenced response rates, and both the probability and rate of reinforcement affected the proportion of trials with responses. Together, these results suggest that the probability of reinforcement, while having little effect on the speed at which responses emerged, affects responding even when the rate of reinforcement is held constant. The results challenge formal learning theories to account for the effects of both the probability and rate of reinforcement. (PsycInfo Database Record (c) 2024 APA, all rights reserved).

References

  1. PLoS Comput Biol. 2015 Nov 04;11(11):e1004567 [PMID: 26535896]
  2. Annu Rev Neurosci. 1988;11:329-52 [PMID: 3284445]
  3. Q J Exp Psychol B. 2004 Jul;57(3):193-243 [PMID: 15204108]
  4. J Exp Psychol Anim Behav Process. 2003 Jan;29(1):62-77 [PMID: 12561134]
  5. Ann N Y Acad Sci. 2007 May;1104:1-20 [PMID: 17344542]
  6. J Comp Physiol Psychol. 1968 Aug;66(1):1-5 [PMID: 5672628]
  7. J Exp Anal Behav. 2001 Mar;75(2):111-34 [PMID: 11394483]
  8. Am Psychol. 1988 Mar;43(3):151-60 [PMID: 3364852]
  9. Psychol Rev. 2000 Apr;107(2):289-344 [PMID: 10789198]
  10. Trends Neurosci. 2009 Feb;32(2):73-8 [PMID: 19136158]
  11. Comp Cogn Behav Rev. 2010;5:1-22 [PMID: 21359131]
  12. J Exp Psychol Anim Learn Cogn. 2019 Jan;45(1):43-58 [PMID: 30604994]
  13. J Exp Psychol Anim Behav Process. 2008 Apr;34(2):185-201 [PMID: 18426303]
  14. J Exp Psychol Anim Learn Cogn. 2020 Jul;46(3):256-272 [PMID: 32162948]
  15. J Exp Psychol Anim Behav Process. 2012 Jul;38(3):217-32 [PMID: 22468633]
  16. Sci Adv. 2024 Sep 6;10(36):eadi7137 [PMID: 39241065]
  17. J Exp Psychol Anim Behav Process. 2006 Oct;32(4):371-85 [PMID: 17044740]
  18. J Exp Anal Behav. 2020 Jan;113(1):15-36 [PMID: 31856323]
  19. J Exp Psychol Anim Learn Cogn. 2024 Oct;50(4):254-266 [PMID: 39432328]
  20. J Exp Psychol Anim Learn Cogn. 2015 Apr;41(2):137-51 [PMID: 25734756]
  21. J Comp Physiol Psychol. 1969 Oct;69(2):241-5 [PMID: 5404453]
  22. Behav Processes. 2003 Apr 28;62(1-3):89-101 [PMID: 12729971]
  23. J Exp Psychol Anim Behav Process. 1990 Jan;16(1):14-26 [PMID: 2303790]
  24. Psychol Rev. 1967 Jan;74(1):71-80 [PMID: 5341445]

Grants

  1. R01 MH068073/NIMH NIH HHS
  2. /Fulbright and Conicyt

MeSH Term

Animals
Conditioning, Classical
Mice
Reinforcement, Psychology
Male
Probability
Extinction, Psychological
Mice, Inbred C57BL
Reinforcement Schedule
Female

Word Cloud

Created with Highcharts 10.0.0reinforcementprobabilityrateresponsesconditionedcontrollingresultsCSconditioningresponseeffectExperimentvstwoexperimentinfluencedacquisitionevenheldconstanttrialssPavlovianstrengthfunctionHowevermanipulationsoftenconfoundedchangesTwobetween-groupexperimentsmiceevaluatedappetitiveextinction1equatedmanipulatingnumberreinforcementsreceivedreinforcedtrialcriticalgrouponeconsecutiverewardsshowed2assessedrolebehaviorstimulususingsplit-trialdesigntotaltimepresenteddifferentnumbersdiscreteeg50%12CS's100%24averagedurationconfirmedratesaffectedproportionTogethersuggestlittlespeedemergedaffectsrespondingchallengeformallearningtheoriesaccounteffectsPsycInfoDatabaseRecordc2024APArightsreservedcanaffectmaintenance

Similar Articles

Cited By (1)