Separation of time-based and trial-based accounts of the partial reinforcement extinction effect.

Mark E Bouton, Amanda M Woods, Travis P Todd
Author Information
  1. Mark E Bouton: University of Vermont, United States. Electronic address: mark.bouton@uvm.edu.
  2. Amanda M Woods: University of Vermont, United States.
  3. Travis P Todd: University of Vermont, United States.

Abstract

Two appetitive conditioning experiments with rats examined time-based and trial-based accounts of the partial reinforcement extinction effect (PREE). In the PREE, the loss of responding that occurs in extinction is slower when the conditioned stimulus (CS) has been paired with a reinforcer on some of its presentations (partially reinforced) instead of every presentation (continuously reinforced). According to a time-based or "time-accumulation" view (e.g., Gallistel and Gibbon, 2000), the PREE occurs because the organism has learned in partial reinforcement to expect the reinforcer after a larger amount of time has accumulated in the CS over trials. In contrast, according to a trial-based view (e.g., Capaldi, 1967), the PREE occurs because the organism has learned in partial reinforcement to expect the reinforcer after a larger number of CS presentations. Experiment 1 used a procedure that equated partially and continuously reinforced groups on their expected times to reinforcement during conditioning. A PREE was still observed. Experiment 2 then used an extinction procedure that allowed time in the CS and the number of trials to accumulate differentially through extinction. The PREE was still evident when responding was examined as a function of expected time units to the reinforcer, but was eliminated when responding was examined as a function of expected trial units to the reinforcer. There was no evidence that the animal responded according to the ratio of time accumulated during the CS in extinction over the time in the CS expected before the reinforcer. The results thus favor a trial-based account over a time-based account of extinction and the PREE. This article is part of a Special Issue entitled: Associative and Temporal Learning.

Keywords

References

  1. Q J Exp Psychol (Hove). 2006 May;59(5):809-29 [PMID: 16608748]
  2. Behav Processes. 2012 May;90(1):66-80 [PMID: 22391153]
  3. J Exp Psychol Anim Behav Process. 2003 Apr;29(2):153-66 [PMID: 12735279]
  4. J Exp Psychol Anim Behav Process. 2003 Jan;29(1):62-77 [PMID: 12561134]
  5. Psychol Rev. 1994 Oct;101(4):587-607 [PMID: 7984708]
  6. J Exp Psychol Anim Behav Process. 2011 Apr;37(2):151-64 [PMID: 21381859]
  7. J Exp Psychol Anim Behav Process. 2004 Jul;30(3):240-50 [PMID: 15279514]
  8. J Exp Psychol Anim Behav Process. 2006 Oct;32(4):371-85 [PMID: 17044740]
  9. Psychol Rev. 2000 Apr;107(2):289-344 [PMID: 10789198]
  10. Trends Neurosci. 2009 Feb;32(2):73-8 [PMID: 19136158]
  11. Proc Natl Acad Sci U S A. 2004 Sep 7;101(36):13124-31 [PMID: 15331782]
  12. Psychon Bull Rev. 1994 Jun;1(2):156-81 [PMID: 24203468]
  13. Psychol Rev. 1980 Nov;87(6):532-52 [PMID: 7443916]
  14. Comp Cogn Behav Rev. 2010;5:1-22 [PMID: 21359131]
  15. Biol Cybern. 1988;58(6):405-15 [PMID: 3395634]
  16. Learn Behav. 2008 May;36(2):104-15 [PMID: 18543711]
  17. Learn Behav. 2004 May;32(2):220-9 [PMID: 15281394]
  18. J Neurosci. 2010 Apr 7;30(14):4990-8 [PMID: 20371819]
  19. Learn Mem. 2004 Sep-Oct;11(5):485-94 [PMID: 15466298]
  20. J Exp Psychol Anim Behav Process. 2011 Jan;37(1):79-93 [PMID: 21261415]
  21. J Exp Psychol Anim Behav Process. 2005 Jul;31(3):319-33 [PMID: 16045386]
  22. J Exp Psychol Anim Behav Process. 1999 Oct;25(4):433-50 [PMID: 17763570]
  23. J Exp Psychol Anim Behav Process. 2004 Jul;30(3):163-76 [PMID: 15279508]
  24. Annu Rev Psychol. 2001;52:111-39 [PMID: 11148301]
  25. Learn Behav. 2004 Aug;32(3):321-34 [PMID: 15672827]
  26. Behav Processes. 2006 Feb 28;71(2-3):307-17 [PMID: 16412585]
  27. J Exp Psychol Anim Behav Process. 2012 Oct;38(4):381-93 [PMID: 22924827]
  28. J Exp Psychol Anim Behav Process. 1977 Jul;3(3):216-28 [PMID: 881613]
  29. J Exp Psychol Anim Behav Process. 2008 Jan;34(1):94-105 [PMID: 18248117]
  30. Q J Exp Psychol B. 2003 Feb;56(1):7-29 [PMID: 12623534]
  31. Behav Processes. 2010 May;84(1):412-20 [PMID: 20067824]

Grants

  1. R01 DA033123/NIDA NIH HHS
  2. R01 MH064847/NIMH NIH HHS
  3. R01 DA33123/NIDA NIH HHS
  4. R01 MH64847/NIMH NIH HHS

MeSH Term

Animals
Association Learning
Conditioning, Psychological
Extinction, Psychological
Female
Rats
Rats, Wistar
Reinforcement Schedule
Reinforcement, Psychology

Word Cloud

Created with Highcharts 10.0.0extinctionPREEreinforcementCSreinforcertimetime-basedtrial-basedpartialexpectedexaminedeffectrespondingoccursreinforcedconditioningaccountspresentationspartiallycontinuouslyviewegorganismlearnedexpectlargeraccumulatedtrialsaccordingnumberExperimentusedprocedurestillfunctionunitsaccountAssociativemodelsTwoappetitiveexperimentsratslossslowerconditionedstimuluspairedinsteadeverypresentationAccording"time-accumulation"GallistelGibbon2000amountcontrastCapaldi19671equatedgroupstimesobserved2allowedaccumulatedifferentiallyevidenteliminatedtrialevidenceanimalrespondedratioresultsthusfavorarticlepartSpecialIssueentitled:TemporalLearningSeparationExtinctionPartialTiming

Similar Articles

Cited By