Discrimination of variable schedules is controlled by interresponse times proximal to reinforcement.

Takayuki Tanno, Alan Silberberg, Takayuki Sakagami
Author Information
  1. Takayuki Tanno: Keio University, Japan. tantantan01@gmail.com

Abstract

In Experiment 1, food-deprived rats responded to one of two schedules that were, with equal probability, associated with a sample lever. One schedule was always variable ratio, while the other schedule, depending on the trial within a session, was: (a) a variable-interval schedule; (b) a tandem variable-interval, differential-reinforcement-of-low-rate schedule; or (c) a tandem variable-interval, differential-reinforcement-of-high-rate schedule. Completion of a sample-lever schedule, which took approximately the same time regardless of schedule, presented two comparison levers, one associated with each sample-lever schedule. Pressing the comparison lever associated with the schedule just presented produced food, while pressing the other produced a blackout. Conditional-discrimination accuracy was related to the size of the difference in reinforced interresponse times and those that preceded it (predecessor interresponse times) between the variable-ratio and other comparison schedules. In Experiment 2, control by predecessor interresponse times was accentuated by requiring rats to discriminate between a variable-ratio schedule and a tandem schedule that required emission of a sequence of a long, then a short interresponse time in the tandem's terminal schedule. These discrimination data are compatible with the copyist model from Tanno and Silberberg (2012) in which response rates are determined by the succession of interresponse times between reinforcers weighted so that each interresponse time's role in rate determination diminishes exponentially as a function of its distance from reinforcement.

Keywords

References

  1. Behav Processes. 2003 Apr 28;62(1-3):49-64 [PMID: 12729968]
  2. J Exp Anal Behav. 2009 Mar;91(2):157-67 [PMID: 19794831]
  3. J Exp Psychol Anim Behav Process. 2000 Oct;26(4):416-27 [PMID: 11056882]
  4. Behav Processes. 2005 May 31;69(2):257-78 [PMID: 15845312]
  5. J Exp Anal Behav. 1994 May;61(3):441-51 [PMID: 16812732]
  6. Psychon Bull Rev. 2012 Oct;19(5):759-78 [PMID: 22673925]
  7. J Exp Anal Behav. 1973 Jul;20(1):137-53 [PMID: 16811687]
  8. J Exp Anal Behav. 1973 May;19(3):491-7 [PMID: 16811679]
  9. J Exp Anal Behav. 1977 Sep;28(2):155-61 [PMID: 16812022]
  10. J Exp Anal Behav. 1993 Mar;59(2):245-64 [PMID: 16812686]
  11. J Exp Anal Behav. 1981 Nov;36(3):387-403 [PMID: 16812255]
  12. J Exp Anal Behav. 2008 Jan;89(1):5-14 [PMID: 18338672]
  13. Behav Processes. 2008 May;78(1):10-6 [PMID: 18178339]
  14. J Exp Anal Behav. 1970 Sep;14(2):145-51 [PMID: 16811464]

MeSH Term

Animals
Conditioning, Operant
Discrimination Learning
Male
Pattern Recognition, Physiological
Rats
Rats, Wistar
Reaction Time
Reinforcement Schedule
Reinforcement, Psychology
Time Perception

Word Cloud

Created with Highcharts 10.0.0scheduleinterresponsetimesvariableratsschedulesassociatedlevervariable-intervaltandemcomparisonExperimentonetworatiosample-levertimepresentedproducedpredecessorvariable-ratiodiscriminationcopyistmodelreinforcement1food-deprivedrespondedequalprobabilitysampleOnealwaysdependingtrialwithinsessionwas:bdifferential-reinforcement-of-low-ratecdifferential-reinforcement-of-high-rateCompletiontookapproximatelyregardlessleversPressingjustfoodpressingblackoutConditional-discriminationaccuracyrelatedsizedifferencereinforcedpreceded2controlaccentuatedrequiringdiscriminaterequiredemissionsequencelongshorttandem'sterminaldatacompatibleTannoSilberberg2012responseratesdeterminedsuccessionreinforcersweightedtime'sroleratedeterminationdiminishesexponentiallyfunctiondistanceDiscriminationcontrolledproximalpressinterval

Similar Articles

Cited By