Effects of adding a second reinforcement alternative: implications for Herrnstein's interpretation of r(e).

Paul L Soto, Jack J McDowell, Jesse Dallery
Author Information
  1. Paul L Soto: Emory University, USA. psoto@ufl.edu

Abstract

Herrnstein's hyperbola describes the relation between response rate and reinforcer rate on variable-interval (VI) schedules. According to Herrnstein's (1970) interpretation, the parameter r(e) represents the reinforcer rate extraneous to the alternative to which the equation is fitted (the target alternative). The hyperbola is based on an assumption that extraneous reinforcer rate remains constant with changes in reinforcer rate on the target alternative (the constant-r(e) assumption) and that matching with no bias and perfect sensitivity occurs between response and reinforcer ratios. In the present experiment, 12 rats pressed levers for food on a series of 10 VI schedules arranged on the target alternative. Across conditions, six VI values and extinction were arranged on a second alternative. Reinforcer rate on the second alternative, r2, negatively covaried with reinforcer rate on the target alternative for five of the six VI values on the second alternative, and significant degrees of bias and undermatching occurred in response ratios. Given covariation of reinforcer rate on the second and target alternatives, the constant-r(e) assumption can be maintained only by assuming that reinforcer rate from unmeasured background sources, rb, covaries with reinforcer rate on the second alternative such that their sum, r(e), remains constant. In a single-schedule arrangement, however, r(e) equals rb and thus rb is assumed to remain constant, forcing a conceptual inconsistency between single- and concurrent-schedule arrangements. Furthermore, although an alternative formulation of the hyperbola can account for variations in bias and sensitivity, the modified equation also is based on the constant-r(e) assumption and therefore suffers from the same logical problem as the hyperbola when reinforcer rate on the second alternative covaries with reinforcer rate on the target alternative.

References

  1. J Exp Anal Behav. 1979 Sep;32(2):269-81 [PMID: 501274]
  2. J Exp Anal Behav. 2000 Jan;73(1):23-43 [PMID: 10682338]
  3. J Exp Anal Behav. 1970 Mar;13(2):243-66 [PMID: 16811440]
  4. J Exp Anal Behav. 1976 Sep;26(2):135-41 [PMID: 16811935]
  5. J Exp Anal Behav. 1962 Oct;5:529-30 [PMID: 13945507]
  6. J Comp Physiol Psychol. 1964 Oct;58:201-7 [PMID: 14215390]
  7. J Exp Anal Behav. 1978 May;29(3):447-52 [PMID: 16812068]
  8. J Exp Anal Behav. 1974 Jul;22(1):231-42 [PMID: 16811782]
  9. J Exp Anal Behav. 1994 May;61(3):505-16 [PMID: 16812733]
  10. Physiol Behav. 1985 Dec;35(6):897-904 [PMID: 2869532]
  11. J Exp Anal Behav. 1981 May;35(3):263-9 [PMID: 16812215]
  12. Behav Pharmacol. 2004 Nov;15(7):443-59 [PMID: 15472567]
  13. J Exp Anal Behav. 1986 Jan;45(1):63-74 [PMID: 3950535]
  14. J Exp Anal Behav. 1999 Sep;72(2):251-68 [PMID: 10503300]
  15. J Exp Anal Behav. 1985 Jan;43(1):61-73 [PMID: 16812408]
  16. J Exp Anal Behav. 1993 Mar;59(2):245-64 [PMID: 16812686]
  17. J Exp Anal Behav. 2005 Jul;84(1):111-27 [PMID: 16156140]
  18. J Exp Anal Behav. 1994 Jan;61(1):65-81 [PMID: 8126392]
  19. J Exp Anal Behav. 1984 Mar;41(2):183-92 [PMID: 16812366]

Grants

  1. R24 DA007256/NIDA NIH HHS
  2. 5R24DA07256/NIDA NIH HHS

MeSH Term

Animals
Behavior, Animal
Male
Models, Psychological
Rats
Rats, Long-Evans
Reinforcement Schedule
Reinforcement, Psychology

Word Cloud

Created with Highcharts 10.0.0ratealternativereinforceresecondtargethyperbolaVIrassumptionHerrnstein'sresponseconstantconstant-rbiasrbschedulesinterpretationextraneousequationbasedremainssensitivityratiosarrangedsixvaluescancovariesdescribesrelationvariable-intervalAccording1970parameterrepresentsfittedchangesmatchingperfectoccurspresentexperiment12ratspressedleversfoodseries10AcrossconditionsextinctionReinforcerr2negativelycovariedfivesignificantdegreesundermatchingoccurredGivencovariationalternativesmaintainedassumingunmeasuredbackgroundsourcessumsingle-schedulearrangementhoweverequalsthusassumedremainforcingconceptualinconsistencysingle-concurrent-schedulearrangementsFurthermorealthoughformulationaccountvariationsmodifiedalsothereforesufferslogicalproblemEffectsaddingreinforcementalternative:implications

Similar Articles

Cited By