The effect of rate of reinforcement and time in session on preference for variability.

Frances K McSweeney, Benjamin P Kowal, Eric S Murphy
Author Information
  1. Frances K McSweeney: Department of Psychology, Washington State University, Pullman, Washington 99164-4820, USA. fkmcs@mail.wsu.edu

Abstract

Pigeons pecked keys on concurrent-chains schedules that provided a variable interval 30-sec schedule in the initial link. One terminal link provided reinforcers in a fixed manner; the other provided reinforcers in a variable manner with the same arithmetic mean as the fixed alternative. In Experiment 1, the terminal links provided fixed and variable interval schedules. In Experiment 2, the terminal links provided reinforcers after a fixed or a variable delay following the response that produced them. In Experiment 3, the terminal links provided reinforcers that were fixed or variable in size. Rate of reinforcement was varied by changing the scheduled interreinforcer interval in the terminal link from 5 to 225 sec. The subjects usually preferred the variable option in Experiments 1 and 2 but differed in preference in Experiment 3. The preference for variability was usually stronger for lower (longer terminal links) than for higher (shorter terminal links) rates of reinforcement. Preference did not change systematically with time in the session. Some aspects of these results are inconsistent with explanations for the preference for variability in terms of scaling factors, scalar expectancy theory, risk-sensitive models of optimal foraging theory, and habituation to the reinforcer. Initial-link response rates also changed within sessions when the schedules provided high, but not low, rates of reinforcement. Within-session changes in responding were similar for the two initial links. These similarities imply that habituation to the reinforcer is represented differently in theories of choice than are other variables related to reinforcement.

References

  1. J Exp Anal Behav. 1981 Jan;35(1):23-9 [PMID: 16812196]
  2. J Exp Anal Behav. 1978 Jan;29(1):77-86 [PMID: 16812041]
  3. J Exp Anal Behav. 1990 Jan;53(1):155-61 [PMID: 2299285]
  4. Behav Processes. 2001 Sep 3;55(3):163-179 [PMID: 11483354]
  5. J Exp Anal Behav. 1981 Nov;36(3):317-28 [PMID: 16812250]
  6. J Exp Anal Behav. 1969 Nov;12(6):887-95 [PMID: 16811417]
  7. Psychol Rev. 1966 Jan;73(1):16-43 [PMID: 5324565]
  8. J Exp Anal Behav. 1974 Jan;21(1):89-97 [PMID: 16811736]
  9. J Exp Anal Behav. 1972 Sep;18(2):253-61 [PMID: 16811629]
  10. J Exp Psychol Anim Behav Process. 1986 Apr;12(2):116-24 [PMID: 3701262]
  11. J Exp Anal Behav. 1973 May;19(3):437-50 [PMID: 16811674]
  12. J Exp Anal Behav. 1967 Jan;10(1):35-43 [PMID: 16811303]
  13. J Exp Anal Behav. 1970 Jul;14(1):73-86 [PMID: 16811459]
  14. J Exp Anal Behav. 1974 Jul;22(1):231-42 [PMID: 16811782]
  15. J Exp Anal Behav. 1972 Nov;18(3):389-401 [PMID: 16811633]
  16. Behav Processes. 1988 Mar;16(1-2):95-110 [PMID: 24896407]
  17. J Exp Anal Behav. 1969 Sep;12(5):723-30 [PMID: 16811396]
  18. J Exp Anal Behav. 1979 Mar;31(2):225-37 [PMID: 16812127]
  19. J Exp Anal Behav. 1962 Oct;5:529-30 [PMID: 13945507]
  20. J Exp Anal Behav. 1983 Jul;40(1):1-13 [PMID: 16812333]
  21. J Exp Anal Behav. 1996 Nov;66(3):369-90 [PMID: 8921615]
  22. J Exp Anal Behav. 1975 Sep;24(2):191-7 [PMID: 16811871]
  23. J Exp Anal Behav. 2000 Jan;73(1):79-92 [PMID: 10682341]
  24. J Exp Anal Behav. 1977 Jan;27(1):171-82 [PMID: 16811974]
  25. Psychol Rev. 2001 Jan;108(1):96-112 [PMID: 11212635]
  26. Behav Neurosci. 1994 Dec;108(6):1019-29 [PMID: 7893394]
  27. J Exp Anal Behav. 1994 Jul;62(1):109-32 [PMID: 16812736]
  28. J Exp Anal Behav. 1968 Nov;11(6):689-702 [PMID: 16811316]
  29. J Exp Anal Behav. 1994 Jan;61(1):113-29 [PMID: 16812722]
  30. J Exp Anal Behav. 1996 Jul;66(1):75-95 [PMID: 16812819]
  31. J Exp Anal Behav. 1976 Mar;25(2):257-61 [PMID: 16811909]
  32. J Exp Anal Behav. 1972 Mar;17(2):169-76 [PMID: 16811579]
  33. J Exp Anal Behav. 1983 Nov;40(3):225-37 [PMID: 16812346]
  34. Behav Neurosci. 1990 Dec;104(6):869-75 [PMID: 2285485]
  35. J Exp Anal Behav. 1964 Mar;7:179-82 [PMID: 14130099]
  36. J Exp Anal Behav. 1983 Mar;39(2):257-66 [PMID: 16812318]
  37. J Exp Anal Behav. 1995 Nov;64(3):299-311 [PMID: 8551191]
  38. J Exp Anal Behav. 1968 May;11(3):263-9 [PMID: 5660707]
  39. J Exp Anal Behav. 1972 May;17(3):369-74 [PMID: 16811593]
  40. J Exp Anal Behav. 1995 May;63(3):313-29 [PMID: 7751835]
  41. J Exp Psychol. 1959 May;57(5):284-7 [PMID: 13654636]
  42. J Exp Anal Behav. 1969 Mar;12(2):247-52 [PMID: 16811349]

Grants

  1. R01 MH61720/NIMH NIH HHS

MeSH Term

Animals
Behavior, Animal
Choice Behavior
Columbidae
Female
Habituation, Psychophysiologic
Male
Reinforcement, Psychology
Time Factors

Word Cloud

Created with Highcharts 10.0.0providedterminalvariablelinksfixedreinforcementreinforcersExperimentpreferenceschedulesintervallinkvariabilityratesinitialmanner12response3usuallytimesessiontheoryhabituationreinforcerPigeonspeckedkeysconcurrent-chains30-secscheduleOnearithmeticmeanalternativedelayfollowingproducedsizeRatevariedchangingscheduledinterreinforcer5225secsubjectspreferredoptionExperimentsdifferedstrongerlowerlongerhighershorterPreferencechangesystematicallyaspectsresultsinconsistentexplanationstermsscalingfactorsscalarexpectancyrisk-sensitivemodelsoptimalforagingInitial-linkalsochangedwithinsessionshighlowWithin-sessionchangesrespondingsimilartwosimilaritiesimplyrepresenteddifferentlytheorieschoicevariablesrelatedeffectrate

Similar Articles

Cited By