The Modulation of Operant Variation by the Probability, Magnitude, and Delay of Reinforcement.

W David Stahlman, Aaron P Blaisdell
Author Information
  1. W David Stahlman: Department of Psychology, University of California, Los Angeles.

Abstract

Recent studies have demonstrated that the expectation of reward delivery has an inverse relationship with operant behavioral variation (e.g., Stahlman, Roberts, & Blaisdell, 2010). Research thus far has largely focused on one aspect of reinforcement - the likelihood of food delivery. In two experiments with pigeons, we examined the effect of two other aspects of reinforcement: the magnitude of the reward and the temporal delay between the operant response and outcome delivery. In the first experiment, we found that a large reward magnitude resulted in reduced spatiotemporal variation in pigeons' pecking behavior. In the second experiment, we found that a 4-s delay between response-dependent trial termination and reward delivery increased variation in behavior. These results indicate that multiple dimensions of the reinforcer modulate operant response variation.

References

  1. J Exp Anal Behav. 1969 Jul;12(4):653-61 [PMID: 16811388]
  2. Behav Processes. 1998 Dec;44(2):147-62 [PMID: 24896972]
  3. J Exp Psychol Anim Behav Process. 2000 Jan;26(1):98-111 [PMID: 10650547]
  4. J Exp Anal Behav. 1990 May;53(3):359-79 [PMID: 2341820]
  5. J Exp Anal Behav. 1985 Nov;44(3):279-99 [PMID: 4086972]
  6. J Exp Anal Behav. 1969 Jan;12(1):73-80 [PMID: 16811341]
  7. J Exp Psychol. 1951 Oct;42(4):273-81 [PMID: 14888834]
  8. Behav Brain Res. 2009 Mar 2;198(1):125-9 [PMID: 19041347]
  9. J Exp Psychol Anim Behav Process. 2008 Jan;34(1):75-93 [PMID: 18248116]
  10. Psychol Bull. 1975 Jul;82(4):463-96 [PMID: 1099599]
  11. J Exp Psychol Anim Behav Process. 1998 Jan;24(1):72-83 [PMID: 9438967]
  12. Learn Behav. 2007 Feb;35(1):11-8 [PMID: 17557387]
  13. J Exp Anal Behav. 1998 Mar;69(2):103-22 [PMID: 9540229]
  14. J Exp Anal Behav. 1983 Jan;39(1):49-59 [PMID: 16812312]
  15. J Exp Psychol Anim Behav Process. 2004 Oct;30(4):271-82 [PMID: 15506853]
  16. J Exp Anal Behav. 1993 Jul;60(1):105-28 [PMID: 8354963]
  17. J Exp Anal Behav. 1974 May;21(3):485-9 [PMID: 16811760]
  18. J Comp Physiol Psychol. 1974 Jun;86(6):1141-8 [PMID: 4836860]
  19. Behav Brain Sci. 2000 Feb;23(1):73-90; discussion 90-130 [PMID: 11303339]
  20. J Exp Psychol Anim Behav Process. 1996 Oct;22(4):497-508 [PMID: 8865615]
  21. J Exp Psychol Anim Behav Process. 2006 Oct;32(4):371-85 [PMID: 17044740]
  22. J Exp Psychol Anim Behav Process. 2010 Jan;36(1):77-91 [PMID: 20141319]
  23. J Exp Anal Behav. 1978 Jul;30(1):63-7 [PMID: 16812089]
  24. J Exp Psychol Anim Behav Process. 2001 Apr;27(2):165-78 [PMID: 11296491]
  25. Learn Behav. 2010 May;38(2):111-8 [PMID: 20400731]
  26. J Exp Psychol Anim Behav Process. 2001 Jan;27(1):79-94 [PMID: 11199517]
  27. J Exp Psychol. 1948 Feb;38(1):1-16 [PMID: 18910254]
  28. Am Psychol. 2004 Dec;59(9):891-906 [PMID: 15584823]
  29. J Exp Anal Behav. 2006 Sep;86(2):159-79 [PMID: 17002225]
  30. Psychon Bull Rev. 2002 Jun;9(2):250-8 [PMID: 12120786]
  31. Nutrition. 2008 May;24(5):492-4 [PMID: 18321679]
  32. J Exp Psychol Anim Behav Process. 1998 Jul;24(3):265-77 [PMID: 12150166]
  33. J Neurophysiol. 2009 Jan;101(1):437-47 [PMID: 18987119]
  34. J Exp Anal Behav. 1992 May;57(3):301-16 [PMID: 1602269]
  35. J Exp Psychol Anim Behav Process. 1999 Jan;25(1):18-27 [PMID: 9987855]
  36. J Exp Anal Behav. 1962 Oct;5:481-6 [PMID: 14018721]
  37. Learn Behav. 2006 May;34(2):111-23 [PMID: 16933797]
  38. J Exp Anal Behav. 1981 Jul;36(1):61-74 [PMID: 16812232]
  39. Science. 1961 Jun 30;133(3470):2067-9 [PMID: 13713776]

Grants

  1. R01 NS059076/NINDS NIH HHS
  2. R01 NS059076-07/NINDS NIH HHS

Word Cloud

Created with Highcharts 10.0.0rewarddeliveryvariationoperanttwomagnitudedelayresponseexperimentfoundbehaviorRecentstudiesdemonstratedexpectationinverserelationshipbehavioralegStahlmanRoberts&Blaisdell2010Researchthusfarlargelyfocusedoneaspectreinforcement-likelihoodfoodexperimentspigeonsexaminedeffectaspectsreinforcement:temporaloutcomefirstlargeresultedreducedspatiotemporalpigeons'peckingsecond4-sresponse-dependenttrialterminationincreasedresultsindicatemultipledimensionsreinforcermodulateModulationOperantVariationProbabilityMagnitudeDelayReinforcement

Similar Articles

Cited By