Operant conditioning.

J E R Staddon, D T Cerutti
Author Information
  1. J E R Staddon: Department of Psychological and Brain Sciences, Duke University, Durham, North Carolina 27708-0086, USA. staddon@psych.duke.edu

Abstract

Operant behavior is behavior "controlled" by its consequences. In practice, operant conditioning is the study of reversible behavior maintained by reinforcement schedules. We review empirical studies and theoretical approaches to two large classes of operant behavior: interval timing and choice. We discuss cognitive versus behavioral approaches to timing, the "gap" experiment and its implications, proportional timing and Weber's law, temporal dynamics and linear waiting, and the problem of simple chain-interval schedules. We review the long history of research on operant choice: the matching law, its extensions and problems, concurrent chain schedules, and self-control. We point out how linear waiting may be involved in timing, choice, and reinforcement schedules generally. There are prospects for a unified approach to all these areas.

References

  1. J Exp Anal Behav. 1997 Jan;67(1):145-59 [PMID: 9037785]
  2. J Exp Anal Behav. 1990 Jan;53(1):189-200 [PMID: 2299288]
  3. J Exp Anal Behav. 1969 Sep;12(5):723-30 [PMID: 16811396]
  4. Behav Processes. 2000 Oct 26;52(1):43-48 [PMID: 11011108]
  5. J Exp Psychol Anim Behav Process. 2000 Jul;26(3):305-22 [PMID: 10913995]
  6. J Exp Anal Behav. 1962 Apr;5:167-73 [PMID: 14454920]
  7. J Exp Psychol Anim Behav Process. 1983 Apr;9(2):171-201 [PMID: 6842136]
  8. J Exp Anal Behav. 1999 Sep;72(2):251-68 [PMID: 10503300]
  9. Cognition. 1990 Nov;37(1-2):55-81 [PMID: 2269008]
  10. J Exp Anal Behav. 1982 Sep;38(2):217-32 [PMID: 16812299]
  11. Behav Anal. 1996 Spring;19(1):125-8 [PMID: 22478254]
  12. J Exp Anal Behav. 1974 Jul;22(1):231-42 [PMID: 16811782]
  13. J Exp Anal Behav. 1988 Sep;50(2):197-210 [PMID: 16812556]
  14. J Exp Anal Behav. 1961 Jul;4:267-72 [PMID: 13713775]
  15. Behav Processes. 2001 May 3;54(1-3):11-32 [PMID: 11369458]
  16. J Exp Anal Behav. 1970 Jul;14(1):55-60 [PMID: 16811457]
  17. Psychol Monogr. 1963;77(13):1-31 [PMID: 5877542]
  18. J Exp Anal Behav. 1968 Sep;11(5):517-24 [PMID: 5722411]
  19. J Exp Anal Behav. 1970 Mar;13(2):243-66 [PMID: 16811440]
  20. J Exp Psychol Anim Behav Process. 1984 Jul;10(3):297-306 [PMID: 6747554]
  21. J Exp Anal Behav. 1999 Mar;71(2):215-51 [PMID: 10220931]
  22. J Exp Anal Behav. 1983 Nov;40(3):321-31 [PMID: 16812350]
  23. J Exp Anal Behav. 1993 Jul;60(1):159-69 [PMID: 8354964]
  24. J Exp Psychol Anim Behav Process. 1988 Oct;14(4):349-67 [PMID: 3183576]
  25. J Exp Anal Behav. 1972 Jan;17(1):15-22 [PMID: 16811561]
  26. J Exp Anal Behav. 1965 Jan;8:19-27 [PMID: 14266504]
  27. J Exp Psychol Anim Behav Process. 1997 Apr;23(2):211-31 [PMID: 9095543]
  28. J Exp Anal Behav. 1980 Mar;33(2):213-9 [PMID: 16812165]
  29. J Exp Anal Behav. 1972 Sep;18(2):223-9 [PMID: 16811625]
  30. J Exp Anal Behav. 1964 Jan;7:27-36 [PMID: 14120136]
  31. J Exp Anal Behav. 1962 Oct;5:543-97 [PMID: 14031747]
  32. J Exp Psychol Anim Behav Process. 1991 Jul;17(3):281-91 [PMID: 1890386]
  33. Psychol Rev. 2001 Jan;108(1):96-112 [PMID: 11212635]
  34. Behav Processes. 1999 Apr;45(1-3):23-31 [PMID: 24897525]
  35. J Exp Anal Behav. 1969 Sep;12(5):677-87 [PMID: 16811392]
  36. J Exp Anal Behav. 1994 Jul;62(1):15-32 [PMID: 8064211]
  37. J Exp Anal Behav. 2000 Jan;73(1):23-43 [PMID: 10682338]
  38. Annu Rev Psychol. 1965;16:63-94 [PMID: 14268897]
  39. J Exp Anal Behav. 2001 May;75(3):247-74 [PMID: 11453618]
  40. J Exp Anal Behav. 1994 Jan;61(1):113-29 [PMID: 16812722]
  41. J Exp Anal Behav. 1977 Sep;28(2):163-70 [PMID: 16812023]
  42. Psychol Rev. 1997 Apr;104(2):241-65 [PMID: 9127582]
  43. J Exp Anal Behav. 1974 Nov;22(3):535-45 [PMID: 16811818]
  44. J Exp Anal Behav. 1974 Mar;21(2):323-30 [PMID: 16811746]
  45. J Exp Anal Behav. 1974 Jul;22(1):115-20 [PMID: 16811769]
  46. J Exp Anal Behav. 2002 Jan;77(1):105-24 [PMID: 11859841]
  47. J Exp Psychol Anim Behav Process. 1989 Jul;15(3):253-63 [PMID: 2760563]
  48. J Exp Psychol Anim Behav Process. 1994 Apr;20(2):184-98 [PMID: 8189187]
  49. J Exp Anal Behav. 2001 Mar;75(2):111-34 [PMID: 11394483]
  50. J Exp Psychol Anim Behav Process. 1981 Jul;7(3):242-68 [PMID: 7252428]
  51. Behav Processes. 1999 Apr;45(1-3):159-71 [PMID: 24897534]
  52. J Exp Anal Behav. 1968 May;11(3):223-38 [PMID: 5660703]
  53. Psychol Rev. 1988 Apr;95(2):274-95 [PMID: 3375401]
  54. J Exp Anal Behav. 1994 Jan;61(1):1-9 [PMID: 16812720]
  55. J Exp Anal Behav. 1992 Jan;57(1):33-46 [PMID: 16812647]
  56. J Exp Anal Behav. 1969 Sep;12(5):689-700 [PMID: 16811393]
  57. J Exp Anal Behav. 1990 May;53(3):381-93 [PMID: 2341821]
  58. J Exp Anal Behav. 1968 Nov;11(6):669-82 [PMID: 16811314]
  59. J Exp Anal Behav. 2000 Jul;74(1):1-24 [PMID: 10966094]
  60. J Exp Anal Behav. 1968 May;11(3):263-9 [PMID: 5660707]
  61. J Exp Psychol Anim Behav Process. 1977 Jul;3(3):216-28 [PMID: 881613]
  62. J Exp Anal Behav. 1979 May;31(3):333-43 [PMID: 16812135]
  63. J Exp Anal Behav. 1995 May;63(3):313-29 [PMID: 7751835]
  64. Psychol Rev. 2000 Apr;107(2):289-344 [PMID: 10789198]
  65. J Exp Anal Behav. 1986 Mar;45(2):229-35 [PMID: 3958668]
  66. J Exp Anal Behav. 1968 Sep;11(5):589-93 [PMID: 5722424]
  67. Science. 1989 May 26;244(4907):933-8 [PMID: 2658056]
  68. Psychon Bull Rev. 1994 Dec;1(4):457-75 [PMID: 24203554]
  69. J Exp Anal Behav. 1974 May;21(3):389-408 [PMID: 16811752]
  70. J Exp Anal Behav. 1987 Jan;47(1):41-56 [PMID: 3559458]
  71. J Exp Anal Behav. 1969 May;12(3):403-11 [PMID: 16811364]
  72. J Exp Anal Behav. 1969 Jul;12(4):605-8 [PMID: 16811382]
  73. Psychol Rev. 2003 Jan;110(1):126-44 [PMID: 12529059]
  74. J Exp Anal Behav. 1967 Nov;10(6):517-27 [PMID: 6080829]
  75. J Exp Anal Behav. 1993 Sep;60(2):293-311 [PMID: 8409823]

Grants

  1. R01 MH064442-02/NIMH NIH HHS

MeSH Term

Attention
Choice Behavior
Conditioning, Operant
Humans
Mental Recall
Motivation
Problem Solving
Reinforcement Schedule

Word Cloud

Created with Highcharts 10.0.0schedulestimingbehavioroperantOperantconditioningreinforcementreviewapproacheschoicelawlinearwaiting"controlled"consequencespracticestudyreversiblemaintainedempiricalstudiestheoreticaltwolargeclassesbehavior:intervaldiscusscognitiveversusbehavioral"gap"experimentimplicationsproportionalWeber'stemporaldynamicsproblemsimplechain-intervallonghistoryresearchchoice:matchingextensionsproblemsconcurrentchainself-controlpointmayinvolvedgenerallyprospectsunifiedapproachareas

Similar Articles

Cited By