Extinction under a behavioral microscope: isolating the sources of decline in operant response rate.

Timothy H C Cheung, Janet L Neisewander, Federico Sanabria
Author Information
  1. Timothy H C Cheung: Department of Psychology, P.O. Box 871104, Arizona State University, Tempe, AZ 85287-1104, USA. tim.hc.cheung@gmail.com

Abstract

Extinction performance is often used to assess underlying psychological processes without the interference of reinforcement. For example, in the extinction/reinstatement paradigm, motivation to seek drug is assessed by measuring responding elicited by drug-associated cues without drug reinforcement. However, extinction performance is governed by several psychological processes that involve motivation, memory, learning, and motoric functions. These processes are confounded when overall response rate is used to measure performance. Based on evidence that operant responding occurs in bouts, this paper proposes an analytic procedure that separates extinction performance into several behavioral components: (1-3) the baseline bout initiation rate, within-bout response rate, and bout length at the onset of extinction; (4-6) their rates of decay during extinction; (7) the time between extinction onset and the decline of responding; (8) the asymptotic response rate at the end of extinction; (9) the refractory period after each response. Data that illustrate the goodness of fit of this analytic model are presented. This paper also describes procedures to isolate behavioral components contributing to extinction performance and make inferences about experimental effects on these components. This microscopic behavioral analysis allows the mapping of different psychological processes to distinct behavioral components implicated in extinction performance, which may further our understanding of the psychological effects of neurobiological treatments.

References

  1. Psychopharmacology (Berl). 2011 Feb;213(2-3):307-20 [PMID: 21079923]
  2. Behav Processes. 2011 May;87(1):125-34 [PMID: 21172410]
  3. J Exp Anal Behav. 1970 Mar;13(2):243-66 [PMID: 16811440]
  4. Behav Processes. 2009 Jun;81(2):309-15 [PMID: 19429225]
  5. Neuropsychopharmacology. 2008 Jan;33(1):56-72 [PMID: 17882236]
  6. J Exp Anal Behav. 2004 Mar;81(2):155-67 [PMID: 15239490]
  7. J Exp Anal Behav. 2006 Jan;85(1):23-39 [PMID: 16602374]
  8. Behav Brain Sci. 2000 Feb;23(1):73-90; discussion 90-130 [PMID: 11303339]
  9. J Exp Anal Behav. 2004 Jan;81(1):65-83 [PMID: 15113134]
  10. Neuropsychopharmacology. 2010 Sep;35(10):2037-48 [PMID: 20520599]
  11. Behav Neurosci. 2001 Apr;115(2):394-402 [PMID: 11345964]
  12. J Exp Anal Behav. 2008 Nov;90(3):363-86 [PMID: 19070342]
  13. Psychol Rev. 1978 Nov;85(6):571-81 [PMID: 734020]
  14. J Exp Anal Behav. 2008 Nov;90(3):345-62 [PMID: 19070341]
  15. Behav Processes. 2003 Apr 28;62(1-3):49-64 [PMID: 12729968]
  16. Neurosci Biobehav Rev. 2004 May;28(3):229-38 [PMID: 15225968]
  17. Psychol Rev. 2008 Jan;115(1):186-98 [PMID: 18211190]
  18. Neurosci Biobehav Rev. 2000 Jan;24(1):31-9 [PMID: 10654658]
  19. Psychol Sch. 2007 May;44(5):471-481 [PMID: 19122766]
  20. Psychopharmacology (Berl). 2002 Oct;163(3-4):362-80 [PMID: 12373437]
  21. J Exp Anal Behav. 2002 May;77(3):211-31 [PMID: 12083677]
  22. Behav Brain Funct. 2008 Feb 08;4:7 [PMID: 18261220]
  23. Physiol Behav. 1987;40(6):793-7 [PMID: 3313453]
  24. Behav Processes. 2010 May;84(1):400-11 [PMID: 20152889]
  25. Behav Res Methods. 2010 Aug;42(3):884-97 [PMID: 20805611]
  26. J Exp Anal Behav. 2006 May;85(3):329-47 [PMID: 16776055]
  27. Behav Brain Funct. 2012 Jan 26;8:5 [PMID: 22277367]
  28. Learn Mem. 2004 Sep-Oct;11(5):485-94 [PMID: 15466298]
  29. Pharmacol Biochem Behav. 2011 Jan;97(3):470-8 [PMID: 20951161]
  30. Cogn Sci. 2008 Dec;32(8):1248-84 [PMID: 21585453]
  31. Psychon Bull Rev. 2005 Aug;12(4):573-604 [PMID: 16447374]
  32. J Exp Anal Behav. 2002 Sep;78(2):127-60 [PMID: 12216975]
  33. J Exp Anal Behav. 1964 Jul;7:333-5 [PMID: 14176286]
  34. J Exp Anal Behav. 1961 Oct;4:317-21 [PMID: 14469791]
  35. Behav Processes. 2000 Jun 23;49(3):121-129 [PMID: 10922525]
  36. Science. 1961 Sep 29;134(3483):943-4 [PMID: 13714876]
  37. Behav Brain Funct. 2012 Dec 13;8:59 [PMID: 23237608]
  38. Psychopharmacology (Berl). 1998 Jan;135(2):151-60 [PMID: 9497020]
  39. J Exp Anal Behav. 2001 May;75(3):247-74 [PMID: 11453618]
  40. J Exp Anal Behav. 2011 Jul;96(1):17-38 [PMID: 21765544]
  41. Psychol Rev. 1958 Sep;65(5):272-82 [PMID: 13591455]
  42. Front Behav Neurosci. 2009 Sep 07;3:13 [PMID: 19826615]
  43. Psychosom Med. 2004 May-Jun;66(3):411-21 [PMID: 15184705]
  44. J Exp Anal Behav. 2003 Sep;80(2):159-71 [PMID: 14674726]
  45. Psychopharmacology (Berl). 2006 Nov;189(1):1-16 [PMID: 17019567]
  46. J Exp Psychol Anim Behav Process. 2011 Jan;37(1):1-9 [PMID: 20718555]
  47. J Exp Psychol Anim Behav Process. 2009 Oct;35(4):447-72 [PMID: 19839699]
  48. Biol Rev Camb Philos Soc. 2007 Nov;82(4):591-605 [PMID: 17944619]
  49. Eur J Pharmacol. 2005 Dec 5;526(1-3):140-6 [PMID: 16253228]
  50. Behav Processes. 2008 Jun;78(2):253-8 [PMID: 18243577]
  51. Psychol Sci. 2005 May;16(5):345-53 [PMID: 15869691]
  52. Psychopharmacology (Berl). 1999 Oct;146(4):362-72 [PMID: 10550487]
  53. Behav Processes. 2007 Jun;75(2):199-205 [PMID: 17383116]
  54. Behav Processes. 2001 Nov 1;56(2):85-101 [PMID: 11672935]
  55. J Chem Inf Comput Sci. 2004 Jan-Feb;44(1):1-12 [PMID: 14741005]

Grants

  1. R01 DA011064/NIDA NIH HHS
  2. R01 DA011064-11/NIDA NIH HHS
  3. R03 MH094562/NIMH NIH HHS
  4. DA011064/NIDA NIH HHS

MeSH Term

Animals
Bayes Theorem
Cocaine
Conditioning, Operant
Extinction, Psychological
Models, Psychological
Psychological Theory
Rats
Rats, Inbred SHR
Rats, Inbred WKY
Reinforcement Schedule
Reinforcement, Psychology
Self Administration

Chemicals

Cocaine

Word Cloud

Created with Highcharts 10.0.0extinctionperformanceresponseratebehavioralpsychologicalprocessesrespondingcomponentsExtinctionusedwithoutreinforcementmotivationdrugseveraloperantpaperanalyticboutonsetdeclineeffectsoftenassessunderlyinginterferenceexampleextinction/reinstatementparadigmseekassessedmeasuringeliciteddrug-associatedcuesHowevergovernedinvolvememorylearningmotoricfunctionsconfoundedoverallmeasureBasedevidenceoccursboutsproposesprocedureseparatescomponents:1-3baselineinitiationwithin-boutlength4-6ratesdecay7time8asymptoticend9refractoryperiodDataillustrategoodnessfitmodelpresentedalsodescribesproceduresisolatecontributingmakeinferencesexperimentalmicroscopicanalysisallowsmappingdifferentdistinctimplicatedmayunderstandingneurobiologicaltreatmentsmicroscope:isolatingsources

Similar Articles

Cited By