An analysis of renewal following fading of reinforcer type.

Kate E Derrenbacker, William E Sullivan, Emily L Baxter, Beatriz Arroyo, Henry S Roane, Charlene N Agnew, Michael Koegel, Andrew R Craig
Author Information
  1. Kate E Derrenbacker: SUNY Upstate Medical University, Rochester, NY, USA. ORCID
  2. William E Sullivan: SUNY Upstate Medical University, Rochester, NY, USA.
  3. Emily L Baxter: University of North Carolina Wilmington, Wilmington, NC, USA.
  4. Beatriz Arroyo: SUNY Upstate Medical University, Rochester, NY, USA. ORCID
  5. Henry S Roane: SUNY Upstate Medical University, Rochester, NY, USA.
  6. Charlene N Agnew: SUNY Upstate Medical University, Rochester, NY, USA. ORCID
  7. Michael Koegel: SUNY Upstate Medical University, Rochester, NY, USA.
  8. Andrew R Craig: SUNY Upstate Medical University, Rochester, NY, USA.

Abstract

Renewal is defined as relapse of a previously extinguished target behavior following a change in context. This form of relapse has been shown to occur when an alternative source of reinforcement that was made available during extinction of the target response is abruptly switched to a different type of reinforcement. The current experiment examined a method for mitigating renewal produced by switching reinforcement by fading reinforcer type during extinction. In Phase 1, rats' target-lever pressing was reinforced with one type of reinforcement (O1). In Phase 2, lever pressing was extinguished and noncontingent reinforcers were delivered. The forward fading group initially experienced all alternative (O2) reinforcement, and the percentage of O1 reinforcement was increased across sessions. The reverse fading group initially experienced 90% O1 and 10% O2 reinforcement, and the percentage of O2 reinforcement was increased across sessions. A third group received delivery of O2 only, serving as a control. In Phase 3, all groups received noncontingent delivery of O1 reinforcement only. Robust renewal was seen in the control group relative to both fading groups. Furthermore, levels of renewal were lower and did not differ significantly between the forward fading and reverse fading group. These findings provide further insight into the role of context in relapse and may provide suggestions for future clinical applications.

Keywords

References

  1. Baer, D. M., Wolf, M. M., & Risley, T. R. (1968). Some current dimensions of applied behavior analysis. Journal of Applied Behavior Analysis, 1(1), 91���97. https://doi.org/10.1901/jaba.1968.1-91
  2. Bouton, M. E. (1993). Context, time, and memory in the interference paradigms of Pavlovian learning. Psychological Bulletin, 114(1), 80���99. https://doi.org/10.1037/0033-2909.114.1.80
  3. Bouton, M. E. (2002). Context, ambiguity, and unlearning: Sources of relapse after behavioral extinction. Biological Psychiatry, 52(10), 976���86. https://doi.org/10.1016/s0006-3223(02)01546-9
  4. Bouton, M. E. (2004). Context and behavioral processes in extinction. Learning & Memory, 11(5), 485���494. https://doi.org/10.1101/lm.78804
  5. Bouton, M. E., & Garc��a���Guti��rrez, A. (2006). Intertrial interval as a contextual stimulus. Behavioral Processes, 71(2���3), 307���317. https://doi.org/10.1016/j.beproc.2005.12.003
  6. Bouton, M. E., Keeney, F. A., & Rosengard, C. (1990). State���dependent fear extinction with two benzodiazepine tranquilizers. Behavioral Neuroscience, 104(1), 44���55. https://doi.org/10.1037/0735-7044.104.1.44
  7. Bouton, M. E., & Todd, T. P. (2014). A fundamental role for context in instrumental learning and extinction. Behavioral Processes, 104, 13���19. https://doi.org/10.1016/j.beproc.2014.02.012
  8. Bouton, M. E., Todd, T. P., Vubric, D., & Winterbauer, N. E. (2011). Renewal after the extinction of free operant behavior. Learning and Behavior, 39(1), 57���67. https://doi.org/10.3758/s13420-011-0018-6.
  9. Bouton, M. E., & Trask, S. (2016). Role of the discriminative properties of the reinforcer in resurgence. Learning and Behavior, 44(2), 137���150. https://doi.org/10.3758/s13420-015-0197-7
  10. Browning, K. O., & Shahan, T. A. (2018). Renewal of extinguished operant behavior following changes in social context. Journal of the Experimental Analysis of Behavior, 110(3), 430���439. https://doi.org/10.1002/jeab.472
  11. Carr, E. G., & Durand, V. M. (1985). Reducing behavior problems through functional communication training. Journal of Applied Behavior Analysis, 18(2), 111���126. https://doi.org/10.1901/jaba.1985.18-111
  12. Cowie, S. (2019). Some weaknesses of a response���strength account of reinforcer effects. European Journal of Behavior Analysis, 21(2), 348���363. https://doi.org/10.1080/15021149.2019.1685247
  13. Cowie, S., & Davison, M. (2016). Control by reinforcers across time and space: A review of recent choice research. Journal of the Experimental Analysis of Behavior, 105(2), 246���269. https://doi.org/10.1002/jeab.200
  14. Craig, A. R., Cunningham, P. J., & Shahan, T. A. (2015). Behavioral momentum and accumulation of mass in multiple schedules. Journal of the Experimental Analysis of Behavior, 103(3), 437���449. https://doi.org/10.1002/jeab.145
  15. Crombag, H. S., Bossert, J. M., Koya, E., & Shaham, Y. (2008). Context���induced relapse to drug seeking: A review. Philosophical Transactions of the Royal Society of London. Series B, Biological Sciences, 363(1507), 3233���3243. https://doi.org/10.1098/rstb.2008.0090
  16. Davison, M., & Cowie, S. (2023). The generalization���across���gradients model applied to conditional temporal discrimination. Journal of the Experimental Analysis of Behavior, 121(3), 327���345. https://doi.org/10.1002/jeab.914
  17. Davison, M., & Nevin, J. A. (1999). Stimuli, reinforcers, and behavior: An integration. Journal of the Experimental Analysis of behavior, 71(3), 439���482. https://doi.org/10.1901/jeab.1999.71-439
  18. Didden, R., Sturmey, P., Sigafoos, J., Lang, R., O'Reilly, M. F., & Lancioni, G. E. (2012). Nature, prevalence, and characteristics of challenging behavior. In J. L. Matson (Ed.), Functional assessment for challenging behaviors���(pp. 25���44). Springer Science + Business Media. https://doi.org/10.1007/978-1-4614-3037-7_3
  19. Fleshler, M., & Hoffman, H. S. (1962). A progression for generating variable���interval schedules. Journal of the Experimental Analysis of Behavior, 5(4), 529���530. https://doi.org/10.1901/jeab.1962.5-529
  20. Galizio, M. (2016). Olfactory stimulus control and the behavioral pharmacology of remembering. Behavior Analysis, 16(4), 169���178. https://doi.org/10.1037/bar0000033
  21. Haney, S. D., Piazza, C. D., Peterson, K. M, & Greer, B. G. (2021). An evaluation of a renewal���mitigation procedure for inappropriate mealtime behavior. Journal of Applied Behavior Analysis, 54(3), 903���927. https://doi.org/10.1002/jaba.815
  22. Kelley, M. E., Jimenez���Gomez, C., Podlesnik, C. A., & Morgan, A. (2018). Evaluation of renewal mitigation of negatively reinforced socially significant operant behavior. Learning and Motivation, 63, 133���141. https://doi.org/10.1016/j.lmot.2018.05.003
  23. Koegel, M., Sullivan, W. E., Agnew, C. N., Derrenbacker, K. E., Baxter, E. L., Roane, H. S., & Craig, A. R. (2021, May 27���31). The effects of fading between reinforcement and extinction contexts on operant renewal. In M. P. Kranak (Chair), Recent research on renewal and resurgence: Bridging the gap between basic and applied research. Symposium presented at the 47th annual meeting of the Association for Behavior Analysis, International, Online.
  24. Lattal, K. A., & Wacker, D. (2015). Some dimensions of recurrent operant behavior. Mexican Journal of Behavior Analysis, 41(2), 1���13. https://doi.org/10.5514/rmac.v41.i2.63716
  25. Lawrence, M. A. (2011) ez: Easy analysis and visualization of factorial experiments. R package (version 3.0���0) [Computer file]. http://CRAN.R-project.org/package=ez
  26. Marsteller, T. M., & St. Peter, C. C. (2014). Effects of fixed���time reinforcement schedules on resurgence of problem behavior. Journal of Applied Behavior Analysis, 47(3), 455���469. https://doi.org/10.1002/jaba.134
  27. Nakajima, S., Tanaka, S., & Urushihara, K. (2000). Renewal of extinguished lever���press responses upon return to the training context. Learning and Motivation, 31(4), 416���431. https://doi.org/10.1006/lmoy.2000.1064
  28. Podlesnik, C. A., Kelley, M. E., Jimenez���Gomez, C., & Bouton, M. E. (2017). Renewed behavior produced by context change and its implications for treatment maintenance: A review. Journal of Applied Behavior Analysis, 50(3), 675���697. https://doi.org/10.1002/jaba.400
  29. Saini, V., & Mitteer, D. R. (2020). A review of investigations of operant renewal with human participants: Implications for theory and practice. Journal of the Experimental Analysis of Behavior, 113(1), 105���123. https://doi.org/10.1002/jeab.562
  30. Saini, V., Sullivan, W. E., Baxter, E. L., DeRosa, N. M., & Roane, H. S. (2018). Renewal during functional communication training. Journal of Applied Behavior Analysis, 51(3), 603���619. https://doi.org/10.1002/jaba.471
  31. Schepers, S. T., & Bouton, M. E. (2015). Effects of reinforcer distribution during response elimination on resurgence of an instrumental behavior. Journal of Experimental Psychology: Animal Learning and Cognition, 41(2), 179���192. https://doi.org/10.1037/xan000061
  32. Schepers, S. T., & Bouton, M. E. (2017). Hunger as a context: Food seeking that is inhibited during hunger can renew in the context of satiety. Psychological Science, 28(11), 1640���1648. https://doi.org/10.1177/0956797617719084
  33. Shahan, T. A., Browning, K. O., & Nall, R. W. (2019). Resurgence as choice in context: Treatment duration and on/off alternative reinforcement. Journal of the Experimental Analysis of Behavior, 113(1), 57���76. https://doi.org/10.1002/jeab.563
  34. Slotnick, B. (2001). Animal cognition and the rat olfactory system. Trends in Cognitive Sciences, 5(5), 216���222. https://doi.org/10.1016/s1364-6613(00)01625-9
  35. Sullivan, W. E., Saini, V., & Roane, H. S. (2018). A nonsequential approach to the study of operant renewal: A reverse translation. Journal of the Experimental Analysis of Behavior, 110(1), 74���86. htpps://doi.org/10.1002/jeab.456
  36. Sweeney, M. M., & Shahan, T. A. (2013). Effects of high, low, and thinning rates of alternative reinforcement on response elimination and resurgence. Journal of the Experimental Analysis of Behavior, 100(1), 102���116. https://doi.org/10.1002/jeab.26
  37. Tiger, J. H., Hanley, G. P., & Bruzek, K. (2008). Functional communication training: A review and practical guide. Behavior Analysis in Practice, 1(1), 16���23. https://doi.org/10.1007/BF03391716
  38. Todd, T. P. (2013). Mechanisms of renewal after the extinction of instrumental behavior. Journal of Experimental Psychology: Animal Behavior Processes, 39(3), 193���207. https://doi.org/10.1037/a0032236
  39. Trask, S., Schepers, S. T., & Bouton, M. E. (2015). Context change explains resurgence after the extinction of operant behavior. Mexican Journal of Behavior Analysis, 41(2), 187���210. https://doi.org/10.5514/rmac.v41.i2.63772
  40. Wathen, S. N., & Podlesnik, C. A. (2018). Laboratory models of treatment relapse and mitigation techniques. Behavior Analysis: Research and Practice, 18(4), 362���387. https://doi.org/10.1037/bar0000119
  41. Wickham H., Averick M., Bryan J., Chang W., McGowan L. D., Fran��ois R., Grolemund G., Hayes, A., Henry, L., Hester, J., Kuhn, M., Pedersen, T. L., Miller, E., Bache, S. M., M��ller, K., Ooms, J., Robinson, D., Seidel, D.P., Spinu, V., ��� Yutani, H. (2019). ���Welcome to the tidyverse.��� Journal of Open Source Software, 4(43), Article 1686. https://doi.org/10.21105/joss.01686
  42. Winterbauer, N. E., & Bouton, M. E. (2010). Mechanisms of resurgence of an extinguished instrumental behavior. Journal of Experimental Psychology: Animal Behavior Processes, 36(3), 343���353. https://doi.org/10.1037/a0017365
  43. Winterbauer, N. E., Lucke, S., & Bouton, M. E. (2013). Some factors modulating the strength of resurgence after extinction of an instrumental behavior. Learning and Motivation, 44(1), 60���71. https://doi.org/10.1016/j.lmot.2012.03.003

Grants

  1. /B. Thomas Golisano

Word Cloud

Created with Highcharts 10.0.0reinforcementfadingtyperenewalgrouprelapseO1O2contextreinforcerPhaseextinguishedtargetfollowingalternativeextinctionpressingnoncontingentforwardinitiallyexperiencedpercentageincreasedacrosssessionsreversereceiveddeliverycontrolgroupsprovideRenewaldefinedpreviouslybehaviorchangeformshownoccursourcemadeavailableresponseabruptlyswitcheddifferentcurrentexperimentexaminedmethodmitigatingproducedswitching1rats'target-leverreinforcedone2leverreinforcersdelivered90%10%thirdserving3RobustseenrelativeFurthermorelevelslowerdiffersignificantlyfindingsinsightrolemaysuggestionsfutureclinicalapplicationsanalysisrats

Similar Articles

Cited By