Autoshaping and automaintenance: a neural-network approach.

José E Burgos
Author Information
  1. José E Burgos: University of Guadalajara, Mexico. jburgos@cucba.udg.mx

Abstract

This article presents an interpretation of autoshaping, and positive and negative automaintenance, based on a neural-network model. The model makes no distinction between operant and respondent learning mechanisms, and takes into account knowledge of hippocampal and dopaminergic systems. Four simulations were run, each one using an A-B-A design and four instances of feedfoward architectures. In A, networks received a positive contingency between inputs that simulated a conditioned stimulus (CS) and an input that simulated an unconditioned stimulus (US). Responding was simulated as an output activation that was neither elicited by nor required for the US. B was an omission-training procedure. Response directedness was defined as sensory feedback from responding, simulated as a dependence of other inputs on responding. In Simulation 1, the phenomena were simulated with a fully connected architecture and maximally intense response feedback. The other simulations used a partially connected architecture without competition between CS and response feedback. In Simulation 2, a maximally intense feedback resulted in substantial autoshaping and automaintenance. In Simulation 3, eliminating response feedback interfered substantially with autoshaping and automaintenance. In Simulation 4, intermediate autoshaping and automaintenance resulted from an intermediate response feedback. Implications for the operant-respondent distinction and the behavior-neuroscience relation are discussed.

References

  1. J Exp Anal Behav. 1984 Nov;42(3):453-67 [PMID: 16812402]
  2. Science. 1997 Mar 14;275(5306):1593-9 [PMID: 9054347]
  3. J Exp Anal Behav. 1974 Jan;21(1):117-24 [PMID: 16811725]
  4. J Exp Anal Behav. 1969 Jul;12(4):511-20 [PMID: 16811370]
  5. Learn Mem. 2003 Nov-Dec;10(6):427-55 [PMID: 14657256]
  6. Behav Processes. 2005 May 31;69(2):249-56 [PMID: 15845311]
  7. J Exp Anal Behav. 1974 Mar;21(2):361-71 [PMID: 16811749]
  8. Science. 1976 Apr 30;192(4238):483-5 [PMID: 1257783]
  9. J Neurophysiol. 1997 Aug;78(2):1184-7 [PMID: 9307149]
  10. J Exp Anal Behav. 1968 Jan;11(1):1-8 [PMID: 5636851]
  11. Behav Processes. 2007 Jun;75(2):242-9 [PMID: 17346905]
  12. Psychol Rev. 1981 Mar;88(2):135-70 [PMID: 7291377]
  13. J Exp Anal Behav. 1997 Mar;67(2):259-73 [PMID: 16812845]
  14. J Exp Anal Behav. 1969 Jan;12(1):187-9 [PMID: 5778312]
  15. J Exp Anal Behav. 1972 Sep;18(2):201-16 [PMID: 16811623]
  16. J Exp Psychol. 1959 Nov;58:341-7 [PMID: 14427737]
  17. J Exp Anal Behav. 1974 Nov;22(3):483-9 [PMID: 16811811]
  18. J Exp Anal Behav. 1974 Nov;22(3):497-506 [PMID: 16811813]
  19. J Exp Anal Behav. 1987 Mar;47(2):241-7 [PMID: 16812478]
  20. Psychol Rev. 1992 Apr;99(2):268-305 [PMID: 1594726]
  21. Neuron. 2002 Oct 10;36(2):241-63 [PMID: 12383780]
  22. Psychol Rev. 1967 May;74(3):151-82 [PMID: 5342881]
  23. Behav Neurosci. 1986 Oct;100(5):764-76 [PMID: 3778639]
  24. Behav Anal. 1995 Spring;18(1):51-68 [PMID: 22478204]
  25. Psychol Rev. 1950 Jul;57(4):193-216 [PMID: 15440996]
  26. Behav Processes. 2002 Apr 28;57(2-3):241-259 [PMID: 11948001]
  27. J Neurosci. 2005 Jun 29;25(26):6235-42 [PMID: 15987953]
  28. J Exp Anal Behav. 1973 Sep;20(2):163-81 [PMID: 4752087]
  29. Psychol Rev. 1952 Nov;59(6):431-42 [PMID: 13004146]
  30. Science. 1971 Mar 5;171(3974):923-5 [PMID: 5541660]
  31. J Exp Anal Behav. 2001 May;75(3):311-33 [PMID: 11453621]
  32. J Exp Anal Behav. 1968 May;11(3):307-9 [PMID: 4969214]
  33. J Exp Anal Behav. 1973 May;19(3):509-16 [PMID: 16811681]
  34. Psychol Rev. 1988 Oct;95(4):411-33 [PMID: 3057526]
  35. J Exp Anal Behav. 1985 May;43(3):365-81 [PMID: 3894561]
  36. J Exp Anal Behav. 2005 Nov;84(3):313-25 [PMID: 16596967]
  37. J Exp Anal Behav. 1979 May;31(3):395-403 [PMID: 16812140]
  38. J Exp Anal Behav. 1972 May;17(3):351-7 [PMID: 16811590]
  39. J Exp Anal Behav. 1972 Nov;18(3):369-83 [PMID: 4661250]
  40. J Exp Anal Behav. 1974 Jan;21(1):125-44 [PMID: 16811726]
  41. Behav Processes. 2003 Apr 28;62(1-3):183-192 [PMID: 12729977]
  42. J Exp Anal Behav. 2000 Nov;74(3):331-46 [PMID: 11218229]
  43. Psychol Rev. 2005 Jul;112(3):560-85 [PMID: 16060751]
  44. Proc Natl Acad Sci U S A. 1968 Jul;60(3):758-65 [PMID: 5243922]
  45. J Exp Anal Behav. 1997 Mar;67(2):193-211 [PMID: 9132463]
  46. J Exp Anal Behav. 1993 Jul;60(1):17-40 [PMID: 8354965]
  47. Science. 1973 Aug 31;181(4102):875-7 [PMID: 17816240]
  48. J Exp Anal Behav. 1999 Mar;71(2):257-63; discussion 293-301 [PMID: 10366311]
  49. J Exp Anal Behav. 2006 Jul;86(1):1-10 [PMID: 16903489]
  50. J Exp Anal Behav. 1973 Mar;19(2):225-32 [PMID: 16811661]
  51. Anim Learn Behav. 1978 May;6(2):209-15 [PMID: 680322]

MeSH Term

Computer Simulation
Feedback
Humans
Neural Networks, Computer
Self Efficacy
Sensation

Word Cloud

Created with Highcharts 10.0.0feedbacksimulatedautoshapingautomaintenanceSimulationresponsepositiveneural-networkmodeldistinctionsimulationsinputsstimulusCSUSrespondingconnectedarchitecturemaximallyintenseresultedintermediatearticlepresentsinterpretationnegativebasedmakesoperantrespondentlearningmechanismstakesaccountknowledgehippocampaldopaminergicsystemsFourrunoneusingA-B-AdesignfourinstancesfeedfowardarchitecturesnetworksreceivedcontingencyconditionedinputunconditionedRespondingoutputactivationneitherelicitedrequiredBomission-trainingprocedureResponsedirectednessdefinedsensorydependence1phenomenafullyusedpartiallywithoutcompetition2substantial3eliminatinginterferedsubstantially4Implicationsoperant-respondentbehavior-neurosciencerelationdiscussedAutoshapingautomaintenance:approach

Similar Articles

Cited By