A salience misattribution model for addictive-like behaviors.

Shivam Kalhan, A David Redish, Robert Hester, Marta I Garrido
Author Information
  1. Shivam Kalhan: School of Psychological Sciences, University of Melbourne, Melbourne, Victoria, Australia. Electronic address: skalhan@student.unimelb.edu.au.
  2. A David Redish: Department of Neuroscience, University of Minnesota, Minneapolis, MN, 55455, USA.
  3. Robert Hester: School of Psychological Sciences, University of Melbourne, Melbourne, Victoria, Australia.
  4. Marta I Garrido: School of Psychological Sciences, University of Melbourne, Melbourne, Victoria, Australia; Australian Research Council Centre of Excellence for Integrative Brain Function, Australia.

Abstract

Adapting to the changing environment is a key component of optimal decision-making. Internal-models that accurately represent and selectively update from behaviorally relevant/salient stimuli may facilitate adaptive behaviors. Anterior cingulate cortex (ACC) and dopaminergic systems may produce these adaptive internal-models through selective updates from behaviorally relevant stimuli. Dysfunction of ACC and dopaminergic systems could therefore produce misaligned internal-models where updates are disproportionate to the salience of the cues. An aspect of addictive-like behaviors is reduced adaptation and, ACC and dopaminergic systems typically exhibit dysfunction in drug-dependents. We argue that ACC and dopaminergic dysfunction in dependents may produce misaligned internal-models such that drug-related stimuli are misattributed with a higher salience compared to non-drug related stimuli. Hence, drug-related rewarding stimuli generate over-weighted updates to the internal-model, while negative feedback and non-drug related rewarding stimuli generate down-weighted updates. This misaligned internal-model may therefore incorrectly reinforce maladaptive drug-related behaviors. We use the proposed framework to discuss ways behavior may be made more adaptive and how the framework may be supported or falsified experimentally.

Keywords

References

  1. Neurosci Lett. 2002 Jun 14;325(3):203-6 [PMID: 12044656]
  2. J Psychoactive Drugs. 2000 Nov;32 Suppl:i-iv, 1-112 [PMID: 11280926]
  3. Psychopharmacology (Berl). 2006 Mar;184(3-4):577-88 [PMID: 16133128]
  4. J Neurosci. 2006 Jun 14;26(24):6583-8 [PMID: 16775146]
  5. Pharmacol Biochem Behav. 2018 Jan;164:99-105 [PMID: 28216068]
  6. Curr Top Behav Neurosci. 2010;3:319-41 [PMID: 21161759]
  7. Drug Alcohol Depend. 2018 Jul 1;188:32-38 [PMID: 29729537]
  8. J Neurosci. 2012 Feb 22;32(8):2619-27 [PMID: 22357846]
  9. Nat Neurosci. 2018 Nov;21(11):1520-1529 [PMID: 30323276]
  10. Science. 2004 Oct 15;306(5695):443-7 [PMID: 15486290]
  11. Nat Commun. 2018 Apr 23;9(1):1611 [PMID: 29686225]
  12. Annu Rev Psychol. 2016;67:23-50 [PMID: 26253543]
  13. Philos Trans R Soc Lond B Biol Sci. 2008 Oct 12;363(1507):3137-46 [PMID: 18640920]
  14. J Exp Psychol Gen. 1999 Mar;128(1):78-87 [PMID: 10100392]
  15. Psychol Addict Behav. 2008 Sep;22(3):426-32 [PMID: 18778136]
  16. Science. 2012 Oct 5;338(6103):135-9 [PMID: 23042898]
  17. Pharmacol Biochem Behav. 2009 Sep;93(3):237-47 [PMID: 19410598]
  18. Proc Natl Acad Sci U S A. 2010 Sep 21;107(38):16667-72 [PMID: 20823246]
  19. J R Soc Med. 1996 Jul;89(7):396-400 [PMID: 8774539]
  20. Science. 2004 Dec 10;306(5703):1944-7 [PMID: 15591205]
  21. Addict Behav. 2009 May;34(5):487-9 [PMID: 19162409]
  22. Nature. 2003 Apr 10;422(6932):614-8 [PMID: 12687000]
  23. Hum Brain Mapp. 2007 Jul;28(7):625-35 [PMID: 17080442]
  24. Neurosci Biobehav Rev. 2019 Sep;104:1-10 [PMID: 31247240]
  25. Psychol Rev. 2007 Jul;114(3):784-805 [PMID: 17638506]
  26. Nat Rev Neurosci. 2010 Feb;11(2):127-38 [PMID: 20068583]
  27. Neuron. 2017 Jul 19;95(2):447-456.e3 [PMID: 28689983]
  28. Trends Neurosci. 2004 Dec;27(12):712-9 [PMID: 15541511]
  29. Neuropsychopharmacology. 2017 Apr;42(5):1049-1057 [PMID: 28042871]
  30. Annu Rev Neurosci. 1995;18:193-222 [PMID: 7605061]
  31. Addiction. 2000 Aug;95 Suppl 2:S119-28 [PMID: 11002907]
  32. J Neurosci. 2011 Mar 16;31(11):4178-87 [PMID: 21411658]
  33. Neuroimage. 2016 Jan 15;125:578-586 [PMID: 26520774]
  34. Am J Psychiatry. 2007 Apr;164(4):622-9 [PMID: 17403976]
  35. Biol Psychiatry. 2005 Feb 1;57(3):287-94 [PMID: 15691530]
  36. Nat Rev Neurosci. 2011 Oct 20;12(11):652-69 [PMID: 22011681]
  37. Psychol Rev. 1948 Jul;55(4):189-208 [PMID: 18870876]
  38. Nat Neurosci. 1999 Jan;2(1):79-87 [PMID: 10195184]
  39. Proc Natl Acad Sci U S A. 1996 Nov 26;93(24):13494-9 [PMID: 8942962]
  40. Neuroimage Clin. 2019;23:101819 [PMID: 31009885]
  41. Psychiatry Res. 2008 Jan 15;162(1):59-72 [PMID: 18093809]
  42. J Cogn Neurosci. 1997 Nov;9(6):788-98 [PMID: 23964600]
  43. Neurosci Biobehav Rev. 2016 Dec;71:252-266 [PMID: 27590829]
  44. Curr Pharm Des. 2012;18(1):113-8 [PMID: 22236117]
  45. Eur J Pharmacol. 1999 Jun 30;375(1-3):13-30 [PMID: 10443561]
  46. Annu Rev Clin Psychol. 2010;6:551-75 [PMID: 20192786]
  47. Annu Rev Psychol. 2004;55:271-304 [PMID: 14744217]
  48. Neurosci Biobehav Rev. 2013 Nov;37(9 Pt A):1946-54 [PMID: 23438892]
  49. Neuropsychopharmacology. 2008 Aug;33(9):2148-57 [PMID: 17987060]
  50. Nat Neurosci. 2007 Sep;10(9):1214-21 [PMID: 17676057]
  51. Nat Neurosci. 2005 Nov;8(11):1458-63 [PMID: 16251988]
  52. Am Psychol. 2016 Nov;71(8):670-679 [PMID: 27977239]
  53. Learn Behav. 2012 Sep;40(3):255-68 [PMID: 22927000]
  54. Nat Commun. 2016 Sep 22;7:12830 [PMID: 27653278]
  55. Neuron. 2016 Jun 1;90(5):1127-38 [PMID: 27181060]
  56. Neuropharmacology. 2004;47 Suppl 1:33-46 [PMID: 15464124]
  57. Neuron. 2016 Jul 6;91(1):182-93 [PMID: 27292535]
  58. Biol Psychiatry. 2009 May 15;65(10):835-40 [PMID: 19200535]
  59. Behav Brain Sci. 2008 Aug;31(4):415-37; discussion 437-87 [PMID: 18662461]
  60. Science. 1988 Jun 17;240(4859):1627-31 [PMID: 3289116]
  61. Biol Psychol. 2007 Apr;75(1):45-51 [PMID: 17196732]
  62. Neuron. 2011 Mar 24;69(6):1204-15 [PMID: 21435563]
  63. Neuropharmacology. 2014 Jan;76 Pt B:518-27 [PMID: 23806805]
  64. Neuropsychopharmacology. 2007 Sep;32(9):1974-84 [PMID: 17268406]
  65. Expert Rev Neurother. 2011 Feb;11(2):275-85 [PMID: 21306214]
  66. Neurosci Biobehav Rev. 2012 Sep;36(8):1870-84 [PMID: 22683741]
  67. Philos Trans R Soc Lond B Biol Sci. 1998 Aug 29;353(1373):1245-55 [PMID: 9770219]
  68. Addict Biol. 2015 Sep;20(5):968-78 [PMID: 25214465]
  69. Neurosci Lett. 2011 May 27;496(1):5-10 [PMID: 21458537]
  70. Proc Natl Acad Sci U S A. 2013 Sep 17;110(38):E3660-9 [PMID: 23986499]
  71. Drug Alcohol Depend. 2008 Jan 1;92(1-3):123-31 [PMID: 17869030]
  72. Am J Psychiatry. 2002 Oct;159(10):1642-52 [PMID: 12359667]
  73. Nat Neurosci. 2005 Nov;8(11):1481-9 [PMID: 16251991]
  74. Curr Opin Neurobiol. 1997 Apr;7(2):255-61 [PMID: 9142748]
  75. Nat Neurosci. 2013 Jul;16(7):966-73 [PMID: 23708143]
  76. Am J Psychiatry. 2000 Nov;157(11):1789-98 [PMID: 11058476]
  77. Nat Rev Neurosci. 2019 Nov;20(11):703-714 [PMID: 31570826]
  78. Psychol Rev. 2002 Oct;109(4):679-709 [PMID: 12374324]
  79. Drug Alcohol Depend. 2008 Apr 1;94(1-3):116-24 [PMID: 18155856]
  80. PLoS Comput Biol. 2019 Sep 16;15(9):e1007331 [PMID: 31525176]
  81. Nature. 2001 Jul 5;412(6842):43-8 [PMID: 11452299]
  82. Psychopharmacology (Berl). 1999 Oct;146(4):373-90 [PMID: 10550488]
  83. Front Psychiatry. 2017 Dec 14;8:285 [PMID: 29312016]
  84. Psychol Rev. 2001 Jul;108(3):624-52 [PMID: 11488380]
  85. Neuropsychopharmacology. 2009 Oct;34(11):2450-8 [PMID: 19553917]
  86. Proc Natl Acad Sci U S A. 2018 Oct 23;115(43):E10167-E10176 [PMID: 30297411]
  87. Pharmacol Biochem Behav. 2011 Jan;97(3):514-20 [PMID: 21047524]
  88. J Neurosci. 1998 Mar 15;18(6):2231-8 [PMID: 9482807]
  89. Brain Res Brain Res Rev. 1993 Sep-Dec;18(3):247-91 [PMID: 8401595]
  90. Neuron. 2012 Oct 4;76(1):240-56 [PMID: 23040818]
  91. Science. 1997 Mar 14;275(5306):1593-9 [PMID: 9054347]
  92. Nature. 1997 Apr 24;386(6627):830-3 [PMID: 9126741]
  93. J Neurosci. 2009 Jun 10;29(23):7489-96 [PMID: 19515916]
  94. Eur J Neurosci. 2008 Apr;27(7):1823-35 [PMID: 18380674]
  95. Science. 2016 Jan 1;351(6268):aac9698 [PMID: 26722001]
  96. PLoS One. 2011;6(10):e25591 [PMID: 22039418]
  97. Drug Alcohol Depend. 2015 Oct 1;155:175-82 [PMID: 26249266]
  98. Am J Psychiatry. 2005 Aug;162(8):1403-13 [PMID: 16055761]
  99. Pharmacol Rev. 2011 Jun;63(2):348-65 [PMID: 21490129]
  100. Nat Rev Genet. 2009 Apr;10(4):225-31 [PMID: 19238175]

Grants

  1. R01 MH112688/NIMH NIH HHS

MeSH Term

Adaptation, Physiological
Behavior, Addictive
Dopamine
Gyrus Cinguli
Humans
Reward

Chemicals

Dopamine

Word Cloud

Created with Highcharts 10.0.0stimulimaybehaviorsACCdopaminergicupdatesadaptivesystemsproduceinternal-modelsmisalignedsaliencedrug-relatedbehaviorallyAnteriorcingulatecortexthereforeaddictive-likedysfunctionnon-drugrelatedrewardinggenerateinternal-modelframeworkAdaptingchangingenvironmentkeycomponentoptimaldecision-makingInternal-modelsaccuratelyrepresentselectivelyupdaterelevant/salientfacilitateselectiverelevantDysfunctiondisproportionatecuesaspectreducedadaptationtypicallyexhibitdrug-dependentsarguedependentsmisattributedhighercomparedHenceover-weightednegativefeedbackdown-weightedincorrectlyreinforcemaladaptiveuseproposeddiscusswaysbehaviormadesupportedfalsifiedexperimentallymisattributionmodelAdaptationAddictionDecision-makingDopamineInternal-modelupdatingPrediction-errorsSalience

Similar Articles

Cited By