Reviving the Dynamics of Attacked Reservoir Computers.

Ruizhi Cao, Chun Guan, Zhongxue Gan, Siyang Leng
Author Information
  1. Ruizhi Cao: Institute of AI and Robotics, Academy for Engineering and Technology, Fudan University, Shanghai 200433, China.
  2. Chun Guan: Institute of AI and Robotics, Academy for Engineering and Technology, Fudan University, Shanghai 200433, China.
  3. Zhongxue Gan: Institute of AI and Robotics, Academy for Engineering and Technology, Fudan University, Shanghai 200433, China.
  4. Siyang Leng: Institute of AI and Robotics, Academy for Engineering and Technology, Fudan University, Shanghai 200433, China. ORCID

Abstract

Physically implemented neural networks are subject to external perturbations and internal variations. Existing works focus on the adversarial attacks but seldom consider attack on the network structure and the corresponding recovery method. Inspired by the biological neural compensation mechanism and the neuromodulation technique in clinical practice, we propose a novel framework of reviving attacked reservoir computers, consisting of several strategies direct at different types of attacks on structure by adjusting only a minor fraction of edges in the reservoir. Numerical experiments demonstrate the efficacy and broad applicability of the framework and reveal inspiring insights into the mechanisms. This work provides a vehicle to improve the robustness of reservoir computers and can be generalized to broader types of neural networks.

Keywords

References

  1. Int J Neural Syst. 2000 Feb;10(1):19-42 [PMID: 10798708]
  2. Phys Rev Lett. 2001 Apr 16;86(16):3682-5 [PMID: 11328053]
  3. Nat Rev Neurosci. 2006 Jul;7(7):563-74 [PMID: 16791145]
  4. Phys Rev E Stat Nonlin Soft Matter Phys. 2005 May;71(5 Pt 2):056103 [PMID: 16089598]
  5. Neural Netw. 2012 Nov;35:1-9 [PMID: 22885243]
  6. Proc Natl Acad Sci U S A. 2002 Jun 11;99(12):7821-6 [PMID: 12060727]
  7. Nat Commun. 2022 Mar 23;13(1):1549 [PMID: 35322037]
  8. J Vis Exp. 2011 May 23;(51): [PMID: 21654618]
  9. Neural Netw. 2020 Aug;128:13-21 [PMID: 32380402]
  10. Proc Natl Acad Sci U S A. 2018 Oct 23;115(43):E9994-E10002 [PMID: 30297422]
  11. IEEE Trans Neural Netw. 1994;5(4):651-8 [PMID: 18267837]
  12. Neural Netw. 2020 Jun;126:191-217 [PMID: 32248008]
  13. Ann Phys Rehabil Med. 2019 Mar;62(2):104-121 [PMID: 30660671]
  14. Neuroimage. 2016 Oct 15;140:57-65 [PMID: 27268424]
  15. Adv Mater. 2022 Dec;34(48):e2108826 [PMID: 35064981]
  16. IEEE Trans Pattern Anal Mach Intell. 2021 Oct;43(10):3309-3320 [PMID: 32286957]
  17. Int J Neuropsychopharmacol. 2014 Oct 31;18(2): [PMID: 25522391]
  18. Brain Connect. 2014 Nov;4(9):662-76 [PMID: 25183440]
  19. Nature. 2000 Jul 27;406(6794):378-82 [PMID: 10935628]
  20. Neural Netw. 2020 Aug;128:234-247 [PMID: 32447266]
  21. Adv Sci (Weinh). 2022 May;9(15):e2106092 [PMID: 35285175]
  22. Neural Comput. 1997 Nov 15;9(8):1735-80 [PMID: 9377276]
  23. Exp Neurol. 2009 Sep;219(1):14-9 [PMID: 19348793]
  24. Nat Rev Neurosci. 2009 Feb;10(2):113-25 [PMID: 19145235]
  25. Neural Netw. 2007 Apr;20(3):335-52 [PMID: 17517495]
  26. Nat Commun. 2020 Sep 11;11(1):4568 [PMID: 32917894]
  27. Brain Stimul. 2012 Jul;5(3):175-195 [PMID: 22037126]

Grants

  1. 2021ZD0201301/STI 2030 - Major Projects
  2. 12101133/National Natural Science Foundation of China
  3. 21YF1402300/Shanghai Sailing Program
  4. 2021SHZDZX0103/Shanghai Municipal Science and Technology Major Project

Word Cloud

Created with Highcharts 10.0.0reservoirneuralstructurenetworksattacksattacknetworkrecoveryframeworkcomputerstypesPhysicallyimplementedsubjectexternalperturbationsinternalvariationsExistingworksfocusadversarialseldomconsidercorrespondingmethodInspiredbiologicalcompensationmechanismneuromodulationtechniqueclinicalpracticeproposenovelrevivingattackedconsistingseveralstrategiesdirectdifferentadjustingminorfractionedgesNumericalexperimentsdemonstrateefficacybroadapplicabilityrevealinspiringinsightsmechanismsworkprovidesvehicleimproverobustnesscangeneralizedbroaderRevivingDynamicsAttackedReservoirComputersEchoStatePropertycomputer

Similar Articles

Cited By