Reservoir computing with noise.

Chad Nathe, Chandra Pappu, Nicholas A Mecholsky, Joe Hart, Thomas Carroll, Francesco Sorrentino
Author Information
  1. Chad Nathe: Mechanical Engineering Department, University of New Mexico, Albuquerque, New Mexico 87131, USA. ORCID
  2. Chandra Pappu: Electrical, Computer and Biomedical Engineering Department, Union College, Schenectady, New York 12309, USA. ORCID
  3. Nicholas A Mecholsky: Department of Physics and Vitreous State Laboratory, The Catholic University of America, Washington, DC 20064, USA. ORCID
  4. Joe Hart: US Naval Research Laboratory, Washington, DC 20375, USA. ORCID
  5. Thomas Carroll: US Naval Research Laboratory, Washington, DC 20375, USA. ORCID
  6. Francesco Sorrentino: Mechanical Engineering Department, University of New Mexico, Albuquerque, New Mexico 87131, USA. ORCID

Abstract

This paper investigates in detail the effects of measurement noise on the performance of reservoir computing. We focus on an application in which reservoir computers are used to learn the relationship between different state variables of a chaotic system. We recognize that noise can affect the training and testing phases differently. We find that the best performance of the reservoir is achieved when the strength of the noise that affects the input signal in the training phase equals the strength of the noise that affects the input signal in the testing phase. For all the cases we examined, we found that a good remedy to noise is to low-pass filter the input and the training/testing signals; this typically preserves the performance of the reservoir, while reducing the undesired effects of noise.

References

  1. Chaos. 2017 Apr;27(4):041102 [PMID: 28456169]
  2. IEEE Trans Neural Netw Learn Syst. 2022 Jun;33(6):2714-2725 [PMID: 34662281]
  3. Philos Trans A Math Phys Eng Sci. 2019 Sep 9;377(2153):20180123 [PMID: 31329059]
  4. Nat Commun. 2011 Sep 13;2:468 [PMID: 21915110]
  5. IEEE Trans Neural Netw Learn Syst. 2022 Jun;33(6):2586-2595 [PMID: 34695007]
  6. Neural Comput. 2002 Nov;14(11):2531-60 [PMID: 12433288]
  7. Sci Rep. 2021 Sep 30;11(1):19465 [PMID: 34593935]
  8. Opt Express. 2012 Jan 30;20(3):3241-9 [PMID: 22330562]
  9. Neural Netw. 2019 Jul;115:100-123 [PMID: 30981085]
  10. Chaos. 2017 Dec;27(12):121102 [PMID: 29289043]
  11. Chaos. 2009 Sep;19(3):033108 [PMID: 19791988]
  12. Chaos. 2021 Oct;31(10):103127 [PMID: 34717323]
  13. Chaos. 2019 Oct;29(10):103128 [PMID: 31675824]
  14. Chaos. 2018 Dec;28(12):123119 [PMID: 30599514]

Grants

  1. R21 EB028489/NIBIB NIH HHS