Solving Constraint Satisfaction Problems with Networks of Spiking Neurons.

Zeno Jonke, Stefan Habenschuss, Wolfgang Maass
Author Information
  1. Zeno Jonke: Faculty of Computer Science and Biomedical Engineering, Institute for Theoretical Computer Science, Graz University of Technology Graz, Austria.
  2. Stefan Habenschuss: Faculty of Computer Science and Biomedical Engineering, Institute for Theoretical Computer Science, Graz University of Technology Graz, Austria.
  3. Wolfgang Maass: Faculty of Computer Science and Biomedical Engineering, Institute for Theoretical Computer Science, Graz University of Technology Graz, Austria.

Abstract

Network of neurons in the brain apply-unlike processors in our current generation of computer hardware-an event-based processing strategy, where short pulses (spikes) are emitted sparsely by neurons to signal the occurrence of an event at a particular point in time. Such spike-based computations promise to be substantially more power-efficient than traditional clocked processing schemes. However, it turns out to be surprisingly difficult to design networks of spiking neurons that can solve difficult computational problems on the level of single spikes, rather than rates of spikes. We present here a new method for designing networks of spiking neurons via an energy function. Furthermore, we show how the energy function of a network of stochastically firing neurons can be shaped in a transparent manner by composing the networks of simple stereotypical network motifs. We show that this design approach enables networks of spiking neurons to produce approximate solutions to difficult (NP-hard) constraint satisfaction problems from the domains of planning/optimization and verification/logical inference. The resulting networks employ noise as a computational resource. Nevertheless, the timing of spikes plays an essential role in their computations. Furthermore, networks of spiking neurons carry out for the Traveling Salesman Problem a more efficient stochastic search for good solutions compared with stochastic artificial neural networks (Boltzmann machines) and Gibbs sampling.

Keywords

References

  1. Annu Rev Neurosci. 2004;27:419-51 [PMID: 15217339]
  2. J Comput Neurosci. 2006 Aug;21(1):35-49 [PMID: 16633938]
  3. Nat Rev Neurosci. 2008 Apr;9(4):292-303 [PMID: 18319728]
  4. Nat Rev Neurosci. 2009 May;10(5):373-83 [PMID: 19377502]
  5. Science. 2011 Jan 7;331(6013):83-7 [PMID: 21212356]
  6. Science. 2011 Mar 11;331(6022):1279-85 [PMID: 21393536]
  7. Nature. 2011 Sep 28;478(7368):246-9 [PMID: 21964339]
  8. PLoS Comput Biol. 2011 Nov;7(11):e1002211 [PMID: 22096452]
  9. PLoS Comput Biol. 2011 Dec;7(12):e1002294 [PMID: 22219717]
  10. PLoS Comput Biol. 2012 Aug;8(8):e1002596 [PMID: 23133368]
  11. PLoS Comput Biol. 2013;9(11):e1003311 [PMID: 24244126]
  12. Science. 2014 Aug 8;345(6197):668-73 [PMID: 25104385]
  13. Front Neuroinform. 2014 Aug 14;8:70 [PMID: 25177291]
  14. Neural Comput. 2015 Dec;27(12):2510-47 [PMID: 26496042]
  15. Nat Commun. 2015 Dec 08;6:8941 [PMID: 26642827]
  16. eNeuro. 2016 Jun 21;3(2):null [PMID: 27419214]
  17. Science. 1986 Aug 8;233(4764):625-33 [PMID: 3755256]

Word Cloud

Created with Highcharts 10.0.0networksneuronsspikingspikesdifficultproblemsneuralprocessingspike-basedcomputationsdesigncancomputationalenergyfunctionFurthermoreshownetworksolutionsnoiseresourcestochasticBoltzmannsamplingNetworkbrainapply-unlikeprocessorscurrentgenerationcomputerhardware-anevent-basedstrategyshortpulsesemittedsparselysignaloccurrenceeventparticularpointtimepromisesubstantiallypower-efficienttraditionalclockedschemesHoweverturnssurprisinglysolvelevelsingleratherratespresentnewmethoddesigningviastochasticallyfiringshapedtransparentmannercomposingsimplestereotypicalmotifsapproachenablesproduceapproximateNP-hardconstraintsatisfactiondomainsplanning/optimizationverification/logicalinferenceresultingemployNeverthelesstimingplaysessentialrolecarryTravelingSalesmanProblemefficientsearchgoodcomparedartificialmachinesGibbsSolvingConstraintSatisfactionProblemsNetworksSpikingNeuronsmachineNP-completeadvantagecomputingbenchmarktasksneuromorphichardware

Similar Articles

Cited By