Dendritic Computing: Branching Deeper into Machine Learning.

Jyotibdha Acharya, Arindam Basu, Robert Legenstein, Thomas Limbacher, Panayiota Poirazi, Xundong Wu
Author Information
  1. Jyotibdha Acharya: Institute of Infocomm Research, A*STAR, Singapore. Electronic address: acharyaj@i2r.a-star.edu.sg.
  2. Arindam Basu: Department of Electrical Engineering, City University of Hong Kong, Hong Kong.
  3. Robert Legenstein: Institute of Theoretical Computer Science, Graz University of Technology, Austria.
  4. Thomas Limbacher: Institute of Theoretical Computer Science, Graz University of Technology, Austria.
  5. Panayiota Poirazi: Institute of Molecular Biology and Biotechnology (IMBB), Foundation for Research and Technology-Hellas (FORTH), Greece.
  6. Xundong Wu: School of Computer Science, Hangzhou Dianzi University, China.

Abstract

In this paper, we discuss the nonlinear computational power provided by dendrites in biological and artificial neurons. We start by briefly presenting biological evidence about the type of dendritic nonlinearities, respective plasticity rules and their effect on biological learning as assessed by computational models. Four major computational implications are identified as improved expressivity, more efficient use of resources, utilizing internal learning signals, and enabling continual learning. We then discuss examples of how dendritic computations have been used to solve real-world classification problems with performance reported on well known data sets used in machine learning. The works are categorized according to the three primary methods of plasticity used-structural plasticity, weight plasticity, or plasticity of synaptic delays. Finally, we show the recent trend of confluence between concepts of deep learning and dendritic computations and highlight some future research directions.

Keywords

MeSH Term

Dendrites
Machine Learning
Models, Neurological
Neuronal Plasticity
Neurons

Word Cloud

Created with Highcharts 10.0.0plasticitylearningcomputationalbiologicaldendriticdiscussdendritesexpressivitycomputationsusedmachinedeepnetworkspapernonlinearpowerprovidedartificialneuronsstartbrieflypresentingevidencetypenonlinearitiesrespectiveruleseffectassessedmodelsFourmajorimplicationsidentifiedimprovedefficientuseresourcesutilizinginternalsignalsenablingcontinualexamplessolvereal-worldclassificationproblemsperformancereportedwellknowndatasetsworkscategorizedaccordingthreeprimarymethodsused-structuralweightsynapticdelaysFinallyshowrecenttrendconfluenceconceptshighlightfutureresearchdirectionsDendriticComputing:BranchingDeeperMachineLearningneuralmaxoutnon-linearrewiring

Similar Articles

Cited By