Neuro-fuzzy decision trees.

Rajen B Bhatt, M Gopal
Author Information
  1. Rajen B Bhatt: Control Laboratories, II/214, Department of Electrical Engineering, Indian Institute of Technology - Delhi, Hauz Khas, New Delhim - 110016, India. rajen.bhatt@gmail.com

Abstract

Fuzzy decision trees are powerful, top-down, hierarchical search methodology to extract human interpretable classification rules. However, they are often criticized to result in poor learning accuracy. In this paper, we propose Neuro-Fuzzy Decision Trees (N-FDTs); a fuzzy decision tree structure with neural like parameter adaptation strategy. In the forward cycle, we construct fuzzy decision trees using any of the standard induction algorithms like fuzzy ID3. In the feedback cycle, parameters of fuzzy decision trees have been adapted using stochastic gradient descent algorithm by traversing back from leaf to root nodes. With this strategy, during the parameter adaptation stage, we keep the hierarchical structure of fuzzy decision trees intact. The proposed approach of applying backpropagation algorithm directly on the structure of fuzzy decision trees improves its learning accuracy without compromising the comprehensibility (interpretability). The proposed methodology has been validated using computational experiments on real-world datasets.

MeSH Term

Decision Making, Computer-Assisted
Decision Trees
Fuzzy Logic
Humans
Information Storage and Retrieval
Learning
Neural Networks, Computer
Neurons

Word Cloud

Created with Highcharts 10.0.0decisiontreesfuzzystructureusinghierarchicalmethodologylearningaccuracylikeparameteradaptationstrategycyclealgorithmproposedFuzzypowerfultop-downsearchextracthumaninterpretableclassificationrulesHoweveroftencriticizedresultpoorpaperproposeNeuro-FuzzyDecisionTreesN-FDTstreeneuralforwardconstructstandardinductionalgorithmsID3feedbackparametersadaptedstochasticgradientdescenttraversingbackleafrootnodesstagekeepintactapproachapplyingbackpropagationdirectlyimproveswithoutcompromisingcomprehensibilityinterpretabilityvalidatedcomputationalexperimentsreal-worlddatasetsNeuro-fuzzy

Similar Articles

Cited By