The Bayesian ARTMAP

Boaz Vigdor, Boaz Lerner

Research output: Contribution to journalArticlepeer-review

75 Scopus citations

Abstract

In this paper, we modify the fuzzy ARTMAP (FA) neural network (NN) using the Bayesian framework in order to improve its classification accuracy while simultaneously reduce its category proliferation. The proposed algorithm, called Bayesian ARTMAP (BA), preserves the FA advantages and also enhances its performance by the following: 1) representing a category using a multidimensional Gaussian distribution, 2) allowing a category to grow or shrink, 3) limiting a category hypervolume, 4) using Bayes' decision theory for learning and inference, and 5) employing the probabilistic association between every category and a class in order to predict the class. In addition, the BA estimates the class posterior probability and thereby enables the introduction of loss and classification according to the minimum expected loss. Based on these characteristics and using synthetic and 20 real-world databases, we show that the BA outperformes the FA, either trained for one epoch or until completion, with respect to classification accuracy, sensitivity to statistical overlapping, learning curves, expected loss, and category proliferation.

Original languageEnglish
Pages (from-to)1628-1644
Number of pages17
JournalIEEE Transactions on Neural Networks
Volume18
Issue number6
DOIs
StatePublished - 1 Nov 2007

Keywords

  • Bayes' decision theory
  • Category proliferation
  • Classification
  • Fuzzy ARTMAP (FA)
  • Neural network (NN)

ASJC Scopus subject areas

  • Software
  • Computer Science Applications
  • Computer Networks and Communications
  • Artificial Intelligence

Fingerprint

Dive into the research topics of 'The Bayesian ARTMAP'. Together they form a unique fingerprint.

Cite this