Building classifiers using Bayesian networks

Nir Friedman*, Moises Goldszmidt

*Corresponding author for this work

Research output: Contribution to conferencePaperpeer-review

142 Scopus citations

Abstract

Recent work in supervised learning has shown that a surprisingly simple Bayesian classifier with strong assumptions of independence among features, called naive Bayes, is competitive with state of the art classifiers such as C4.5. This fact raises the question of whether a classifier with less restrictive assumptions can perform even better. In this paper we examine and evaluate approaches for inducing classifiers from data, based on recent results in the theory of learning Bayesian networks. Bayesian networks are factored representations of probability distributions that generalize the naive Bayes classifier and explicitly represent statements about independence. Among these approaches we single out a method we call Tree Augmented Naive Bayes (TAN), which outperforms naive Bayes, yet at the same time maintains the computational simplicity (no search involved) and robustness which are characteristic of naive Bayes. We experimentally tested these approaches using benchmark problems from the U. C. Irvine repository, and compared them against C4.5, naive Bayes, and wrapper-based feature selection methods.

Original languageAmerican English
Pages1277-1284
Number of pages8
StatePublished - 1996
Externally publishedYes
EventProceedings of the 1996 13th National Conference on Artificial Intelligence. Part 2 (of 2) - Portland, OR, USA
Duration: 4 Aug 19968 Aug 1996

Conference

ConferenceProceedings of the 1996 13th National Conference on Artificial Intelligence. Part 2 (of 2)
CityPortland, OR, USA
Period4/08/968/08/96

Fingerprint

Dive into the research topics of 'Building classifiers using Bayesian networks'. Together they form a unique fingerprint.

Cite this