Loading...
Thumbnail Image
Publication

Accuracy bounds for ensembles under 0 - 1 loss.

Abstract
This paper is an attempt to increase the understanding in the behavior of ensembles for discrete variables in a quantitative way. A set of tight upper and lower bounds for the accuracy of an ensemble is presented for wide classes of ensemble algorithms, including bagging and boosting. The ensemble accuracy is expressed in terms of the accuracies of the members of the ensemble. Since those bounds represent best and worst case behavior only, we study typical behavior as well, and discuss its properties. A parameterised bound is presented which describes ensemble bahavior as a mixture of dependent base classifier and independent base classifier areas. Some empirical results are presented to support our conclusions.
Type
Working Paper
Type of thesis
Series
Computer Science Working Papers
Citation
Bouckaert, R.R. (2002). Accuracy bounds for ensembles under 0 1 loss. (Working paper series. University of Waikato, Department of Computer Science. No. 04/02/2002). Hamilton, New Zealand: University of Waikato.
Date
2002-06-01
Publisher
Dept. of Computer Science
Degree
Supervisors
Rights
University of Waikato, Department of Computer Science