Research Commons
      • Browse 
        • Communities & Collections
        • Titles
        • Authors
        • By Issue Date
        • Subjects
        • Types
        • Series
      • Help 
        • About
        • Collection Policy
        • OA Mandate Guidelines
        • Guidelines FAQ
        • Contact Us
      • My Account 
        • Sign In
        • Register
      View Item 
      •   Research Commons
      • University of Waikato Research
      • Computing and Mathematical Sciences
      • Computing and Mathematical Sciences Papers
      • View Item
      •   Research Commons
      • University of Waikato Research
      • Computing and Mathematical Sciences
      • Computing and Mathematical Sciences Papers
      • View Item
      JavaScript is disabled for your browser. Some features of this site may not work without it.

      A diversity-aware model for majority vote ensemble accuracy

      Lim, Nick Jin Sean; Durrant, Robert J.
      Thumbnail
      Files
      durrant20a.pdf
      Published version, 3.960Mb
      durrant20a-supp.pdf
      Supplementary material, 693.4Kb
      Link
       proceedings.mlr.press
      Find in your library  
      Citation
      Export citation
      Lim, N. J. S., & Durrant, R. J. (2020). A diversity-aware model for majority vote ensemble accuracy. In S. Chiappa & R. Calandra (Eds.), International Conference on Artificial Intelligence and Statistics (Vol. 108, pp. 4078–4086).
      Permanent Research Commons link: https://hdl.handle.net/10289/13951
      Abstract
      Ensemble classifiers are a successful and popular approach for classification, and are frequently found to have better generalization performance than single models in practice. Although it is widely recognized that ‘diversity’ between ensemble members is important in achieving these performance gains, for classification ensembles it is not widely understood which diversity measures are most predictive of ensemble performance, nor how large an ensemble should be for a particular application. In this paper, we explore the predictive power of several common diversity measures and show – with extensive experiments – that contrary to earlier work that finds no clear link between these diversity measures (in isolation) and ensemble accuracy instead by using the ρ diversity measure of Sneath and Sokal as an estimator for the dispersion parameter of a Polya-Eggenberger distribution we can predict, independently of the choice of base classifier family, the accuracy of a majority vote classifier ensemble ridiculously well. We discuss our model and some implications of our findings – such as diversity-aware (non-greedy) pruning of a majority-voting ensemble.
      Date
      2020
      Type
      Conference Contribution
      Publisher
      Addison-Wesley
      Rights
      © Copyright 2020 by the author(s).
      Collections
      • Computing and Mathematical Sciences Papers [1452]
      Show full item record  

      Usage

      Downloads, last 12 months
      21
       
       

      Usage Statistics

      For this itemFor all of Research Commons

      The University of Waikato - Te Whare Wānanga o WaikatoFeedback and RequestsCopyright and Legal Statement