Research Commons
      • Browse 
        • Communities & Collections
        • Titles
        • Authors
        • By Issue Date
        • Subjects
        • Types
        • Series
      • Help 
        • About
        • Collection Policy
        • OA Mandate Guidelines
        • Guidelines FAQ
        • Contact Us
      • My Account 
        • Sign In
        • Register
      View Item 
      •   Research Commons
      • University of Waikato Research
      • Computing and Mathematical Sciences
      • Computing and Mathematical Sciences Papers
      • View Item
      •   Research Commons
      • University of Waikato Research
      • Computing and Mathematical Sciences
      • Computing and Mathematical Sciences Papers
      • View Item
      JavaScript is disabled for your browser. Some features of this site may not work without it.

      Probability calibration trees

      Leathart, Tim; Frank, Eibe; Holmes, Geoffrey; Pfahringer, Bernhard
      Thumbnail
      Files
      leathart17a.pdf
      Published version, 165.5Kb
      Link
       proceedings.mlr.press
      Citation
      Export citation
      Leathart, T., Frank, E., Holmes, G., & Pfahringer, B. (2017). Probability calibration trees. In M.-L. Zhang & Y.-K. Noh (Eds.), Proceedings of 9th Asian Conference on Machine Learning (Vol. PMLR 77, pp. 145–160). Seoul, Korea.
      Permanent Research Commons link: https://hdl.handle.net/10289/11515
      Abstract
      Obtaining accurate and well calibrated probability estimates from classifiers is useful in many applications, for example, when minimising the expected cost of classifications. Existing methods of calibrating probability estimates are applied globally, ignoring the potential for improvements by applying a more fine-grained model. We propose probability calibration trees, a modification of logistic model trees that identifies regions of the input space in which different probability calibration models are learned to improve performance. We compare probability calibration trees to two widely used calibration methods—isotonic regression and Platt scaling—and show that our method results in lower root mean squared error on average than both methods, for estimates produced by a variety of base learners.
      Date
      2017
      Type
      Conference Contribution
      Rights
      © 2017 T. Leathart, E. Frank, G. Holmes & B. Pfahringer.
      Collections
      • Computing and Mathematical Sciences Papers [1454]
      Show full item record  

      Usage

      Downloads, last 12 months
      125
       
       

      Usage Statistics

      For this itemFor all of Research Commons

      The University of Waikato - Te Whare Wānanga o WaikatoFeedback and RequestsCopyright and Legal Statement