Semi-random model tree ensembles: An effective and scalable regression method
Pfahringer, B. (2011). Semi-random model tree ensembles: An effective and scalable regression method. In D.Wang & M. Reynolds (Eds.): AI 2011: Advances in Artificial Intelligence, Lecture Notes in Computer Science, 2011, Volume 7106/2011 (pp. 231-240). Springer-Verlag Berlin Heidelberg.
Permanent Research Commons link: https://hdl.handle.net/10289/6372
We present and investigate ensembles of semi-random model trees as a novel regression method. Such ensembles combine the scalability of tree-based methods with predictive performance rivalling the state of the art in numeric prediction. An empirical investigation shows that Semi-Random Model Trees produce predictive performance which is competitive with state-of-the-art methods like Gaussian Processes Regression or Additive Groves of Regression Trees. The training and optimization of Random Model Trees scales better than Gaussian Processes Regression to larger datasets, and enjoys a constant advantage over Additive Groves of the order of one to two orders of magnitude.