Show simple item record  

dc.contributor.authorBouckaert, Remco R.
dc.contributor.authorFrank, Eibe
dc.coverage.spatialConference held at Sydney, Australia:en_NZ
dc.date.accessioned2008-11-21T03:57:36Z
dc.date.available2008-11-21T03:57:36Z
dc.date.issued2004
dc.identifier.citationBouckaert, R. R. & Frank, E. (2004). Evaluating the replicability of significance tests for comparing learning algorithms. In H. Dai, R. Srikant, & C. Zhang (Eds.), Proceedings 8th Pacific-Asia Conference, PAKDD 2004, Sydney, Australia, May 26-28, 2004(pp. 3-12). Berlin: Springer.en_US
dc.identifier.urihttps://hdl.handle.net/10289/1451
dc.description.abstractEmpirical research in learning algorithms for classification tasks generally requires the use of significance tests. The quality of a test is typically judged on Type I error (how often the test indicates a difference when it should not) and Type II error (how often it indicates no difference when it should). In this paper we argue that the replicability of a test is also of importance. We say that a test has low replicability if its outcome strongly depends on the particular random partitioning of the data that is used to perform it. We present empirical measures of replicability and use them to compare the performance of several popular tests in a realistic setting involving standard learning algorithms and benchmark datasets. Based on our results we give recommendations on which test to use.en_US
dc.language.isoen
dc.publisherSpringeren_US
dc.relation.urihttp://www.springerlink.com/content/uwp1jx7hbd142141/en_US
dc.sourcePAKDD 2004en_NZ
dc.subjectcomputer scienceen_US
dc.subjectsignificance testen_US
dc.titleEvaluating the replicability of significance tests for comparing learning algorithmsen_US
dc.typeConference Contributionen_US
dc.identifier.doi10.1007/978-3-540-24775-3_3en_US
dc.relation.isPartOf8th Pacific-Asia Conference on Advances in Knowledge Discovery and Data Mining Conferenceen_NZ
pubs.begin-page3en_NZ
pubs.elements-id14809
pubs.end-page12en_NZ
pubs.finish-date2004-05-28en_NZ
pubs.place-of-publicationBerlinen_NZ
pubs.start-date2004-05-26en_NZ
pubs.volumeLNAI 3056en_NZ


Files in this item

FilesSizeFormatView

There are no files associated with this item.

This item appears in the following Collection(s)

Show simple item record