MIR task and evaluation techniques

dc.contributor.author	McEnnis, Daniel
dc.date.accessioned	2009-08-12T04:51:47Z
dc.date.available	2009-08-12T04:51:47Z
dc.date.issued	2009-08-12
dc.description.abstract	Existing tasks in MIREX have traditionally focused on low-level MIR tasks working with flat (usually DSP-only) ground-truth. These evaluation techniques, however, can not evaluate the increasing number of algorithms that utilize relational data and are not currently utilizing the state of the art in evaluating ranked or ordered output. This paper summarizes the state of the art in evaluating relational ground-truth. These components are then synthesized into novel evaluation techniques that are then applied to 14 concrete music document retrieval tasks, demonstrating how these evaluation techniques can be applied in a practical context.	en
dc.format.mimetype	application/pdf
dc.identifier.citation	McEnnis, D. (2009). MIR task and evaluation techniques. (Working paper 05/2009). Hamilton, New Zealand: University of Waikato, Department of Computer Science.	en
dc.identifier.issn	1177-777X
dc.identifier.uri	https://hdl.handle.net/10289/2815
dc.language.iso	en
dc.publisher	University of Waikato, Department of Computer Science	en
dc.relation.ispartofseries	Computer Science Working Papers
dc.subject	computer science	en
dc.subject	evaluation techniques	en
dc.subject	MIREX	en
dc.title	MIR task and evaluation techniques	en
dc.type	Working Paper	en
pubs.elements-id	53911
uow.relation.series	05/2009