Loading...
Thumbnail Image
Item

MIR task and evaluation techniques

Abstract
Existing tasks in MIREX have traditionally focused on low-level MIR tasks working with flat (usually DSP-only) ground-truth. These evaluation techniques, however, can not evaluate the increasing number of algorithms that utilize relational data and are not currently utilizing the state of the art in evaluating ranked or ordered output. This paper summarizes the state of the art in evaluating relational ground-truth. These components are then synthesized into novel evaluation techniques that are then applied to 14 concrete music document retrieval tasks, demonstrating how these evaluation techniques can be applied in a practical context.
Type
Working Paper
Type of thesis
Series
Computer Science Working Papers
Citation
McEnnis, D. (2009). MIR task and evaluation techniques. (Working paper 05/2009). Hamilton, New Zealand: University of Waikato, Department of Computer Science.
Date
2009-08-12
Publisher
University of Waikato, Department of Computer Science
Degree
Supervisors
Rights