Methodologies for evaluation of note-based music-retrieval systems

Methodologies for evaluation of note-based music-retrieval systems

0.00 Avg rating0 Votes
Article ID: iaor20071042
Country: United States
Volume: 18
Issue: 3
Start Page Number: 339
End Page Number: 347
Publication Date: Jun 2006
Journal: INFORMS Journal On Computing
Authors: , ,
Keywords: music
Abstract:

There have been many proposed music-retrieval systems, based on a variety of principles. How the effectiveness of these systems compares is not clear. The evaluation of some systems has been informal, without the rigor applied in other areas of information retrieval, and comparison of systems is difficult because of the lack of a common data set, queries, or relevance judgments. In this paper we explain how we collected artificial and expert music queries and name-based relevance judgments, and describe software we developed for collection of manual relevance judgments. Together with a collection of downloaded musical instrument digital interface (MIDI) files, these sets of queries and relevance judgments provide valuable tools for measuring music-retrieval systems. As an example of the value of these tools, we use them to compare the effect of using the expert queries and manual judgments to that of the artificial queries and manual judgments used in our earlier experiments.

Reviews

Required fields are marked *. Your email address will not be published.