Evaluation in music information retrieval
Mostra el registre complet Registre parcial de l'ítem
- dc.contributor.author Urbano, Juliánca
- dc.contributor.author Schedl, Markusca
- dc.contributor.author Serra, Xavierca
- dc.date.accessioned 2018-06-14T09:35:54Z
- dc.date.available 2018-06-14T09:35:54Z
- dc.date.issued 2013
- dc.description.abstract The field of Music Information Retrieval has always acknowledged the need for rigorous scientific evaluations, and several efforts have set out to develop and provide the infrastructure, technology and methodologies needed to carry out these evaluations. The community has enormously gained from these evaluation forums, but we have reached a point where we are stuck with evaluation frameworks that do not allow us to improve as much and as well as we want. The community recently acknowledged this problem and showed interest in addressing it, though it is not clear what to do to improve the situation. We argue that a good place to start is again the Text IR field. Based on a formalization of the evaluation process, this paper presents a survey of past evaluation work in the context of Text IR, from the point of view of validity, reliability and efficiency of the experiments. We show the problems that our community currently has in terms of evaluation, point to several lines of research to improve it and make various proposals in that line.
- dc.format.mimetype application/pdf
- dc.identifier.citation Urbano J, Schedl M, Serra X. Evaluation in music information retrieval. J Intell Inf Syst. 2013;41(3):345-69. DOI: 10.1007/s10844-013-0249-4
- dc.identifier.doi http://dx.doi.org/10.1007/s10844-013-0249-4
- dc.identifier.issn 0925-9902
- dc.identifier.uri http://hdl.handle.net/10230/34901
- dc.language.iso eng
- dc.publisher Springerca
- dc.relation.ispartof Journal of Intelligent Information Systems. 2013;41(3):345-69.
- dc.rights © Springer The final publication is available at Springer via http://dx.doi.org/10.1007/s10844-013-0249-4
- dc.rights.accessRights info:eu-repo/semantics/openAccess
- dc.subject.keyword Music Information Retrieval
- dc.subject.keyword Text Information Retrieval
- dc.subject.keyword Evaluation and Experimentation Survey
- dc.title Evaluation in music information retrievalca
- dc.type info:eu-repo/semantics/article
- dc.type.version info:eu-repo/semantics/acceptedVersion