ELMD: an automatically generated entity linking gold standard dataset in the music domain

Oramas, Sergio; Espinosa-Anke, Luis; Sordo, Mohamed; Saggion, Horacio; Serra, Xavier

ELMD: an automatically generated entity linking gold standard dataset in the music domain

Llicència

Citació

Oramas S, Espinosa-Anke L, Sordo M, Saggion H, Serra X. ELMD: an automatically generated entity linking gold standard dataset in the music domain. In: Calzolari N, Choukri K, Declerck T, Goggi S, Grobelnik M, Maegaard B, Mariani J, Mazo H, Moreno A, Odijk J, Piperidis S, editors. 10th International Conference on Language Resources and Evaluation LREC 2016; 2016 May 23-28; Portoroz, Slovenia. [Place unknown]: European Language Resources Association, 2016. p. 3312-17.

Resum

In this paper we present a gold standard dataset for Entity Linking (EL) in the Music Domain. It contains thousands of musical named entities such as Artist, Song or Record Label, which have been automatically annotated on a set of artist biographies coming from the Music website and social network LAST.FM. The annotation process relies on the analysis of the hyperlinks present in the source texts and in a voting-based algorithm for EL, which considers, for each entity mention in text, the degree of agreement across three state-of-the-art EL systems. Manual evaluation shows that EL Precision is at least 94%, and due to its tunable nature, it is possible to derive annotations favouring higher Precision or Recall, at will. We make available the annotated dataset along with evaluation data and the code.