​What do entity-centric models learn? Insights from entity linking in multi-party dialogue

Boleda, Gemma; Aina, Laura; Silberer, Carina; Sorodoc, Ionut-Teodor; Westera, Matthijs

What do entity-centric models learn? Insights from entity linking in multi-party dialogue

License

Citation

Aina L, Silberer C, Sorodoc I, Westera M, Boleda G. What do entity-centric models learn? Insights from entity linking in multi-party dialogue. In: Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies; 2019 Jun 2-7; Minneapolis, United States of America. Stroudsburg (PA): ACL; 2019. p. 3772–83.

Abstract

Humans use language to refer to entities in the external world. Motivated by this, in recent years several models that incorporate a bias towards learning entity representations have been proposed. Such entity-centric models have shown empirical success, but we still know little about why. In this paper we analyze the behavior of two recently proposed entity-centric models in a referential task, Entity Linking in Multi-party Dialogue (SemEval 2018 Task 4). We show that these models outperform the state of the art on this task, and that they do better on lower frequency entities than a counterpart model that is not entity-centric, with the same model size. We argue that making models entitycentric naturally fosters good architectural decisions. However, we also show that these models do not really build entity representations and that they make poor use of linguistic context. These negative results underscore the need for model analysis, to test whether the motivations for particular architectures are borne out in how models behave when deployed.

Description

Comunicació presentada a la Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT 2019), celebrada els dies 2 a 7 de juny de 2019 a Minneapolis, Estats Units d'Amèrica.