Internal and external pressures on language emergence: least effort, object constancy and frequency
Mostra el registre complet Registre parcial de l'ítem
- dc.contributor.author Rodríguez Luna, Diana
- dc.contributor.author Ponti, Edoardo Maria
- dc.contributor.author Hupkes, Dieuwke
- dc.contributor.author Bruni, Elia
- dc.date.accessioned 2024-06-25T06:08:59Z
- dc.date.available 2024-06-25T06:08:59Z
- dc.date.issued 2020
- dc.description Comunicació presentada al The 2020 Conference on Empirical Methods in Natural Language
- dc.description.abstract In previous work, artificial agents were shown to achieve almost perfect accuracy in referential games where they have to communicate to identify images. Nevertheless, the resulting communication protocols rarely display salient features of natural languages, such as compositionality. In this paper, we propose some realistic sources of pressure on communication that avert this outcome. More specifically, we formalise the principle of least effort through an auxiliary objective. Moreover, we explore several game variants, inspired by the principle of object constancy, in which we alter the frequency, position, and luminosity of the objects in the images. We perform an extensive analysis on their effect through compositionality metrics, diagnostic classifiers, and zero-shot evaluation. Our findings reveal that the proposed sources of pressure result in emerging languages with less redundancy, more focus on high-level conceptual information, and better abilities of generalisation. Overall, our contributions reduce the gap between emergent and natural languages.
- dc.description.sponsorship DH is funded by the Netherlands Organization for Scientific Research (NWO), through a Gravitation Grant 024.001.006 to the Language in Interaction Consortium. EB is funded by the European Union’s Horizon 2020 research and innovation program under the Marie Sklodowska-Curie grant agreement No 790369 (MAGIC). EMP is supported by the ERC Consolidator Grant LEXICAL (no 648909).
- dc.format.mimetype application/pdf
- dc.identifier.citation Rodríguez D, Ponti EM, Hupkes D, Bruni E. Internal and external pressures on language emergence: least effort, object constancy and frequency. In: Cohn T, He Y, Liu Y, editors. Findings of the Association for Computational Linguistics: EMNLP 2020; 2020 Nov 16-20; [Kerrville, Texas]. Stroudsburg (PA): Association for Computational Linguistics; 2020. p. 4428-37. DOI: 10.18653/v1/2020.findings-emnlp.397
- dc.identifier.doi http://dx.doi.org/10.18653/v1/2020.findings-emnlp.397
- dc.identifier.isbn 978-1-952148-90-3
- dc.identifier.uri http://hdl.handle.net/10230/60576
- dc.language.iso eng
- dc.publisher Association for Computational Linguistics
- dc.relation.projectID info:eu-repo/grantAgreement/EC/H2020/790369
- dc.relation.projectID info:eu-repo/grantAgreement/EC/FP7/648909
- dc.rights ACL materials are Copyright © 1963–2024 ACL; other materials are copyrighted by their respective copyright holders. Materials prior to 2016 here are licensed under the Creative Commons Attribution-NonCommercial-ShareAlike 3.0 International License. Permission is granted to make copies for the purposes of teaching and research. Materials published in or after 2016 are licensed on a Creative Commons Attribution 4.0 International License.
- dc.rights.accessRights info:eu-repo/semantics/openAccess
- dc.rights.uri http://creativecommons.org/licenses/by-nc-sa/3.0/
- dc.subject.other Comunicació
- dc.subject.other Tractament del llenguatge natural (Informàtica)
- dc.subject.other Sistema mètric
- dc.title Internal and external pressures on language emergence: least effort, object constancy and frequency
- dc.type info:eu-repo/semantics/conferenceObject
- dc.type.version info:eu-repo/semantics/publishedVersion