“Show me the cup”: reference with continuous representations

Mostra el registre complet Registre parcial de l'ítem

  • dc.contributor.author Boleda, Gemmaca
  • dc.contributor.author Baroni, Marcoca
  • dc.contributor.author Padó, Sebastianca
  • dc.date.accessioned 2017-08-25T17:16:57Z
  • dc.date.available 2017-08-25T17:16:57Z
  • dc.date.issued 2018
  • dc.description Comunicació presentada a CICLing 2017, celebrat a Budapest (Hongria) del 17 al 23 d'abril de 2017.
  • dc.description.abstract One of the most basic functions of language is to refer to objects in a shared scene. Modeling reference with continuous representations is challenging because it requires individuation, i.e., tracking and distinguishing an arbitrary number of referents. We introduce a neural network model that, given a de nite description and a set of objects represented by natural images, points to the intended object if the expression has a unique referent, or indicates a failure, if it does not. The model, directly trained on reference acts, is competitive with a pipeline manually engineered to perform the same task, both when referents are purely visual, and when they are characterized by a combination of visual and linguistic properties.en
  • dc.description.sponsorship This project has received funding from the European Union's Horizon 2020 research and innovation programme under the Marie Sklodowska-Curie grant agreement No 655577 (LOVe) and ERC grant agreement No 715154 (AMORE); ERC 2011 Starting Independent Research Grant n. 283554 (COMPOSES); DFG (SFB 732, Project D10); and Spanish MINECO (grant FFI2013-41301-P).en
  • dc.format.mimetype application/pdf
  • dc.identifier.citation Baroni M, Boleda G, Padó S. “Show me the cup”: reference with continuous representations. In: Gelbukh A, editor. Computational linguistics and intelligent text processing: 18th International Conference, CICLing 2017 revised selected papers, part 1; 2017 Apr 17-23; Budapest, Hungary. Cham: Springer; 2018. p. 209-24.
  • dc.identifier.uri http://hdl.handle.net/10230/32700
  • dc.language.iso eng
  • dc.publisher Springer
  • dc.relation.ispartof Gelbukh A, editor. Computational linguistics and intelligent text processing: 18th International Conference, CICLing 2017 revised selected papers, part 1; 2017 Apr 17-23; Budapest, Hungary. Cham: Springer; 2018. p. 209-24.
  • dc.relation.projectID info:eu-repo/grantAgreement/EC/H2020/655577
  • dc.relation.projectID info:eu-repo/grantAgreement/EC/H2020/715154
  • dc.relation.projectID info:eu-repo/grantAgreement/ES/1PE/FFI2013-41301-P
  • dc.relation.projectID info:eu-repo/grantAgreement/EC/FP7/283554
  • dc.rights.accessRights info:eu-repo/semantics/openAccess
  • dc.subject.keyword Referenceen
  • dc.subject.keyword Semanticsen
  • dc.subject.keyword Computational semanticsen
  • dc.subject.keyword Distributed representationsen
  • dc.subject.keyword Computational Linguisticsen
  • dc.subject.keyword Natural Language Processingen
  • dc.title “Show me the cup”: reference with continuous representationsca
  • dc.type info:eu-repo/semantics/conferenceObject
  • dc.type.version info:eu-repo/semantics/acceptedVersion