Referential communication in heterogeneous communities of pre-trained visual deep networks

Mostra el registre complet Registre parcial de l'ítem

• dc.contributor.author Mahaut, Matéo
• dc.contributor.author Franzon, Francesca
• dc.contributor.author Dessì, Roberto
• dc.contributor.author Baroni, Marco
• dc.date.accessioned 2023-07-31T13:46:57Z
• dc.date.available 2023-07-31T13:46:57Z
• dc.date.issued 2023-07-31
• dc.description Comunicació presentada a la 22nd International Conference on Autonomous Agents and Multiagent Systems (AAMAS 2023), celebrada a Londres del 29 de maig al 2 de juny de 2023.ca
• dc.description.abstract As large pre-trained image-processing neural networks are being embedded in autonomous agents such as self-driving cars or robots, the question arises of how such systems can communicate with each other about the surrounding world, despite their different architectures and training regimes. As a first step in this direction, we explore the task of referential communication in a community of state-of-the-art pre-trained visual networks, showing that they can develop a shared protocol to refer to a target image among a set of candidates. Such shared protocol, induced in a self-supervised way, can to some extent be used to communicate about previously unseen object categories. Finally, we show that a new neural network can learn the shared protocol developed in a community with remarkable ease, and the process of integrating a new agent into a community more stably succeeds when the original community includes a larger set of heterogeneous networks.ca
• dc.description.sponsorship This project has received funding from the European Research Council (ERC) under the European Union’s Horizon 2020 research and innovation programme (grant agreement No. 101019291).
• dc.format.mimetype application/pdf*
• dc.identifier.citation Mahaut M, Franzon F, Dessi R, Baroni M. Referential communication in heterogeneous communities of pre-trained visual deep networks. In: AAMAS 2023. 22nd International Conference on Autonomous Agents and Multiagent Systems; 2023 May 29-Jun 2; London, United Kingdom. [Richland]: IFAAMAS; 2023. p. 2619-21.
• dc.identifier.isbn 9781450394321
• dc.identifier.uri http://hdl.handle.net/10230/57743
• dc.language.iso engca
• dc.publisher International Foundation for Autonomous Agents and Multiagent Systems (IFAAMAS)
• dc.relation.ispartof AAMAS 2023. 22nd International Conference on Autonomous Agents and Multiagent Systems; 2023 May 29-Jun 2; London, United Kingdom. [Richland]: IFAAMAS; 2023.
• dc.relation.projectID info:eu-repo/grantAgreement/EC/H2020/101019291
• dc.rights © 2023 International Foundation for Autonomous Agents and Multiagent Systems (www.ifaamas.org). All rights reserved. https://www.ifaamas.org/Proceedings/aamas2023/ca
• dc.rights.accessRights info:eu-repo/semantics/openAccessca
• dc.subject.keyword Emergent deep net communication
• dc.subject.keyword Deep visual nets
• dc.subject.keyword Multi-agent communication
• dc.title Referential communication in heterogeneous communities of pre-trained visual deep networksca
• dc.type info:eu-repo/semantics/conferenceObjectca
• dc.type.version info:eu-repo/semantics/publishedVersionca