Reference bias in monolingual machine translation evaluation

Mostra el registre complet Registre parcial de l'ítem

• dc.contributor.author Fomicheva, Marina
• dc.contributor.author Specia, Lucia
• dc.date.accessioned 2024-03-13T09:57:32Z
• dc.date.available 2024-03-13T09:57:32Z
• dc.date.issued 2016
• dc.description Comunicació presentada a la 54th Annual Meeting of the Association for Computational Linguistics, celebrada del 7 al 10 d'agost de 2016 a Berlín, Alemanya.
• dc.description.abstract In the translation industry, human translations are assessed by comparison with the source texts. In the Machine Translation (MT) research community, however, it is a common practice to perform quality assessment using a reference translation instead of the source text. In this paper we show that this practice has a serious issue – annotators are strongly biased by the reference translation provided, and this can have a negative impact on the assessment of MT quality.
• dc.description.sponsorship Marina Fomicheva was supported by funding from IULA (UPF) and the FI-DGR grant program of the Generalitat de Catalunya. Lucia Specia was supported by the QT21 project (H2020 No. 645452).
• dc.format.mimetype application/pdf
• dc.identifier.citation Fomicheva M, Specia L. Reference bias in monolingual machine translation evaluation. In: Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers); 2016 Aug 7-10; Berlin, Germany. Stroudsburg (PA): Association for Computational Linguistics; 2016. p. 77-82. DOI: 10.18653/v1/P16-2013
• dc.identifier.doi http://dx.doi.org/10.18653/v1/P16-2013
• dc.identifier.uri http://hdl.handle.net/10230/59399
• dc.language.iso eng
• dc.publisher ACL (Association for Computational Linguistics)
• dc.relation.ispartof Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers); 2016 Aug 7-10; Berlin, Germany. Stroudsburg (PA): Association for Computational Linguistics; 2016. p. 77-82
• dc.relation.projectID info:eu-repo/grantAgreement/EC/H2020/645452
• dc.rights ACL materials are Copyright © 1963–2023 ACL; other materials are copyrighted by their respective copyright holders. Materials prior to 2016 here are licensed under the Creative Commons Attribution-NonCommercial-ShareAlike 3.0 International License. Permission is granted to make copies for the purposes of teaching and research. Materials published in or after 2016 are licensed on a Creative Commons Attribution 4.0 International License.
• dc.rights.accessRights info:eu-repo/semantics/openAccess
• dc.rights.uri http://creativecommons.org/licenses/by/4.0/
• dc.subject.other Traducció automàtica
• dc.subject.other Traducció automàtica -- Avaluació
• dc.title Reference bias in monolingual machine translation evaluation
• dc.type info:eu-repo/semantics/conferenceObject
• dc.type.version info:eu-repo/semantics/publishedVersion