Towards human linguistic machine translation evaluation
Mostra el registre complet Registre parcial de l'ítem
- dc.contributor.author Costa-jussà, Marta R.ca
- dc.contributor.author Farrús, Mireiaca
- dc.date.accessioned 2018-04-26T14:17:07Z
- dc.date.available 2018-04-26T14:17:07Z
- dc.date.issued 2015
- dc.description.abstract When evaluating machine translation outputs, linguistics is usually taken into account implicitly. Annotators have to decide whether a sentence is better than another or not, using, for example, adequacy and fluency criteria or, as recently proposed, editing the translation output so that it has the same meaning as a reference translation, and it is understandable. Therefore, the important fields of linguistics of meaning (semantics) and grammar (syntax) are indirectly considered. In this study, we propose to go one step further towards a linguistic human evaluation. The idea is to introduce linguistics implicitly by formulating precise guidelines. These guidelines strictly mark the difference between the sub- elds of linguistics such as: morphology, syntax, semantics, and orthography. We show our guidelines have a high inter-annotation agreement and wide error coverage. Additionally, we examine how the linguistic human evaluation data correlate with: among different types of machine translation systems (rule and statistical-based); and with adequacy and fluency.en
- dc.description.sponsorship The authors would like to thank the Institute for Infocomm Research for their support and permission to publish this research. This work has been partially funded by the Seventh Framework Program of the European Commission through the International Outgoing Fellowship Marie Curie Action (IMTraP-2011-29951).en
- dc.format.mimetype application/pdf
- dc.identifier.citation Costa-Jussà MR, Farrús M. Towards human linguistic machine translation evaluation. Lit Ling Comput. 2015;30(2):157-66. DOI: 10.1093/llc/fqt065
- dc.identifier.doi http://dx.doi.org/10.1093/llc/fqt065
- dc.identifier.issn 0268-1145
- dc.identifier.uri http://hdl.handle.net/10230/34495
- dc.language.iso eng
- dc.publisher Oxford University Pressca
- dc.relation.ispartof Literary and linguistic computing. 2015;30(2):157-66.
- dc.rights © Oxford University Press. This is a pre-copy-editing, author-produced PDF of an article accepted for publication in Literary and Linguistic Computing following peer review. The definitive publisher-authenticated version "Costa-Jussà MR, Farrús M. Towards human linguistic machine translation evaluation. Lit Ling Comput. 2013; 30 (2): 157-66" is available online at: http://dx.doi.org/10.1093/llc/fqt065
- dc.rights.accessRights info:eu-repo/semantics/openAccess
- dc.subject.keyword Machine translationen
- dc.subject.keyword Linguistic evaluationen
- dc.title Towards human linguistic machine translation evaluationca
- dc.type info:eu-repo/semantics/article
- dc.type.version info:eu-repo/semantics/submittedVersion