Automatic and human evaluation study of a rule-based and a statistical Catalan-Spanish machine translation systems

Mostra el registre complet Registre parcial de l'ítem

  • dc.contributor.author Costa-jussà, Marta R.ca
  • dc.contributor.author Farrús, Mireiaca
  • dc.contributor.author Mariño Acebal, José B.ca
  • dc.contributor.author Fonollosa, José A Rodriguezca
  • dc.date.accessioned 2017-07-03T16:38:30Z
  • dc.date.available 2017-07-03T16:38:30Z
  • dc.date.issued 2010
  • dc.description Comunicació presentada a: LREC 2010, Seventh International Conference on Language Resources and Evaluation, celebrat a Valletta, Malta, del 17 al 23 de maig de 2010.ca
  • dc.description.abstract Machine translation systems can be classified into rule-based and corpus-based approaches, in terms of their core technology. Since both paradigms have largely been used during the last years, one of the aims in the research community is to know how these systems differ in terms of translation quality. To this end, this paper reports a study and comparison of a rule-based and a corpus-based (particularly, statistical) Catalan-Spanish machine translation systems, both of them freely available in the web. The translation quality analysis is performed under two different domains: journalistic and medical. The systems are evaluated by using standard automatic measures, as well as by native human evaluators. Automatic results show that the statistical system performs better than the rule-based system. Human judgements show that in the Spanishto-Catalan direction the statistical system also performs better than the rule-based system, while in the Catalan-to-Spanish direction is the other way round. Although the statistical system obtains the best automatic scores, its errors tend to be more penalized by human judgements than the errors of the rule-based system. This can be explained because statistical errors are usually unexpected and they do not follow any pattern.en
  • dc.description.sponsorship This work has been partially funded by the Spanish Department of Education and Science through the Juan de la Cierva fellowship program and the BUCEADOR project (TEC2009-14094-C04-01). The authors also wants to thank the Barcelona Media Innovation Centre for its support and permission to publish this research and the UniversalDoctor Project for providing the medical test material.ca
  • dc.format.mimetype application/pdfca
  • dc.identifier.citation Costa-Jussà MR, Farrús M, Mariño JB, Fonollosa JAR. Automatic and human evaluation study of a rule-based and a statistical Catalan-Spanish machine translation systems. In: Calzolari N, Choukri K, Maegaard B, Mariani J, Odijk J, Piperidis S, Rosner M, Tapias, editors. LREC 2010, Seventh International Conference on Language Resources and Evaluation; 2010 May 17-23; Valletta (Malta). [place unknown]: European Language Resources Association (ELRA); 2010. p. 1706-11.
  • dc.identifier.uri http://hdl.handle.net/10230/32490
  • dc.language.iso eng
  • dc.publisher European Language Resources Association (ELRA)ca
  • dc.relation.ispartof Calzolari N, Choukri K, Maegaard B, Mariani J, Odijk J, Piperidis S, Rosner M, Tapias, editors. LREC 2010, Seventh International Conference on Language Resources and Evaluation; 2010 May 17-23; Valletta (Malta). [place unknown]: European Language Resources Association (ELRA); 2010. p. 1706-11.
  • dc.relation.projectID info:eu-repo/grantAgreement/ES/3PN/TEC2009-14094-C04-01
  • dc.rights Published with the permission of ELRA. This paper was published within the proceedings of the LREC 2010 Conference. © 2010 ELRA - European Language Resources Association. All rights reserved.
  • dc.rights.accessRights info:eu-repo/semantics/openAccess
  • dc.subject.other Traducció automàticaca
  • dc.subject.other Català -- Traducció automàticaca
  • dc.subject.other Castellà -- Traducció automàticaca
  • dc.title Automatic and human evaluation study of a rule-based and a statistical Catalan-Spanish machine translation systemsca
  • dc.type info:eu-repo/semantics/conferenceObject
  • dc.type.version info:eu-repo/semantics/publishedVersion