Analysis of inter-transcriber consistency in the Cat_ToBI prosodic labeling system
Mostra el registre complet Registre parcial de l'ítem
- dc.contributor.author Escudero Mancebo, Davidca
- dc.contributor.author Aguilar Cuevas, Lourdesca
- dc.contributor.author Vanrell, Maria del Marca
- dc.contributor.author Prieto Vives, Pilar, 1965-ca
- dc.date.accessioned 2017-01-17T14:55:51Z
- dc.date.available 2017-01-17T14:55:51Z
- dc.date.issued 2012
- dc.description.abstract A set of tools to analyze inconsistencies observed in a Cat_ToBI labeling experiment are presented. We formalize and use the metrics that are commonly used in inconsistency tests. The metrics are systematically applied to analyze the robustness of every symbol and every pair of transcribers. The results reveal agreement rates for this study that are comparable to previous ToBI inter-reliability tests. The inter-transcriber confusion rates are transformed into distance matrices to use multidimensional scaling for visualizing the confusion between the different ToBI symbols and the disagreement between the raters. Potential different labeling criteria are identified and subsets of symbols that are candidates to be fused are proposed.en
- dc.description.sponsorship The authors are indebted to other researchers of the Grup d’Estudis de Prosòdia GrEP (Departament de Traducció i Ciències del Llenguatge, Universitat Pompeu Fabra) who contributed constructively to the discussion of this work while it was underway. Particular thanks are due to the subjects who performed the annotations of Catalan utterances (J. Borràs-Comes, V. Crespo-Sendra, R. Sichel-Bazin, E. Estebas-Vilaplana and the postgraduate students CA, CR, EP and GV) for their valuable comments and information./n/nThis research has been funded by six research grants awarded by the Spanish Ministerio de Ciencia e Innovación, namely the Glissando project FFI2008-04982-C003-02, FFI2008-04982-C003-03, FFI2011-29559-C02-01, FFI2011-29559-C02-02, FFI2009-07648/FILO and CONSOLIDER-INGENIO 2010 Programme CSD2007-00012, and by a grant awarded by the Generalitat de Catalunya to the Grup d’Estudis de Prosòdia (2009SGR-701).en
- dc.format.mimetype application/pdfca
- dc.identifier.citation Escudero D, Aguilar L, Vanrell MM, Prieto P. Analysis of inter-transcriber consistency in the Cat_ToBI prosodic labeling system. Speech Commun. 2012 May; 54(4):566–82. DOI: 10.1016/j.specom.2011.12.002
- dc.identifier.doi http://dx.doi.org/10.1016/j.specom.2011.12.002
- dc.identifier.issn 0167-6393
- dc.identifier.uri http://hdl.handle.net/10230/27918
- dc.language.iso engen
- dc.publisher Elsevierca
- dc.relation.ispartof Speech communication. 2012 May; 54(4): 566–582
- dc.relation.projectID info:eu-repo/grantAgreement/ES/3PN/FFI2008-04982-C003-02
- dc.relation.projectID info:eu-repo/grantAgreement/ES/3PN/FFI2008-04982-C003-03
- dc.relation.projectID info:eu-repo/grantAgreement/ES/3PN/FFI2011-29559-C02-01
- dc.relation.projectID info:eu-repo/grantAgreement/ES/3PN/FFI2011-29559-C02-02
- dc.relation.projectID info:eu-repo/grantAgreement/ES/3PN/FFI2009-07648/FILO
- dc.relation.projectID info:eu-repo/grantAgreement/ES/2PN/CSD2007-00012
- dc.rights © Elsevier http://dx.doi.org/10.1016/j.specom.2011.12.002
- dc.rights.accessRights info:eu-repo/semantics/openAccess
- dc.subject.keyword Prosodyen
- dc.subject.keyword Prosodic labelingen
- dc.subject.keyword Inter-transcriber consistencyen
- dc.subject.keyword ToBIen
- dc.title Analysis of inter-transcriber consistency in the Cat_ToBI prosodic labeling systemen
- dc.type info:eu-repo/semantics/article
- dc.type.version info:eu-repo/semantics/acceptedVersion