Welcome to the UPF Digital Repository

Analysis of inter-transcriber consistency in the Cat_ToBI prosodic labeling system

Show simple item record

dc.contributor.author Escudero Mancebo, David
dc.contributor.author Aguilar Cuevas, Lourdes
dc.contributor.author Vanrell, Maria del Mar
dc.contributor.author Prieto Vives, Pilar, 1965-
dc.date.accessioned 2017-01-17T14:55:51Z
dc.date.available 2017-01-17T14:55:51Z
dc.date.issued 2012
dc.identifier.citation Escudero D, Aguilar L, Vanrell MM, Prieto P. Analysis of inter-transcriber consistency in the Cat_ToBI prosodic labeling system. Speech Commun. 2012 May; 54(4):566–82. DOI: 10.1016/j.specom.2011.12.002
dc.identifier.issn 0167-6393
dc.identifier.uri http://hdl.handle.net/10230/27918
dc.description.abstract A set of tools to analyze inconsistencies observed in a Cat_ToBI labeling experiment are presented. We formalize and use the metrics that are commonly used in inconsistency tests. The metrics are systematically applied to analyze the robustness of every symbol and every pair of transcribers. The results reveal agreement rates for this study that are comparable to previous ToBI inter-reliability tests. The inter-transcriber confusion rates are transformed into distance matrices to use multidimensional scaling for visualizing the confusion between the different ToBI symbols and the disagreement between the raters. Potential different labeling criteria are identified and subsets of symbols that are candidates to be fused are proposed.
dc.description.sponsorship The authors are indebted to other researchers of the Grup d’Estudis de Prosòdia GrEP (Departament de Traducció i Ciències del Llenguatge, Universitat Pompeu Fabra) who contributed constructively to the discussion of this work while it was underway. Particular thanks are due to the subjects who performed the annotations of Catalan utterances (J. Borràs-Comes, V. Crespo-Sendra, R. Sichel-Bazin, E. Estebas-Vilaplana and the postgraduate students CA, CR, EP and GV) for their valuable comments and information./n/nThis research has been funded by six research grants awarded by the Spanish Ministerio de Ciencia e Innovación, namely the Glissando project FFI2008-04982-C003-02, FFI2008-04982-C003-03, FFI2011-29559-C02-01, FFI2011-29559-C02-02, FFI2009-07648/FILO and CONSOLIDER-INGENIO 2010 Programme CSD2007-00012, and by a grant awarded by the Generalitat de Catalunya to the Grup d’Estudis de Prosòdia (2009SGR-701).
dc.format.mimetype application/pdf
dc.language.iso eng
dc.publisher Elsevier
dc.relation.ispartof Speech communication. 2012 May; 54(4): 566–582
dc.rights © Elsevier http://dx.doi.org/10.1016/j.specom.2011.12.002
dc.title Analysis of inter-transcriber consistency in the Cat_ToBI prosodic labeling system
dc.type info:eu-repo/semantics/article
dc.identifier.doi http://dx.doi.org/10.1016/j.specom.2011.12.002
dc.subject.keyword Prosody
dc.subject.keyword Prosodic labeling
dc.subject.keyword Inter-transcriber consistency
dc.subject.keyword ToBI
dc.relation.projectID info:eu-repo/grantAgreement/ES/3PN/FFI2008-04982-C003-02
dc.relation.projectID info:eu-repo/grantAgreement/ES/3PN/FFI2008-04982-C003-03
dc.relation.projectID info:eu-repo/grantAgreement/ES/3PN/FFI2011-29559-C02-01
dc.relation.projectID info:eu-repo/grantAgreement/ES/3PN/FFI2011-29559-C02-02
dc.relation.projectID info:eu-repo/grantAgreement/ES/3PN/FFI2009-07648/FILO
dc.relation.projectID info:eu-repo/grantAgreement/ES/2PN/CSD2007-00012
dc.rights.accessRights info:eu-repo/semantics/openAccess
dc.type.version info:eu-repo/semantics/acceptedVersion


This item appears in the following Collection(s)

Show simple item record

Search DSpace

Advanced Search


My Account


In collaboration with Compliant to Partaking