Escudero Mancebo, DavidAguilar Cuevas, LourdesVanrell, Maria del MarPrieto Vives, Pilar, 1965-2017-01-172017-01-172012Escudero D, Aguilar L, Vanrell MM, Prieto P. Analysis of inter-transcriber consistency in the Cat_ToBI prosodic labeling system. Speech Commun. 2012 May; 54(4):566–82. DOI: 10.1016/j.specom.2011.12.0020167-6393http://hdl.handle.net/10230/27918A set of tools to analyze inconsistencies observed in a Cat_ToBI labeling experiment are presented. We formalize and use the metrics that are commonly used in inconsistency tests. The metrics are systematically applied to analyze the robustness of every symbol and every pair of transcribers. The results reveal agreement rates for this study that are comparable to previous ToBI inter-reliability tests. The inter-transcriber confusion rates are transformed into distance matrices to use multidimensional scaling for visualizing the confusion between the different ToBI symbols and the disagreement between the raters. Potential different labeling criteria are identified and subsets of symbols that are candidates to be fused are proposed.application/pdfeng© Elsevier http://dx.doi.org/10.1016/j.specom.2011.12.002info:eu-repo/semantics/articlehttp://dx.doi.org/10.1016/j.specom.2011.12.002ProsodyProsodic labelingInter-transcriber consistencyToBIinfo:eu-repo/semantics/openAccess