Welcome to the UPF Digital Repository

A Framework for multi-f0 modeling in SATB choir recordings

Show simple item record

dc.contributor.author Cuesta, Helena
dc.contributor.author Gómez Gutiérrez, Emilia, 1975-
dc.contributor.author Chandna, Pritish
dc.date.accessioned 2019-10-31T12:04:47Z
dc.date.available 2019-10-31T12:04:47Z
dc.date.issued 2019
dc.identifier.citation Cuesta H, Gómez E, Chandna P. A Framework for multi-f0 modeling in SATB choir recordings. In: Proceedings of the 16th Sound & Music Computing Conference SMC 2019; 2019 May 28-31; Malaga, Spain. [Málaga]: Sound and Music Computing; 2019. p. 447-53.
dc.identifier.isbn 978-84-09-08518-7
dc.identifier.issn 2518-3672
dc.identifier.uri http://hdl.handle.net/10230/42577
dc.description Comunicació presentada a: Sound & Music Computing Conference celebrada del 28 al 31 de maig de 2019 a Màlaga, Espanya.
dc.description.abstract Fundamental frequency (f0) modeling is an important but relatively unexplored aspect of choir singing. Performance evaluation as well as auditory analysis of singing, whether individually or in a choir, often depend on extracting f0 contours for the singing voice. However, due to the large number of singers, singing at a similar frequency range, extracting the exact individual pitch contours from choir recordings is a challenging task. In this paper, we address this task and develop a methodology for modeling pitch contours of SATB choir recordings. A typical SATB choir consists of four parts, each covering a distinct range of pitches and often with multiple singers each. We first evaluate some state-of-the-art multi-f0 estimation systems for the particular case of choirs with a single singer per part, and observe that the pitch of individual singers can be estimated to a relatively high degree of accuracy. We observe, however, that the scenario of multiple singers for each choir part (i.e. unison singing) is far more challenging. In this work we propose a methodology based on combining a multi-f0 estimation methodology based on deep learning followed by a set of traditional DSP techniques to model f0 and its dispersion instead of a single f0 trajectory for each choir part. We present and discuss our observations and test our framework with different singer configurations.
dc.description.sponsorship This work is partially supported by the European Commission under the TROMPA project (H2020 770376) and by Spanish Ministry of Economy and Competitiveness under the CASAS project (TIN2015-70816-R). First author is supported by FI Predoctoral Grant from AGAUR (Generalitat de Catalunya).
dc.format.mimetype application/pdf
dc.language.iso eng
dc.publisher Sound and Music Computing
dc.relation.ispartof Proceedings of the 16th Sound & Music Computing Conference SMC 2019; 2019 May 28-31; Malaga, Spain. [Málaga]: Sound and Music Computing; 2019.
dc.rights © 2018 Helena Cuesta et al. This is an open-access article distributed under the terms of the Creative Commons Attribution 3.0 Unported License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
dc.rights.uri https://creativecommons.org/licenses/by/3.0/
dc.title A Framework for multi-f0 modeling in SATB choir recordings
dc.type info:eu-repo/semantics/conferenceObject
dc.relation.projectID info:eu-repo/grantAgreement/EC/H2020/770376
dc.relation.projectID info:eu-repo/grantAgreement/ES/1PE/TIN2015-70816-R
dc.rights.accessRights info:eu-repo/semantics/openAccess
dc.type.version info:eu-repo/semantics/publishedVersion


This item appears in the following Collection(s)

Show simple item record

Search DSpace

Advanced Search


My Account


Compliant to Partaking