Expressive singing synthesis based on unit selection for the singing synthesis challenge 2016

Bonada, Jordi, 1973-; Umbert Morist, Martí; Blaauw, Merlijn

doi:http://dx.doi.org/10.21437/Interspeech.2016-872

Expressive singing synthesis based on unit selection for the singing synthesis challenge 2016

Citation

Bonada J, Umbert M, Blaauw M. Expressive singing synthesis based on unit selection for the singing synthesis challenge 2016. In: Morgan N, editor. Interspeech 2016; 2016 Sep 8-12; San Francisco, CA. [place unknown]: ISCA; 2016. p. 1230-4. DOI: 10.21437/Interspeech.2016-872

Abstract

Sample and statistically based singing synthesizers typically require a large amount of data for automatically generating expressive synthetic performances. In this paper we present a singing synthesizer that using two rather small databases is able to generate expressive synthesis from an input consisting of notes and lyrics. The system is based on unit selection and uses the Wide-Band Harmonic Sinusoidal Model for transforming samples. The first database focuses on expression and consists of less than 2 minutes of free expressive singing using solely vowels. The second one is the timbre database which for the English case consists of roughly 35 minutes of monotonic singing of a set of sentences, one syllable per beat. The synthesis is divided in two steps. First, an expressive vowel singing performance of the target song is generated using the expression database. Next, this performance is used as input control of the synthesis using the timbre database and the target lyrics. A selection of synthetic performances have been submitted to the Interspeech Singing Synthesis Challenge 2016, in which they are compared to other competing systems.

Description

Comunicació presentada al Interspeech 2016, celebrat a San Francisco (Califòrnia, EUA) els dies 8 a 12 de septembre de 2016, i organitzat per la International Speech Communication Association (ISCA).