Welcome to the UPF Digital Repository

On the use of note onsets for improved lyrics-to-audio alignment in Turkish Makam music

Show simple item record

dc.contributor.author Dzhambazov, Georgi Bogomilov
dc.contributor.author Srinivasamurthy, Ajay
dc.contributor.author Sentürk, Sertan
dc.contributor.author Serra, Xavier
dc.date.accessioned 2017-10-30T09:03:20Z
dc.date.available 2017-10-30T09:03:20Z
dc.date.issued 2016
dc.identifier.citation Dzhambazov G, Srinivasamurthy A, Senturk S, Serra X. On the use of note onsets for improved lyrics-to-audio alignment in Turkish Makam music. In: Devaney J, Mandel MI, Turnbull D, Tzanetakis G, editors. ISMIR 2016. Proceedings of the 17th International Society for Music Information Retrieval Conference; 2016 Aug 7-11; New York City (NY). [Canada]: ISMIR; 2016. p. 716-22.
dc.identifier.uri http://hdl.handle.net/10230/33116
dc.description Comunicació presentada a la 17th International Society for Music Information Retrieval Conference (ISMIR 2016), celebrada els dies 7 a 11 d'agost de 2016 a Nova York, EUA.
dc.description.abstract Lyrics-to-audio alignment aims to automatically match given lyrics and musical audio. In this work we extend a state of the art approach for lyrics-to-audio alignment with information about note onsets. In particular, we consider the fact that transition to next lyrics syllable usually implies transition to a new musical note. To this end we formulate rules that guide the transition between consecutive phonemes when a note onset is present. These rules are incorporated into the transition matrix of a variable-time hidden Markov model (VTHMM) phonetic recognizer based on MFCCs. An estimated melodic contour is input to an automatic note transcription algorithm, from which the note onsets are derived. The proposed approach is evaluated on 12 a cappella audio recordings of Turkish Makam music using a phrase-level accuracy measure. Evaluation of the alignment is also presented on a polyphonic version of the dataset in order to assess how degradation in the extracted onsets affects performance. Results show that the proposed model outperforms a baseline approach unaware of onset transition rules. To the best of our knowledge, this is the one of the first approaches tackling lyrics tracking, which combines timbral features with a melodic feature in the alignment process itself.
dc.description.sponsorship This work is partly supported by the European Research Council under the European Union’s Seventh Framework Program, as part of the CompMusic project (ERC grant agreement 267583) and partly by the AGAUR research grant. We acknowledge as well financial support from the Spanish Ministry of Economy and Competitiveness, through the ”María de Maeztu” Programme for Centres/Units of Excellence in R&D” (MDM-2015-0502).
dc.format.mimetype application/pdf
dc.language.iso eng
dc.publisher International Society for Music Information Retrieval (ISMIR)
dc.relation.ispartof Devaney J, Mandel MI, Turnbull D, Tzanetakis G, editors. ISMIR 2016. Proceedings of the 17th International Society for Music Information Retrieval Conference; 2016 Aug 7-11; New York City (NY). [Canada]: ISMIR; 2016. p. 716-22.
dc.rights © Georgi Dzhambazov, Ajay Srinivasamurthy, Sertan Senturk , Xavier Serra . Licensed under a Creative Commons Attribution 4.0 International License (CC BY 4.0). Attribution: Georgi Dzhambazov, Ajay Srinivasamurthy, Sertan Senturk , Xavier Serra. “On the use of note onsets for improved lyrics-to-audio alignment in Turkish Makammusic”, 17th International Society for Music Information Retrieval Conference, 2016.
dc.rights.uri http://creativecommons.org/licenses/by/4.0/
dc.subject.other Música -- Anàlisi
dc.title On the use of note onsets for improved lyrics-to-audio alignment in Turkish Makam music
dc.type info:eu-repo/semantics/conferenceObject
dc.relation.projectID info:eu-repo/grantAgreement/EC/FP7/267583
dc.rights.accessRights info:eu-repo/semantics/openAccess
dc.type.version info:eu-repo/semantics/publishedVersion

Thumbnail

This item appears in the following Collection(s)

Show simple item record

Search DSpace


Advanced Search

Browse

My Account

Statistics

In collaboration with Compliant to Partaking