Narang, JyotiTamer, Nazif CanVega, Viviana De LaSerra, Xavier2024-10-292024-10-292024Narang J, Tamer NC, Vega VDL, Serra X. Automatic estimation of singing voice musical dynamics. Paper presented at: 25th International Society for Music Information Retrieval Conference (ISMIR2024); 2024 November 10-14; San Francisco, USA.http://hdl.handle.net/10230/68387This work has been accepted at 25th International Society for Music Information Retrieval Conference (ISMIR2024), in San Francisco, USA. November 10-14, 2024Musical dynamics form a core part of expressive singing voice performances. However, automatic analysis of musical dynamics for singing voice has received limited attention partly due to the scarcity of suitable datasets and a lack of clear evaluation frameworks. To address this challenge, we propose a methodology for dataset curation. Employing the proposed methodology, we compile a dataset comprising 509 musical dynamics annotated singing voice performances, aligned with 163 score files, leveraging stateof-the-art source separation and alignment techniques. The scores are sourced from the OpenScore Lieder corpus of romantic-era compositions, widely known for its wealth of expressive annotations. Utilizing the curated dataset, we train a multi-head attention based CNN model with varying window sizes to evaluate the effectiveness of estimating musical dynamics. We explored two distinct perceptually motivated input representations for the model training: log-Mel spectrum and bark-scale based features. For testing, we manually curate another dataset of 25 musical dynamics annotated performances in collaboration with a professional vocalist. We conclude through our experiments that bark-scale based features outperform log-Melfeatures for the task of singing voice dynamics prediction. The dataset along with the code is shared publicly for further research on the topic.application/pdfeng© Narang J, Tamer NC, Vega VDL, Serra X. Licensed under a Creative Commons Attribution 4.0 International License (CC BY 4.0). Attribution: Jyoti Narang, Nazif Can Tamer, Viviana De La Vega, Xavier Serra, “Automatic estimation of singing voice musical dynamics”, in Proc. of the 25th Int. Society for Music Information Retrieval Conf., San Francisco, United States, 2024.info:eu-repo/semantics/conferenceObjectMusical dynamicsSinging voice performanceAutomatic analysisinfo:eu-repo/semantics/openAccess