High-resolution violin transcription using weak labels

Tamer, Nazif Can; Özer, Yigitcan; Müller, Meinard; Serra, Xavier

High-resolution violin transcription using weak labels

License

Citation

Tamer, N, Özer, Y, Müller, M, Serra, X. High-resolution violin transcription using weak labels. 2023. handle: http://hdl.handle.net/10230/58121

This citation was generated automatically.

Abstract

A descriptive transcription of a violin performance requires detecting not only the notes but also the fine-grained pitch variations, such as vibrato. Most existing deep learning methods for music transcription do not capture these variations and often need frame-level annotations, which are scarce for the violin. In this paper, we propose a novel method for high-resolution violin transcription that can leverage piece-level weak labels for training. Our conformer-based model works on the raw audio waveform and transcribes violin notes and their corresponding pitch deviations with 5.8 ms frame resolution and 10-cent frequency resolution. We demonstrate that our method (1) outperforms generic systems in the proxy tasks of violin transcription and pitch estimation, and (2) can automatically generate new training labels by aligning its feature representations with unseen scores. We share our model along with 34 hours of score-aligned solo violin performance dataset, notably including the 24 Paganini Caprices.

Description

This work has been accepted at the 24th International Society for Music Information Retrieval Conference (ISMIR 2023), at Milan, Italy. October 5-9, 2023.