Melody extraction from polyphonic music signals: approaches, applications and challenges

Salamon, Justin; Gómez Gutiérrez, Emilia, 1975-; Ellis, Daniel P. W.; Richard, Gaël

doi:http://dx.doi.org/10.1109/MSP.2013.2271648

Melody extraction from polyphonic music signals: approaches, applications and challenges

Citation

Salamon J, Gómez E, Ellis DPW, Richard G. Melody extraction from polyphonic music signals: approaches, applications and challenges. IEEE Signal Process Mag. 2014;31(2):118-34. DOI: 10.1109/MSP.2013.2271648

Abstract

Melody extraction algorithms aim to produce a sequence of frequency values corresponding to the pitch of the dominant melody from a musical recording. Over the past decade melody extraction has emerged as an active research topic, comprising a large variety of proposed algorithms spanning a wide range of techniques. This article provides an overview of these techniques, the applications for which melody extraction is useful, and the challenges that remain. We start with a discussion of `melody' from both musical and signal processing perspectives, and provide a case study which interprets the output of a melody extraction algorithm for specific excerpts. We then provide a comprehensive comparative analysis of melody extraction algorithms based on the results of an international evaluation campaign. We discuss issues of algorithm design, evaluation and applications which build upon melody extraction. Finally, we discuss some of the remaining challenges in melody extraction research in terms of algorithmic performance, development, and evaluation methodology.