Predictability of music descriptor time series and its application to cover song detection

Serrà Julià, Joan; Kantz, Holger; Serra, Xavier; Andrzejak, Ralph Gregor

doi:http://dx.doi.org/10.1109/TASL.2011.2162321

Predictability of music descriptor time series and its application to cover song detection

Citation

Serra J, Kantz H, Serra X, Andrzejak R G. Predictability of music descriptor time series and its application to cover song detection. IEEE Transactions on Audio, Speech and Language Processing. 2011; 20(2): 514-525. DOI 10.1109/TASL.2011.2162321

Abstract

Intuitively, music has both predictable and unpredictable components. In this work we assess this qualitative statement in a quantitative way using common time series models fitted to state-of-the-art music descriptors. These descriptors cover different musical facets and are extracted from a large collection of real audio recordings comprising a variety of musical genres. Our findings show that music descriptor time series exhibit a certain predictability not only for short time intervals, but also for mid-term and relatively long intervals. This fact is observed independently of the descriptor, musical facet and time series model we consider. Moreover, we show that our findings are not only of theoretical relevance /nbut can also have practical impact. To this end we demonstrate that music predictability at relatively long time intervals can be exploited in a real-world application, namely the automatic identification of cover songs (i.e. different renditions or versions of the same musical piece). Importantly, this prediction strategy yields a parameter-free approach for cover song identification that is substantially faster, allows for reduced computational storage and still maintains highly competitive accuracies when compared to state-of-the-art systems.