Multi-instance dynamic ordinal random fields for weakly-supervised pain intensity estimation

Ruiz Ovejero, Adrià; Rudovic, Ognjen; Binefa i Valls, Xavier; Pantic, Maja

doi:http://dx.doi.org/10.1007/978-3-319-54184-6_11

Multi-instance dynamic ordinal random fields for weakly-supervised pain intensity estimation

Citation

Ruiz A, Rudovic O, Binefa X, Pantic M. Multi-instance dynamic ordinal random fields for weakly-supervised pain intensity estimation. In: Lai SH, Lepetit V, Nishino K, Sato Y. Computer Vision – ACCV 2016. 13th Asian Conference on Computer Vision, Taipei, Taiwan, November 20-24, 2016, Revised Selected Papers, Part II. [Cham]: Springer International Publishing, 2017. [17] p. (LNCS; no. 10112). DOI: 10.1007/978-3-319-54184-6_11

Abstract

In this paper, we address the Multi-Instance-Learning (MIL) problem when bag labels are naturally represented as ordinal variables (Multi-Instance-Ordinal Regression). Moreover, we consider the case where bags are temporal sequences of ordinal instances. To model this, we propose the novel Multi-Instance Dynamic Ordinal Random Fields (MI-DORF). In this model, we treat instance-labels inside the bag as latent ordinal states. The MIL assumption is modelled by incorporating a high-order cardinality potential relating bag and instance-labels, into the energy function. We show the benefits of the proposed approach on the task of weakly-supervised pain intensity estimation from the UNBC Shoulder-Pain Database. In our experiments, the proposed approach significantly outperforms alternative non-ordinal methods that either ignore the MIL assumption, or do not model dynamic information in target data.

Description

Comunicació presentada a: Computer Vision – ACCV 2016, 13th Asian Conference on Computer Vision, celebrat a Taipei, Taiwan, del 20 al 24 de novembre de 2016.