Latent-based adversarial neural networks for facial affect estimations

Aspandi, Decky; Mallol Ragolta, Adrià; Schuller, Björn; Binefa i Valls, Xavier

doi:http://dx.doi.org/10.1109/FG47880.2020.00053

Latent-based adversarial neural networks for facial affect estimations

Citation

Aspandi D, Mallol-Ragolta A, Schuller B, Binefa X. Latent-based adversarial neural networks for facial affect estimations. In: Štruc V, Gómez-Fernández F, editors. 15th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2020); 2020 Nov 16-20; Buenos Aires, Argentina. New Jersey: IEEE; 2020. p. 606-10. DOI: 10.1109/FG47880.2020.00053

Abstract

There is a growing interest in affective computing research nowadays given its crucial role in bridging humans with computers. This progress has recently been accelerated due to the emergence of bigger dataset. One recent advance in this field is the use of adversarial learning to improve model learning through augmented samples. However, the use of latent features, which is feasible through adversarial learning, is not largely explored, yet. This technique may also improve the performance of affective models, as analogously demonstrated in related fields, such as computer vision. To expand this analysis, in this work, we explore the use of latent features through our proposed adversarial-based networks for valence and arousal recognition in the wild. Specifically, our models operate by aggregating several modalities to our discriminator, which is further conditioned to the extracted latent features by the generator. Our experiments on the recently released SEWA dataset suggest the progressive improvements of our results. Finally, we show our competitive results on the Affective Behavior Analysis in-the-Wild (ABAW) challenge dataset.

Description

Comunicació presentada al 15th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2020), celebrat del 16 al 20 de novembre de 2020 a Buenos Aires, Argentina.