Optimization techniques for speech emotion recognition

Sidorova, Julia

Optimization techniques for speech emotion recognition

Document Type

Doctoral thesis
Published Version

Author

Sidorova, Julia

Director

Badia i Cardús, Antoni

Publication Date

2009-12-15

Citation

Sidorova, J. Optimization techniques for speech emotion recognition. Universitat Pompeu Fabra; 2009. handle: http://hdl.handle.net/10803/7575

This citation was generated automatically.

Doctoral program

Programa de doctorat en Traducció i Ciències del Llenguatge

Abstract

Hay tres aspectos innovadores. Primero, un algoritmo novedoso para calcular el contenido emocional de un enunciado, con un diseño mixto que emplea aprendizaje estadístico e información sintáctica. Segundo, una extensión para selección de rasgos que permite adaptar los pesos y así aumentar la flexibilidad del sistema. Tercero, una propuesta para incorporar rasgos de alto nivel al sistema. Dichos rasgos, combinados con los rasgos de bajo nivel, permiten mejorar el rendimiento del sistema.
The first contribution of this thesis is a speech emotion recognition system called the ESEDA capable of recognizing emotions in di®erent languages. The second contribution is the classifier TGI+. First objects are modeled by means of a syntactic method and then, with a statistical method the mappings of samples are classified, not their feature vectors. The TGI+ outperforms the state of the art top performer on a benchmark data set of acted emotions. The third contribution is high-level features, which are distances from a feature vector to the tree automata accepting class i, for all i in the set of class labels. The set of low-level features and the set of high-level features are concatenated and the resulting set is submitted to the feature selection procedure. Then the classification step is done in the usual way. Testing on a benchmark dataset of authentic emotions showed that this classification strategy outperforms the state of the art top performer.

Keywords

autómata de arboles, calificadores, reconocimiento de emociones vía voz, emoción, tree automata, classification, pattern recognition, constructed features, speech emotion recognition, emotion