Feature selection for speech emotion recognition in Spanish and Basque: on the use of machine learning to improve human-computer interaction

Andoni Arruti; Idoia Cearreta; Aitor Alvarez; Elena Lazkano; Basilio Sierra

doi:10.1371/journal.pone.0108975

Feature selection for speech emotion recognition in Spanish and Basque: on the use of machine learning to improve human-computer interaction

PLoS One. 2014 Oct 3;9(10):e108975. doi: 10.1371/journal.pone.0108975. eCollection 2014.

Authors

Andoni Arruti¹, Idoia Cearreta¹, Aitor Alvarez², Elena Lazkano¹, Basilio Sierra¹

Affiliations

¹ Computer Science Faculty (University of the Basque Country), San Sebastián, Spain.
² Vicomtech-IK4 Research Alliance, San Sebastián, Spain.

Abstract

Study of emotions in human-computer interaction is a growing research area. This paper shows an attempt to select the most significant features for emotion recognition in spoken Basque and Spanish Languages using different methods for feature selection. RekEmozio database was used as the experimental data set. Several Machine Learning paradigms were used for the emotion classification task. Experiments were executed in three phases, using different sets of features as classification variables in each phase. Moreover, feature subset selection was applied at each phase in order to seek for the most relevant feature subset. The three phases approach was selected to check the validity of the proposed approach. Achieved results show that an instance-based learning algorithm using feature subset selection techniques based on evolutionary algorithms is the best Machine Learning paradigm in automatic emotion recognition, with all different feature sets, obtaining a mean of 80,05% emotion recognition rate in Basque and a 74,82% in Spanish. In order to check the goodness of the proposed process, a greedy searching approach (FSS-Forward) has been applied and a comparison between them is provided. Based on achieved results, a set of most relevant non-speaker dependent features is proposed for both languages and new perspectives are suggested.

Publication types

Research Support, Non-U.S. Gov't

MeSH terms

Algorithms
Emotions*
Humans
Machine Learning*
Pattern Recognition, Automated / methods*
Speech*
User-Computer Interface*

Grants and funding

This work has been done within the Basque Government Research Team grant under project TIN2010-15549 of the Spanish Ministry and the University of the Basque Country UPV/EHU, under grant UFI11/45 (BAILab). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.