A multimodal approach for online estimation of subtle facial expression
Xiang, X. Kankanhalli, M.S.
Xiang, X.
Citations
Altmetric:
Alternative Title
Abstract
Recognizing subtle emotional expression of human is a challenging and interesting problem in the field of human computer interaction. Multimodality is a prospective way to help solve this problem. Therefore, in this paper, we first take advantage of a novel "sparse representation" approach to compute the matching degree of current facial expression to each basic emotion class. Concurrently, we also use an eye tracker to obtain the instant pupillary response, which gives us clues to the subtle emotion. We combine the results of facial expression and pupillary information, take into account the previous emotional state to classify the current subtle emotional expression. Finally, a Markov Model is used to compute a directed graph to model the changes of human's emotion. The experimental results show that: First, the sparse representation has a good classification rate on facial expression; Second, the fusion of facial expression, pupillary size and previous emotional state is a promising strategy for analyzing subtle expression. © 2012 Springer-Verlag.
Keywords
eye pupil, online, subtle facial expression
Source Title
Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Publisher
Series/Report No.
Collections
Rights
Date
2012
DOI
10.1007/978-3-642-34778-8_37
Type
Conference Paper