Why is facial expression analysis in the wild challenging?

Tobias Gehrig, Hazim Kemal Ekenel

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

16 Citations (Scopus)

Abstract

In this paper, we discuss the challenges for facial expression analysis in the wild. We studied the problems exemplarily on the Emotion Recognition in the Wild Challenge 2013 [3] dataset. We performed extensive experiments on this dataset comparing different approaches for face alignment, face representation, and classification, as well as human performance. It turns out that under close-to-real conditions, especially with co-occurring speech, it is hard even for humans to assign emotion labels to clips when only taking video into account. Our experiments on automatic emotion classification achieved at best a correct classification rate of 29.81% on the test set using Gabor features and linear support vector machines, which were trained on web images. This result is 7.06% better than the official baseline, which additionally incorporates time information.

Original languageEnglish
Title of host publicationEmotiW 2013 - Proceedings of the 2013 ACM Emotion Recognition in the Wild Challenge and Workshop, Co-located with ICMI 2013
PublisherAssociation for Computing Machinery
Pages9-16
Number of pages8
ISBN (Print)9781450325646
DOIs
Publication statusPublished - 2013
Event2013 1st ACM Emotion Recognition in the Wild Challenge and Workshop, EmotiW 2013 - Co-located with ICMI 2013 - Sydney, NSW, Australia
Duration: 9 Dec 20139 Dec 2013

Publication series

NameEmotiW 2013 - Proceedings of the 2013 ACM Emotion Recognition in the Wild Challenge and Workshop, Co-located with ICMI 2013

Conference

Conference2013 1st ACM Emotion Recognition in the Wild Challenge and Workshop, EmotiW 2013 - Co-located with ICMI 2013
Country/TerritoryAustralia
CitySydney, NSW
Period9/12/139/12/13

Keywords

  • DCT
  • Emotion
  • EmotiW
  • Facial expression
  • FACS
  • Gabor
  • LBP
  • SVM

Fingerprint

Dive into the research topics of 'Why is facial expression analysis in the wild challenging?'. Together they form a unique fingerprint.

Cite this