Analysis of EEG Signals and Facial Expressions for Continuous Emotion Detection

Emotions are time varying affective phenomena that are elicited as a result of stimuli. Videos and movies in particular are made to elicit emotions in their audiences. Detecting the viewers' emotions instantaneously can be used to find the emotional traces of videos. In this paper, we present our approach in instantaneously detecting the emotions of video viewers' emotions from electroencephalogram (EEG) signals and facial expressions. A set of emotion inducing videos were shown to participants while their facial expressions and physiological responses were recorded. The expressed valence (negative to positive emotions) in the videos of participants' faces were annotated by five annotators. The stimuli videos…

• NS
  National Science Foundation
• IR
  Innovative Research Group Project of the National Natural Science Foundation of China
• OO
  Office of Naval Research

  Awards: N00014-12-1-1028, N00014-14-1-0484
• DO
  Division of Computer and Network Systems

  Award: 1314484
• AR
  Army Research Office

  Award: W911NF-14-1-0218