A Comprehensive Review of Multimodal Emotion Recognition: Techniques, Challenges, and Future Directions
Indexed incrossrefdoajpubmed
Abstract
This paper presents a comprehensive review of multimodal emotion recognition (MER), a process that integrates multiple data modalities such as speech, visual, and text to identify human emotions. Grounded in biomimetics, the survey frames MER as a bio-inspired sensing paradigm that emulates the way humans seamlessly fuse multisensory cues to communicate affect, thereby transferring principles from living systems to engineered solutions. By leveraging various modalities, MER systems offer a richer and more robust analysis of emotional states compared to unimodal approaches. The review covers the general structure of MER systems, feature extraction techniques, and multimodal information fusion strategies,…
Citation impact
51
total citations
- FWCI
- 82.09
- Percentile
- 100%
- References
- 103
Citations per year
Authors
3Topics & keywords
Topics
Keywords
- Modalities
- Generalizability theory
- Computer science
- Human–computer interaction
- Process (computing)
- Affective computing
- Artificial intelligence
- Multimodality
No related works found for this paper.