A multimodal fusion project for emotion detection using a large number of video clips, audio, and subtitle text extracted from the TV show Friends.
The goal was to build a robust model that captures emotional cues across modalities to track emotional evolution across scenes and characters.