| Index | Model | Paper | Year | Project | Dataset | Method |
|---|---|---|---|---|---|---|
| VAT-Challenge | MuSe | The MuSe 2021 Multimodal Sentiment Analysis Challenge: Sentiment, Emotion, Physiological-Emotion, and Stress | MM 2021 | [coding] | MuSe-Wilder, MuSe-Sent, MuSe-Stress, MuSe-Physio | Aduio+Video+Text, MuSe-Sent, MuSe-Physio, Multimodal Emotion, Sentiment, Physiological-Emotion, and Stress Detection |
| VAT-Dataset | ERATO, SMTA | Pairwise Emotional Relationship Recognition in Drama Videos: Dataset and Benchmark | MM 2021 | [coding] | ERATO | Aduio+Video+Text, Dataset, Baseline model |
| VA | MPATN | Zero-shot Video Emotion Recognition via Multimodal Protagonist-aware Transformer Network | MM 2021 | YouTube-24, VideoStory-P14, LIRIS-ACCEDE-11 | Aduio+Video, movement signal, Video Emotion Recognition | |
| VT | Exploiting BERT for Multimodal Target Sentiment Classification through Input Space Translation | MM 2021 | [coding] | Twitter15, Twitter-17 | Image+Text, Translates images in input space using an object-aware transformer | |
| VAT | MetaDrop | Learning What and When to Drop: Adaptive Multimodal and Contextual Dynamics for Emotion Recognition in Conversation | MM 2021 | IEMOCAP, MELD | Aduio+Video+Text, movement signal, Emotion Recognition in Conversation | |
| VAT | TFR-Net | Transformer-based Feature Reconstruction Network for Robust Multimodal Sentiment Analysis | MM 2021 | [coding] | MOSI, SIMS | Aduio+Video+Text, Multimodal Sentiment Analysis |
| PS | HetEmotionNet | HetEmotionNet: Two-Stream Heterogeneous Graph Recurrent Neural Network for Multi-modal Emotion Recognition | MM 2021 | [coding] | DEAP, MAHNOB-HCI | EEG+PPS+GTN, A novel two-stream heterogeneous graph recurrent neural network |
| PS | Simplifying Multimodal Emotion Recognition with Single Eye Movement Modality | MM 2021 | SEED, SEED-IV, SEED-V | EEG+Eye movement signal, A generative adversarial network-based framework | ||
| PS | SFE-Net | SFE-Net: EEG-based Emotion Recognition with Symmetrical Spatial Feature Extraction | MM 2021 | DEAP, SEED | EEG, movement signal, A spatial folding ensemble network (SFE-Net) | |
| PS | MD-AGCN | A Multi-Domain Adaptive Graph Convolutional Network for EEG-based Emotion Recognition | MM 2021 | SEED, SEED-IV, SEED-V | EEG, A Multi-Domain Adaptive Graph Convolutional Network |
| Index | Model | Paper | Year | Project | Dataset | Method |
|---|---|---|---|---|---|---|
| VAT | PMR | Progressive Modality Reinforcement for Human Multimodal Emotion Recognition from Unaligned Multimodal Sequences | CVPR 2021 | CMU-MOSI, CMU-MOSEI and IEMOCAP | Aduio+Video+Text, e Progressive Modality Reinforcement | |
| VAT-Dataset | ERATO, SMTA | Pairwise Emotional Relationship Recognition in Drama Videos: Dataset and Benchmark | CVPR 2021 | [coding] | ERATO | Aduio+Video+Text, Dataset, Baseline model |
| VA | MPATN | Zero-shot Video Emotion Recognition via Multimodal Protagonist-aware Transformer Network | CVPR 2021 | YouTube-24, VideoStory-P14, LIRIS-ACCEDE-11 | Aduio+Video, movement signal, Video Emotion Recognition | |
| VT | Exploiting BERT for Multimodal Target Sentiment Classification through Input Space Translation | CVPR 2021 | [coding] | Twitter15, Twitter-17 | Image+Text, Translates images in input space using an object-aware transformer | |
| VAT | MetaDrop | Learning What and When to Drop: Adaptive Multimodal and Contextual Dynamics for Emotion Recognition in Conversation | MM 2021 | IEMOCAP, MELD | Aduio+Video+Text, movement signal, Emotion Recognition in Conversation | |
| VAT | TFR-Net | Transformer-based Feature Reconstruction Network for Robust Multimodal Sentiment Analysis | CVPR 2021 | [coding] | MOSI, SIMS | Aduio+Video+Text, Multimodal Sentiment Analysis |
| PS | HetEmotionNet | HetEmotionNet: Two-Stream Heterogeneous Graph Recurrent Neural Network for Multi-modal Emotion Recognition | CVPR 2021 | [coding] | DEAP, MAHNOB-HCI | EEG+PPS+GTN, A novel two-stream heterogeneous graph recurrent neural network |
| PS | Simplifying Multimodal Emotion Recognition with Single Eye Movement Modality | CVPR 2021 | SEED, SEED-IV, SEED-V | EEG+Eye movement signal, A generative adversarial network-based framework | ||
| PS | SFE-Net | SFE-Net: EEG-based Emotion Recognition with Symmetrical Spatial Feature Extraction | CVPR 2021 | DEAP, SEED | EEG, movement signal, A spatial folding ensemble network (SFE-Net) | |
| PS | MD-AGCN | A Multi-Domain Adaptive Graph Convolutional Network for EEG-based Emotion Recognition | CVPR 2021 | SEED, SEED-IV, SEED-V | EEG, A Multi-Domain Adaptive Graph Convolutional Network |