Review Progress

🥚 : 리뷰 전

🐣 : 리뷰 중

🐥 : 리뷰 완료

🐔 : 리뷰 완료(주요 논문)

Multi-modal Sentiment & Emotion Analysis

• General Sentiment or Emotion Classification Task

  [ACL 2019] Multimodal Transformer for Unaligned Multimdoal Language Sequences

  [ACL 2022] Multimodal Sarcasm Target Identification in Tweets

  [ACL 2023] Tackling Modality Heterogeneity with Multi-View Calibration Network for Multimodal Sentiment Detection

  [ACL 2023] ConFEDE: Contrastive Feature Decomposition for Multimodal Sentiment Analysis

  [ACL 2023] MultiEMO: An Attention-Based Correlation-Aware Multimodal Fusion Framework for Emotion Recognition in Conversations

  [EMNLP 2023] Learning Language-guided Adaptive Hyper-modality Representation for Multimodal Sentiment Analysis

  [EMNLP 2022] Multimodal Contrastive Learning via Uni-Modal Coding and Cross-Modal Prediction for Multimodal Sentiment Analysis

  [EMNLP 2022] UniMSE: Towards Unified Multimodal Sentiment Analysis and Emotion Recognition

  [EMNLP 2023] E-CORE: Emotion Correlation Enhanced Empathetic Dialogue Generation

  [NAACL 2022] CLMLF:A Contrastive Learning and Multi-Layer Fusion Method for Multimodal Sentiment Detection

  [CVPR 2022] Multimodal Dynamics: Dynamical Fusion for Trustworthy Multimodal Classification

  [NAACL 2022] Analyzing Modality Robustness in Multimodal Sentiment Analysis

  [Preprint] Hybrid Fusion Based Interpretable Multimodal Emotion Recognition with Limited Labelled Data

  [ACM DL 2023] Multimodal Sentiment Analysis: A Survey of Methods, Trends, and Challenges

  [ICTC 2023] Multi-modal Emotion Recognition Utilizing Korean-English Vision and Language Information Alignment Pre-trained Model

  [CVPR 2023] Dynamic Multimodal Fusion

  [MM 2023] Revisiting Disentanglement and Fusion on Modality and Context in Conversational Multimodal Emotion Recognition

  [EMNLP 2024] Knowledge-Guided Dynamic Modality Attention Fusion Network for Multimodal Sentiment Analysis

  [arXiv 2024] TCAN: Text-oriented Cross Attention Network for Multimodal Sentiment Analysis

  [AAAI 2025] DLF: Disentangled-Language-Focused Multimodal Sentiment Analysis

• Missing modality

  [ACL 2021] Missing Modality Imagination Network for Emotion Recognition with Uncertain Missing Modalities

  [EMNLP 2022] Mitigating Inconsistencies in Multimodal Sentiment Analysis under Uncertain Missing Modalities

  [SIGIR 2022] Tag-assisted Multimodal Sentiment Analysis under Uncertain Missing Modalities

  [CVPR 2023] Multi-Modal Learning With Missing Modality via Shared-Specific Feature Modelling

  [AAAI 2023] Towards Good Practices for Missing Modality Robust Action Recognition

  [NeurIPS 2023] Learning Unseen Modality Interaction

  [IEEE 2023] GCNet: Graph Completion Network for Incomplete Multimodal Learning in Conversation

  [NeurIPS 2023] Incomplete Multimodality-Diffused Emotion Recognition

  [CVPR 2023] Multimodal Prompting with Missing Modalities for Visual Recognition

  [IEEE Transactions on Affective Computing 2024] Contrastive Learning based Modality-Invariant Feature Acquisition for Robust Multimodal Emotion Recognition with Missing Modalities

  [Information Fusion 101. 2024] Modality translation-based multimodal sentiment analysis under uncertain missing modalities

  [AAAI 2024] A Unified Self-Distillation Framework for Multimodal Sentiment Analysis with Uncertain Missing Modalities

  [CVPR 2024] Correlation-Decoupled Knowledge Distillation for Multimodal Sentiment Analysis with Incomplete Modalities

  [COLING, 2024] InfoEnh: Towards Multimodal Sentiment Analysis via Information Bottleneck Filter and Optimal Transport Alignment

  [AAAI 2024] A Unified Self-Distillation Framework for Multimodal Sentiment Analysis with Uncertain Missing Modalities

  [ACL 2024] Multimodal Prompt Learning with Missing Modalities for Sentiment Analysis and Emotion Recognition

  [LREC-COLING 2024] InfoEnh: Towards Multimodal Sentiment Analysis via Information Bottleneck Filter and Optimal Transport Alignment

• Representation Learning with Multi-modality data

  [NeurIPS 2021] VATT: Transformer for Multimodal Self-Supervised Learning from Raw Video, Audio and Text

Large Language Model (LLM)

[Google 2020] Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer

Trajectory Related Works

[IEEE Access 2021] A two-block RNN-based trajectory prediction from incomplete trajectory

[CVPR 2022] Imitative Non-Autoregressive Modeling for Trajectory Forecasting and Imputation

[ECCV 2022] Human Trajectory Prediction via Neural Social Physics

[CVPR 2024] OOSTraj: Out-of-Sight Trajectory Prediction With Vision-Positioning Denoising

[NeurIPS 2024] Pedestrian Trajectory Prediction with Missing Data: Datasets, Imputation, and Benchmarking

[ACM MM 2024] Neural Interaction Energy for Multi-Agent Trajectory Prediction