Summary of papers and projects for visual dialog, video dialog, and multimodal dialog
TCSVT 2023Heterogeneous Knowledge Network for Visual Dialog link
CVPR 2022UTC: A Unified Transformer With Inter-Task Contrastive Learning for Visual Dialog linkArXiv 2022Modeling Coreference Relations in Visual Dialog linkICASSP 2022Improving Cross-Modal Understanding in Visual Dialog Via Contrastive Learning linkInformation Processing & Management 2022HVLM: Exploring Human-Like Visual Cognition and Language-Memory Network for Visual Dialog linkPattern Recognition 2022VD-PCR: Improving visual dialog with pronoun coreference resolution link
CVPR 2019Recursive Visual Attention in Visual Dialog link
CVPR 2017Visual Dialog link
EMNLP 2022 FindingsCollaborative Reasoning on Multi-Modal Semantic Graphs for Video-Grounded Dialogue Generation linkNAACL 2022VGNMN: Video-grounded Neural Module Networks for Video-Grounded Dialogue Systems linkEMNLP 2022Information-Theoretic Text Hallucination Reduction for Video-grounded Dialogue linkAAAI 2022 WorkshopAudio Visual Scene-Aware Dialog Generation with Transformer-based Video Representations linkICIP 2022Video-Grounded Dialogues with Joint Video and Image Training linkECCV 2022Video Dialog as Conversation about Objects Living in Space-Time link code
TASLP 2021End-to-End Recurrent Cross-Modality Attention for Video Dialogue linkTASLP 2021Bridging Text and Video: A Universal Multimodal Transformer for Audio-Visual Scene-Aware Dialog linkAAAI 2021Dynamic Graph Representation Learning for Video Dialog via Multi-Modal Shuffled Transformers linkAAAI 2021Structured Co-reference Graph Attention for Video-grounded Dialogue linkICLR 2021Learning Reasoning Paths over Semantic Graphs for Video-grounded Dialogues link
TCSVT 2020Video Dialog via Multi-Grained Convolutional Self-Attention Context Multi-Modal Networks linkNAACL 2020Video-Grounded Dialogues with Pretrained Generation Language Models linkEMNLP 2020BiST: Bi-directional Spatio-Temporal Reasoning for Video-Grounded Dialogues link code
ACL 2019Multimodal Transformer Networks for End-to-End Video-Grounded Dialogue Systems link codeICASSP 2019End-to-end Audio Visual Scene-aware Dialog Using Multimodal Attention-based Video Features link
ICASSP 2022A Non-Hierarchical Attention Network with Modality Dropout for Textual Response Generation in Multimodal Dialogue Systems linkArXiv 2022Multimodal Dialog Systems with Dual Knowledge-enhanced Generative Pretrained Language Model link
SIGIR 2021MMConv: An Environment for Multimodal Conversational Search across Multiple Domains linkACMMM 2021Multimodal Dialog System: Relational Graph-based Context-aware Question Understanding link
ACMMM 2020Multimodal Dialogue Systems via Capturing Context-aware Dependencies of Semantic Elements link