/MM2022_sub1465

Primary LanguagePythonApache License 2.0Apache-2.0

RADAR

Implementation of paper Micro-video Tagging via Jointly Modeling Social Influence and Tag Relation.

In this paper, we study the problem of micro-video tagging, formulated as a link prediction problem in a video-tag network to jointly model social influence and tag relation. Our RADAR model derive a better video and tag representation through Behavior Spread modeling and visual and linguistic knowledge aggregation. Extensive experiments on industrial datasets of three verticals verify the superiority of our model compared with several state-of-the-art baselines.

Framework

framework

Datasets

Coming soon.

Prerequisites

See Installation Guide for details.

Quick Start

a. To reproduce Table 2 in paper.

bash benchmark/vanilla.sh # Vanilla
bash benchmark/mlgcn.sh # ML-GCN
bash benchmark/nextvlad.sh # NeXtVLAD
bash benchmark/cma.sh # CMA
bash benchmark/mall.sh # MALL-CNN
bash benchmark/taggnn.sh # TagGNN
bash benchmark/taghan.sh # HAN
bash benchmark/taghgt.sh # HGT
bash benchmark/simple_hgn.sh # Simple_HGN
bash benchmark/ourgnn.sh # Ours

b. To reproduce Table 3 in paper.

# 5.5.1 Ablation of different relations.
bash benchmark/ourgnn_relation_ablation.sh
# 5.5.2 Ablation of GGT.
bash benchmark/ourgnn_ggt_ablation.sh
# 5.5.3 Ablation of AAN.
bash benchmark/ourgnn_aan_ablation.sh
# 5.5.4 Ablation of bidirectional edges.
bash benchmark/ourgnn_bidirectional.sh

c. To reproduce Figure 7 in paper.

bash benchmark/ourgnn_layer_ablation.sh # (a)
python benchmark/ours_aan_sensi.py # (b)