This is the repository of CLMLF:A Contrastive Learning and Multi-Layer Fusion Method for Multimodal Sentiment Detection [pdf] (Findings of NAACL 2022)
We give the version of the python package we used, please refer to requirements.txt
The code will released soon.
python 3.6
pytorch 1.7.1
transformer 4.10.0
We provide text data in dataset\data\. As for images, please download from the link below:
MVSA-*
http://mcrlab.net/research/mvsa-sentiment-analysis-on-multi-view-social-data/
HFM https://github.com/headacheboy/data-of-multimodal-sarcasm-detection
For example, MVSA-Single's images should be put in dataset\data\MVSA-single\dataset_image
Download model:
百度网盘：
链接：https://pan.baidu.com/s/1EUyZFN2uv3QxgNaS_ivh9A
提取码：yuvw
Google drive:
https://drive.google.com/file/d/1ZLHu6JsrAj3QE4dz4X5tFIBE5VprNZbp/view?usp=sharing
We provide running scripts as follow:
As for MVSA-Single:
sh train-single.sh 0
As for MVSA-Mulitple:
sh train-mul.sh 0
As for HFM:
sh train-hfm.sh 0
If you find this code useful for your research, please consider citing:
@inproceedings{li2022clmlfa,
title = "{CLMLF}:A Contrastive Learning and Multi-Layer Fusion Method for Multimodal Sentiment Detection",
author = "Zhen Li and Bing Xu and Conghui Zhu and Tiejun Zhao",
booktitle = "Findings of the Association for Computational Linguistics: NAACL 2022",
year = "2022",
publisher = "Association for Computational Linguistics",
}