wrk226/pytorch-multimodal_sarcasm_detection

About five attributes

Closed this issue · 3 comments

Hi, I am trying to run your code. But I have a problem in getting the attribute modality.
It seems that there is not the trained predictor in this repository.
Would you please explain how to train and which specific dataset and labels are used for training?
Thanks!

You can find the image data from here.
I didn't share the well-trained model because it doesn't take a long time to train it.
In order to train the model and understand the code, you may start from train.ipynb.

You can find the image data from here. I didn't share the well-trained model because it doesn't take a long time to train it. In order to train the model and understand the code, you may start from train.ipynb.

Thanks. I have trained the model to detect sarcasm.
But we have some problems to "predict" because when a new picture comes, how can we get five attributes like "img_to_five_words.txt"?
In other words, how can we train the ResNet in the procedure of attribute modality? The paper said it is fine-tuned through the COCO dataset with another ResNet model, but we did not find it:(

Thanks. I have trained the model to detect sarcasm. But we have some problems to "predict" because when a new picture comes, how can we get five attributes like "img_to_five_words.txt"? In other words, how can we train the ResNet in the procedure of attribute modality? The paper said it is fine-tuned through the COCO dataset with another ResNet model, but we did not find it:(

You are right, the author didn't share that model. When I tested the model on a new image I manually wrote five attributes for it... You may ask the author from the official repo or you may use any of the "Multi-class Classification" models for it.