linjieli222/HERO
Research code for EMNLP 2020 paper "HERO: Hierarchical Encoder for Video+Language Omni-representation Pre-training"
PythonMIT
Pinned issues
Issues
- 0
- 2
Unable to download pretrained models & features
#48 opened by Yuuraa - 0
/scripts/download_didemo.sh
#51 opened by HaungVita - 0
The number of queries for the didemo dataset
#50 opened by tfka - 1
Unable to download pretrained models & features
#49 opened by yliu-cs - 0
How to Visualize?
#47 opened by Yangaiei - 2
Reproducing Results on TVC w/o pre-training, getting scores higher than what is reported in the paper Table 4
#46 opened by Swetha5 - 2
- 5
Datapath
#44 opened by avinashsai - 2
- 2
RuntimeError: Mismatched data types: One rank had type int64, but another rank had type uint8.
#38 opened by wqf321 - 2
How long/memory cost does it take to extract all slowest features for howto100m?
#39 opened by forrestsz - 2
HPS file missing for TVQA task and eval_videoQA.py fails because of this (how to fix)?
#43 opened by yrf1 - 1
- 1
Reproducing VCMR results for didemo video only
#40 opened by hdy007007 - 5
An error during finetuning for the TVR task
#37 opened by HenryHZY - 4
- 3
OOM in pretraining
#30 opened by hgzjy25 - 1
code for how2r and how2qa
#35 opened by tfka - 2
Error while pretraining with TV data
#33 opened by michaelmyc - 5
got error while running pretrain.py
#32 opened by liveseongho - 0
I found a bug in pretrain.py
#31 opened by liveseongho - 4
some questions of model details
#22 opened by JinmingZhao - 4
- 3
Pre-training based on HowTo100M dataset
#17 opened by Unified-Robots - 4
One issue about pretrain-tv-init.bin file
#16 opened by Unified-Robots - 2
The baseline code
#15 opened by PipiZong - 4
How to process the HowTo100M dataset?
#13 opened by Unified-Robots - 4
Finetuning for the TVR task
#11 opened by Unified-Robots - 4
Single-channel results on multi-channel datasets
#2 opened by antoyang - 2
question about vocab size
#25 opened by taeho-kil - 2
download HowTo100M dataset
#24 opened by JKBox - 2
- 2
Checkpoint for TVQA task
#27 opened by raksharamesh14 - 4
I find a bug in svmr evaluation
#29 opened by hgzjy25 - 2
TVC cannot reproduce results
#28 opened by Liu0329 - 6
- 2
some questions about inplace
#23 opened by y1129800378 - 5
The video features used in TVC task
#5 opened by tuyunbin - 0
Using the pretrained hero on custom datasets
#12 opened by PipiZong - 2
How many train steps are needed to get the performance of the paper when finetuning TVR dataset?
#14 opened by liveseongho - 5
Preprocessing code for VIOLIN
#10 opened by Worm4047 - 1
model weights without pretraining
#9 opened by kevinlee9 - 1
Can not download the video_db file
#8 opened by houzhijian - 4
Frame-level feature
#6 opened by shinying - 2
running on cpu
#3 opened by Melika-Ayoughi - 2
Feature extractor for custom dataset
#4 opened by aleSuglia - 3