What does YOUR_INPUT_FILE look like? Can you provide an example? Thanks very much!
XiaozhuLove opened this issue · 3 comments
cd retrieval_lm
python passage_retrieval.py
--model_name_or_path facebook/contriever-msmarco --passages psgs_w100.tsv
--passages_embeddings "wikipedia_embeddings/*"
--data YOUR_INPUT_FILE
--output_dir YOUR_OUTPUT_FILE
--n_docs 20
cd retrieval_lm python passage_retrieval.py --model_name_or_path facebook/contriever-msmarco --passages psgs_w100.tsv --passages_embeddings "wikipedia_embeddings/*" --data YOUR_INPUT_FILE --output_dir YOUR_OUTPUT_FILE --n_docs 20
its script has some problems, it doesn't have --data argument, only has --dataset or --query, you need change it ,and i try to run it just by simple jsonl or json file with questions @XiaozhuLove
@innovation64 Can I just use the json file in eval_data or Could you please share your json file?
cd retrieval_lm python passage_retrieval.py --model_name_or_path facebook/contriever-msmarco --passages psgs_w100.tsv --passages_embeddings "wikipedia_embeddings/*" --data YOUR_INPUT_FILE --output_dir YOUR_OUTPUT_FILE --n_docs 20
its script has some problems, it doesn't have --data argument, only has --dataset or --query, you need change it ,and i try to run it just by simple jsonl or json file with questions @XiaozhuLove