/Frugal-Prompting

Official Code for Experiments Done in the Paper "Frugal Prompting for Dialog Models"

Primary LanguageJupyter Notebook

Frugal Prompting for Dialog Models

Official repository for experiments in the 'Frugal Prompting for Dialog Models' paper.

Steps

cd utils/deb/
bash setup.sh
cd ../

# Downloads the BLEURT-base checkpoint. 
cd bleurt/bleurt
wget https://storage.googleapis.com/bleurt-oss-21/BLEURT-20.zip .
unzip BLEURT-20.zip
cd ../../../

# Concat ./context_data/topical_chat/generated_summary/test_summary_and_knowledge_dialogdata_part1.txt and part2.txt
# to ./context_data/topical_chat/generated_summary/test_summary_and_knowledge_dialogdata.txt:
cat ./context_data/topical_chat/generated_summary/test_summary_and_knowledge_dialogdata_part1.txt ./context_data/topical_chat/generated_summary/test_summary_and_knowledge_dialogdata_part2.txt > ./context_data/topical_chat/generated_summary/test_summary_and_knowledge_dialogdata.txt

# nltk
python -c "import nltk; nltk.download('punkt')"
python -c "import nltk; nltk.download('wordnet')"

Experiments

Inference Step

To run the experiments described in the paper, first execute all_exp_batch.sh. This will automatically generate and start the experiments.

Evaluation Step

For evaluating the generation outputs, the same commands from Inference Step has to be run with the extra -e flag.