/fed

Code for SIGdial 2020 paper: Unsupervised Evaluation of Interactive Dialog with DialoGPT (https://arxiv.org/abs/2006.12719)

Primary LanguagePython

FED

import fed
  
# Load model
model, tokenizer = fed.load_models("microsoft/DialoGPT-large")

# Evaluate
conversation = "<|endoftext|> Hi! <|endoftext|> Hello, how is your day? <|endoftext|> It's good. It's raining a bit, but I am enjoying a good book. How about you? <|endoftext|> It's good, I just got back from walking my dog What book did you read?"
scores = fed.evaluate(conversation,
                      model,
                      tokenizer)