Using LoRA to fine-tune LLaMA-3-8B for [Mask] guessing task.
Mask Wiki Documents from TriviaQA_Test (165052 Samples after filting)
{
"instruction": "Your Task is to GUESS the complete sentence to fill in the [Mask] section of the Wiki Document.",
"input": wiki_title + '\n' + masked_wiki_document,
"output": mask_sentence,
}