Contrastive search for longer sequence decoding
Opened this issue · 0 comments
YeonwooSung commented
Contrastive search is originally proposed in "[A Contrastive Framework for Neural Text Generation"](Contrastive search is originally proposed in "A Contrastive Framework for Neural Text Generation") at NeurIPS 2022.
The contrastive search is well-known for text-generation for long sequence text data.
HuggingFace blog: Generating Human-level Text with Contrastive Search in Transformers