wutong4012

PoSE

Positional Skip-wise Training for Efficient Context Window Extension of LLMs to Extremely Length (ICLR 2024)

yarn

YaRN: Efficient Context Window Extension of Large Language Models

lost-in-the-middle

Code and data for "Lost in the Middle: How Language Models Use Long Contexts"

AR-Diffusion

[NIPS 2023] AR-Diffusion: Auto-Regressive Diffusion Model for Text Generation

Contra_VAE

Combines Optimus and Brownian Bridge processes to control long text generation.

CREAM

Continuity5 Relativity indExing with gAussian Middle (CREAM)

Self-Consistent-Learning

[ECAI 2023 Oral] Enhancing Text Generation with Cooperative Training

wutong4012.github.io

wutong4012/AR-Diffusion

[NIPS 2023] AR-Diffusion: Auto-Regressive Diffusion Model for Text Generation

wutong4012/Contra_VAE

Combines Optimus and Brownian Bridge processes to control long text generation.

wutong4012/CREAM

Continuity5 Relativity indExing with gAussian Middle (CREAM)

wutong4012/Self-Consistent-Learning

[ECAI 2023 Oral] Enhancing Text Generation with Cooperative Training

wutong4012/wutong4012.github.io