/ANPD

Primary LanguagePython

ANPD

The software package for the paper “Lossless Acceleration of Large Language Model via Adaptive N-gram Parallel Decoding” will be available soon.