Pinned Repositories
SDSAT
The official implementation of "SDSAT: Accelerating LLM Inference through Speculative Decoding with Semantic Adaptive Tokens"
REST
REST: Retrieval-Based Speculative Decoding, NAACL 2024
parallel-decoding
Repository of the paper "Accelerating Transformer Inference for Translation via Parallel Decoding"
hasuoshenyun's Repositories
hasuoshenyun doesn’t have any repository yet.