hasuoshenyun

Pinned Repositories

• SDSAT

  The official implementation of "SDSAT: Accelerating LLM Inference through Speculative Decoding with Semantic Adaptive Tokens"

  Language:Python50

• REST

  REST: Retrieval-Based Speculative Decoding, NAACL 2024

  Language:C15751310

• parallel-decoding

  Repository of the paper "Accelerating Transformer Inference for Translation via Parallel Decoding"

  Language:Python99327

hasuoshenyun's Repositories