PoHaoYen

PoHaoYen's Stars

• Jikai0Wang/OPT-Tree

  OPT-Tree: Speculative Decoding with Adaptive Draft Tree Structure

  Language:Python181

• goliaro/specinfer-ae

  Language:Shell123

• NJUNLP/MCSD

  Multi-Candidate Speculative Decoding

  Language:Python285

• hemingkx/SpeculativeDecodingPapers

  📰 Must-read papers and blogs on Speculative Decoding ⚡️

  45220

• OptimalScale/LMFlow

  An Extensible Toolkit for Finetuning and Inference of Large Foundation Models. Large Models for All.

  Language:Python8.3k826

• romsto/Speculative-Decoding

  Implementation of the paper Fast Inference from Transformers via Speculative Decoding, Leviathan et al. 2023.

  Language:Python25

• microsoft/DeepSpeedExamples

  Example models using DeepSpeed

  Language:Python6.1k1k

• feifeibear/LLMSpeculativeSampling

  Fast inference from large lauguage models via speculative decoding

  Language:Python56457

• lucidrains/speculative-decoding

  Explorations into some recent techniques surrounding speculative decoding

  Language:Python21016

• uw-mad-dash/decoding-speculative-decoding

  Language:Python91

• lol0963332320/ICLAB

  81

• zhijs/-Reinforcement-Learning-five-in-a-row-

  基于DQN的五子棋人机对弈

  Language:Python5512

• zhiyiYo/Alpha-Gobang-Zero

  A gobang robot based on reinforcement learning.

  Language:Python11826

• ultralytics/ultralytics

  Ultralytics YOLO11 🚀

  Language:Python32.4k6.2k

• Entropy-xcy/bitnet158

  Language:Python6712

• Beomi/BitNet-Transformers

  0️⃣1️⃣🤗 BitNet-Transformers: Huggingface Transformers Implementation of "BitNet: Scaling 1-bit Transformers for Large Language Models" in pytorch with Llama(2) Architecture

  Language:Python27532

• joey00072/ohara

  Collection of autoregressive model implementation

  Language:Python665

• cnclabs/smore

  SMORe: Modularize Graph Embedding for Recommendation

  Language:C++37482