JKYtydt

Pinned Repositories

• cake

  Distributed LLM and StableDiffusion inference for mobile, desktop and server.

  Language:Rust2.4k3922126

• Time-LLM

  [ICLR 2024] Official implementation of " 🦙 Time-LLM: Time Series Forecasting by Reprogramming Large Language Models"

  Language:Python1.2k13125201

• DeepSpeed-MII

  MII makes low-latency and high-throughput inference possible, powered by DeepSpeed.

  Language:Python1.8k41293172

• neuralforecast

  Scalable and user friendly neural :brain: forecasting algorithms.

  Language:Python2.9k35516331

• vllm

  A high-throughput and memory-efficient inference and serving engine for LLMs

  Language:Python25.6k2184.2k3.7k

JKYtydt's Repositories