MonadKai

MonadKai's Stars

• hacksider/Deep-Live-Cam

  real time face swap and one-click video deepfake with only a single image

  Language:Python41k2435456k

• statsd/statsd

  Daemon for easy but powerful stats aggregation

  Language:JavaScript17.7k4522792k

• stas00/ml-engineering

  Machine Learning Engineering Open Book

  Language:Python11.7k11730715

• vladmandic/automatic

  SD.Next: Advanced Implementation Generative Image Models

  Language:Python5.7k612.2k431

• fastapi-users/fastapi-users

  Ready-to-use and customizable users management for FastAPI

  Language:Python4.7k46277389

• SchedMD/slurm

  Slurm: A Highly Scalable Workload Manager

  Language:C2.7k1290672

• blmoistawinde/HarvestText

  文本挖掘和预处理工具（文本清洗、新词发现、情感分析、实体识别链接、关键词抽取、知识抽取、句法分析等），无监督或弱监督方法

  Language:Python2.4k5546329

• pytorch/rl

  A modular, primitive-first, python-first PyTorch library for Reinforcement Learning.

  Language:Python2.4k42640312

• predibase/lorax

  Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs

  Language:Python2.2k33245145

• microsoft/aici

  AICI: Prompts as (Wasm) Programs

  Language:Rust2k247578

• kingjulio8238/Memary

  The Open Source Memory Layer For Autonomous Agents

  Language:Jupyter Notebook1.5k1628103

• facebookincubator/submitit

  Python 3.8+ toolbox for submitting jobs to Slurm

  Language:Python1.3k24119125

• XAMPPRocky/octocrab

  A modern, extensible GitHub API Client for Rust.

  Language:Rust1.1k10215269

• MDK8888/GPTFast

  Accelerate your Hugging Face Transformers 7.6-9x. Native to Hugging Face and PyTorch.

  Language:Python68771065

• distantmagic/paddler

  Stateful load balancer custom-tailored for llama.cpp 🏓🦙

  Language:Rust61081425

• mit-han-lab/distrifuser

  [CVPR 2024 Highlight] DistriFusion: Distributed Parallel Inference for High-Resolution Diffusion Models

  Language:Python59492323

• MooreThreads/torch_musa

  torch_musa is an open source repository based on PyTorch, which can make full use of the super computing power of MooreThreads graphics cards.

  Language:Python32395422

• awolverp/cachebox

  The fastest memoizing and caching Python library written in Rust.

  Language:Rust258585

• huggingface/llm-swarm

  Manage scalable open LLM inference endpoints in Slurm clusters

  Language:Python23833123

• codingonion/awesome-cuda-and-hpc

  🔥🔥🔥 A collection of some awesome public CUDA, cuBLAS, TensorRT and High Performance Computing (HPC) projects.

  1465018

• HPMLL/BurstGPT

  A ChatGPT(GPT-3.5) & GPT-4 Workload Trace to Optimize LLM Serving Systems

  Language:Python135648

• Dao-AILab/fast-hadamard-transform

  Fast Hadamard transform in CUDA, with a PyTorch interface

  Language:C1114616

• intel/llm-on-ray

  Pretrain, finetune and serve LLMs on Intel platforms with Ray

  Language:Python10388230

• wangsiping97/FastGEMV

  High-speed GEMV kernels, at most 2.7x speedup compared to pytorch baseline.

  Language:Cuda90643

• allegro/allms

  A versatile and powerful library designed to streamline the process of querying LLMs

  Language:Python73301

• MDK8888/vllmini

  A minimal implementation of vllm.

  Language:Cuda30110

• Aaronhuang-778/SliM-LLM

  SliM-LLM: Salience-Driven Mixed-Precision Quantization for Large Language Models

  Language:Python24271

• huggingface/pyo3-special-method-derive

  Automatically derive Python dunder methods for your Rust code

  Language:Rust13132

• huggingface/tei-gaudi

  A blazing fast inference solution for text embeddings models

  Language:Rust7404

• pykeio/speech-synthesis

  Common Rust traits for speech synthesis

  Language:Rust3200