anttttti

anttttti's Stars

• All-Hands-AI/OpenHands

  🙌 OpenHands: Code Less, Make More

  Language:Python32.2k2881.4k3.7k

• ztjhz/BetterChatGPT

  An amazing UI for OpenAI's ChatGPT (Website + Windows + MacOS + Linux)

  Language:TypeScript8k613902.7k

• peak/s5cmd

  Parallel S3 and local filesystem execution tool.

  Language:Go2.6k31375226

• neuralmagic/sparseml

  Libraries for applying sparsification recipes to neural networks with a few lines of code, enabling faster and smaller models

  Language:Python2k48205144

• refuel-ai/autolabel

  Label, clean and enrich text datasets with LLMs.

  Language:Python2k20250139

• princeton-nlp/SWE-bench

  [ICLR 2024] SWE-Bench: Can Language Models Resolve Real-world Github Issues?

  Language:Python1.8k25133311

• unslothai/hyperlearn

  2-2000x faster ML algos, 50% less memory usage, works on all hardware - new and old.

  Language:Jupyter Notebook1.8k8923127

• anthropics/anthropic-sdk-python

  Language:Python1.4k115147166

• pemistahl/lingua-py

  The most accurate natural language detection library for Python, suitable for short text and mixed-language text

  Language:Python1.1k118244

• pemistahl/lingua-rs

  The most accurate natural language detection library for Rust, suitable for short text and mixed-language text

  Language:Rust87695440

• prometheus-eval/prometheus-eval

  Evaluate your LLM's response with Prometheus and GPT4 💯

  Language:Python76233047

• IST-DASLab/marlin

  FP16xINT4 LLM inference kernel that can achieve near-ideal ~4x speedups up to medium batchsizes of 16-32 tokens.

  Language:Python573152845

• efeslab/Nanoflow

  A throughput-oriented high-performance serving framework for LLMs

  Language:Cuda52951421

• vllm-project/llm-compressor

  Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM

  Language:Python497125840

• nlpxucan/evol-instruct

  25210515

• neuralmagic/nm-vllm

  A high-throughput and memory-efficient inference and serving engine for LLMs

  Language:Python2518209

• unifyai/unify

  LLMs Run Riot in Production. Get Back in The Driving Seat. Build Your Own Evals, Iterate Quickly, and Go from Prototype to Production in No Time ⚡

  Language:Python17131324

• perpetual-ml/perpetual

  A self-generalizing gradient boosting machine which doesn't need hyperparameter optimization

  Language:Rust157846

• IBM/data-prep-kit

  Open source project for data preparation of LLM application builders

  Language:Python15116215108

• neuralmagic/AutoFP8

  Language:Python151132616

• premAI-io/benchmarks

  🕹️ Performance Comparison of MLOps Engines, Frameworks, and Languages on Mainstream AI Models.

  Language:Shell129131075

• ModelCloud/GPTQModel

  An easy-to-use LLM quantization and inference toolkit based on GPTQ algorithm (weight-only quantization).

  Language:Python9135019

• cognitivecomputations/spectrum

  Language:Python753410

• HandH1998/QQQ

  QQQ is an innovative and hardware-optimized W4A8 quantization solution.

  Language:Python595144

• IST-DASLab/Sparse-Marlin

  Boosting 4-bit inference kernels with 2:4 Sparsity

  Language:Cuda47612

• anthropics/anthropic-bedrock-python

  399855

• Qurrent-AI/RES-Q

  RES-Q: Evaluating the Code-Editing Capability of Large Language Model Systems at the Repository Scale

  Language:Python23001

• woheller69/LLAMA_TK_CHAT

  Simple chat interface for local AI using llama-cpp-python and llama-cpp-agent

  Language:Python7301

• TeHikuMedia/nga-tautohetohe-reo

  Corpus of Te Reo derived from the New Zealand Hansard

  Language:Python6950

• sasha0552/pascal-pkgs-ci

  The main repository for building Pascal-compatible versions of ML applications and libraries.

  50