Frozenmad

Frozenmad's Stars

• huangb23/VTimeLLM

  [CVPR'2024 Highlight] Official PyTorch implementation of the paper "VTimeLLM: Empower LLM to Grasp Video Moments".

  Language:Python24011

• pipipi-pikachu/PPTist

  PowerPoint-ist（/'pauəpɔintist/）, An online presentation application that replicates most of the commonly used features of MS PowerPoint, allowing for the editing and presentation of PPT online.

  Language:Vue6.2k1.2k

• SqueezeBits/QUICK

  QUICK: Quantization-aware Interleaving and Conflict-free Kernel for efficient LLM inference

  Language:Python1135

• kyegomez/BitNet

  Implementation of "BitNet: Scaling 1-bit Transformers for Large Language Models" in pytorch

  Language:Python1.7k156

• TUDB-Labs/mLoRA

  An Efficient "Factory" to Build Multiple LoRA Adapters

  Language:Python28654

• rayleizhu/vllm-ra

  [ACL 2024] RelayAttention for Efficient Large Language Model Serving with Long System Prompts

  Language:Python353

• thunlp/Ouroboros

  Ouroboros: Speculative Decoding with Large Model Enhanced Drafting (EMNLP 2024 main)

  Language:Python829

• efeslab/Atom

  [MLSys'24] Atom: Low-bit Quantization for Efficient and Accurate LLM Serving

  Language:Cuda28125

• replicate/cog

  Containers for machine learning

  Language:Python8.2k569

• SafeAILab/EAGLE

  Official Implementation of EAGLE-1 (ICML'24) and EAGLE-2 (EMNLP'24)

  Language:Python87191

• delicious-tasty/Paella

  Language:Python19

• bitsandbytes-foundation/bitsandbytes

  Accessible large language models via k-bit quantization for PyTorch.

  Language:Python6.5k641

• Vahe1994/SpQR

  Language:Python53344

• v2fly/fhs-install-v2ray

  Bash script for installing V2Ray in operating systems such as Debian / CentOS / Fedora / openSUSE that support systemd

  Language:Shell6.3k1.5k

• flexflow/flexflow-train

  Automatically Discovering Fast Parallelization Strategies for Distributed Deep Neural Network Training

  Language:C++1.7k233

• megvii-research/Sparsebit

  A model compression and acceleration toolbox based on pytorch.

  Language:Python32940

• IST-DASLab/gptq

  Code for the ICLR 2023 paper "GPTQ: Accurate Post-training Quantization of Generative Pretrained Transformers".

  Language:Python2k157

• modularml/mojo

  The Mojo Programming Language

  Language:Mojo23.5k2.6k

• mlc-ai/mlc-llm

  Universal LLM Deployment Engine with ML Compilation

  Language:Python19.5k1.6k

• OpenMOSS/MOSS

  An open-source tool-augmented conversational language model from Fudan University

  Language:Python12k1.1k

• fpgaminer/GPTQ-triton

  GPTQ inference Triton kernel

  Language:Jupyter Notebook29022

• Stability-AI/StableLM

  StableLM: Stability AI Language Models

  Language:Jupyter Notebook15.8k1k

• Vision-CAIR/MiniGPT-4

  Open-sourced codes for MiniGPT-4 and MiniGPT-v2 (https://minigpt-4.github.io, https://minigpt-v2.github.io/)

  Language:Python25.5k2.9k

• toeverything/AFFiNE

  There can be more than Notion and Miro. AFFiNE(pronounced [ə‘fain]) is a next-gen knowledge base that brings planning, sorting and creating all together. Privacy first, open-source, customizable and ready to use.

  Language:TypeScript43.6k2.8k

• LAION-AI/Open-Assistant

  OpenAssistant is a chat-based assistant that understands tasks, can interact with third-party systems, and retrieve information dynamically to do so.

  Language:Python37.1k3.2k

• mlc-ai/web-llm

  High-performance In-browser LLM Inference Engine

  Language:TypeScript14.1k915

• databrickslabs/dolly

  Databricks’ Dolly, a large language model trained on the Databricks Machine Learning Platform

  Language:Python10.8k1.2k

• Significant-Gravitas/AutoGPT

  AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on what matters.

  Language:Python170k44.7k

• OptimalScale/LMFlow

  An Extensible Toolkit for Finetuning and Inference of Large Foundation Models. Large Models for All.

  Language:Python8.3k826

• ROCm/HIP

  HIP: C++ Heterogeneous-Compute Interface for Portability

  Language:C++3.8k540