controlRun

controlRun's Stars

• huggingface/transformers

  🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

  Language:Python133k26.5k

• sgl-project/sglang

  SGLang is a fast serving framework for large language models and vision language models.

  Language:Python5.4k393

• ollama/ollama

  Get up and running with Llama 3.2, Mistral, Gemma 2, and other large language models.

  Language:Go91.8k7.2k

• hiyouga/LLaMA-Factory

  Efficiently Fine-Tune 100+ LLMs in WebUI (ACL 2024)

  Language:Python31.8k3.9k

• casper-hansen/AutoAWQ

  AutoAWQ implements the AWQ algorithm for 4-bit quantization with a 2x speedup during inference. Documentation:

  Language:Python1.7k202

• AutoGPTQ/AutoGPTQ

  An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.

  Language:Python4.4k467

• dataelement/bisheng

  BISHENG is an open LLM devops platform for next generation Enterprise AI applications. Powerful and comprehensive features include: GenAI workflow, RAG, Agent, Unified model management, Evaluation, SFT, Dataset Management, Enterprise-level System Management, Observability and more.

  Language:Python8.6k1.6k

• vllm-project/vllm

  A high-throughput and memory-efficient inference and serving engine for LLMs

  Language:Python27.8k4.1k

• jackfrued/Python-100-Days

  Python - 100天从新手到大师

  Language:Python155k52.1k

• triton-inference-server/server

  The Triton Inference Server provides an optimized cloud and edge inferencing solution.

  Language:Python8.1k1.5k

• triton-inference-server/fastertransformer_backend

  Language:Python411134

• mlc-ai/mlc-llm

  Universal LLM Deployment Engine with ML Compilation

  Language:Python18.8k1.5k

• NVIDIA/FasterTransformer

  Transformer related optimization, including BERT, GPT

  Language:C++5.8k889

• Ailln/cn2an

  📦 快速转化「中文数字」和「阿拉伯数字」～ (最新特性：分数，日期、温度等转化）

  Language:Python66081

• run-llama/llama_index

  LlamaIndex is a data framework for your LLM applications

  Language:Python35.8k5.1k

• THUDM/ChatGLM-6B

  ChatGLM-6B: An Open Bilingual Dialogue Language Model | 开源双语对话语言模型

  Language:Python40.5k5.2k

• TheNetAdmin/zjuthesis

  Zhejiang University Graduation Thesis LaTeX Template

  Language:TeX2.6k601

• tensorflow/models

  Models and examples built with TensorFlow

  Language:Python77k45.8k

• iree-org/iree

  A retargetable MLIR-based machine learning compiler and runtime toolkit.

  Language:C++2.6k581

• ModelTC/MQBench

  Model Quantization Benchmark

  Language:Shell755137

• Jermmy/pytorch-quantization-demo

  A simple network quantization demo using pytorch from scratch.

  Language:Python49796

• pytorch/pytorch

  Tensors and Dynamic neural networks in Python with strong GPU acceleration

  Language:Python82.6k22.2k

• BBuf/tvm_mlir_learn

  compiler learning resources collect.

  Language:Python2.1k324

• mit-han-lab/torchsparse

  [MICRO'23, MLSys'22] TorchSparse: Efficient Training and Inference Framework for Sparse Convolution on GPUs.

  Language:Cuda1.2k138

• DeepVAC/deepvac

  PyTorch Project Specification.

  Language:Python659104

• tensorlayer/TensorLayer

  Deep Learning and Reinforcement Learning Library for Scientists and Engineers

  Language:Python7.3k1.6k

• xinge008/Cylinder3D

  Rank 1st in the leaderboard of SemanticKITTI semantic segmentation (both single-scan and multi-scan) (Nov. 2020) (CVPR2021 Oral)

  Language:Python853180

• mit-han-lab/e3d

  Efficient 3D Deep Learning

  461

• SmallPond/MyNES

  一步步实现简易红白机模拟器运行超级玛丽，以https://github.com/amhndu/SimpleNES 为模板

  Language:C++14043

• ARM-software/CMSIS_5

  CMSIS Version 5 Development Repository

  Language:C1.3k1.1k