huntzhan

huntzhan's Stars

• hoppscotch/hoppscotch

  Open source API development ecosystem - https://hoppscotch.io (open-source alternative to Postman, Insomnia)

  Language:TypeScript65.7k4831.7k4.6k

• Hannibal046/Awesome-LLM

  Awesome-LLM: a curated list of Large Language Model

  19k378271.5k

• ashishps1/awesome-system-design-resources

  Learn System Design concepts and prepare for interviews using free resources.

  Language:Java18.5k277184.5k

• THUDM/ChatGLM3

  ChatGLM3 series: Open Bilingual Chat LLMs | 开源双语对话语言模型

  Language:Python13.5k987831.6k

• triton-lang/triton

  Development repository for the Triton language and compiler

  Language:C++13.5k1931.5k1.7k

• cpacker/MemGPT

  Letta (fka MemGPT) is a framework for creating stateful LLM services.

  Language:Python12.1k1167821.3k

• ggerganov/ggml

  Tensor library for machine learning

  Language:C++11.2k1314191k

• NVIDIA/Megatron-LM

  Ongoing research training transformer models at scale

  Language:Python10.6k1637812.4k

• NVIDIA/TensorRT-LLM

  TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that execute those TensorRT engines.

  Language:C++8.7k942k996

• facebookresearch/xformers

  Hackable and optimized Transformers building blocks, supporting a composable construction.

  Language:Python8.7k77560618

• abetlen/llama-cpp-python

  Python bindings for llama.cpp

  Language:Python8.2k741.1k970

• 01-ai/Yi

  A series of large language models trained from scratch by developers @01-ai

  Language:Jupyter Notebook7.7k107290481

• bitsandbytes-foundation/bitsandbytes

  Accessible large language models via k-bit quantization for PyTorch.

  Language:Python6.3k521k633

• pytorch-labs/gpt-fast

  Simple and efficient pytorch-native transformer text generation in <1000 LOC of python.

  Language:Python5.7k60104514

• dushixiang/next-terminal

  Next Terminal是一个简单好用安全的开源交互审计系统，支持RDP、SSH、VNC、Telnet、Kubernetes协议。

  Language:JavaScript4.8k52384722

• huggingface/alignment-handbook

  Robust recipes to align language models with human and AI preferences

  Language:Python4.7k111137411

• kermitt2/grobid

  A machine learning software for extracting information from scholarly documents

  Language:Java3.6k94881459

• tartley/colorama

  Simple cross-platform colored terminal text in Python

  Language:Python3.6k48244255

• li-plus/chatglm.cpp

  C++ implementation of ChatGLM-6B & ChatGLM2-6B & ChatGLM3 & GLM4(V)

  Language:C++2.9k43252335

• Paitesanshi/LLM-Agent-Survey

  2.6k7321153

• wangshusen/RecommenderSystem

  2.5k276375

• marella/ctransformers

  Python bindings for the Transformer models implemented in C/C++ using GGML library.

  Language:C1.8k19201138

• MetaGLM/FinGLM

  FinGLM: 致力于构建一个开放的、公益的、持久的金融大模型项目，利用开源开放来促进「AI+金融」。

  Language:HTML1.8k2930269

• SkyworkAI/Skywork

  Skywork series models are pre-trained on 3.2TB of high-quality multilingual (mainly Chinese and English) and code data. We have open-sourced the model, training data, evaluation data, evaluation methods, etc. 天工系列模型在3.2TB高质量多语言和代码数据上进行预训练。我们开源了模型参数，训练数据，评估数据，评估方法。

  Language:Python1.2k2463111

• zixian2021/AI-interview-cards

  最完整的AI算法面试题目仓库，1000道，25个类目

  1.1k9395

• XiongjieDai/GPU-Benchmarks-on-LLM-Inference

  Multiple NVIDIA GPUs or Apple Silicon for Large Language Model Inference?

  Language:Jupyter Notebook1.1k181742

• bilibili/Index-1.9B

  A SOTA lightweight multilingual LLM

  Language:Python90892548

• cytopia/linux-timemachine

  Rsync-based OSX-like time machine for Linux, MacOS and BSD for atomic and resumable local and remote backups

  Language:Shell791233664

• pytorch-labs/float8_experimental

  This repository contains the experimental PyTorch native float8 training UX

  Language:Python211254720

• paralym/COIG-CQIA

  78295