yaof20

yaof20's Stars

• dair-ai/Prompt-Engineering-Guide

  🐙 Guides, papers, lecture, notebooks and resources for prompt engineering

  Language:MDX52.1k5702075k

• geekan/MetaGPT

  🌟 The Multi-Agent Framework: First AI Software Company, Towards Natural Language Programming

  Language:Python46.5k9047285.5k

• microsoft/DeepSpeed

  DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

  Language:Python36.1k3482.9k4.2k

• openai/chatgpt-retrieval-plugin

  The ChatGPT Retrieval Plugin lets you easily find personal or work documents by asking questions in natural language.

  Language:Python21.1k3202363.7k

• huggingface/peft

  🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

  Language:Python16.9k1121.1k1.7k

• meta-llama/llama-recipes

  Scripts for fine-tuning Meta Llama with composable FSDP & PEFT methods to cover single/multi-node GPUs. Supports default & custom datasets for applications such as summarization and Q&A. Supporting a number of candid inference solutions such as HF TGI, VLLM for local or cloud deployment. Demo apps to showcase Meta Llama for WhatsApp & Messenger.

  Language:Jupyter Notebook15.8k2044002.3k

• Stability-AI/StableLM

  StableLM: Stability AI Language Models

  Language:Jupyter Notebook15.8k201761k

• huggingface/trl

  Train transformer language models with reinforcement learning.

  Language:Python10.5k771.3k1.4k

• artidoro/qlora

  QLoRA: Efficient Finetuning of Quantized LLMs

  Language:Jupyter Notebook10.1k85250826

• huggingface/text-generation-inference

  Large Language Model Text Generation Inference

  Language:Python9.6k1051.4k1.1k

• NVIDIA/cutlass

  CUDA Templates for Linear Algebra Subroutines

  Language:C++6k1101.2k1k

• arcee-ai/mergekit

  Tools for merging pretrained large language models.

  Language:Python5.1k52331469

• Facico/Chinese-Vicuna

  Chinese-Vicuna: A Chinese Instruction-following LLaMA-based Model —— 一个中文低资源的llama+lora方案，结构参考alpaca

  Language:C4.2k58248419

• yuanzhoulvpi2017/zero_nlp

  中文nlp解决方案(大模型、数据、模型、训练、推理)

  Language:Jupyter Notebook3.1k30201378

• zjunlp/LLMAgentPapers

  Must-read Papers on LLM Agents.

  2k5110110

• microsoft/DeepSpeed-MII

  MII makes low-latency and high-throughput inference possible, powered by DeepSpeed.

  Language:Python1.9k42314176

• gpu-mode/resource-stream

  GPU programming related news and material links

  1.3k43278

• AGI-Edgerunners/LLM-Agents-Papers

  A repo lists papers related to LLM based agent

  Language:Python1.2k341177

• srush/awesome-o1

  A bibliography and survey of the papers surrounding o1

  Language:TeX1k24041

• hollobit/GenAI_LLM_timeline

  ChatGPT, GenerativeAI and LLMs Timeline

  94785459

• bigcode-project/bigcode-evaluation-harness

  A framework for the evaluation of autoregressive code generation language models.

  Language:Python86012151223

• SinclairCoder/Instruction-Tuning-Papers

  Reading list of Instruction-tuning. A trend starts from Natrural-Instruction (ACL 2022), FLAN (ICLR 2022) and T0 (ICLR 2022).

  75816324

• alibaba/Megatron-LLaMA

  Best practice for training LLaMA models in Megatron-LM

  Language:Python63876455

• Jack47/hack-SysML

  The road to hack SysML and become an system expert

  Language:Emacs Lisp45332254

• microsoft/GRIN-MoE

  GRadient-INformed MoE

  2608218

• Hannibal046/nanoRWKV

  The nanoGPT-style implementation of RWKV Language Model - an RNN with GPT-level LLM performance.

  Language:Python1944912

• luban-agi/Awesome-Tool-Learning

  A curated list of papers and applications on tool learning.

  115414

• RZFan525/Awesome-ScalingLaws

  A curated list of awesome resources dedicated to Scaling Laws for LLMs

  67104

• THUlawtech/MUSER

  Language:Python22111

• kyegomez/FlashLora

  FlashAttention2.0 with Lora

  Language:Python920