ericxian1997

ericxian1997's Stars

• microsoft/DeepSpeed

  DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

  Language:Python36.2k3492.9k4.2k

• geekan/HowToLiveLonger

  程序员延寿指南 | A programmer's guide to live longer

  30.8k2361292.1k

• meta-llama/llama3

  The official Meta Llama 3 GitHub site

  Language:Python27.9k2352753.2k

• facebookresearch/fastText

  Library for fast text representation and classification.

  Language:HTML26k8461.1k4.7k

• spotify/luigi

  Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in.

  Language:Python18k4711k2.4k

• Lightning-AI/litgpt

  20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.

  Language:Python11.2k1008221.1k

• jzhang38/TinyLlama

  The TinyLlama project is an open endeavor to pretrain a 1.1B Llama model on 3 trillion tokens.

  Language:Python8.1k110158490

• openai/transformer-debugger

  Language:Python4.1k2614241

• atfortes/Awesome-LLM-Reasoning

  Reasoning in Large Language Models: Papers and Resources, including Chain-of-Thought and OpenAI o1 🍓

  2.3k403127

• opendilab/PPOxFamily

  PPO x Family DRL Tutorial Course（决策智能入门级公开课：8节课帮你盘清算法理论，理顺代码逻辑，玩转决策AI应用实践 ）

  Language:Python2k1718180

• GAIR-NLP/O1-Journey

  O1 Replication Journey: A Strategic Progress Report – Part I

  1.9k351557

• jquesnelle/yarn

  YaRN: Efficient Context Window Extension of Large Language Models

  Language:Python1.4k1556118

• mlfoundations/dclm

  DataComp for Language Models

  Language:HTML1.2k3768111

• yaodongC/awesome-instruction-dataset

  A collection of open-source dataset to train instruction-following LLMs (ChatGPT,LLaMA,Alpaca)

  1.1k16858

• trotsky1997/MathBlackBox

  Language:Python9932610101

• SimpleBerry/LLaMA-O1

  Large Reasoning Models

  Language:Python787192544

• NVIDIA/NeMo-Curator

  Scalable data pre processing and curation toolkit for LLMs

  Language:Jupyter Notebook7381415896

• NVIDIA/NeMo-Aligner

  Scalable toolkit for efficient model alignment

  Language:Python674188484

• madaan/self-refine

  LLMs can generate feedback on their work, use it to improve the output, and repeat this process iteratively.

  Language:Python654142154

• FranxYao/Long-Context-Data-Engineering

  Implementation of paper Data Engineering for Scaling Language Models to 128K Context

  Language:Python44881729

• MARIO-Math-Reasoning/Super_MARIO

  Language:Python294123023

• facebookresearch/MetaICL

  An original implementation of "MetaICL Learning to Learn In Context" by Sewon Min, Mike Lewis, Luke Zettlemoyer and Hannaneh Hajishirzi

  Language:Python25892136

• OFA-Sys/InsTag

  InsTag: A Tool for Data Analysis in LLM Supervised Fine-tuning

  2364107

• withinmiaov/A-Survey-on-Mixture-of-Experts

  The official GitHub page for the survey paper "A Survey on Mixture of Experts".

  1948413

• src-d/minhashcuda

  Weighted MinHash implementation on CUDA (multi-gpu).

  Language:C++11611324

• TIGER-AI-Lab/LongICLBench

  Code and Data for "Long-context LLMs Struggle with Long In-context Learning"

  Language:Python97344

• allenai/allennlp-reading-comprehension

  Language:Python8112825

• OpenLMLab/scaling-rope

  code for Scaling Laws of RoPE-based Extrapolation

  71322

• hughbzhang/o1_inference_scaling_laws

  Replicating O1 inference-time scaling laws

  Language:Python70103

• tml-epfl/icl-alignment

  Is In-Context Learning Sufficient for Instruction Following in LLMs?

  Language:Python26203