Inf1delis

Inf1delis's Stars

• josephmisiti/awesome-machine-learning

  A curated list of awesome Machine Learning frameworks, libraries and software.

  Language:Python65.6k3.3k8914.6k

• microsoft/DeepSpeed

  DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

  Language:Python35k3422.7k4.1k

• openai/evals

  Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.

  Language:Python14.8k2622082.6k

• Dao-AILab/flash-attention

  Fast and memory-efficient exact attention

  Language:Python13.6k1151k1.2k

• state-spaces/mamba

  Mamba SSM architecture

  Language:Python12.7k1015131.1k

• facebookresearch/nougat

  Implementation of Nougat Neural Optical Understanding for Academic Documents

  Language:Python8.8k63213560

• facebookresearch/xformers

  Hackable and optimized Transformers building blocks, supporting a composable construction.

  Language:Python8.4k74532600

• EleutherAI/lm-evaluation-harness

  A framework for few-shot evaluation of language models.

  Language:Python6.6k371.1k1.7k

• facebookresearch/metaseq

  Repo for external large-scale work

  Language:Python6.5k112294724

• google/flax

  Flax is a neural network library for JAX that is designed for flexibility.

  Language:Python6k86899634

• TimDettmers/bitsandbytes

  Accessible large language models via k-bit quantization for PyTorch.

  Language:Python5.8k48968584

• ahkarami/Deep-Learning-in-Production

  In this repository, I will share some useful notes and references about deploying deep learning-based models in production.

  4.3k1484684

• faridrashidi/kaggle-solutions

  🏅 Collection of Kaggle Solutions and Ideas 🏅

  Language:HTML4k7471.5k

• wookayin/gpustat

  📊 A simple command-line utility for querying and monitoring GPU status

  Language:Python4k44121281

• mosaicml/llm-foundry

  LLM training code for Databricks foundation models

  Language:Python4k46380525

• bytedance/byteps

  A high performance and generic framework for distributed DNN training

  Language:Python3.6k85267487

• facebookresearch/fairscale

  PyTorch extensions for high performance and large scale training.

  Language:Python3.2k46359279

• NVIDIA/nccl

  Optimized primitives for collective multi-GPU communication

  Language:C++3.2k1531.3k796

• turboderp/exllama

  A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.

  Language:Python2.7k37219215

• ai-forever/ru-gpts

  Russian GPT3 models.

  Language:Python2.1k8698441

• microsoft/Megatron-DeepSpeed

  Ongoing research training transformer language models at scale, including: BERT & GPT-2

  Language:Python1.9k24182342

• yandexdataschool/Practical_DL

  DL course co-developed by YSDA, HSE and Skoltech

  Language:Jupyter Notebook1.5k6918636

• laekov/fastmoe

  A fast MoE impl for PyTorch

  Language:Python1.5k13120186

• microsoft/mup

  maximal update parametrization (µP)

  Language:Jupyter Notebook1.4k296194

• AI-Yash/st-chat

  Streamlit Component, for a Chatbot UI

  Language:JavaScript9341050257

• mistralai/megablocks-public

  Language:Python8589054

• alasdairforsythe/tokenmonster

  Ungreedy subword tokenizer and vocabulary trainer for Python, Go & Javascript

  Language:Go548102619

• lucidrains/ring-attention-pytorch

  Implementation of 💍 Ring Attention, from Liu et al. at Berkeley AI, in Pytorch

  Language:Python460111427

• ai-forever/gigachain

  ⚡ Фреймворк для создания комплексных приложений с LLM ⚡

  Language:Jupyter Notebook310103137

• lucidrains/st-moe-pytorch

  Implementation of ST-Moe, the latest incarnation of MoE after years of research at Brain, in Pytorch

  Language:Python28371126