RobinQrtz

RobinQrtz's Stars

• NielsRogge/Transformers-Tutorials

  This repository contains demos I made with the Transformers library by HuggingFace.

  Language:Jupyter Notebook9.6k1.5k

• susumuota/nano-askllm

  Unofficial implementation of the Ask-LLM paper 'How to Train Data-Efficient LLMs', arXiv:2402.09668.

  Language:Python101

• linkedin/Liger-Kernel

  Efficient Triton Kernels for LLM Training

  Language:Python3.8k229

• allenai/open-instruct

  Language:Python2.1k237

• arcee-ai/PruneMe

  Automated Identification of Redundant Layer Blocks for Pruning in Large Language Models

  Language:Python20426

• pytorch/torchtitan

  A native PyTorch Library for large model training

  Language:Python2.8k222

• togethercomputer/RedPajama-Data

  The RedPajama-Data repository contains code for preparing large datasets for training large language models.

  Language:Python4.6k351

• allenai/bff

  Language:Rust389

• allenai/papermage

  library supporting NLP and CV research on scientific papers

  Language:Python71557

• McGill-NLP/llm2vec

  Code for 'LLM2Vec: Large Language Models Are Secretly Powerful Text Encoders'

  Language:Python1.4k101

• NbAiLab/tokenizer-benchmark

  Benchmark for Scandinavian Tokenizers

  Language:Python6

• databricks/megablocks

  Language:Python1.2k175

• LumiOpen/Megatron-DeepSpeed

  Ongoing research training transformer language models at scale, including: BERT & GPT-2

  Language:Python21

• welfare-state-analytics/riksdagen-corpus

  Swedish parliamentary proceedings - Riksdagens protokoll 1867-today

  Language:Python265

• huggingface/datatrove

  Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.

  Language:Python2.1k154

• huggingface/datablations

  Scaling Data-Constrained Language Models

  Language:Jupyter Notebook32520

• hplt-project/data-analytics-tool

  Data Analytics Tool

  Language:JavaScript101

• catie-aq/flashT5

  A fast implementation of T5/UL2 in PyTorch using Flash Attention

  Language:Python739

• ltgoslo/ltg-bert

  LTG-Bert

  Language:Python294

• huggingface/nanotron

  Minimalistic large language model 3D-parallelism training

  Language:Python1.3k133

• stas00/ml-engineering

  Machine Learning Engineering Open Book

  Language:Python12k727

• mlabonne/llm-course

  Course to get into Large Language Models (LLMs) with roadmaps and Colab notebooks.

  Language:Jupyter Notebook40k4.2k

• arcee-ai/mergekit

  Tools for merging pretrained large language models.

  Language:Python4.9k458

• fastai/numerical-linear-algebra

  Free online textbook of Jupyter notebooks for fast.ai Computational Linear Algebra course

  Language:Jupyter Notebook10.3k2.6k

• karpathy/llama2.c

  Inference Llama 2 in one file of pure C

  Language:C17.6k2.1k

• ggerganov/llama.cpp

  LLM inference in C/C++

  Language:C++69.2k10k

• karpathy/makemore

  An autoregressive character-level language model for making more things

  Language:Python2.6k696

• nomic-ai/gpt4all

  GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.

  Language:C++71.1k7.7k

• DigitalPhonetics/IMS-Toucan

  Controllable and fast Text-to-Speech for over 7000 languages!

  Language:Python1.5k168

• google-research/deduplicate-text-datasets

  Language:Rust1.1k111