Pinned Repositories
ao
Native PyTorch library for quantization and sparsity
ctf
CTF Field Guide
env-gym
llm.c
LLM training in simple, raw C/CUDA
maxEQsim
native-sparse-attention
Building Native Sparse Attention
ring-attention
Optimized kernels for ring-attention [WIP]
triton_blocks
Code blocks for writing triton kernels
PufferLib
Simplifying reinforcement learning for complex game environments
ring-flash-attention
Ring attention implementation with flash attention
Iron-Bound's Repositories
Iron-Bound/env-gym
Iron-Bound/ring-attention
Optimized kernels for ring-attention [WIP]
Iron-Bound/maxEQsim
Iron-Bound/native-sparse-attention
Building Native Sparse Attention
Iron-Bound/AMD-AI-Guide
AMD (Radeon GPU) ROCm based setup for popular AI tools on Ubuntu 22.04 / 23.04
Iron-Bound/ao
Native PyTorch library for quantization and sparsity
Iron-Bound/bitsandbytes-rocm
8-bit CUDA functions for PyTorch Rocm compatible
Iron-Bound/llm.c
LLM training in simple, raw C/CUDA
Iron-Bound/pokegym
Gymnasium environment for Pokemon Red
Iron-Bound/PufferLib
Simplifying reinforcement learning for complex game environments
Iron-Bound/triton_blocks
Code blocks for writing triton kernels
Iron-Bound/arc_draw_more_samples_pub
Draw more samples
Iron-Bound/boey-baselines
Playing Pokemon Red with Reinforcement Learning
Iron-Bound/dora
Implementation of DoRA
Iron-Bound/fsdp_qlora
Training LLMs with QLoRA + FSDP
Iron-Bound/gpt-fast
Simple and efficient pytorch-native transformer text generation in <1000 LOC of python.
Iron-Bound/gpt-wpre
Whole-Program Reverse Engineering with GPT-3
Iron-Bound/gptcore
Fast modular code to create and train cutting edge LLMs
Iron-Bound/LASP
Linear Attention Sequence Parallelism (LASP)
Iron-Bound/libmgba-py
(Forked) Python bindings for libmgba
Iron-Bound/llm-course
Course to get into Large Language Models (LLMs) with roadmaps and Colab notebooks.
Iron-Bound/lm-evaluation-harness
A framework for few-shot evaluation of language models.
Iron-Bound/open-gpu-kernel-modules
NVIDIA Linux open GPU with P2P support
Iron-Bound/pyreft
ReFT: Representation Finetuning for Language Models
Iron-Bound/reasoning-gym
procedural reasoning datasets
Iron-Bound/ring-attention-pytorch
Explorations into Ring Attention, from Liu et al. at Berkeley AI
Iron-Bound/ring-flash-attention
Ring attention implementation with flash attention
Iron-Bound/schedule_free
Schedule-Free Optimization in PyTorch
Iron-Bound/tree-diffusion
Iron-Bound/xlstm-resources
Resources about xLSTM by Sepp Hochreiter