conceptofmind
Odin sacrificed his eye to acquire knowledge but I would give far more.
Teraflop AIBoston
Pinned Repositories
Adaptive-Token-Sampling-Flax
hf_fsdp
A very basic fsdp wrapper for HF.
LaMDA-rlhf-pytorch
Open-source pre-training implementation of Google's LaMDA in PyTorch. Adding RLHF similar to ChatGPT.
PaLM
An open-source implementation of Google's PaLM models
PaLM-flax
Implementation of the SOTA Transformer architecture from PaLM - Scaling Language Modeling with Pathways in JAX/Flax
Simple-ViT-flax
t5-pytorch
Implementation of Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer in PyTorch.
toolformer
vit-flax
Implementation of numerous Vision Transformers in Google's JAX and Flax.
ViT-Patch-Merger
conceptofmind's Repositories
conceptofmind/PaLM
An open-source implementation of Google's PaLM models
conceptofmind/LaMDA-rlhf-pytorch
Open-source pre-training implementation of Google's LaMDA in PyTorch. Adding RLHF similar to ChatGPT.
conceptofmind/toolformer
conceptofmind/t5-pytorch
Implementation of Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer in PyTorch.
conceptofmind/hf_fsdp
A very basic fsdp wrapper for HF.
conceptofmind/mpire
A Python package for easy multiprocessing, but faster than multiprocessing
conceptofmind/PaLM-rlhf-pytorch
Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architecture. Basically ChatGPT but with PaLM
conceptofmind/conceptofmind
Config files for my GitHub profile.
conceptofmind/edgar-crawler
Download financial reports from SEC's EDGAR quickly. Extract clean textual data from specific item sections and bootstrap your financial research. Software from the research paper published in ECONLP 2021.
conceptofmind/fastText
Library for fast text representation and classification.
conceptofmind/GPTQ-for-LLaMa
4 bits quantization of LLaMa using GPTQ
conceptofmind/HojiChar
The robust text processing pipeline framework enabling customizable, efficient, and metric-logged text preprocessing.
conceptofmind/magic-wormhole
get things from one computer to another, safely
conceptofmind/pynecone
🕸 Web apps in pure Python 🐍
conceptofmind/scaled-rope
conceptofmind/unsloth-bert
conceptofmind/attention_sinks
Extend existing LLMs way beyond the original training length with constant memory usage, without retraining
conceptofmind/cc_net
Tools to download and cleanup Common Crawl data
conceptofmind/CoH
conceptofmind/common-pile
Repo to hold code and track issues for the collection of permissively licensed data
conceptofmind/Daft
Distributed DataFrame for Python designed for the cloud, powered by Rust
conceptofmind/Data-Provenance-Collection
conceptofmind/hidet
An open-source efficient deep learning framework/compiler, written in python.
conceptofmind/jax-dataloader
Pytorch-like dataloaders in JAX.
conceptofmind/pytriton
PyTriton is a Flask/FastAPI-like interface that simplifies Triton's deployment in Python environments.
conceptofmind/self-instruct
Aligning pretrained language models with instruction data generated by themselves.
conceptofmind/streaming-llm
Efficient Streaming Language Models with Attention Sinks
conceptofmind/torchscale
Transformers at any scale
conceptofmind/vocos
Vocos: Closing the gap between time-domain and Fourier-based neural vocoders for high-quality audio synthesis
conceptofmind/wikipedia-downloader
Downloads 2020 English Wikipedia articles as plaintext