kyegomez
Founder of Swarms https://github.com/kyegomez/swarms Leader of Agora, open source AI Research lab: https://discord.gg/RVCz3yxr
SwarmsPalo Alto
Pinned Repositories
AlphaFold3
Implementation of Alpha Fold 3 from the paper: "Accurate structure prediction of biomolecular interactions with AlphaFold3" in PyTorch
Andromeda
An all-new Language Model That Processes Ultra-Long Sequences of 100,000+ Ultra-Fast
BitNet
Implementation of "BitNet: Scaling 1-bit Transformers for Large Language Models" in pytorch
Gemini
The open source implementation of Gemini, the model that will "eclipse ChatGPT" by Google
LongNet
Implementation of plug in and play Attention from "LongNet: Scaling Transformers to 1,000,000,000 Tokens"
MultiModalMamba
A novel implementation of fusing ViT with Mamba into a fast, agile, and high performance Multi-Modal Model. Powered by Zeta, the simplest AI framework ever.
swarms
Orchestrate Swarms of Agents From Any Framework Like OpenAI, Langchain, and Etc for Business Operation Automation. Join our Community: https://discord.gg/DbjBMJTSWD
swarms-pytorch
Swarming algorithms like PSO, Ant Colony, Sakana, and more in PyTorch 😊
tree-of-thoughts
Plug in and Play Implementation of Tree of Thoughts: Deliberate Problem Solving with Large Language Models that Elevates Model Reasoning by atleast 70%
zeta
Build high-performance AI models with modular building blocks
kyegomez's Repositories
kyegomez/601-daysthatgobyonEuropa
kyegomez/APAC-SCALE
Transformers at any scale
kyegomez/APACOWL
Config files for my GitHub profile.
kyegomez/dark-flat-iterm-colors
A dark flat theme for color scheme for iterm2, designed for Powerlevel9k and oh-my-zsh
kyegomez/flash-attention-jax
Implementation of Flash Attention in Jax
kyegomez/FLASHATTENION-LION-OPTIMIZE
Fast and memory-efficient exact attention coupled with the LION Optimizer for ultra fast performance
kyegomez/GATO-by-Deepmind
Unofficial GATO: Ready to train
kyegomez/KNOTX
KNOTX is a new and theoretical activation function designed for ultra-fast multi-modality learning utilizing knot theory + dynamical systems modeling.
kyegomez/LaMDA-pytorch
Open-source pre-training implementation of Google's LaMDA in PyTorch.
kyegomez/RETRO-pytorch
Implementation of RETRO, Deepmind's Retrieval based Attention net, in Pytorch
kyegomez/small-books
Small books on popular frameworks such as Next js, React js, and Airflow amongst others!
kyegomez/visual-chatgpt
VisualChatGPT