kyegomez
Founder of Swarms https://github.com/kyegomez/swarms Leader of Agora, open source AI Research lab: https://discord.gg/RVCz3yxr
SwarmsPalo Alto
Pinned Repositories
AlphaFold3
Implementation of Alpha Fold 3 from the paper: "Accurate structure prediction of biomolecular interactions with AlphaFold3" in PyTorch
Andromeda
An all-new Language Model That Processes Ultra-Long Sequences of 100,000+ Ultra-Fast
BitNet
Implementation of "BitNet: Scaling 1-bit Transformers for Large Language Models" in pytorch
Gemini
The open source implementation of Gemini, the model that will "eclipse ChatGPT" by Google
LongNet
Implementation of plug in and play Attention from "LongNet: Scaling Transformers to 1,000,000,000 Tokens"
MultiModalMamba
A novel implementation of fusing ViT with Mamba into a fast, agile, and high performance Multi-Modal Model. Powered by Zeta, the simplest AI framework ever.
swarms
Orchestrate Swarms of Agents From Any Framework Like OpenAI, Langchain, and Etc for Business Operation Automation. Join our Community: https://discord.gg/DbjBMJTSWD
swarms-pytorch
Swarming algorithms like PSO, Ant Colony, Sakana, and more in PyTorch 😊
tree-of-thoughts
Plug in and Play Implementation of Tree of Thoughts: Deliberate Problem Solving with Large Language Models that Elevates Model Reasoning by atleast 70%
zeta
Build high-performance AI models with modular building blocks
kyegomez's Repositories
kyegomez/NaViT
My implementation of "Patch n’ Pack: NaViT, a Vision Transformer for any Aspect Ratio and Resolution"
kyegomez/Andromeda
An all-new Language Model That Processes Ultra-Long Sequences of 100,000+ Ultra-Fast
kyegomez/swarms-pytorch
Swarming algorithms like PSO, Ant Colony, Sakana, and more in PyTorch 😊
kyegomez/Jamba
PyTorch Implementation of Jamba: "Jamba: A Hybrid Transformer-Mamba Language Model"
kyegomez/PALI
Democratization of "PaLI: A Jointly-Scaled Multilingual Language-Image Model"
kyegomez/Gamba
Implementation of PyTorch: "GAMBA: MARRY GAUSSIAN SPLATTING WITH MAMBA FOR SINGLE-VIEW 3D RECONSTRUCTION"
kyegomez/EvoVLM-JP
Plug in & Play Pytorch Implementation of the paper: "Evolutionary Optimization of Model Merging Recipes" by Sakana AI
kyegomez/Simba
A simpler Pytorch + Zeta Implementation of the paper: "SiMBA: Simplified Mamba-based Architecture for Vision and Multivariate Time series"
kyegomez/Exa
Unleash the full potential of exascale LLMs on consumer-class GPUs, proven by extensive benchmarks, with no long-term adjustments and minimal learning curve.
kyegomez/Mirasol
Pytorch Implementation of the Model from "MIRASOL3B: A MULTIMODAL AUTOREGRESSIVE MODEL FOR TIME-ALIGNED AND CONTEXTUAL MODALITIES"
kyegomez/Fuyu
Implementation of Adepts Fuyu all-new Multi-Modality model in pytorch
kyegomez/FastFF
Zeta implementation of a reusable and plug in and play feedforward from the paper "Exponentially Faster Language Modeling"
kyegomez/ViTAR
Implementation of ViTaR: ViTAR: Vision Transformer with Any Resolution in PyTorch
kyegomez/swarm-ecosystem
The Swarm Ecosystem
kyegomez/Zero
A Reliable, Customize-able, and Scalable Zapier Alternative for Production-Grade Workflow Automation
kyegomez/FlamingoZeta
Flamingo Implemnted in Zeta + Pytorch primitives for high performance multi-modal learning
kyegomez/swarms-core
Multi-threading, Concurrency, Asynchrony, and various Execution Methods implemented in a Rust backend for bleeding edge performance.
kyegomez/AttnWithConvolutions
Interleaved Attention's with convolutions for text modeling
kyegomez/SimpleUnet
An simple implementation of Unet because all the implementations i've seen are wayy tooo complicated.
kyegomez/Genie
Implementation of the paper: "Genie: Generative Interactive Environments" from Deepmind
kyegomez/GradientEquillibrum
An implementation of an Gradient Algorithm that fines the equilibrium instead of the minimum or maximum
kyegomez/Kosmos-API
This repository holds the infrastructure to serve Kosmos to customers.
kyegomez/TritonTransformer
Transformer Implementation in Triton
kyegomez/APACAI-Developer-Platform
kyegomez/HGRN2
Implementation of the paper: "HGRN2: Gated Linear RNNs with State Expansion" in PyTorch
kyegomez/SIMA
Pytorch Implementation of Deepmind's SIMA: "Scaling Instructable Agents Across Many Simulated Worlds"
kyegomez/sky-serve-cheatsheet
A simple Cheat Sheet for Sky Serve!
kyegomez/agora-landing-page
Agora landing page
kyegomez/consul-cheatsheet
A simple cheatsheet for HashiCorp's Consul
kyegomez/SimpleDiffusion
Implementation of a simple Diffusion model so I can learn how they work, they are my weakness now.