kyegomez
Founder of Swarms https://github.com/kyegomez/swarms Leader of Agora, open source AI Research lab: https://discord.gg/RVCz3yxr
SwarmsPalo Alto
Pinned Repositories
AlphaFold3
Implementation of Alpha Fold 3 from the paper: "Accurate structure prediction of biomolecular interactions with AlphaFold3" in PyTorch
Andromeda
An all-new Language Model That Processes Ultra-Long Sequences of 100,000+ Ultra-Fast
BitNet
Implementation of "BitNet: Scaling 1-bit Transformers for Large Language Models" in pytorch
Gemini
The open source implementation of Gemini, the model that will "eclipse ChatGPT" by Google
LongNet
Implementation of plug in and play Attention from "LongNet: Scaling Transformers to 1,000,000,000 Tokens"
MultiModalMamba
A novel implementation of fusing ViT with Mamba into a fast, agile, and high performance Multi-Modal Model. Powered by Zeta, the simplest AI framework ever.
swarms
Orchestrate Swarms of Agents From Any Framework Like OpenAI, Langchain, and Etc for Business Operation Automation. Join our Community: https://discord.gg/DbjBMJTSWD
swarms-pytorch
Swarming algorithms like PSO, Ant Colony, Sakana, and more in PyTorch 😊
tree-of-thoughts
Plug in and Play Implementation of Tree of Thoughts: Deliberate Problem Solving with Large Language Models that Elevates Model Reasoning by atleast 70%
zeta
Build high-performance AI models with modular building blocks
kyegomez's Repositories
kyegomez/MambaTransformer
Integrating Mamba/SSMs with Transformer for Enhanced Long Context and High-Quality Sequence Modeling
kyegomez/Andromeda
An all-new Language Model That Processes Ultra-Long Sequences of 100,000+ Ultra-Fast
kyegomez/PALI
Democratization of "PaLI: A Jointly-Scaled Multilingual Language-Image Model"
kyegomez/MoE-Mamba
Implementation of MoE Mamba from the paper: "MoE-Mamba: Efficient Selective State Space Models with Mixture of Experts" in Pytorch and Zeta
kyegomez/SparseAttention
Pytorch Implementation of the sparse attention from the paper: "Generating Long Sequences with Sparse Transformers"
kyegomez/metnet3
An implementation of "metnet3" in Pytorch
kyegomez/EvoVLM-JP
Plug in & Play Pytorch Implementation of the paper: "Evolutionary Optimization of Model Merging Recipes" by Sakana AI
kyegomez/Athena-for-Search
The World's First AI-Enabled Multi-Modality Native Search Engine
kyegomez/HLT
Implementation of the transformer from the paper: "Real-World Humanoid Locomotion with Reinforcement Learning"
kyegomez/awesome-robotic-foundation-models
A vast array of Multi-Modal Embodied Robotic Foundation Models!
kyegomez/EAOT
The open source implementation of "Connecting Large Language Models with Evolutionary Algorithms Yields Powerful Prompt Optimizers"
kyegomez/HRTX
Multi-Modal Multi-Embodied Hivemind-like Iteration of RTX-2
kyegomez/MMCA
The open source community's implementation of the all-new Multi-Modal Causal Attention from "DeepSpeed-VisualChat: Multi-Round Multi-Image Interleave Chat via Multi-Modal Causal Attention"
kyegomez/The-Domain
An Interface with all of Humanity's knowledge
kyegomez/CLIPQ
A simple implementation of a CLIP that splits up an image into quandrants and then gets the embeddings for each quandrant
kyegomez/HeptapodLM
An Implementation of an Transformer model that generates tokens non-linearly all at once like the heptapods from Arrival
kyegomez/VideoVIT
Open source implementation of a vision transformer that can understand Videos using max vit as a foundation.
kyegomez/VIMA
My simple implementation of "VIMA: General Robot Manipulation with Multimodal Prompts"
kyegomez/Zero
A Reliable, Customize-able, and Scalable Zapier Alternative for Production-Grade Workflow Automation
kyegomez/OpBots
Automating Common Tasks, Workflows, and Operations to maintain 100s of Github repositories
kyegomez/ConvNet
Implementation of the NFNets from the paper: "ConvNets Match Vision Transformers at Scale" by Google Research
kyegomez/CrysisAI
Implementation of the AI model from Crysis with Heat Imaging and multi-object detection using Yolo.
kyegomez/LongVit
A simplistic pytorch implementation of LongVit using my previous implementation of LongNet as a foundation.
kyegomez/Model-Infra-Template
A template for deploying ultra powerful LLMs effortlessly with the best optimizations
kyegomez/MultiGroupQueryAttention
Implementation of the all-new paper "GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpoints"
kyegomez/swarms-home
A conversational platform for the swarms framework.
kyegomez/SlackScraper
Scraper for Slack Messages
kyegomez/LeNet5
A simple implementation of LeNet5 for practice for the book "Pytorch Pocket Reference"
kyegomez/dinov2
PyTorch code and models for the DINOv2 self-supervised learning method.
kyegomez/unilm
Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities