TokenBender
I fine-tune models/build datasets and stuff. I specialise in code generation and character/roleplay models.
Currently hacking away LLM related stuff. Ex - IntelBangalore
Pinned Repositories
autoInstruct
Handles everything related to working with instruction datasets
chatbot-ui-react
ChatMaxx Furiousa - So that I don't have to buy subscription from everyone like it is OTT wars
context
llama3-recipes
playtorch
zero to one repo for ramping up to SoTA
seamless_communication
Foundational Models for State-of-the-Art Speech and Text Translation
wikivec2text
Simple embedding -> text model trained on a small subset of Wikipedia sentences.
TokenBender's Repositories
TokenBender/autoInstruct
Handles everything related to working with instruction datasets
TokenBender/chatbot-ui-react
ChatMaxx Furiousa - So that I don't have to buy subscription from everyone like it is OTT wars
TokenBender/context
TokenBender/llama3-recipes
TokenBender/playtorch
zero to one repo for ramping up to SoTA
TokenBender/axolotl
Go ahead and axolotl questions
TokenBender/aider
aider is AI pair programming in your terminal
TokenBender/BlockMerge_Gradient
Merge Transformers language models by use of gradient parameters.
TokenBender/claude_github_cloudflare_worker
TokenBender/confetti
confetti lol
TokenBender/cpl
Code for Contrastive Preference Learning (CPL)
TokenBender/Dataset-Conversion-Toolkit
a set of scripts to easily convert all training data from huggingface into alpaca instruct or sharegpt format, which should allow for ease of use with any trainer
TokenBender/datatrove
Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.
TokenBender/DeepSeek-Coder-local-UI
DeepSeek Coder: Let the Code Write Itself
TokenBender/e5-mistral-7b-instruct
Finetune mistral-7b-instruct for sentence embeddings
TokenBender/finetune-Qwen2-VL
TokenBender/kotaemon
An open-source RAG-based tool for chatting with your documents.
TokenBender/llama2.mojo
Inference Llama 2 in one file of pure 🔥
TokenBender/lm-evaluation-harness
A framework for few-shot evaluation of autoregressive language models.
TokenBender/log
Personal blog/website
TokenBender/lq-lora
TokenBender/mamba
TokenBender/mergekit
Tools for merging pretrained large language models.
TokenBender/ohmyzsh
🙃 A delightful community-driven (with 2,200+ contributors) framework for managing your zsh configuration. Includes 300+ optional plugins (rails, git, macOS, hub, docker, homebrew, node, php, python, etc), 140+ themes to spice up your morning, and an auto-update tool so that makes it easy to keep up with the latest updates from the community.
TokenBender/open-artifacts
Like Claude Artifacts but lives in a single static HTML page which you can use with any language model of your choosing
TokenBender/pdf_to_image
convert any pdf to images per page
TokenBender/swarm
Framework for building, orchestrating and deploying multi-agent systems. Managed by OpenAI Solutions team. Experimental framework.
TokenBender/text-generation-webui
A Gradio web UI for Large Language Models. Supports transformers, GPTQ, llama.cpp (GGUF), Llama models.
TokenBender/the_art_of_tokenbending
This is where I talk about my experiments with AI, NLP (LLMs)
TokenBender/WizardLM
Family of instruction-following LLMs powered by Evol-Instruct: WizardLM, WizardCoder and WizardMath