Alpaca - Code and documentation to train Stanford's Alpaca models, and generate the data.
BELLE - A 7B Large Language Model fine-tune by 34B Chinese Character Corpus, based on LLaMA and Alpaca.
Bloom - BigScience Large Open-science Open-access Multilingual Language Model
dolly - Databricks’ Dolly, a large language model trained on the Databricks Machine Learning Platform
Falcon 40B - Falcon-40B-Instruct is a 40B parameters causal decoder-only model built by TII based on Falcon-40B and finetuned on a mixture of Baize. It is made available under the Apache 2.0 license.
FastChat (Vicuna) - An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and FastChat-T5.
GLM-6B (ChatGLM) - An Open Bilingual Pre-Trained Model, quantization of ChatGLM-130B, can run on consumer-level GPUs.
ChatGLM2-6B - ChatGLM2-6B is the second-generation version of the open-source bilingual (Chinese-English) chat model ChatGLM-6B.
disco-diffusion - A frankensteinian amalgamation of notebooks, models and techniques for the generation of AI Art and Animations.
midjourney - Midjourney is an independent research lab exploring new mediums of thought and expanding the imaginative powers of the human species.
segment-anything (SAM) - produces high quality object masks from input prompts such as points or boxes, and it can be used to generate masks for all objects in an image.
bark - Bark is a transformer-based text-to-audio model created by Suno. Bark can generate highly realistic, multilingual speech as well as other audio - including music, background noise and simple sound effects.
whisper - Robust Speech Recognition via Large-Scale Weak Supervision
Jina - Build multimodal AI services via cloud native technologies · Model Serving · Generative AI · Neural Search · Cloud Native
Mosec - A machine learning model serving framework with dynamic batching and pipelined stages, provides an easy-to-use Python interface.
TFServing - A flexible, high-performance serving system for machine learning models.
Torchserve - Serve, optimize and scale PyTorch models in production
Triton Server (TRTIS) - The Triton Inference Server provides an optimized cloud and edge inferencing solution.
langchain-serve - Serverless LLM apps on Production with Jina AI Cloud
lanarky - FastAPI framework to build production-grade LLM applications
Xinference - Replace OpenAI GPT with another LLM in your app by changing a single line of code. Xinference gives you the freedom to use any LLM you need. With Xinference, you're empowered to run inference with any open-source language models, speech recognition models, and multimodal models, whether in the cloud, on-premises, or even on your laptop.
Deepchecks - Tests for Continuous Validation of ML Models & Data. Deepchecks is a Python package for comprehensively validating your machine learning models and data with minimal effort.
Evidently - Evaluate and monitor ML models from validation to production.
Giskard - Testing framework dedicated to ML models, from tabular to LLMs. Detect risks of biases, performance issues and errors in 4 lines of code.
agenta - The LLMOps platform to build robust LLM apps. Easily experiment and evaluate different prompts, models, and workflows to build robust apps.
Arize-Phoenix - ML observability for LLMs, vision, language, and tabular models.
BudgetML - Deploy a ML inference service on a budget in less than 10 lines of code.
CometLLM - The 100% opensource LLMOps platform to log, manage, and visualize your LLM prompts and chains. Track prompt templates, prompt variables, prompt duration, token usage, and other metadata. Score prompt outputs and visualize chat history all within a single UI.
deeplake - Stream large multimodal datasets to achieve near 100% GPU utilization. Query, visualize, & version control data. Access data w/o the need to recompute the embeddings for the model finetuning.
Dify - Open-source framework aims to enable developers (and even non-developers) to quickly build useful applications based on large language models, ensuring they are visual, operable, and improvable.
Dstack - Cost-effective LLM development in any cloud (AWS, GCP, Azure, Lambda, etc).
Embedchain - Framework to create ChatGPT like bots over your dataset.
GPTCache - Creating semantic cache to store responses from LLM queries.
Haystack - Quickly compose applications with LLM Agents, semantic search, question-answering and more.
langchain - Building applications with LLMs through composability
LangFlow - An effortless way to experiment and prototype LangChain flows with drag-and-drop components and a chat interface.
LangKit - Out-of-the-box LLM telemetry collection library that extracts features and profiles prompts, responses and metadata about how your LLM is performing over time to find problems at scale.
LiteLLM 🚅 - A simple & light 100 line package to standardize LLM API calls across OpenAI, Azure, Cohere, Anthropic, Replicate API Endpoints
LlamaIndex - Provides a central interface to connect your LLMs with external data.
LLMApp - LLM App is a Python library that helps you build real-time LLM-enabled data pipelines with few lines of code.
LLMFlows - LLMFlows is a framework for building simple, explicit, and transparent LLM applications such as chatbots, question-answering systems, and agents.
LLMonitor - Observability and monitoring for AI apps and agents. Debug agents with powerful tracing and logging. Usage analytics and dive deep into the history of your requests. Developer friendly modules with plug-and-play integration into LangChain.
magentic - Seamlessly integrate LLMs as Python functions. Use type annotations to specify structured output. Mix LLM queries and function calling with regular Python code to create complex LLM-powered functionality.
Pezzo 🕹️ - Pezzo is the open-source LLMOps platform built for developers and teams. In just two lines of code, you can seamlessly troubleshoot your AI operations, collaborate and manage your prompts in one place, and instantly deploy changes to any environment.
promptfoo - Open-source tool for testing & evaluating prompt quality. Create test cases, automatically check output quality and catch regressions, and reduce evaluation cost.
prompttools - Open-source tools for testing and experimenting with prompts. The core idea is to enable developers to evaluate prompts using familiar interfaces like code and notebooks. In just a few lines of codes, you can test your prompts and parameters across different models (whether you are using OpenAI, Anthropic, or LLaMA models). You can even evaluate the retrieval accuracy of vector databases.
TrueFoundry - Deploy LLMOps tools like Vector DBs, Embedding server etc on your own Kubernetes (EKS,AKS,GKE,On-prem) Infra including deploying, Fine-tuning, tracking Prompts and serving Open Source LLM Models with full Data Security and Optimal GPU Management. Train and Launch your LLM Application at Production scale with best Software Engineering practices.
ReliableGPT 💪 - Handle OpenAI Errors (overloaded OpenAI servers, rotated keys, or context window errors) for your production LLM Applications.
Weights & Biases (Prompts)- A suite of LLMOps tools within the developer-first W&B MLOps platform. Utilize W&B Prompts for visualizing and inspecting LLM execution flow, tracking inputs and outputs, viewing intermediate results, securely managing prompts and LLM chain configurations.
xTuring - Build and control your personal LLMs with fast and efficient fine-tuning.
ZenML - Open-source framework for orchestrating, experimenting and deploying production-grade ML solutions, with built-in langchain & llama_index integrations.
Milvus - Vector database for scalable similarity search and AI applications.
Pinecone - The Pinecone vector database makes it easy to build high-performance vector search applications. Developer-friendly, fully managed, and easily scalable without infrastructure hassles.
pgvector - Open-source vector similarity search for Postgres.
pgvecto.rs - Vector database plugin for Postgres, written in Rust, specifically designed for LLM.
Qdrant - Vector Search Engine and Database for the next generation of AI applications. Also available in the cloud
Vald - A Highly Scalable Distributed Vector Search Engine
Vearch - A distributed system for embedding-based vector retrieval
VectorDB - A Python vector database you just need - no more, no less.
Weaviate - Weaviate is an open source vector search engine that stores both objects and vectors, allowing for combining vector search with structured filtering with the fault-tolerance and scalability of a cloud-native database, all accessible through GraphQL, REST, and various language clients.
alpaca-lora - Instruct-tune LLaMA on consumer hardware
finetuning-scheduler - A PyTorch Lightning extension that accelerates and enhances foundation model experimentation with flexible fine-tuning schedules.
LMFlow - An Extensible Toolkit for Finetuning and Inference of Large Foundation Models
Lora - Using Low-rank adaptation to quickly fine-tune diffusion models.
p-tuning-v2 - An optimized prompt tuning strategy achieving comparable performance to fine-tuning on small/medium-sized models and sequence tagging challenges. (ACL 2022)
QLoRA - Efficient finetuning approach that reduces memory usage enough to finetune a 65B parameter model on a single 48GB GPU while preserving full 16-bit finetuning task performance.
ColossalAI - An integrated large-scale model training system with efficient parallelization techniques.
DeepSpeed - DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
Horovod - Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.
Jax - Autograd and XLA for high-performance machine learning research.
Kedro - Kedro is an open-source Python framework for creating reproducible, maintainable and modular data science code.
Keras - Keras is a deep learning API written in Python, running on top of the machine learning platform TensorFlow.
LightGBM - A fast, distributed, high performance gradient boosting (GBT, GBDT, GBRT, GBM or MART) framework based on decision tree algorithms, used for ranking, classification and many other machine learning tasks.
MegEngine - MegEngine is a fast, scalable and easy-to-use deep learning framework, with auto-differentiation.
metric-learn - Metric Learning Algorithms in Python.
MindSpore - MindSpore is a new open source deep learning training/inference framework that could be used for mobile, edge and cloud scenarios.
Oneflow - OneFlow is a performance-centered and open-source deep learning framework.
PaddlePaddle - Machine Learning Framework from Industrial Practice.
PyTorch - Tensors and Dynamic neural networks in Python with strong GPU acceleration.
PyTorch Lightning - Deep learning framework to train, deploy, and ship AI products Lightning fast.
XGBoost - Scalable, Portable and Distributed Gradient Boosting (GBDT, GBRT or GBM) Library.
Aim - an easy-to-use and performant open-source experiment tracker.
ClearML - Auto-Magical CI/CD to streamline your ML workflow. Experiment Manager, MLOps and Data-Management
Comet - Comet is an MLOps platform that offers experiment tracking, model production management, a model registry, and full data lineage from training straight through to production. Comet plays nicely with all your favorite tools, so you don't have to change your existing workflow. Check out CometLLM for all your prompt engineering needs!
Guild AI - Experiment tracking, ML developer tools.
Kedro-Viz - Kedro-Viz is an interactive development tool for building data science pipelines with Kedro. Kedro-Viz also allows users to view and compare different runs in the Kedro project.
LabNotebook - LabNotebook is a tool that allows you to flexibly monitor, record, save, and query all your machine learning experiments.
Sacred - Sacred is a tool to help you configure, organize, log and reproduce experiments.
Weights & Biases - A developer first, lightweight, user-friendly experiment tracking and visualization tool for machine learning projects, streamlining collaboration and simplifying MLOps. W&B excels at tracking LLM-powered applications, featuring W&B Prompts for LLM execution flow visualization, input and output monitoring, and secure management of prompts and LLM chain configurations.
TensorSpace - Neural network 3D visualization framework, build interactive and intuitive model in browsers, support pre-trained deep learning models from TensorFlow, Keras, TensorFlow.js.
dtreeviz - A python library for decision tree visualization and model interpretation.
Zetane Viewer - ML models and internal tensors 3D visualizer.
Zeno - AI evaluation platform for interactively exploring data and model outputs.
Model Editing
FastEdit - FastEdit aims to assist developers with injecting fresh and customized knowledge into large language models efficiently using one single command.
ArtiVC - A version control system to manage large files.
Lake is a dataset format with a simple API for creating, storing, and collaborating on AI datasets of any size.
Piperider - A CLI tool that allows you to build data profiles and write assertion tests for easily evaluating and tracking your data's reliability over time.
LUX - A Python library that facilitates fast and easy data exploration by automating the visualization and data analysis process.
Upgini - Free automated data & feature enrichment library for machine learning: automatically searches through thousands of ready-to-use features from public and community shared data sources and enriches your training dataset with only the accuracy improving features
Feast - An open source feature store for machine learning.
Comet - Comet is an MLOps platform that offers experiment tracking, model production management, a model registry, and full data lineage from training straight through to production. Comet plays nicely with all your favorite tools, so you don't have to change your existing workflow. Check out CometLLM for all your prompt engineering needs!
ClearML - Auto-Magical CI/CD to streamline your ML workflow. Experiment Manager, MLOps and Data-Management.
OpenLLM - An open platform for operating large language models (LLMs) in production. Fine-tune, serve, deploy, and monitor any LLMs with ease.
MLflow - Open source platform for the machine learning lifecycle.
MLRun - An open MLOps platform for quickly building and managing continuous ML applications across their lifecycle.
ModelFox - ModelFox is a platform for managing and deploying machine learning models.
Kserve - Standardized Serverless ML Inference Platform on Kubernetes
Kubeflow - Machine Learning Toolkit for Kubernetes.
PAI - Resource scheduling and cluster management for AI.
Primehub - An effortless infrastructure for machine learning built on the top of Kubernetes.
OpenModelZ - One-click machine learning deployment (LLM, text-to-image and so on) at scale on any cluster (GCP, AWS, Lambda labs, your home lab, or even a single machine).
Seldon-core - An MLOps framework to package, deploy, monitor and manage thousands of production machine learning models
TrueFoundry - A PaaS to deploy, Fine-tune and serve LLM Models on a company’s own Infrastructure with Data Security and Optimal GPU and Cost Management. Launch your LLM Application at Production scale with best DevSecOps practices.
Weights & Biases - A lightweight and flexible platform for machine learning experiment tracking, dataset versioning, and model management, enhancing collaboration and streamlining MLOps workflows. W&B excels at tracking LLM-powered applications, featuring W&B Prompts for LLM execution flow visualization, input and output monitoring, and secure management of prompts and LLM chain configurations.
Comet - Comet is an MLOps platform that offers Model Production Management, a Model Registry, and full model lineage from training straight through to production. Use Comet for model reproducibility, model debugging, model versioning, model visibility, model auditing, model governance, and model monitoring.
dvc - Data Version Control | Git for Data & Models | ML Experiments Management
ModelDB - Open Source ML Model Versioning, Metadata, and Experiment Management
MLEM - A tool to package, serve, and deploy any ML model on any platform.
ormb - Docker for Your ML/DL Models Based on OCI Artifacts
ONNX-MLIR - Compiler technology to transform a valid Open Neural Network Exchange (ONNX) graph into code that implements the graph with minimum runtime support.
TVM - Open deep learning compiler stack for cpu, gpu and specialized accelerators
octoml-profile - octoml-profile is a python library and cloud service designed to provide the simplest experience for assessing and optimizing the performance of PyTorch models on cloud hardware with state-of-the-art ML acceleration technology.
scalene - a high-performance, high-precision CPU, GPU, and memory profiler for Python
Auto-PyTorch - Automatic architecture search and hyperparameter optimization for PyTorch.
auto-sklearn - an automated machine learning toolkit and a drop-in replacement for a scikit-learn estimator.
Dragonfly - An open source python library for scalable Bayesian optimisation.
Determined - scalable deep learning training platform with integrated hyperparameter tuning support; includes Hyperband, PBT, and other search methods.
DEvol (DeepEvolution) - a basic proof of concept for genetic architecture search in Keras.
EvalML - An open source python library for AutoML.
FEDOT - AutoML framework for the design of composite pipelines.
learn2learn - PyTorch Meta-learning Framework for Researchers.
Ludwig - a toolbox built on top of TensorFlow that allows to train and test deep learning models without the need to write code.
MOE - a global, black box optimization engine for real world metric optimization by Yelp.
Model Search - a framework that implements AutoML algorithms for model architecture search at scale.
NASGym - a proof-of-concept OpenAI Gym environment for Neural Architecture Search (NAS).
NNI - An open source AutoML toolkit for automate machine learning lifecycle, including feature engineering, neural architecture search, model compression and hyper-parameter tuning.
TensorFlow Model Optimization - A suite of tools that users, both novice and advanced, can use to optimize machine learning models for deployment and execution.
TNN - A uniform deep learning inference framework for mobile, desktop and server.
EasyFL - An Easy-to-use Federated Learning Platform
FATE - An Industrial Grade Federated Learning Framework
FedML - The federated learning and analytics library enabling secure and collaborative machine learning on decentralized data anywhere at any scale. Supporting large-scale cross-silo federated learning, cross-device federated learning on smartphones/IoTs, and research simulation.
Harmonia - Harmonia is an open-source project aiming at developing systems/infrastructures and libraries to ease the adoption of federated learning (abbreviated to FL) for researches and production usage.
visenger/awesome-mlops - An awesome list of references for MLOps - Machine Learning Operations
currentslab/awesome-vector-search - A curated list of awesome vector search framework/engine, library, cloud service and research papers to vector similarity search.
- Code and documentation to train Stanford's Alpaca models, and generate the data.
- A 7B Large Language Model fine-tune by 34B Chinese Character Corpus, based on LLaMA and Alpaca.
- BigScience Large Open-science Open-access Multilingual Language Model
- Databricks’ Dolly, a large language model trained on the Databricks Machine Learning Platform
- An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and FastChat-T5.
- An Open Bilingual Pre-Trained Model, quantization of ChatGLM-130B, can run on consumer-level GPUs.
- ChatGLM2-6B is the second-generation version of the open-source bilingual (Chinese-English) chat model ChatGLM-6B.
- An Open Bilingual Pre-Trained Model (ICLR 2023)
- An implementation of model parallel autoregressive transformers on GPUs, based on the DeepSpeed library.
- A Chinese LLM, Based on LLaMA and fine tune by Stanford Alpaca, Alpaca LoRA, Japanese-Alpaca-LoRA.
- StableLM: Stability AI Language Models
- A frankensteinian amalgamation of notebooks, models and techniques for the generation of AI Art and Animations.
- produces high quality object masks from input prompts such as points or boxes, and it can be used to generate masks for all objects in an image.
- A latent text-to-image diffusion model
- High-Resolution Image Synthesis with Latent Diffusion Models
- Bark is a transformer-based text-to-audio model created by Suno. Bark can generate highly realistic, multilingual speech as well as other audio - including music, background noise and simple sound effects.
- Robust Speech Recognition via Large-Scale Weak Supervision
- Alpaca-LoRA as Chatbot service
- MII makes low-latency and high-throughput inference possible, powered by DeepSpeed.
- Running large language models on a single GPU for throughput-oriented scenarios.
- Drag & drop UI to build your customized LLM flow using LangchainJS.
- Port of Facebook's LLaMA model in C/C++
- OpenAI compatible API for LLMs and embeddings (LLaMA, Vicuna, ChatGLM and many others)
- Large Language Model Text Generation Inference
- A high-throughput and memory-efficient inference and serving engine for LLMs.
- Port of OpenAI's Whisper model in C/C++
- Real-time inference for Stable Diffusion - 0.88s latency. Covers AITemplate, nvFuser, TensorRT, FlashAttention.
- The Unified Model Serving Framework
- Build multimodal AI services via cloud native technologies · Model Serving · Generative AI · Neural Search · Cloud Native
- A machine learning model serving framework with dynamic batching and pipelined stages, provides an easy-to-use Python interface.
- A flexible, high-performance serving system for machine learning models.
- Serve, optimize and scale PyTorch models in production
- The Triton Inference Server provides an optimized cloud and edge inferencing solution.
- Serverless LLM apps on Production with Jina AI Cloud
- FastAPI framework to build production-grade LLM applications
- Replace OpenAI GPT with another LLM in your app by changing a single line of code. Xinference gives you the freedom to use any LLM you need. With Xinference, you're empowered to run inference with any open-source language models, speech recognition models, and multimodal models, whether in the cloud, on-premises, or even on your laptop.
- Tests for Continuous Validation of ML Models & Data. Deepchecks is a Python package for comprehensively validating your machine learning models and data with minimal effort.
- Evaluate and monitor ML models from validation to production.
- Testing framework dedicated to ML models, from tabular to LLMs. Detect risks of biases, performance issues and errors in 4 lines of code.
- Always know what to expect from your data.
- The open standard for data logging
- The LLMOps platform to build robust LLM apps. Easily experiment and evaluate different prompts, models, and workflows to build robust apps.
- ML observability for LLMs, vision, language, and tabular models.
- Deploy a ML inference service on a budget in less than 10 lines of code.
- The 100% opensource LLMOps platform to log, manage, and visualize your LLM prompts and chains. Track prompt templates, prompt variables, prompt duration, token usage, and other metadata. Score prompt outputs and visualize chat history all within a single UI.
- Stream large multimodal datasets to achieve near 100% GPU utilization. Query, visualize, & version control data. Access data w/o the need to recompute the embeddings for the model finetuning.
- Open-source framework aims to enable developers (and even non-developers) to quickly build useful applications based on large language models, ensuring they are visual, operable, and improvable.
- Cost-effective LLM development in any cloud (AWS, GCP, Azure, Lambda, etc).
- Framework to create ChatGPT like bots over your dataset.
- Creating semantic cache to store responses from LLM queries.
- Quickly compose applications with LLM Agents, semantic search, question-answering and more.
- Building applications with LLMs through composability
- An effortless way to experiment and prototype LangChain flows with drag-and-drop components and a chat interface.
- Out-of-the-box LLM telemetry collection library that extracts features and profiles prompts, responses and metadata about how your LLM is performing over time to find problems at scale.
- A simple & light 100 line package to standardize LLM API calls across OpenAI, Azure, Cohere, Anthropic, Replicate API Endpoints
- Provides a central interface to connect your LLMs with external data.
- LLM App is a Python library that helps you build real-time LLM-enabled data pipelines with few lines of code.
- LLMFlows is a framework for building simple, explicit, and transparent LLM applications such as chatbots, question-answering systems, and agents.
- Observability and monitoring for AI apps and agents. Debug agents with powerful tracing and logging. Usage analytics and dive deep into the history of your requests. Developer friendly modules with plug-and-play integration into LangChain.
- Seamlessly integrate LLMs as Python functions. Use type annotations to specify structured output. Mix LLM queries and function calling with regular Python code to create complex LLM-powered functionality.
- Pezzo is the open-source LLMOps platform built for developers and teams. In just two lines of code, you can seamlessly troubleshoot your AI operations, collaborate and manage your prompts in one place, and instantly deploy changes to any environment.
- Open-source tool for testing & evaluating prompt quality. Create test cases, automatically check output quality and catch regressions, and reduce evaluation cost.
- Open-source tools for testing and experimenting with prompts. The core idea is to enable developers to evaluate prompts using familiar interfaces like code and notebooks. In just a few lines of codes, you can test your prompts and parameters across different models (whether you are using OpenAI, Anthropic, or LLaMA models). You can even evaluate the retrieval accuracy of vector databases.
- Handle OpenAI Errors (overloaded OpenAI servers, rotated keys, or context window errors) for your production LLM Applications.
- Build and control your personal LLMs with fast and efficient fine-tuning.
- Open-source framework for orchestrating, experimenting and deploying production-grade ML solutions, with built-in
- An easy to use Neural Search Engine. Index latent vectors along with JSON metadata and do efficient k-NN search.
- the open source embedding database
- Tensor search for humans.
- Vector database for scalable similarity search and AI applications.
- Open-source vector similarity search for Postgres.
- Vector database plugin for Postgres, written in Rust, specifically designed for LLM.
- Vector Search Engine and Database for the next generation of AI applications. Also available in the cloud
- Build AI-powered semantic search applications
- A Highly Scalable Distributed Vector Search Engine
- A distributed system for embedding-based vector retrieval
- A Python vector database you just need - no more, no less.
- Weaviate is an open source vector search engine that stores both objects and vectors, allowing for combining vector search with structured filtering with the fault-tolerance and scalability of a cloud-native database, all accessible through GraphQL, REST, and various language clients.
- CodeGen is an open-source model for program synthesis. Trained on TPU-v4. Competitive with OpenAI Codex.
- Open Code LLMs for Code Understanding and Generation.
- An open-source alternative to GitHub Copilot server
- Self-hosted AI coding assistant. An opensource / on-prem alternative to GitHub Copilot.
- Run VS Code on any machine anywhere and access it in the browser.
- OS-agnostic, system-level binary package manager and ecosystem.
- Moby is an open-source project created by Docker to enable and accelerate software containerization.
- 🏕️ Reproducible development environment for AI/ML.
- The Jupyter notebook is a web-based notebook environment for interactive computing.
- A build, packaging, and run system for ephemeral multi-container environments.
- Instruct-tune LLaMA on consumer hardware
- A PyTorch Lightning extension that accelerates and enhances foundation model experimentation with flexible fine-tuning schedules.
- An Extensible Toolkit for Finetuning and Inference of Large Foundation Models
- Using Low-rank adaptation to quickly fine-tune diffusion models.
- State-of-the-art Parameter-Efficient Fine-Tuning.
- An optimized prompt tuning strategy achieving comparable performance to fine-tuning on small/medium-sized models and sequence tagging challenges. (ACL 2022)
- Efficient finetuning approach that reduces memory usage enough to finetune a 65B parameter model on a single 48GB GPU while preserving full 16-bit finetuning task performance.
- 🚀 A simple way to train and use PyTorch models with multi-GPU, TPU, mixed-precision.
- Lightweight, Portable, Flexible Distributed/Mobile Deep Learning with Dynamic, Mutation-aware Dataflow Dep Scheduler.
- A fast open framework for deep learning.
- An integrated large-scale model training system with efficient parallelization techniques.
- DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
- Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.
- Autograd and XLA for high-performance machine learning research.
- Kedro is an open-source Python framework for creating reproducible, maintainable and modular data science code.
- Keras is a deep learning API written in Python, running on top of the machine learning platform TensorFlow.
- A fast, distributed, high performance gradient boosting (GBT, GBDT, GBRT, GBM or MART) framework based on decision tree algorithms, used for ranking, classification and many other machine learning tasks.
- MegEngine is a fast, scalable and easy-to-use deep learning framework, with auto-differentiation.
- Metric Learning Algorithms in Python.
- MindSpore is a new open source deep learning training/inference framework that could be used for mobile, edge and cloud scenarios.
- OneFlow is a performance-centered and open-source deep learning framework.
- Machine Learning Framework from Industrial Practice.
- Tensors and Dynamic neural networks in Python with strong GPU acceleration.
- Deep learning framework to train, deploy, and ship AI products Lightning fast.
- Scalable, Portable and Distributed Gradient Boosting (GBDT, GBRT or GBM) Library.
- Machine Learning in Python.
- An Open Source Machine Learning Framework for Everyone.
- A minimalist neural network library optimized for sparse data and single machine environments.
- an easy-to-use and performant open-source experiment tracker.
- Auto-Magical CI/CD to streamline your ML workflow. Experiment Manager, MLOps and Data-Management
- Comet is an MLOps platform that offers experiment tracking, model production management, a model registry, and full data lineage from training straight through to production. Comet plays nicely with all your favorite tools, so you don't have to change your existing workflow. Check out CometLLM for all your prompt engineering needs!
- Experiment tracking, ML developer tools.
- Machine Learning automation and tracking.
- Kedro-Viz is an interactive development tool for building data science pipelines with Kedro. Kedro-Viz also allows users to view and compare different runs in the Kedro project.
- LabNotebook is a tool that allows you to flexibly monitor, record, save, and query all your machine learning experiments.
- Sacred is a tool to help you configure, organize, log and reproduce experiments.
- A developer first, lightweight, user-friendly experiment tracking and visualization tool for machine learning projects, streamlining collaboration and simplifying MLOps. W&B excels at tracking LLM-powered applications, featuring W&B Prompts for LLM execution flow visualization, input and output monitoring, and secure management of prompts and LLM chain configurations.
- A model-agnostic visual debugging tool for machine learning.
- Visualizer for neural network, deep learning, and machine learning models.
- Bring multiple data streams into one dashboard.
- TensorFlow's Visualization Toolkit.
- Neural network 3D visualization framework, build interactive and intuitive model in browsers, support pre-trained deep learning models from TensorFlow, Keras, TensorFlow.js.
- A python library for decision tree visualization and model interpretation.
- ML models and internal tensors 3D visualizer.
- AI evaluation platform for interactively exploring data and model outputs.
- A version control system to manage large files. Lake is a dataset format with a simple API for creating, storing, and collaborating on AI datasets of any size.
- Git for Data.
- Data Version Control | Git for Data & Models | ML Experiments Management.
- Storage layer that brings scalable, ACID transactions to Apache Spark and other engines.
- Pachyderm is a version control system for data.
- A self-organizing data hub for S3.
- A distributed POSIX file system built on top of Redis and S3.
- Git-like capabilities for your object storage.
- Modern columnar data format for ML implemented in Rust.
- A CLI tool that allows you to build data profiles and write assertion tests for easily evaluating and tracking your data's reliability over time.
- A Python library that facilitates fast and easy data exploration by automating the visualization and data analysis process.
- The Virtual Feature Store. Turn your existing data infrastructure into a feature store.
- An open source python framework for automated feature engineering
- Free automated data & feature enrichment library for machine learning: automatically searches through thousands of ready-to-use features from public and community shared data sources and enriches your training dataset with only the accuracy improving features
- An open source feature store for machine learning.
- An open platform for operating large language models (LLMs) in production. Fine-tune, serve, deploy, and monitor any LLMs with ease.
- Open source platform for the machine learning lifecycle.
- ModelFox is a platform for managing and deploying machine learning models.
- Standardized Serverless ML Inference Platform on Kubernetes
- Machine Learning Toolkit for Kubernetes.
- Resource scheduling and cluster management for AI.
- Machine Learning Management & Orchestration Platform.
- An effortless infrastructure for machine learning built on the top of Kubernetes.
- One-click machine learning deployment (LLM, text-to-image and so on) at scale on any cluster (GCP, AWS, Lambda labs, your home lab, or even a single machine).
- An MLOps framework to package, deploy, monitor and manage thousands of production machine learning models
- A platform to programmatically author, schedule and monitor workflows.
- An Open-Source Platform for Production Data Science
- Workflow engine for Kubernetes.
- Kubernetes-native workflow automation platform for complex, mission-critical data and ML processes at scale.
- A lightweight framework to represent ML/language model pipelines as a series of python functions.
- Machine Learning Pipelines for Kubeflow.
- Build and manage real-life data science projects with ease!
- The fastest way to build data pipelines. Develop iteratively, deploy anywhere.
- The easiest way to automate your data.
- An open-source unstructured data ETL tool to streamline the end-to-end unstructured data processing pipeline.
- Kubernetes-native Job Queueing.
- A Highly Scalable Workload Manager.
- A Cloud Native Batch System (Project under CNCF).
- Light-weight, universal resource scheduler for container orchestrator systems.
- Open Source ML Model Versioning, Metadata, and Experiment Management
- A tool to package, serve, and deploy any ML model on any platform.
- Docker for Your ML/DL Models Based on OCI Artifacts
- Compiler technology to transform a valid Open Neural Network Exchange (ONNX) graph into code that implements the graph with minimum runtime support.
- Open deep learning compiler stack for cpu, gpu and specialized accelerators
- octoml-profile is a python library and cloud service designed to provide the simplest experience for assessing and optimizing the performance of PyTorch models on cloud hardware with state-of-the-art ML acceleration technology.
- a high-performance, high-precision CPU, GPU, and memory profiler for Python
- a platform for Neural Network Search (NAS) that allows you to generate efficient deep networks for your applications.
- A framework to find the best performing AI/ML model for any AI problem.
- An autoML framework & toolkit for machine learning on graphs
- AutoML for Image, Text, and Tabular Data.
- Provide an input CSV and a target field to predict, generate a model + code to run it.
- AutoML library for deep learning.
- Automatic architecture search and hyperparameter optimization for PyTorch.
- an automated machine learning toolkit and a drop-in replacement for a scikit-learn estimator.
- An open source python library for scalable Bayesian optimisation.
- scalable deep learning training platform with integrated hyperparameter tuning support; includes Hyperband, PBT, and other search methods.
- a basic proof of concept for genetic architecture search in Keras.
- An open source python library for AutoML.
- AutoML framework for the design of composite pipelines.
- Fast and lightweight AutoML (paper).
- A hyperparameter optimization framework, inspired by Optuna.
- a framework for distributed hyperparameter optimization.
- a library for hyperparameter optimization and black box optimization benchmarks.
- open source code for tuning hyperparams with Hyperband.
- A General Automated Machine Learning Framework.
- Distributed Asynchronous Hyperparameter Optimization in Python.
- A toolset for black-box hyperparameter optimisation.
- Katib is a Kubernetes-native project for automated machine learning (AutoML).
- Hyperparameter tuning for humans.
- PyTorch Meta-learning Framework for Researchers.
- a toolbox built on top of TensorFlow that allows to train and test deep learning models without the need to write code.
- a global, black box optimization engine for real world metric optimization by Yelp.
- a framework that implements AutoML algorithms for model architecture search at scale.
- a proof-of-concept OpenAI Gym environment for Neural Architecture Search (NAS).
- An open source AutoML toolkit for automate machine learning lifecycle, including feature engineering, neural architecture search, model compression and hyper-parameter tuning.
- A hyperparameter optimization framework.
- An open-source, low-code machine learning library in Python that automates machine learning workflows.
- Scalable Hyperparameter Tuning.
- Bayesian optimization in high-dimensions via random embedding.
- a Robust Bayesian Optimization framework.
- Sequential model-based optimization with a
- a software package to perform Bayesian optimization.
- one of the very first AutoML methods and open-source software packages.
- A Meta-Learning library for PyTorch.
- an AutoML algorithm tool chain by Huawei Noah's Arb Lab.
- FeatherCNN is a high performance inference engine for convolutional neural networks.
- A library for high performance deep learning inference on NVIDIA GPUs.
- ncnn is a high-performance neural network inference framework optimized for the mobile platform.
- use AutoML to do model compression.
- A suite of tools that users, both novice and advanced, can use to optimize machine learning models for deployment and execution.
- A uniform deep learning inference framework for mobile, desktop and server.
- An Easy-to-use Federated Learning Platform
- An Industrial Grade Federated Learning Framework
- The federated learning and analytics library enabling secure and collaborative machine learning on decentralized data anywhere at any scale. Supporting large-scale cross-silo federated learning, cross-device federated learning on smartphones/IoTs, and research simulation.
- A Friendly Federated Learning Framework
- Harmonia is an open-source project aiming at developing systems/infrastructures and libraries to ease the adoption of federated learning (abbreviated to FL) for researches and production usage.
- A framework for implementing federated learning
- A curated list of awesome projects and resources related to Argo
- Automated Deep Learning: Neural Architecture Search Is Not the End (a curated list of AutoDL resources and an in-depth analysis)
- Curating a list of AutoML-related research, tools, projects and other resources
- A curated list of automated machine learning papers, articles, tutorials, slides and projects
- A curated list of Federated Learning Systems related academic papers, articles, tutorials, slides and projects.
- A curated list of federated learning publications, re-organized from Arxiv (mostly)
- All materials you need for Federated Learning: blogs, videos, papers, and softwares, etc.
- This is the Fuzzy Labs guide to the universe of free and open source MLOps tools.
- A curated list of awesome open source libraries to deploy, monitor, version and scale your machine learning
- A list of awesome compiler projects and papers for tensor computation and deep learning.
- A curated list of awesome MLOps tools.
- An awesome list of references for MLOps - Machine Learning Operations
- A curated list of awesome vector search framework/engine, library, cloud service and research papers to vector similarity search.
