parano
Founder/CEO of BentoML, previously @databricks, ML/AI Platforms & Systems, Product Design
San Francisco, CA
Pinned Repositories
BentoML
The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!
OpenLLM
Run any open-source LLMs, such as Llama, Mistral, as OpenAI compatible API endpoint in the cloud.
awesome-model-serving
A curated list of awesome projects, papers, resources related to machine learning model serving
BentoML
Model Serving Made Easy
CritterSafari
MHCID 2014 - Captone Project - Functional Prototype - STEM Team
GeneticAlgorithm-TSP
Applying Genetic Algorithm to Travelling Salesman Problem
Global-Terrorism-Visualization
Global Terrorism Visualization
snapux
SnapUX - YC Hackathon Oct 2018
vimfiles
My Vim Configuration
parano's Repositories
parano/GeneticAlgorithm-TSP
Applying Genetic Algorithm to Travelling Salesman Problem
parano/vimfiles
My Vim Configuration
parano/BentoML
Model Serving Made Easy
parano/bentoml-feedstock
A conda-smithy repository for bentoml.
parano/BentoSVD
parano/RealChar
🎙️🤖Create, Customize and Talk to your AI Character/Companion in Realtime (All in One Codebase!). Have a natural seamless conversation with AI everywhere (mobile, web and terminal) using LLM OpenAI GPT3.5/4, Anthropic Claude2, Chroma Vector DB, Whisper Speech2Text, ElevenLabs Text2Speech🎙️🤖
parano/yatai-deployment-operator
parano/.github
✨🍱🦄️
parano/awesome-production-machine-learning
A curated list of awesome open source libraries to deploy, monitor, version and scale your machine learning
parano/BentoCrewAI
Serving CrewAI Agent as REST API with BentoML, optionally with self-host open-source LLMs
parano/bentoctl
CLI tool for deploying ML models in the cloud - built on top of BentoML 🚀
parano/BentoVLLM
how to build a LLM application using BentoML using vLLM
parano/BentoVoiceAgent
Build Phone Calling Voice Agent fully powered by open source models.
parano/circus
A Process & Socket Manager built with zmq
parano/CLIP-API-service
CLIP as a service - Embed image and sentences, object recognition, visual reasoning, image classification and reverse image search
parano/deploy-bento-action
A GitHub Action to deploy bento to cloud
parano/diffusers-examples
parano/Fraud-Detection-Model-Serving
Online model serving with Fraud Detection model trained with XGBoost on IEEE-CIS dataset
parano/IF-multi-GPUs-demo
parano/k8s-device-plugin
NVIDIA device plugin for Kubernetes
parano/NLP-multi-task-service
Online Inference API for NLP, Transformer models - summarization, text classification, sentiment analysis and more
parano/OneDiffusion
OneDiffusion: Run any Stable Diffusion models and fine-tuned weights with ease
parano/OpenLLM
An open platform for operating large language models(LLMs) in production. Fine-tune, serve, deploy, and monitor any LLMs with ease.
parano/parano
parano/Pneumonia-Detection-demo
Pneumonia Detection - Healthcare Imaging Application built with BentoML and fine-tuned Vision Transformer (ViT) model
parano/quickstart
parano/sentence-embedding-bento
parano/stable-diffusion-bentoml
parano/Yatai
Run BentoML workflow at scale on Kubernetes 🦄️
parano/yatai-chart
Helm Chart for installing BentoML Yatai on Kubernetes