torchserve
There are 59 repositories under torchserve topic.
cceyda/torchserve-dashboard
Management Dashboard for Torchserve
alvarobartt/serving-pytorch-models
Serving PyTorch models with TorchServe :fire:
louisoutin/yolov5_torchserve
Torchserve server using a YoloV5 model running on docker with GPU and static batch inference to perform production ready and real time inference.
notAI-tech/fastDeploy
Deploy DL/ ML inference pipelines with minimal extra code.
aws-samples/amazon-sagemaker-endpoint-deployment-of-fastai-model-with-torchserve
Deploy FastAI Trained PyTorch Model in TorchServe and Host in Amazon SageMaker Inference Endpoint
scaleoutsystems/stackn
A minimalistic and pluggable machine learning platform for Kubernetes.
cceyda/lit-NER
TorchServe+Streamlit for easily serving your HuggingFace NER models
kamalkraj/Swin-Transformer-Serve
Deploy Swin Transformer using TorchServe
manhph2211/ML-Deployment
Pushing Deep Learning models into production using torchserve, kubernetes and react web app :smile:
npatta01/pytorch-serving-workshop
Slides and notebook for the workshop on serving bert models in production
Biano-AI/serving-compare-middleware
FastAPI middleware for comparing different ML model serving approaches
aws-samples/torchserve-eks
How to deploy TorchServe on an Amazon EKS cluster for inference.
aws-samples/amazon-sagemaker-endpoint-deployment-of-siamese-network-with-torchserve
Twin Neural Network Training with PyTorch and fast.ai and its Deployment with TorchServe on Amazon SageMaker
artefactory/deploy-fastai-torchserve-aiplatform
Deploy FastAI Trained PyTorch Model in TorchServe and Host in GCP's AI-Platform Prediciton.
AshutoshDongare/HuggingFace-Model-Serving
Quick and easy tutorial to serve HuggingFace sentiment analysis model using torchserve
fabridamicelli/torchserve-docker
TorchServe images with specific Python version working out-of-the-box.
Faruman/AnalysisOfMlModelDeploymentOptions
This paper compares Flask, FastAPI, and TorchServe for deploying PyTorch models. Flask is simple, FastAPI adds performance, and TorchServe is best for large-scale production. FastAPI is ideal for small deployments, while TorchServe suits complex environments. AWS Lambda is suggested for advanced use cases.
RamanHacks/pytorch-hackathon
DET is an end-to-end tool for extracting Key-Value pairs from a variety of documents, built entirely on PyTorch and served using TorchServe.
GlenCrawford/musical_valence_predictor
Predicting musical valence of Spotify songs using PyTorch.
i008/pl-lightning-torchserve-neptune-template
This repo implements a minimalistic pytorch_lightning + neptune + torchserve flow for (computer vision) model training and deployment
bioinf-mcb/BERT-torchserve-quickstart
Serving BERT embeddings via Torchserve
dimitreOliveira/torchserve_od_example
Simple example of using TorchServe to serve a PyTorch Object Detection model
froukje/mnist-deployment
Deploy App for MNIST Classification using TorchServe and Flask
Muthukamalan/DogBreedsClassifier
helps to classify dogs breed
oke-aditya/torch_serve_mnist
Tutorial on how to run MNIST using Torch-Serve
philippmoehl/ml-lifecycle
ML Lifecycle project
williamcorsel/TorchMenu
GUI for managing your TorchServe server
ajithvcoder/Multivideo_Objectdetection_MLOPS_Project
Multi video offline streaming and Yolov8 object detection with Kafka, torch serve, AWS EC2
Awrsha/inference-comparison
A comprehensive platform for comparing performance across various inference servers including Triton Inference Server, TorchServe, and PyTorch Direct with a modern UI and advanced analytics capabilities.
jatin837/tomato_health_check_with_computer_vision
Blight detection in tomato 🍅 using convolutional neural networks
Muthukamalan/MLOps-at-GenAI
helpers to deploy Stable Diffusion model on torchserve
naram92/DeepFakeDetection-torchserve-deployment
How to deploy the deefake detection model using torchserve
stevinc/MNIST-Inference
MNIST inference using torchserve, flask and docker
tadayosi/torchserve-client-java
A Java client library for PyTorch TorchServe
texano00/TorchServe-Lab
🚀 TorchServe playground includes step by step Kubernetes installation and inference stress tests using JMeter (most models from HuggingFace)
tripathiarpan20/HF-torchserve-pipeline
Template to serve, optimize and scale 🤗 pipeline in production with Torchserve & Docker