ai-inference

There are 9 repositories under ai-inference topic.

bentoml/BentoML
The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!
Language:Python7.3k 76 1.1k799
uxlfoundation/scikit-learn-intelex
Extension for Scikit-learn is a seamless way to speed up your Scikit-learn application
Language:Python1.2k 29 240179
uxlfoundation/oneDAL
oneAPI Data Analytics Library (oneDAL)
Language:C++620 47 139217
intel/dffml
The easiest way to use Machine Learning. Mix and match underlying ML libraries and data set sources. Generate new datasets or modify existing ones with ease.
Language:Python252 18 844138
philips-software/go-hsdp-api
Client library to interact with various APIs used within Philips in a simple and uniform way
Language:Go31 8 1511
superjamie/rocswap
llama.cpp + ROCm + llama-swap
Language:Dockerfile5 1 00
blace-ai/blace-ai
Cross-platform c++ sdk & model hub for easy ai inference
3 5 01
valvebara/valvebara
No more Hugging Face cost leaks.
Language:TypeScript3 3 41
open-vela/apps_mlearning_tflite-micro
Customed version of Google's tflite-micro
Language:C++12