ai-inference

There are 10 repositories under ai-inference topic.

bentoml/BentoML
The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!
Language:Python8.2k 78 1.1k885
uxlfoundation/scikit-learn-intelex
Extension for Scikit-learn is a seamless way to speed up your Scikit-learn application
Language:Python1.3k 23 254184
uxlfoundation/oneDAL
oneAPI Data Analytics Library (oneDAL)
Language:C++642 41 148226
intel/dffml
The easiest way to use Machine Learning. Mix and match underlying ML libraries and data set sources. Generate new datasets or modify existing ones with ease.
Language:Python254 16 844138
blace-ai/blace-ai
Cross-platform c++ sdk & model hub for easy ai inference
Language:C++60 8 152
philips-software/go-hsdp-api
Client library to interact with various APIs used within Philips in a simple and uniform way
Language:Go32 8 1511
superjamie/rocswap
llama.cpp + ROCm + llama-swap
Language:Dockerfile14 3 01
tinyBigGAMES/JetInfero
Local LLM Inference Library
Language:Pascal12 2 03
open-vela/apps_mlearning_tflite-micro
Customed version of Google's tflite-micro
Language:C++8 1 02
valvebara/valvebara
No more Hugging Face cost leaks.
Language:TypeScript3 3 41