cookbooks π for Mesolitica products! This repository only applicable for commercial models from https://mesolitica.com, not open models from https://mesolitica.com/opensource
Get your API key at https://app.nous.mesolitica.com/
We hosted scalar documentation at https://llm-router.nous.mesolitica.com/scalar
All API support concurrency requests, it means,
- If you have a batch of texts, you can fire multiple requests at the same without impacting the latency, same goes to Speech API.
- For Websocket Speech API, you can connect multiple users from your side to do real-time audio streaming to the Websocket server.
- Python OpenAI compatible
- Streaming Python OpenAI compatible
- RAG
- JSON format
- Function call
- System prompt
Originally from https://huggingface.co/datasets/NousResearch/json-mode-eval, this test is to test how good the models able to convert human natural text into JSON output given the OpenAPI schema.
pyaudio-websocket.mov
recordrtc-fastapi.mov
recordrtc.mov
If you are interested to self-host Mesolitica products in your virtual private network, Contact us at khalil@mesolitica.com or husein@mesolitica.com to know more.
- βΎοΈ usage of all quota, MaLLaM π, Speech, Translation and chatbots.
- Up-to-date enterprise versioning including evolution of MaLLaM π, Speech, Translation and chatbots.
- Can be either on private cloud or on premise, Dashboard and all the APIs will be hosted using virtual private IP.
- If you do not have hardware accelerator, we partner with NVIDIA APAC to include hardware solution with support.
- Bring your own hardware accelerator, we do not provide support.
We only provide yearly licensing with starting specific amount.