All related to Nous, MaLLaM π, Retrieval, Classifier, Speech, Translation, cookbooks π , bugs π and feature requests ππ½. This repository only applicable for commercial models from https://mesolitica.com, not open models from https://mesolitica.com/opensource
MaLLaM π is Multi-lingual Malaysian Chat Language Model, 32k context length, Malaysian centric and private, in the future we will support longer context length and code interpreter, get your API key at https://app.nous.mesolitica.com/
API documentation at https://llm-router.nous.mesolitica.com/scalar#tag/default/post/chat/completions
Currently we only support Chat Completion.
MaLLaM π is compatible with OpenAI library for Python and Node JS.
from openai import OpenAI
client = OpenAI(
base_url="https://llm-router.nous.mesolitica.com",
)
completion = client.chat.completions.create(
model="mallam-small",
messages=[
{ "role": "system", "content": "You are a helpful assistant." },
{ "role": "user", "content": "Hello!" }
]
)
print(completion.choices[0].message)
ChatCompletionMessage(content='hello! Bagaimanakah saya boleh membantu anda hari ini?', role='assistant', function_call=None, tool_calls=None)
const OpenAI = require('openai');
const openai = new OpenAI({
baseURL: 'https://llm-router.nous.mesolitica.com',
});
async function main() {
const completion = await openai.chat.completions.create({
model: "mallam-small",
messages: [
{ "role": "system", "content": "Awak pembantu AI yang berguna." },
{ "role": "user", "content": "Hello!" }
],
});
console.log(completion.choices[0]);
}
main();
{
index: 0,
message: {
role: 'assistant',
content: 'hello! Saya di sini untuk memberikan maklumat dan menjawab sebarang soalan yang anda ada.'
},
logprobs: null,
finish_reason: 'stop'
}
curl -X 'POST' \
'https://llm-router.nous.mesolitica.com/chat/completions' \
-H 'accept: application/json' \
-H 'Content-Type: application/json' \
-H 'Authorization: Bearer api_key' \
-d '{
"model": "mallam-small",
"temperature": 0.9,
"top_p": 0.95,
"top_k": 50,
"max_tokens": 1024,
"messages": [
{
"role": "system",
"content": "Awak pembantu AI yang berguna."
},
{
"role": "user",
"content": "Hello!"
}
],
"tools": [],
"stream": false
}'
{"id":"cmpl-2def863689fa4502bc7d554a687d1f8c","object":"chat.completion","created":1570278,"model":"mallam-small","choices":[{"index":0,"message":{"role":"assistant","content":"helo! Bagaimana saya boleh membantu anda hari ini?"},"logprobs":null,"finish_reason":"stop"}],"usage":{"prompt_tokens":25,"total_tokens":48,"completion_tokens":23}}
We covered RAG, JSON prompts and so much more.
Originally from https://huggingface.co/datasets/NousResearch/json-mode-eval, this test is to test how good the models able to convert human natural text into JSON output given the OpenAPI schema.
Speech is End-to-End streamable Malaysian Speech-to-Text and Speech Translation with Speaker Diarization, get your API key at https://app.nous.mesolitica.com/
API documentation at https://llm-router.nous.mesolitica.com/scalar#tag/default/post/audio/transcriptions
If you are interested to self-host Nous in your virtual private network, Contact us at khalil@mesolitica.com or husein@mesolitica.com to know more.
- βΎοΈ usage of all quota, MaLLaM π, Speech, Translation and chatbots.
- Up-to-date enterprise versioning including evolution of MaLLaM π, Speech, Translation and chatbots.
- Can be either on private cloud or on premise, Dashboard and all the APIs will be hosted using virtual private IP.
- If you do not have hardware accelerator, we partner with NVIDIA APAC to include hardware solution with support.
- Bring your own hardware accelerator, we do not provide support.
We provide quarterly and yearly licensing, and yearly licencing is much more cheaper in the long term, include support.