siabar/worker-lorax

Lorax (Predibase) Endpoint | Serverless Worker

Example Input

{
    "input": {
        "inputs": "prompt",
        "parameters": {
            "max_new_tokens": 1000,
            "temperature": 1.0,
            "top_p": 0.99,
            "do_sample": false,
            "seed": 42
        }
    }
}