Prototype for LLM in Elixir.
Camel.get_accelerator
Heavily based on: https://github.com/Atome-FE/llama-node/
If available in Hex, the package can be installed
by adding camel
to your list of dependencies in mix.exs
:
def deps do
[
{:camel, "~> 0.1.0"}
]
end
Documentation can be generated with ExDoc and published on HexDocs. Once published, the docs can be found at https://hexdocs.pm/ellem.
This is a test for llama models. It is being developed as a prototype
Camel.new("./open_llama_3b-f16.bin") |> Camel.generate("Today is the best day to")