distributed-llm

There are 1 repositories under distributed-llm topic.

  • distributed-llama

    b4rtaz/distributed-llama

    Connect home devices into a powerful cluster to accelerate LLM inference. More devices means faster inference.

    Language:C++2k3986140