kherud/grpc-llama.cpp

A gRPC server for llama.cpp - A Port of Facebook's LLaMA model in C/C++

C++