kherud/java-llama.cpp

Json request like role system or role user isn't support?

Opened this issue · 2 comments

yousefabdel1727 commented

How i can use json as normal server?

yousefabdel1727 commented

\nllama: and \nuser isn't useful with a lot of models, i want get normal response like server and request also like normal server by json?

vaiju1981 commented

I added initial support for the messages in the rerank pr (#96).