icppWorld/icpp_llm

../out/model260k.bin -z ..\out\tok512.bin

Closed this issue · 1 comments

twobob commented

do it. ;)

Not really an issue but CMON. begging for it.

icppWorld commented

@twobob ,

I implemented it, and described here in the icpp_llama2/README how you can deploy stories260K.bin with the tok512.bin tokenizer.

Let me know how it works for you.