/deepshard-tasks

task to optimize for tokens/sec inferencing for llama.

Primary LanguagePython

Watchers