/popuko

A pythonic programming languge for LLMs

Primary LanguagePython

popuko

A pythonic programming languge for LLMs

Key features

  • Async Execution
  • KV-cache