sshh12/multi_token

OpenAI Client for Serving

Opened this issue · 1 comments

I'd love to update and merge an OpenAI compatible serving script for these models if possible

Hey! Happy to accept a PR. Not sure how OpenAI spec handles multimodal inputs but I'm open to it.