Issues
- 0
Dynamic Batch Inference
#20 opened by jstzwj - 0
Implementation of API authentication and logging
#17 opened by jstzwj - 1
support logprobs parameter
#12 opened by jstzwj - 2
support chatglm2?
#14 opened by yuanjie-ai - 0
Document for langport
#13 opened by jstzwj - 0
- 0
Redesign Timer & Event Loop
#5 opened by FrostMiKu - 1
Refactor the match method of the adapter
#3 opened by FrostMiKu - 0
- 0
Test Huggingface Text Generation APIs
#2 opened by jstzwj - 0
HTTP/2 and HTTP/3 support
#1 opened by jstzwj