Pinned Repositories
batch-inference
Dynamic batching library for Deep Learning inference. Tutorials for LLM, GPT scenarios.
chunk-attention
ChatBot-GPT2
[Pytorch] A GPT2-ChatBot implemented by huggingface/transformers
YongHuangSJTU's Repositories
YongHuangSJTU/ChatBot-GPT2
[Pytorch] A GPT2-ChatBot implemented by huggingface/transformers