owenliang/qwen-vllm

lora加载如何实现

nlp-learner opened this issue · 1 comments

nlp-learner commented

热插拔的lora加载如何实现，我看VLLM在加载lora时会有词表大小限制？

dengyingxu commented

vllm官方实现lora热拔插了