Issues
- 0
Some weights were not used after GPTQ quantization
#416 opened by chongkuiqi - 1
code of visual embedding adapter?
#336 opened by MartinYYYYan - 3
vllm和hf推理的结果差异较大
#481 opened by yangte3518880 - 1
量化模型GPTQ推理速度慢
#483 opened by thuBingo - 2
Bug in beam_search: memory allocation
#334 opened by greeksharifa - 2
missing dependency
#480 opened by jpcam - 1
7b-awq模型在A10上使用VLLM镜像部署,显存总是oom。
#482 opened by ZhanNicky - 0
High training loss when using M-ROPE
#406 opened by Wiselnn570 - 0
[Qwen2-VL SFT training implemention ! ] Qwen2-VL has been implemented in PaddleMIX, welcome to use it !
#479 opened by nemonameless - 2
请问Qwen2-VL支持多轮对话微调吗?
#417 opened by lcs0215 - 0
AWQ output result is incorrect, return [the .]
#478 opened by lxiaoxiaoxing - 0
Why Qwen2-VL do not release Qwen2-VL (pretrain model), but Qwen-VL release that one(Qwen-VL + Qwen-VL-Char)?
#477 opened by CarlHuangNuc - 0
Birthday wishes in marathi
#426 opened by brahmamudi-serial-today-episode - 2
使用AutoGPTQ量化lora微调后的72b模型
#347 opened by ChinChyi - 6
按照要求安装transformers和vllm后使用vllm部署报错
#348 opened by xuyifan-0731 - 0
qwen2-Vl如何封装API,官网有提供吗 还是需要自己写fastAPI呢
#414 opened by ops-xin - 0
- 0
- 0
multi turn issue
#413 opened by codeMonkey-shin - 1
VQA Score support
#408 opened by Dratlan - 0
基于box提问效果较差,是prompt或者调用上有问题吗?请帮确认下
#411 opened by qinzhenyi1314 - 1
多轮对话模板
#404 opened by THU-Kingmin - 4
- 0
Where can I find the implementation of M-RoPE?
#409 opened by Backdrop9019 - 1
I use the key "fps" instead of "video_fps." ,but it still doesn't work !!!
#351 opened by jackhexiangyu12 - 0
How many samples in calibration dataset should i use when AWQ quantization ?
#407 opened by chongkuiqi - 0
moov atom not found
#405 opened by cuizhiling - 0
是否各个阶段的模型release (stage1,stage2)
#403 opened by CarlHuangNuc - 0
多模态大模型grounding/Detection的时候如何加入空的bbox
#394 opened by xingmimfl - 0
how about data release plan on stage2,stage3?
#353 opened by CarlHuangNuc - 0
refcoco系列指标无法对齐
#352 opened by 2018211801 - 0
Cannot call any model using api key
#349 opened by HumayounMustafa - 1
- 0
Qwen2VLForConditionalGeneration.from_pretrained 出现问题
#344 opened by ChinChyi - 0
vllm error
#345 opened by liulixin29 - 2
72b 模型对显卡的硬件要求说明
#340 opened by V-yw - 1
- 0
Can anyone confirm if this is how qwen2-vl prompting for grounding task with multiple bounding boxes?
#342 opened by 5thGenDev - 1
Does Qwen2-VL-72B-Instruct have text generation capabilities equivalent to Qwen2-72B-Instruct ?
#341 opened by Valdanitooooo - 0
请问当前支持的图像格式有哪些,svg格式是不是不支持?
#339 opened by yangxin60-tal - 5
vllm部署,在请求时报这个错误“TypeError: Unable to evaluate type annotation 'Required[Union[str, Iterable[ChatCompletionContentPartTextParam]]]'.”
#338 opened by liukun2007 - 0
vllm离线推理正常,在线推理利用官方格式报错400
#337 opened by BIAO-ac - 0
how to run 7B BF16 in A10(24G)?
#335 opened by MultiChen - 1
eval scripts
#309 opened by mfarre - 0
- 0
请问下是否支持 qwen2-vl-72b 纯本文和图片指令数据的混合微调?
#332 opened by Luccadoremi - 0
[Typo]For quantized models, we offer two types of quantization: AWQ and GPQ(🤗🤖).
#331 opened by PaulWongDlut - 0
When I upload more than one image at the same time, the VLLM server reports the following error.
#308 opened by Sushaokun - 0
OpenAI API server for macOS
#307 opened by ChristianWeyer - 0