Maknee/minigpt4.cpp
Port of MiniGPT4 in C++ (4bit, 5bit, 6bit, 8bit, 16bit CPU inference with GGML)
C++MIT
Issues
- 3
Unable to use GPU acceleration
#21 opened by deadpipe - 2
gradio errors 'scale should be integer' and 'button object ha no attribute style'
#22 opened by FilRav - 2
how to tokennizer vicuna
#20 opened by beyondli - 2
How to accelerate inference?
#16 opened by dengtianbi - 2
Question: partly GPU inference?
#15 opened by mvsoom - 1
why the webui.py did not load minigpt4-7b.bin,just load the ggml ,direct launch the web
#19 opened by sigrace1111 - 1
MiniGPT-v2 support
#18 opened by balisujohn - 2
two questions
#17 opened by Amin456789 - 5
CMake build fails for Ubuntu 20.04.6 LTS
#14 opened by mvsoom - 2
- 2
Files uploaded to minigpt4-7b-ggml and minigpt4-13b-ggml HF repositories are the same
#9 opened by felladrin - 2
Generate a bin file in Linux.
#8 opened by Rui-Hu01 - 10
Error trying to load on windows
#2 opened by iHaagcom