captioning
caption playground
Submodules:
git submodule add <repository_url> repositories/<repository_name>
cd repositories/<repository_name>
git checkout <commit_sha>
cd ../..
git commit -am "Add <repository_name> submodule at <commit_sha>"
InstructBlip:
https://github.com/salesforce/LAVIS/tree/main/projects/instructblip
Install:
git clone https://github.com/salesforce/LAVIS.git
cd LAVIS
pip install -e .vicuna 13B v1.1 (huggingface format):
aws s3 sync s3://mewtant-ai-models/llm/vicuna-13b-f79578f/ ./vicuna13b
配置vicuna:
cd ~/dev/LAVIS
nano lavis/configs/models/blip2/blip2_instruct_vicuna13b.yaml
# llm_model: "/home/ubuntu/dev/anucuiv-b31"demo:
cd ~/dev/LAVIS/projects/instructblip/
python run_demo.py