microsoft/LLaVA-Med

Issues

• ValueError: weight is on the meta device, we need a `value` to put in on 0.

  #97 opened 3 months ago by Draculair
  1

• How to get "pretrain_mm_mlp_adapter" weights, which are aligned on medical concepts?

  #56 opened 9 months ago by nourheshamshaheen
  2

• What is the prompt of doing multi-choice questions?

  #96 opened 3 months ago by zzzzxciid
  0

• KeyError: 'llava_mistral'

  #95 opened 3 months ago by Draculair
  0

• ValueError: weight is on the meta device, we need a `value` to put in on 0.

  #94 opened 3 months ago by Mike-ihr
  0

• NETWORK ERROR DUE TO HIGH TRAFFIC. PLEASE REGENERATE OR REFRESH THIS PAGE.

  #92 opened 4 months ago by quansui398
  1

• base model for llava-med-v1.5-mistral-7b

  #93 opened 4 months ago by cdxeve
  0

• where is pubmed_600k.json?

  #68 opened 8 months ago by james20141606
  2

• Can't we train and fine tune the Llavamed model

  #87 opened 5 months ago by liucheny
  9

• Why only Gradio?

  #90 opened 4 months ago by jogihood
  0

• Excuse me, I deployed LLaVA-med locally, why is my answer only one word?

  #86 opened 4 months ago by ZG-yuan
  2

• biomedical concept alignment data

  #85 opened 5 months ago by hddbang
  1

• Question about the collection of "Instruction-following data"

  #57 opened 9 months ago by CinKKKyo
  2

• Problem when downloading PMC articals.

  #60 opened 9 months ago by Kingofolk
  1

• training hyperparameters of llava-med 1.5

  #88 opened 5 months ago by alyakin314
  0

• please add huggingface integration

  #62 opened 9 months ago by dirtycomputer
  3

• Trainable parameters during finetuning for medical VQA

  #81 opened 6 months ago by DopamineLcy
  1

• How to start a model worker using multiple GPUs？And where is the "--num-gpus"?

  #82 opened 6 months ago by WZA-GH
  1

• How can I train this model?

  #84 opened 5 months ago by LCR2001
  1

• How to use llava-v1.6-mistral-7b training

  #72 opened 8 months ago by xuzhaoyang-svg
  3

• Applying for link to image zip

  #71 opened 7 months ago by BUAADreamer
  3

• How to download the images?

  #79 opened 7 months ago by zihui-debug
  10

• About "image.zip" download

  #83 opened 5 months ago by NyKxo1
  0

• How to load LLaVA-Med by LlavaForConditionalGeneration?

  #50 opened 10 months ago by WenxiongLiao
  1

• How were conversation metrics calculated in the new Benchmark tests with LLaVA 1.5?

  #80 opened 6 months ago by NicoZenith
  0

• The "llava/data/download_images.py" file is lost?

  #78 opened 7 months ago by BoyCO3
  2

• About the four delta checkpoints

  #66 opened 7 months ago by MandyChaseHappy
  0

• CLIPVisionTower'object has no attribute 'device'

  #75 opened 7 months ago by 2927803072
  0

• Scripts for evaluations on biomed tasks

  #74 opened 7 months ago by rthapa84
  0

• Results of MMBench-dev

  #73 opened 8 months ago by Yanllan
  0

• the bug in /llava/serve/gradio_patch.py

  #46 opened a year ago by pqpq17
  3

• question about the --version parameter

  #69 opened 8 months ago by Yanllan
  2

• Regarding the training speed for Medical Visual Instruction Tuning.

  #70 opened 8 months ago by xxxstrygs33
  0

• RuntimeError: probability tensor contains either inf, nan or element < 0

  #44 opened a year ago by yihp
  9

• support llama 2 llama1 EOL

  #67 opened 8 months ago by idan-tankel
  0

• How to run VQA inference on a single image?

  #59 opened 9 months ago by Raman1121
  2

• Possible Access to LlaVa-Med using BioMed CLIP?

  #65 opened 8 months ago by tj-zhu
  0

• when use "microsoft/BiomedCLIP-PubMedBERT_256-vit_base_patch16_224" , shape mismatch error

  #51 opened 9 months ago by jzssz
  1

• llava/eval/model_vqa.py results incorrectly during inference

  #64 opened 8 months ago by veinhao
  0

• Evaluation command -- Parameter file path

  #63 opened 9 months ago by hylq66
  0

• 如何进行多机多卡训练？

  #61 opened 9 months ago by pengjianqiang
  0

• Response in messy encoding for RAD-VQA evaluation

  #53 opened 9 months ago by YatingPan
  2

• Missing Archive: PMC7236913.tar.gz Not Found on HTTP Server

  #58 opened 9 months ago by tsungjung411
  0

• 使用biomed-clip的llava-med在预训练阶段有用到一般llava使用的web图像-文本对吗？还是只用医学图像-文本预训练

  #55 opened 9 months ago by Yang-bug-star
  0

• Error no file named pytorch_model.bin, tf_model.h5, model.ckpt.index or flax_model.msgpack found in directory

  #45 opened a year ago by narminGhaffari
  2

• What and where is the Loss function used in LLAVA-MED

  #54 opened 9 months ago by peterphancong
  0

• Where we can get the data used in the first stage of training like pubmed_600k.json?

  #52 opened 9 months ago by mao1207
  0

• Instruct image loss

  #48 opened 10 months ago by laihaoran
  1

• Where can I download the pre-train weights?

  #49 opened 10 months ago by YangQiuEric
  0

• one question about the image data

  #47 opened a year ago by constnoexcept
  1