microsoft/LLaVA-Med

Issues

• Applying for link to image zip

  #71 opened 13 days ago by BUAADreamer
  1

• How to download the images?

  #79 opened 14 days ago by zihui-debug
  0

• downloading datas is very low...

  #31 opened 2 months ago by zhoucz97
  16

• The "llava/data/download_images.py" file is lost?

  #78 opened 14 days ago by BoyCO3
  1

• About the four delta checkpoints

  #66 opened a month ago by MandyChaseHappy
  0

• Confusion about the accuracy of the model

  #28 opened 7 months ago by WindMarx
  13

• CLIPVisionTower'object has no attribute 'device'

  #75 opened a month ago by 2927803072
  0

• Scripts for evaluations on biomed tasks

  #74 opened a month ago by rthapa84
  0

• Results of MMBench-dev

  #73 opened a month ago by Yanllan
  0

• please add huggingface integration

  #62 opened 2 months ago by dirtycomputer
  1

• How to use llava-v1.6-mistral-7b training

  #72 opened a month ago by xuzhaoyang-svg
  0

• llama version

  #30 opened 5 months ago by zhoucz97
  5

• Candidate file?

  #26 opened 7 months ago by hellocym
  5

• the bug in /llava/serve/gradio_patch.py

  #46 opened 5 months ago by pqpq17
  3

• question about the --version parameter

  #69 opened 2 months ago by Yanllan
  2

• Regarding the training speed for Medical Visual Instruction Tuning.

  #70 opened 2 months ago by xxxstrygs33
  0

• where is pubmed_600k.json?

  #68 opened 2 months ago by james20141606
  0

• RuntimeError: probability tensor contains either inf, nan or element < 0

  #44 opened 5 months ago by yihp
  9

• support llama 2 llama1 EOL

  #67 opened 2 months ago by idan-tankel
  0

• How to run VQA inference on a single image?

  #59 opened 2 months ago by Raman1121
  2

• Possible Access to LlaVa-Med using BioMed CLIP?

  #65 opened 2 months ago by tj-zhu
  0

• when use "microsoft/BiomedCLIP-PubMedBERT_256-vit_base_patch16_224" , shape mismatch error

  #51 opened 3 months ago by jzssz
  1

• llava/eval/model_vqa.py results incorrectly during inference

  #64 opened 2 months ago by veinhao
  0

• Evaluation command -- Parameter file path

  #63 opened 2 months ago by hylq66
  0

• 如何进行多机多卡训练？

  #61 opened 2 months ago by pengjianqiang
  0

• Problem when downloading PMC articals.

  #60 opened 2 months ago by Kingofolk
  0

• NETWORK ERROR DUE TO HIGH TRAFFIC. PLEASE REGENERATE OR REFRESH THIS PAGE.

  #41 opened 5 months ago by yihp
  3

• Response in messy encoding for RAD-VQA evaluation

  #53 opened 3 months ago by YatingPan
  2

• Missing Archive: PMC7236913.tar.gz Not Found on HTTP Server

  #58 opened 3 months ago by tsungjung411
  0

• Question about the collection of "Instruction-following data"

  #57 opened 3 months ago by CinKKKyo
  0

• How to get "pretrain_mm_mlp_adapter" weights, which are aligned on medical concepts?

  #56 opened 3 months ago by nourheshamshaheen
  0

• 使用biomed-clip的llava-med在预训练阶段有用到一般llava使用的web图像-文本对吗？还是只用医学图像-文本预训练

  #55 opened 3 months ago by Yang-bug-star
  0

• Error no file named pytorch_model.bin, tf_model.h5, model.ckpt.index or flax_model.msgpack found in directory

  #45 opened 5 months ago by narminGhaffari
  2

• What and where is the Loss function used in LLAVA-MED

  #54 opened 3 months ago by peterphancong
  0

• Where we can get the data used in the first stage of training like pubmed_600k.json?

  #52 opened 3 months ago by mao1207
  0

• out of memory - even reduced the elements in the instruction following dataset to just one

  #43 opened 5 months ago by mao1207
  2

• How to load LLaVA-Med by LlavaForConditionalGeneration?

  #50 opened 3 months ago by WenxiongLiao
  0

• Instruct image loss

  #48 opened 4 months ago by laihaoran
  1

• Where can I download the pre-train weights?

  #49 opened 4 months ago by YangQiuEric
  0

• one question about the image data

  #47 opened 4 months ago by constnoexcept
  1

• Projector weight for model

  #34 opened 6 months ago by TrungQuocNguyen
  1

• Removing Dependency on "flash-attn" in a Deep Learning Project

  #42 opened 5 months ago by LiangXin1001
  2

• Evaluation images not in llava_med_image_urls.jsonl?

  #33 opened 6 months ago by remvanthull
  4

• The demo is not working, and the chat interface does not show up

  #27 opened 7 months ago by krishnaadithya
  30

• So...has anyone actually managed to get this running with results similar to the original paper?

  #36 opened 6 months ago by abhisuri97
  2

• confusion about the provided model download

  #25 opened 7 months ago by WindMarx
  10

• A sincere request for the annotation files

  #39 opened 6 months ago by WindMarx
  0

• A bug about saving model

  #32 opened 6 months ago by WindMarx
  2

• Is it possible to fine-tune for downstream task on a XEON CPU?

  #37 opened 6 months ago by tsantra
  0

• .

  #29 opened 7 months ago by abdinf
  0