BradyFU/Video-MME

Issues

• raw evaluations for proprietary models

  #33 opened 24 days ago by orrzohar
  0

• Evaluation frame counts inconsistent

  #32 opened 2 months ago by my-other-github-account
  0

• add eval Molmo-7B-D-0924

  #31 opened 2 months ago by wuhongsheng
  0

• How can randomness be avoided?

  #30 opened 3 months ago by Lanbai-eleven
  0

• About the question template

  #29 opened 3 months ago by jdsannchao
  0

• GPT4o evaluation

  #20 opened 5 months ago by resi1ience
  4

• Some subtitles are missing

  #28 opened 3 months ago by Richar-Du
  2

• Validation set

  #27 opened 3 months ago by sanjayss34
  1

• What's the license of Video-MME?

  #25 opened 3 months ago by whwu95
  1

• Results of LLaVA-Next-video-7B

  #24 opened 3 months ago by farewellthree
  2

• Question about VideoMME' s certificated length

  #26 opened 3 months ago by EricLina
  0

• Aligning Question Count with eval_your_results.py

  #23 opened 4 months ago by JinhuiYE
  1

• where is the dataset

  #22 opened 4 months ago by Derek-Kun
  1

• Exact results number for Figure 3

  #21 opened 5 months ago by Ziyang412
  2

• Certificates of the videos

  #16 opened 5 months ago by Ciel127
  2

• how to evaluate gemini-1.5 pro

  #18 opened 5 months ago by royzhang12
  2

• Question about the evaluation script in the leaderboard

  #19 opened 5 months ago by Richar-Du
  2

• The settings of videollava when reproducing

  #13 opened 6 months ago by Kongyj
  5

• Fix leaderboard sorting by LLM parameters on project page

  #15 opened 5 months ago by maxbourke
  1

• How to use video-mme?

  #17 opened 5 months ago by OliverLeeXZ
  1

• A video is broken

  #14 opened 6 months ago by sunh-23
  1

• request for participating the leaderboard

  #12 opened 6 months ago by Share14
  0

• An open-source video understanding model that supports audio input

  #11 opened 6 months ago by AshOneN
  1

• InternVL-Eval

  #10 opened 6 months ago by BlueBlueFF
  1

• where is the question json file?

  #8 opened 6 months ago by mu-cai
  1

• About dataset download

  #9 opened 6 months ago by mary-0830
  1

• Updated results of VideoChat2 and some problems

  #7 opened 7 months ago by Andy1621
  1

• internvideo model result？

  #5 opened 7 months ago by BlueBlueFF
  1

• ❓[Question] How to acquire the subtitles of all videos?

  #6 opened 7 months ago by clownrat6
  1

• Great job! How can I participate in the leaderboard? Do we need open source code and weight?

  #1 opened 7 months ago by yjhdhr
  1

• Hi, How to evaluate image-vlm model on your video benchmark?

  #2 opened 7 months ago by dragen1860
  3

• Hi, excuse me, can you provide me a script for downloading youtube video/meta information? thank you!!

  #4 opened 7 months ago by whyang78
  2

• Several urls deprecated

  #3 opened 7 months ago by Lyken17
  1