leexinhao

leexinhao's Stars

• OpenBMB/MiniCPM-V

  MiniCPM-V 2.6: A GPT-4V Level MLLM for Single Image, Multi Image and Video on Your Phone

  Language:Python13.1k107617914

• voxel51/fiftyone

  Refine high-quality datasets and visual AI models

  Language:Python9.3k651.6k608

• QwenLM/Qwen2-VL

  Qwen2-VL is the multimodal large language model series developed by Qwen team, Alibaba Cloud.

  Language:Python4.3k32510270

• LLaVA-VL/LLaVA-NeXT

  Language:Python3.6k35387334

• EvolvingLMMs-Lab/lmms-eval

  Accelerating the development of large multimodal models (LMMs) with one-click evaluation module - lmms-eval.

  Language:Python2.3k8286231

• yunlong10/Awesome-LLMs-for-Video-Understanding

  🔥🔥🔥Latest Papers, Codes and Datasets on Vid-LLMs.

  2.1k55797

• MeetKai/functionary

  Chat language model that can use tools and interpret the results

  Language:Python1.5k21131114

• rhymes-ai/Aria

  Codebase for Aria - an Open Multimodal Native MoE

  Language:Jupyter Notebook1k205286

• zhuzilin/ring-flash-attention

  Ring attention implementation with flash attention

  Language:Python717134360

• rese1f/MovieChat

  [CVPR 2024] MovieChat: From Dense Token to Sparse Memory for Long Video Understanding

  Language:Python604128542

• SHI-Labs/NATTEN

  Neighborhood Attention Extension. Bringing attention to a neighborhood near you!

  Language:Cuda4301113536

• showlab/videollm-online

  VideoLLM-online: Online Video Large Language Model for Streaming Video (CVPR 2024)

  Language:Python41685241

• pkunlp-icler/FastV

  [ECCV 2024 Oral] Code for paper: An Image is Worth 1/2 Tokens After Layer 2: Plug-and-Play Inference Acceleration for Large Vision-Language Models

  Language:Python39634215

• daixiangzi/Awesome-Token-Compress

  A paper list of some recent works about Token Compress for Vit and VLM

  38713820

• EvolvingLMMs-Lab/LongVA

  Long Context Transfer from Language to Vision

  Language:Python36873719

• VectorSpaceLab/Video-XL

  🔥🔥First-ever hour scale video understanding models

  Language:Python25853018

• kongds/E5-V

  E5-V: Universal Embeddings with Multimodal Large Language Models

  Language:Python2373228

• JUNJIE99/MLVU

  🔥🔥MLVU: Multi-task Long Video Understanding Benchmark

  Language:Python1874110

• IVGSZ/Flash-VStream

  This is the official implementation of "Flash-VStream: Memory-Based Real-Time Understanding for Long Video Streams"

  Language:Python17333014

• MCG-NJU/AWT

  [NeurIPS 2024] AWT: Transferring Vision-Language Models via Augmentation, Weighting, and Transportation

  Language:Python95414

• egoschema/EgoSchema

  Language:Python861232

• Gumpest/SparseVLMs

  Official implementation of paper "SparseVLM: Visual Token Sparsification for Efficient Vision-Language Model Inference".

  Language:Python822167

• QQ-MM/Video-CCAM

  A lightweight flexible Video-MLLM developed by TencentQQ Multimedia Research Team.

  Language:Python684113

• KangarooGroup/Kangaroo

  official impelmentation of Kangaroo: A Powerful Video-Language Model Supporting Long-context Video Input

  Language:Python63380

• Beckschen/LLaVolta

  [NeurIPS 2024] Efficient Large Multi-modal Models via Visual Context Compression

  Language:Python52354

• fmthoker/SEVERE-BENCHMARK

  Language:Python26222

• MCG-NJU/ZeroI2V

  [ECCV 2024] ZeroI2V: Zero-Cost Adaptation of Pre-trained Transformers from Image to Video

  Language:Python20101

• MCG-NJU/VideoEval

  VideoEval: Comprehensive Benchmark Suite for Low-Cost Evaluation of Video Foundation Model

  Language:Python10100

• XingruiWang/SuperCLEVR-Physics

  A video question answering dataset that focuses on the dynamics properties of objects (velocity, acceleration) and their collisions within 4D scenes.

  Language:Python8100

• leexinhao/VideoEval

  A vision-centric evaluation method for video foundation models that is comprehensive, challenging, indicative, and low-cost.

  Language:Python31