OpenGVLab

General Vision Team of Shanghai AI Laboratory

Pinned Repositories

Ask-Anything
[CVPR2024 Highlight][VideoChatGPT] ChatGPT with video understanding! And many more supported LMs such as miniGPT4, StableLM, and MOSS.
Language:Python3.3k 32 247268
DragGAN
Unofficial Implementation of DragGAN - "Drag Your GAN: Interactive Point-based Manipulation on the Generative Image Manifold" （DragGAN 全功能实现，在线Demo，本地部署试用，代码、模型已全部开源，支持Windows, macOS, Linux）
Language:Python5k 64 113489
InternGPT
InternGPT (iGPT) is an open source demo platform where you can easily showcase your AI models. Now it supports DragGAN, ChatGPT, ImageBind, multimodal chat like GPT-4, SAM, interactive image editing, etc. Try it at igpt.opengvlab.com (支持DragGAN、ChatGPT、ImageBind、SAM的在线Demo系统)
Language:Python3.2k 39 51232
InternImage
[CVPR 2023 Highlight] InternImage: Exploring Large-Scale Vision Foundation Models with Deformable Convolutions
Language:Python2.8k 33 274255
InternVideo
[ECCV2024] Video Foundation Models & Data for Multimodal Understanding
Language:Python2.1k 25 280131
InternVL
[CVPR 2024 Oral] InternVL Family: A Pioneering Open-Source Alternative to GPT-4o. 接近GPT-4o表现的开源多模态对话模型
Language:Python9.4k 65 1.1k732
LLaMA-Adapter
[ICLR 2024] Fine-tuning LLaMA to follow Instructions within 1 Hour and 1.2M Parameters
Language:Python5.9k 75 147383
OmniQuant
[ICLR2024 spotlight] OmniQuant is a simple and powerful quantization technique for LLMs.
Language:Python867 15 9170
VideoMamba
[ECCV2024] VideoMamba: State Space Model for Efficient Video Understanding
Language:Python1k 11 11284
VisionLLM
VisionLLM Series
Language:Python1.1k 39 2257

OpenGVLab's Repositories

OpenGVLab/InternVL
[CVPR 2024 Oral] InternVL Family: A Pioneering Open-Source Alternative to GPT-4o. 接近GPT-4o表现的开源多模态对话模型
Language:Python9.4k 65 1.1k732
OpenGVLab/InternVideo
[ECCV2024] Video Foundation Models & Data for Multimodal Understanding
Language:Python2.1k 25 280131
OpenGVLab/OmniQuant
[ICLR2024 spotlight] OmniQuant is a simple and powerful quantization technique for LLMs.
Language:Python867 15 9170
OpenGVLab/ScaleCUA
ScaleCUA is the open-sourced computer use agents that can operate on corss-platform environments (Windows, macOS, Ubuntu, Android).
Language:Python79445
OpenGVLab/VideoChat-Flash
VideoChat-Flash: Hierarchical Compression for Long-Context Video Modeling
Language:Python478 20 7214
OpenGVLab/OmniCorpus
[ICLR 2025 Spotlight] OmniCorpus: A Unified Multimodal Corpus of 10 Billion-Level Images Interleaved with Text
Language:Python401 12 116
OpenGVLab/PonderV2
[T-PAMI 2025] PonderV2: Pave the Way for 3D Foundation Model with A Universal Pre-training Paradigm
Language:Python363 19 309
OpenGVLab/EfficientQAT
[ACL 2025 Main] EfficientQAT: Efficient Quantization-Aware Training for Large Language Models
Language:Python308 5 2922
OpenGVLab/VideoChat-R1
[NIPS2025] VideoChat-R1 & R1.5: Enhancing Spatio-Temporal Perception and Reasoning via Reinforcement Fine-Tuning
Language:Python220 8 349
OpenGVLab/EgoVideo
[CVPR 2024 Champions][ICLR 2025] Solutions for EgoVis Chanllenges in CVPR 2024
Language:Jupyter Notebook131 1 204
OpenGVLab/GUI-Odyssey
[ICCV 2025] GUIOdyssey is a comprehensive dataset for training and evaluating cross-app navigation agents. GUIOdyssey consists of 8,834 episodes from 6 mobile devices, spanning 6 types of cross-app tasks, 212 apps, and 1.4K app combos.
Language:Python131 3 188
OpenGVLab/PIIP
[NeurIPS 2024 Spotlight ⭐️ & TPAMI 2025] Parameter-Inverted Image Pyramid Networks (PIIP)
Language:Python105 6 55
OpenGVLab/ZeroGUI
ZeroGUI: Automating Online GUI Learning at Zero Human Cost
Language:Python1006
OpenGVLab/Mono-InternVL
[CVPR 2025] Mono-InternVL: Pushing the Boundaries of Monolithic Multimodal Large Language Models with Endogenous Visual Pre-training
Language:Python91 2 80
OpenGVLab/VeBrain
Visual Embodied Brain: Let Multimodal Large Language Models See, Think, and Control in Spaces
85 2 47
OpenGVLab/NaViL
Language:Python837
OpenGVLab/MUTR
「AAAI 2024」 Referred by Multi-Modality: A Unified Temporal Transformers for Video Object Segmentation
Language:Python82 2 87
OpenGVLab/EgoExoLearn
[CVPR 2024] Data and benchmark code for the EgoExoLearn dataset
Language:Python70 1 102
OpenGVLab/SDLM
Sequential Diffusion Language Model (SDLM) enhances pre-trained autoregressive language models by adaptively determining generation length and maintaining KV-cache compatibility, achieving high efficiency and throughput.
Language:Python681
OpenGVLab/LORIS
[ICML2023] Long-Term Rhythmic Video Soundtracker
Language:Python60 5 71
OpenGVLab/TPO
Task Preference Optimization: Improving Multimodal Large Language Models with Vision Task Alignment
Language:Jupyter Notebook60 1 31
OpenGVLab/PVC
[CVPR 2025] PVC: Progressive Visual Token Compression for Unified Image and Video Processing in Large Vision-Language Models
Language:Python50 0 41
OpenGVLab/GenExam
GenExam: A Multidisciplinary Text-to-Image Exam
Language:Python39 2 03
OpenGVLab/MetaCaptioner
Language:Python383
OpenGVLab/Docopilot
[CVPR 2025] Docopilot: Improving Multimodal Models for Document-Level Understanding
Language:Python35 1 41
OpenGVLab/FluxViT
Make Your Training Flexible: Towards Deployment-Efficient Video Models
Language:Python33 2 10
OpenGVLab/Vlaser
Vlaser: Vision-Language-Action Model with Synergistic Embodied Reasoning
Language:Python26
OpenGVLab/VRBench
[ICCV 2025] A Benchmark for Multi-Step Reasoning in Long Narrative Videos
Language:Python21 1 10
OpenGVLab/SID-VLN
Official implementation of: Learning Goal-Oriented Language-Guided Navigation with Self-Improving Demonstrations at Scale
Language:Python81
OpenGVLab/ExpVid
6