jfliang3324

jfliang3324's Stars

• LLaVA-VL/LLaVA-NeXT

  Language:Python2.3k155

• Yxxxb/VoCo-LLaMA

  VoCo-LLaMA: This repo is the official implementation of "VoCo-LLaMA: Towards Vision Compression with Large Language Models".

  Language:Python714

• IVGSZ/Flash-VStream

  This is the official implementation of "Flash-VStream: Memory-Based Real-Time Understanding for Long Video Streams"

  Language:Python995

• showlab/videollm-online

  VideoLLM-online: Online Video Large Language Model for Streaming Video (CVPR 2024)

  Language:Python16323

• farewellthree/BT-Adapter

  [CVPR 2024] Official PyTorch implementation of the paper "One For All: Video Conversation is Feasible Without Video Instruction Tuning"

  Language:Python23

• jfliang3324/GUIDE

  Language:Python4

• Becomebright/GroundVQA

  Official PyTorch code of "Grounded Question-Answering in Long Egocentric Videos", accepted by CVPR 2024.

  Language:Python491

• flow-diffusion/AVDC

  Official repository of Learning to Act from Actionless Videos through Dense Correspondences.

  Language:Python15712

• fpv-iplab/EASG

  Action Scene Graphs for Long-Form Understanding of Egocentric Videos (CVPR 2024)

  Language:Jupyter Notebook24

• cvlab-columbia/viper

  Code for the paper "ViperGPT: Visual Inference via Python Execution for Reasoning"

  Language:Jupyter Notebook1.6k117

• melonking32/PETAL

  Language:Python10

• Coobiw/MPP-LLaVA

  Personal Project: MPP-Qwen14B & MPP-Qwen-Next(Multimodal Pipeline Parallel based on Qwen-LM). Support [video/image/multi-image] {sft/conversations}. Don't let the poverty limit your imagination! Train your own 8B/14B LLaVA-training-like MLLM on RTX3090/4090 24GB.

  Language:Jupyter Notebook34719

• luogen1996/LaVIN

  [NeurIPS 2023] Official implementations of "Cheap and Quick: Efficient Vision-Language Instruction Tuning for Large Language Models"

  Language:Python49936

• VPGTrans/VPGTrans

  Codes for VPGTrans: Transfer Visual Prompt Generator across LLMs. VL-LLaMA, VL-Vicuna.

  Language:Python26725

• PKU-YuanGroup/Video-LLaVA

  Video-LLaVA: Learning United Visual Representation by Alignment Before Projection

  Language:Python2.8k202

• lucidrains/CoCa-pytorch

  Implementation of CoCa, Contrastive Captioners are Image-Text Foundation Models, in Pytorch

  Language:Python1k88

• RenShuhuai-Andy/TESTA

  [EMNLP 2023] TESTA: Temporal-Spatial Token Aggregation for Long-form Video-Language Understanding

  Language:Python443

• mlfoundations/open_flamingo

  An open-source framework for training large multimodal models.

  Language:Python3.6k278

• Luodian/Otter

  🦦 Otter, a multi-modal model based on OpenFlamingo (open-sourced version of DeepMind's Flamingo), trained on MIMIC-IT and showcasing improved instruction-following and in-context learning ability.

  Language:Python3.5k242

• OpenGVLab/Ask-Anything

  [CVPR2024 Highlight][VideoChatGPT] ChatGPT with video understanding! And many more supported LMs such as miniGPT4, StableLM, and MOSS.

  Language:Python3k243

• amusi/ICCV2023-Papers-with-Code

  ICCV 2023 论文和开源项目合集

  2.5k248

• yangjianxin1/Firefly

  Firefly: 大模型训练工具，支持训练Qwen2、Yi1.5、Phi-3、Llama3、Gemma、MiniCPM、Yi、Deepseek、Orion、Xverse、Mixtral-8x7B、Zephyr、Mistral、Baichuan2、Llma2、Llama、Qwen、Baichuan、ChatGLM2、InternLM、Ziya2、Vicuna、Bloom等大模型

  Language:Python5.6k505

• google-research/scenic

  Scenic: A Jax Library for Computer Vision Research and Beyond

  Language:Python3.2k426

• Francis-Rings/ILA

  Language:Python303

• Yui010206/SeViLA

  [NeurIPS 2023] Self-Chained Image-Language Model for Video Localization and Question Answering

  Language:Python17521

• medhini/Instructional-Video-Summarization

  Code for paper, "TL;DW? Summarizing Instructional Videos with Task Relevance & Cross-Modal Saliency" ECCV 2022

  Language:Python342

• Vision-CAIR/MiniGPT-4

  Open-sourced codes for MiniGPT-4 and MiniGPT-v2 (https://minigpt-4.github.io, https://minigpt-v2.github.io/)

  Language:Python25.3k2.9k

• j-min/HiREST

  Hierarchical Video-Moment Retrieval and Step-Captioning (CVPR 2023)

  Language:Python888

• nishiwen1214/ChatReviewer

  ChatReviewer: 使用ChatGPT分析论文优缺点，提出改进建议

  Language:Python1.3k116

• openai/CLIP

  CLIP (Contrastive Language-Image Pretraining), Predict the most relevant text snippet given an image

  Language:Jupyter Notebook24.6k3.2k