CloudWalking0

CloudWalking0's Stars

• QwenLM/Qwen2-VL

  Qwen2-VL is the multimodal large language model series developed by Qwen team, Alibaba Cloud.

  Language:Python3.9k236

• OpenGVLab/InternVL

  [CVPR 2024 Oral] InternVL Family: A Pioneering Open-Source Alternative to GPT-4o. 接近GPT-4o表现的开源多模态对话模型

  Language:Python6.6k514

• QwenLM/Qwen2.5

  Qwen2.5 is the large language model series developed by Qwen team, Alibaba Cloud.

  Language:Shell11.3k685

• harvardnlp/annotated-transformer

  An annotated implementation of the Transformer paper.

  Language:Jupyter Notebook5.8k1.3k

• LLaVA-VL/LLaVA-NeXT

  Language:Python3.2k279

• dvlab-research/LLaMA-VID

  LLaMA-VID: An Image is Worth 2 Tokens in Large Language Models (ECCV 2024)

  Language:Python75246

• rese1f/MovieChat

  [CVPR 2024] MovieChat: From Dense Token to Sparse Memory for Long Video Understanding

  Language:Python55742

• RenShuhuai-Andy/TimeChat

  [CVPR 2024] TimeChat: A Time-sensitive Multimodal Large Language Model for Long Video Understanding

  Language:Python31729

• magic-research/PLLaVA

  Official repository for the paper PLLaVA

  Language:Python62245

• ziplab/LongVLM

  Language:Python756

• DAMO-NLP-SG/VideoLLaMA2

  VideoLLaMA 2: Advancing Spatial-Temporal Modeling and Audio Understanding in Video-LLMs

  Language:Python98265

• RupertLuo/Valley

  The official repository of "Video assistant towards large language model makes everything easy"

  Language:Python21414

• DAMO-NLP-SG/Video-LLaMA

  [EMNLP 2023 Demo] Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understanding

  Language:Python2.9k264

• mbzuai-oryx/Video-ChatGPT

  [ACL 2024 🔥] Video-ChatGPT is a video conversation model capable of generating meaningful conversation about videos. It combines the capabilities of LLMs with a pretrained visual encoder adapted for spatiotemporal video representation. We also introduce a rigorous 'Quantitative Evaluation Benchmarking' for video-based conversational models.

  Language:Python1.3k110

• lyuchenyang/Macaw-LLM

  Macaw-LLM: Multi-Modal Language Modeling with Image, Video, Audio, and Text Integration

  Language:Python1.6k128

• Luodian/Otter

  🦦 Otter, a multi-modal model based on OpenFlamingo (open-sourced version of DeepMind's Flamingo), trained on MIMIC-IT and showcasing improved instruction-following and in-context learning ability.

  Language:Python3.6k243

• PKU-YuanGroup/Video-LLaVA

  【EMNLP 2024🔥】Video-LLaVA: Learning United Visual Representation by Alignment Before Projection

  Language:Python3.1k219

• OpenGVLab/Ask-Anything

  [CVPR2024 Highlight][VideoChatGPT] ChatGPT with video understanding! And many more supported LMs such as miniGPT4, StableLM, and MOSS.

  Language:Python3.1k253

• yunlong10/Awesome-LLMs-for-Video-Understanding

  🔥🔥🔥Latest Papers, Codes and Datasets on Vid-LLMs.

  1.7k88

• showlab/Awesome-Unified-Multimodal-Models

  📖 This is a repository for organizing papers, codes and other resources related to unified multimodal models.

  29513

• omerbt/TokenFlow

  Official Pytorch Implementation for "TokenFlow: Consistent Diffusion Features for Consistent Video Editing" presenting "TokenFlow" (ICLR 2024)

  Language:Python1.6k138

• YBYBZhang/ControlVideo

  [ICLR 2024] Official pytorch implementation of "ControlVideo: Training-free Controllable Text-to-Video Generation"

  Language:Python79257

• duyguceylan/pix2video

  Code for the paper "Pix2Video: Video Editing using Image Diffusion"

  Language:Python675

• ChenyangQiQi/FateZero

  [ICCV 2023 Oral] "FateZero: Fusing Attentions for Zero-shot Text-based Video Editing"

  Language:Jupyter Notebook1.1k106

• Weifeng-Chen/control-a-video

  Official Implementation of "Control-A-Video: Controllable Text-to-Video Generation with Diffusion Models"

  Language:Python37827

• imhuay/Algorithm_Interview_Notes-Chinese-backups

  Language:Python19028

• QwenLM/Qwen

  The official repo of Qwen (通义千问) chat & pretrained large language model proposed by Alibaba Cloud.

  Language:Python15k1.2k

• WeThinkIn/Interview-for-Algorithm-Engineer

  【三年面试五年模拟】AI算法工程师面试秘籍。涵盖AIGC、传统深度学习、自动驾驶、机器学习、计算机视觉、自然语言处理、SLAM、具身智能、元宇宙、AGI等AI行业面试笔试经验与干货知识。

  936145

• THUDM/CogVideo

  text and image to video generation: CogVideoX (2024) and CogVideo (ICLR 2023)

  Language:Python10k940

• PixArt-alpha/PixArt-alpha

  PixArt-α: Fast Training of Diffusion Transformer for Photorealistic Text-to-Image Synthesis

  Language:Python2.9k182