video-understanding

There are 182 repositories under video-understanding topic.

open-mmlab/mmaction2
OpenMMLab's Next Generation Video Understanding Toolbox and Benchmark
Language:Python4k 43 1.3k1.2k
jinwchoi/awesome-action-recognition
A curated list of action recognition and related area resources
3.7k 207 9721
OpenGVLab/Ask-Anything
[CVPR2024 Highlight][VideoChatGPT] ChatGPT with video understanding! And many more supported LMs such as miniGPT4, StableLM, and MOSS.
Language:Python2.8k 37 171224
showlab/Awesome-Video-Diffusion
A curated list of recent diffusion models for video generation, editing, restoration, understanding, etc.
2.6k 119 15158
mit-han-lab/temporal-shift-module
[ICCV 2019] TSM: Temporal Shift Module for Efficient Video Understanding
Language:Python2k 42 219418
open-mmlab/mmaction
An open-source toolbox for action understanding based on PyTorch
Language:Python1.9k 41 197352
yjxiong/temporal-segment-networks
Code & Models for Temporal Segment Networks (TSN) in ECCV 2016
Language:Python1.5k 42 283479
PaddlePaddle/PaddleVideo
Awesome video understanding toolkits based on PaddlePaddle. It supports video data annotation tools, lightweight RGB and skeleton based action recognition model, practical applications for video tagging and sport action detection.
Language:Python1.4k 38 314373
MCG-NJU/VideoMAE
[NeurIPS 2022 Spotlight] VideoMAE: Masked Autoencoders are Data-Efficient Learners for Self-Supervised Video Pre-Training
Language:Python1.2k 16 118121
yjxiong/tsn-pytorch
Temporal Segment Networks (TSN) in PyTorch
Language:Python1.1k 28 133314
OpenGVLab/InternVideo
Video Foundation Models & Data for Multimodal Understanding
Language:Python1k 27 11970
TheShadow29/awesome-grounding
awesome grounding: A curated list of research papers in visual grounding
973 28 595
PKU-YuanGroup/Chat-UniVi
[CVPR 2024 Highlight🔥] Chat-UniVi: Unified Visual Representation Empowers Large Language Models with Image and Video Understanding
Language:Python665 7 4134
yjxiong/action-detection
temporal action detection with SSN
Language:Python641 30 116176
henghuiding/MeViS
[ICCV 2023] MeViS: A Large-scale Benchmark for Video Segmentation with Motion Expressions
Language:Python461 7 916
yoosan/video-understanding-dataset
A collection of recent video understanding datasets, under construction!
448 24 679
chihyaoma/Activity-Recognition-with-CNN-and-RNN
Temporal Segments LSTM and Temporal-Inception for Activity Recognition
Language:Lua439 26 29149
OpenGVLab/VideoMAEv2
[CVPR 2023] VideoMAE V2: Scaling Video Masked Autoencoders with Dual Masking
Language:Python430 6 4942
Vision-CAIR/MiniGPT4-video
Official code for MiniGPT4-video
Language:Python402 9 2642
MCG-NJU/TDN
[CVPR 2021] TDN: Temporal Difference Networks for Efficient Action Recognition
Language:Python362 10 7154
v-iashin/SpecVQGAN
Source code for "Taming Visually Guided Sound Generation" (Oral at the BMVC 2021)
Language:Jupyter Notebook323 8 3336
movienet/movienet-tools
Tools for movie and video research
Language:C++255 11 3829
JunweiLiang/Multiverse
Dataset, code and model for the CVPR'20 paper "The Garden of Forking Paths: Towards Multi-Future Trajectory Prediction". And for the ECCV'20 SimAug paper.
Language:Python251 10 4561
NVlabs/STEP
STEP: Spatio-Temporal Progressive Learning for Video Action Detection. CVPR'19 (Oral)
Language:Python246 19 2348
hustvl/TeViT
Temporally Efficient Vision Transformer for Video Instance Segmentation, CVPR 2022, Oral
Language:Python234 8 1217
rohitgirdhar/ActionVLAD
ActionVLAD for video action classification (CVPR 2017)
Language:Python218 12 3862
alibaba-mmai-research/TAdaConv
[ICLR 2022] TAda! Temporally-Adaptive Convolutions for Video Understanding. This codebase provides solutions for video classification, video representation learning and temporal detection.
Language:Python217 6 2329
rlleshi/phar
deep learning sex position classifier
Language:Python212 7 1523
whwu95/Cap4Video
【CVPR'2023 Highlight & TPAMI】Cap4Video: What Can Auxiliary Captions Do for Text-Video Retrieval?
Language:Python212 9 2816
whwu95/Text4Vis
【AAAI'2023 & IJCV】Transferring Vision-Language Models for Visual Recognition: A Classifier Perspective
Language:Python197 6 2115
wangheda/youtube-8m
The 2nd place Solution to the Youtube-8M Video Understanding Challenge by Team Monkeytyping (based on tensorflow)
Language:Python177 13 560
SoccerNet/sn-gamestate
SoccerNet Game State Reconstruction: End-to-End Athlete Tracking and Identification on a Minimap (CVPR24 - CVSports workshop)
Language:Python176 13 925
fabienbaradel/object_level_visual_reasoning
Pytorch Implementation of "Object level Visual Reasoning in Videos", F. Baradel, N. Neverova, C. Wolf, J. Mille, G. Mori , ECCV 2018
Language:Python173 15 820
chinancheng/awesome-activity-prediction
Paper list of activity prediction and related area
169 14 134
antoyang/TubeDETR
[CVPR 2022 Oral] TubeDETR: Spatio-Temporal Video Grounding with Transformers
Language:Python161 3 208
antoyang/VidChapters
[NeurIPS 2023 D&B] VidChapters-7M: Video Chapters at Scale
Language:Jupyter Notebook155 3 1715

video-understanding

open-mmlab/mmaction2

jinwchoi/awesome-action-recognition

OpenGVLab/Ask-Anything

showlab/Awesome-Video-Diffusion

mit-han-lab/temporal-shift-module

open-mmlab/mmaction

yjxiong/temporal-segment-networks

PaddlePaddle/PaddleVideo

MCG-NJU/VideoMAE

yjxiong/tsn-pytorch

OpenGVLab/InternVideo

TheShadow29/awesome-grounding

PKU-YuanGroup/Chat-UniVi

yjxiong/action-detection

henghuiding/MeViS

yoosan/video-understanding-dataset

chihyaoma/Activity-Recognition-with-CNN-and-RNN

OpenGVLab/VideoMAEv2

Vision-CAIR/MiniGPT4-video

MCG-NJU/TDN

v-iashin/SpecVQGAN

movienet/movienet-tools

JunweiLiang/Multiverse

NVlabs/STEP

hustvl/TeViT

rohitgirdhar/ActionVLAD

alibaba-mmai-research/TAdaConv

rlleshi/phar

whwu95/Cap4Video

whwu95/Text4Vis

wangheda/youtube-8m

SoccerNet/sn-gamestate

fabienbaradel/object_level_visual_reasoning

chinancheng/awesome-activity-prediction

antoyang/TubeDETR

antoyang/VidChapters