shiny-red-apple

shiny-red-apple's Stars

• v-iashin/video_features

  Extract video features from raw videos using multiple GPUs. We support RAFT flow frames as well as S3D, I3D, R(2+1)D, VGGish, CLIP, and TIMM models.

  Language:Python50996

• v-iashin/BMT

  Source code for "Bi-modal Transformer for Dense Video Captioning" (BMVC 2020)

  Language:Jupyter Notebook22557

• BradyFU/Awesome-Multimodal-Large-Language-Models

  :sparkles::sparkles:Latest Advances on Multimodal Large Language Models

  12.2k779

• lucidrains/MaMMUT-pytorch

  Implementation of MaMMUT, a simple vision-encoder text-decoder architecture for multimodal tasks from Google, in Pytorch

  Language:Python974

• rowanz/merlot_reserve

  Code release for "MERLOT Reserve: Neural Script Knowledge through Vision and Language and Sound"

  Language:Python13732

• zhengzangw/awesome-huge-models

  A collection of AWESOME things about HUGE AI models.

  29523

• dhansmair/flamingo-mini

  Implementation of the deepmind Flamingo vision-language model, based on Hugging Face language models and ready for training

  Language:Python16316

• lucidrains/flamingo-pytorch

  Implementation of 🦩 Flamingo, state-of-the-art few-shot visual question answering attention net out of Deepmind, in Pytorch

  Language:Python1.2k59

• rowanz/merlot

  MERLOT: Multimodal Neural Script Knowledge Models

  Language:Python22325

• KaiyangZhou/pytorch-vsumm-reinforce

  Unsupervised video summarization with deep reinforcement learning (AAAI'18)

  Language:Python471150

• m-bain/frozen-in-time

  Frozen in Time: A Joint Video and Image Encoder for End-to-End Retrieval [ICCV'21]

  Language:Python34544

• e-apostolidis/PGL-SUM

  A PyTorch Implementation of PGL-SUM from "Combining Global and Local Attention with Positional Encoding for Video Summarization" (IEEE ISM 2021)

  Language:Python8432

• ok1zjf/VASNet

  PyTorch implementation of the ACCV 2018-AIU2018 paper Video Summarization with Attention

  Language:Python18047

• semchan/Uformer

  A PyTorch implementation of our paper Video summarization with u-shaped transformer. Published in Applied Intelligence.

  Language:Python71

• e-apostolidis/AC-SUM-GAN

  A PyTorch Implementation of AC-SUM-GAN from "AC-SUM-GAN: Connecting Actor-Critic and Generative Adversarial Networks for Unsupervised Video Summarization" (IEEE TCSVT 2021)

  Language:Python2910

• medhini/clip_it

  CLIP-It! Language-Guided Video Summarization

  731

• hong8e/KoROUGE

  Calculating ROUGE score for Korean (Wrapper for ROUGE-1.5.5.pl script)

  Language:Python91