bpiyush

bpiyush's Stars

• meta-llama/llama-recipes

  Scripts for fine-tuning Meta Llama with composable FSDP & PEFT methods to cover single/multi-node GPUs. Supports default & custom datasets for applications such as summarization and Q&A. Supporting a number of candid inference solutions such as HF TGI, VLLM for local or cloud deployment. Demo apps to showcase Meta Llama for WhatsApp & Messenger.

  Language:Jupyter Notebook15.3k1943802.2k

• salesforce/LAVIS

  LAVIS - A One-stop Library for Language-Vision Intelligence

  Language:Jupyter Notebook10k99667974

• cambrian-mllm/cambrian

  Cambrian-1 is a family of multimodal LLMs with a vision-centric design.

  Language:Python1.8k2169115

• google-gemini/generative-ai-python

  The official Python library for the Google Gemini API

  Language:Python1.6k32279321

• facebookresearch/TimeSformer

  The official pytorch implementation of our paper "Is Space-Time Attention All You Need for Video Understanding?"

  Language:Python1.6k27129212

• FoundationVision/LlamaGen

  Autoregressive Model Beats Diffusion: 🦙 Llama for Scalable Image Generation

  Language:Python1.3k216655

• DAMO-NLP-SG/VideoLLaMA2

  VideoLLaMA 2: Advancing Spatial-Temporal Modeling and Audio Understanding in Video-LLMs

  Language:Python9001010360

• rhymes-ai/Aria

  Codebase for Aria - an Open Multimodal Native MoE

  Language:Jupyter Notebook845183070

• PKU-YuanGroup/LanguageBind

  【ICLR 2024🔥】 Extending Video-Language Pretraining to N-modality by Language-based Semantic Alignment

  Language:Python729156352

• ylsung/Ladder-Side-Tuning

  PyTorch codes for "LST: Ladder Side-Tuning for Parameter and Memory Efficient Transfer Learning"

  Language:Python23211110

• ziqipang/LM4VisualEncoding

  [ICLR 2024 (Spotlight)] "Frozen Transformers in Language Models are Effective Visual Encoder Layers"

  Language:Python225497

• zhangfaen/finetune-Qwen2-VL

  Language:Jupyter Notebook20821920

• reka-ai/reka-vibe-eval

  Multimodal language model benchmark, featuring challenging examples

  Language:Python1491646

• joaanna/something_else

  Code repository for the paper: 'Something-Else: Compositional Action Recognition with Spatial-Temporal Interaction Networks'

  Language:Python14662214

• epic-kitchens/epic-kitchens-100-annotations

  :plate_with_cutlery: Annotations for the public release of the EPIC-KITCHENS-100 dataset

  Language:Python133153428

• see2sound/see2sound

  Official code for SEE-2-SOUND: Zero-Shot Spatial Environment-to-Spatial Sound

  Language:Python116549

• yukw777/VideoBLIP

  Supercharged BLIP-2 that can handle videos

  Language:Python116376

• dylran/crowddiff

  Language:Python10243112

• NeeluMadan/ViFM_Survey

  Foundation Models for Video Understanding: A Survey

  97103

• songrise/CLIP-Count

  [ACM MM23] CLIP-Count: Towards Text-Guided Zero-Shot Object Counting

  Language:Python927168

• wenhuchen/Time-Sensitive-QA

  Code and Data for NeurIPS2021 Paper "A Dataset for Answering Time-Sensitive Questions"

  Language:Jupyter Notebook63376

• park-jungin/DualPath

  Language:Jupyter Notebook47252

• ninatu/howtocaption

  Official implementation of "HowToCaption: Prompting LLMs to Transform Video Annotations at Scale." ECCV 2024

  Language:Python45510

• Yiming-M/CLIP-EBC

  The official implementation of the crowd counting model CLIP-EBC.

  Language:Jupyter Notebook454218

• alibaba-mmai-research/DiST

  ICCV2023: Disentangling Spatial and Temporal Learning for Efficient Image-to-Video Transfer Learning

  Language:Python39251

• wlin-at/MAXI

  MAtch, eXpand and Improve: Unsupervised Finetuning for Zero-Shot Action Recognition with Language Knowledge (ICCV 2023)

  Language:Python27363

• leexinhao/ZeroI2V

  Official implementation of "ZeroI2V: Zero-Cost Adaptation of Pre-trained Transformers from Image to Video" (ECCV2024)

  Language:Python18370

• zhaochen0110/Timo

  Code and data for "Timo: Towards Better Temporal Reasoning for Language Models" (COLM 2024)

  Language:Python18111

• eisneim/clip-vip_video_search

  showing how to use CLIP-Vip to do video search

  Language:Python13102

• Pshubham1012/Classification-approach

  Language:Python1