captioning
There are 81 repositories under captioning topic.
facebookresearch/mmf
A modular framework for vision & language multimodal research from Facebook AI Research (FAIR)
roboflow/maestro
streamline the fine-tuning process for multimodal models: PaliGemma 2, Florence-2, and Qwen2.5-VL
fpgaminer/joycaption
JoyCaption is an image captioning Visual Language Model (VLM) being built from the ground up as a free, open, and uncensored model for the community to use in training Diffusion models.
ltguo19/VSUA-Captioning
Code for "Aligning Linguistic Words and Visual Semantic Units for Image Captioning", ACM MM 2019
DavidHuji/CapDec
CapDec: SOTA Zero Shot Image Captioning Using CLIP and GPT2, EMNLP 2022 (findings)
Labbeti/aac-datasets
Audio Captioning datasets for PyTorch.
HaydenFaulkner/Tennis
A Tennis dataset and models for event detection & commentary generation
mitvis/vistext
VisText is a benchmark dataset for semantically rich chart captioning.
drethage/fully-convolutional-point-network
Fully-Convolutional Point Networks for Large-Scale Point Clouds
Chen-Yang-Liu/Awesome-RS-Temporal-VLM
Remote Sensing Temporal Vision-Language Models: A Comprehensive Survey
audio-captioning/clotho-dataset
Python code for handling the Clotho dataset.
Mauville/MedCLIP
Medical image captioning using OpenAI's CLIP
wangleihitcs/MedicalReportGeneration
A Base Tensorflow Project for Medical Report Generation
ParitoshParmar/MTL-AQA
What and How Well You Performed? A Multitask Learning Approach to Action Quality Assessment [CVPR 2019]
aimagelab/pacscore
[CVPR 2023 & IJCV 2025] Positive-Augmented Contrastive Learning for Image and Video Captioning Evaluation
TheShadow29/VidSitu
[CVPR21] Visual Semantic Role Labeling for Video Understanding (https://arxiv.org/abs/2104.00990)
42lux/CaptainCaption
A gradio based image captioning tool that uses the GPT-4-Vision API to generate detailed descriptions of images.
Labbeti/aac-metrics
Metrics for evaluating Automated Audio Captioning systems, designed for PyTorch.
lucidrains/AoA-pytorch
A Pytorch implementation of Attention on Attention module (both self and guided variants), for Visual Question Answering
DavidMChan/caption-by-committee
Using LLMs and pre-trained caption models for super-human performance on image captioning.
audio-captioning/dcase-2020-baseline
Audio captioning baseline system for DCASE 2020 challenge.
deepgram-devs/video-chat
Sample app to display live captioning to a WebRTC video session with the Deepgram API.
CurryYuan/X-Trans2Cap
[CVPR 2022] X-Trans2Cap: Cross-Modal Knowledge Transfer using Transformer for 3D Dense Captioning
aimagelab/camel
CaMEL: Mean Teacher Learning for Image Captioning. ICPR 2022
RyanLiut/awesome-diverse-captioning
Some papers about *diverse* image (a few videos) captioning
ebu/ebu-tt-live-toolkit
Toolkit for supporting the EBU-TT Live specification
elbayadm/PaperNotes
My notes on some Deep Learning papers
FeiElysia/awesome-zero-shot-captioning
A curated list of zero-shot captioning papers
AdrianHsu/S2VT-seq2seq-video-captioning-attention
S2VT (seq2seq) video captioning with bahdanau & luong attention implementation in Tensorflow
aimagelab/PMA-Net
With a Little Help from your own Past: Prototypical Memory Networks for Image Captioning. ICCV 2023
audio-captioning/caption-evaluation-tools
Tools for the evaluation of audio captioning.
hassanhub/R3Transformer
Official python implementation of R3-Transformer
rayandrew/indonesian-image-captioning
Indonesian Image Captioning using Attention-based Semantic Compositional Networks
ImKeTT/ZeroGen
[NLPCC'23] ZeroGen: Zero-shot Multimodal Controllable Text Generation with Multiple Oracles PyTorch Implementation
nssharmaofficial/reddit-hole
Automated reddit scraper and video creator