visual-question-answering

There are 192 repositories under visual-question-answering topic.

  • salesforce/BLIP

    PyTorch code for BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generation

    Language:Jupyter Notebook5k33202660

  • OFA-Sys/OFA

    Official repository of OFA (ICML 2022). Paper: OFA: Unifying Architectures, Tasks, and Modalities Through a Simple Sequence-to-Sequence Learning Framework

    Language:Python2.4k21364248

  • peteanderson80/bottom-up-attention

    Bottom-up attention model for image captioning and VQA, based on Faster R-CNN and Visual Genome

    Language:Jupyter Notebook1.4k26118378

  • lucidrains/flamingo-pytorch

    Implementation of 🦩 Flamingo, state-of-the-art few-shot visual question answering attention net out of Deepmind, in Pytorch

    Language:Python1.2k211359

  • YehLi/xmodaler

    X-modaler is a versatile and high-performance codebase for cross-modal analytics(e.g., image captioning, video captioning, vision-language pre-training, visual question answering, visual commonsense reasoning, and cross-modal retrieval).

    Language:Python1k3662111

  • richard-peng-xia/awesome-multimodal-in-medical-imaging

    A collection of resources on applications of multi-modal learning in medical imaging.

    62118462

  • jnhwkim/ban-vqa

    Bilinear attention networks for visual question answering

    Language:Python5451445100

  • MILVLG/mcan-vqa

    Deep Modular Co-Attention Networks for Visual Question Answering

    Language:Python44863888

  • MMMU-Benchmark/MMMU

    This repo contains evaluation code for the paper "MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGI"

    Language:Python37744130

  • zjukg/KG-MM-Survey

    Knowledge Graphs Meet Multi-Modal Learning: A Comprehensive Survey

    3647019

  • davidmascharka/tbd-nets

    PyTorch implementation of "Transparency by Design: Closing the Gap Between Performance and Interpretability in Visual Reasoning"

    Language:Jupyter Notebook348151474

  • MILVLG/openvqa

    A lightweight, scalable, and general framework for visual question answering research

    Language:Python321122964

  • MILVLG/prophet

    Implementation of CVPR 2023 paper "Prompting Large Language Models with Answer Heuristics for Knowledge-based Visual Question Answering".

    Language:Python27134127

  • lupantech/MathVista

    MathVista: data, code, and evaluation for Mathematical Reasoning in Visual Contexts

    Language:Jupyter Notebook26162640

  • Cyanogenoid/pytorch-vqa

    Strong baseline for visual question answering

    Language:Python23992197

  • HanXinzi-AI/awesome-computer-vision-resources

    a collection of computer vision projects&tools. 计算机视觉方向项目和工具集合。

    2102029

  • qiantianwen/NuScenes-QA

    [AAAI 2024] NuScenes-QA: A Multi-modal Visual Question Answering Benchmark for Autonomous Driving Scenario.

    Language:Python16714101

  • markdtw/vqa-winner-cvprw-2017

    Pytorch implementation of winner from VQA Chllange Workshop in CVPR'17

    Language:Python16411738

  • MMStar-Benchmark/MMStar

    [NeurIPS 2024] This repo contains evaluation code for the paper "Are We on the Right Way for Evaluating Large Vision-Language Models"

    Language:Python1601105

  • antoyang/FrozenBiLM

    [NeurIPS 2022] Zero-Shot Video Question Answering via Frozen Bidirectional Language Models

    Language:Python15651523

  • Yushi-Hu/tifa

    TIFA: Accurate and Interpretable Text-to-Image Faithfulness Evaluation with Question Answering

    Language:Python1413129

  • zhegan27/VILLA

    Research Code for NeurIPS 2020 Spotlight paper "Large-Scale Adversarial Training for Vision-and-Language Representation Learning": UNITER adversarial training part

    Language:Python11981214
  • just-ask

    antoyang/just-ask

    [ICCV 2021 Oral + TPAMI] Just Ask: Learning to Answer Questions from Millions of Narrated Videos

    Language:Jupyter Notebook11851315

  • anisha2102/docvqa

    Document Visual Question Answering

    Language:Python11251525

  • sdc17/UPop

    [ICML 2023] UPop: Unified and Progressive Pruning for Compressing Vision-Language Transformers.

    Language:Python1015165

  • mesnico/RelationNetworks-CLEVR

    A pytorch implementation for "A simple neural network module for relational reasoning", working on the CLEVR dataset

    Language:Python877924

  • showlab/LOVA3

    (NeurIPS 2024) Learning to Visual Question Answering, Asking and Assessment

    Language:Python79402

  • mlvlab/Flipped-VQA

    Large Language Models are Temporal and Causal Reasoners for Video Question Answering (EMNLP 2023)

    Language:Python745239

  • Shivanshu-Gupta/Visual-Question-Answering

    CNN+LSTM, Attention based, and MUTAN-based models for Visual Question Answering

    Language:Python745619

  • violetteshev/bottom-up-features

    Bottom-up features extractor implemented in PyTorch.

    Language:Python7131819

  • allenai/aokvqa

    Official repository for the A-OKVQA dataset

    Language:Python685167

  • China-UK-ZSL/ZS-F-VQA

    [Paper][ISWC 2021] Zero-shot Visual Question Answering using Knowledge Graph

    Language:Python6731215

  • rentainhe/TRAR-VQA

    [ICCV 2021] Official implementation of the paper "TRAR: Routing the Attention Spans in Transformers for Visual Question Answering"

    Language:Python6631018

  • DenisDsh/VizWiz-VQA-PyTorch

    PyTorch VQA implementation that achieved top performances in the (ECCV18) VizWiz Grand Challenge: Answering Visual Questions from Blind People

    Language:Jupyter Notebook604219

  • ivonajdenkoska/multimodal-meta-learn

    Official code repository for "Meta Learning to Bridge Vision and Language Models for Multimodal Few-Shot Learning" (published at ICLR 2023).

    Language:Python57652
  • KVQA

    SKTBrain/KVQA

    Korean Visual Question Answering

    56345