multimodal-datasets
There are 18 repositories under multimodal-datasets topic.
salesforce/LAVIS
LAVIS - A One-stop Library for Language-Vision Intelligence
drmuskangarg/Multimodal-datasets
This repository is build in association with our position paper on "Multimodality for NLP-Centered Applications: Resources, Advances and Frontiers". As a part of this release we share the information about recent multimodal datasets which are available for research purposes. We found that although 100+ multimodal language resources are available in literature for various NLP tasks, still publicly available multimodal datasets are under-explored for its re-usage in subsequent problem domains.
AnkurDeria/MFT
Pytorch implementation of Multimodal Fusion Transformer for Remote Sensing Image Classification.
yuanxiaosc/Multimodal-short-video-dataset-and-baseline-classification-model
500,000 multimodal short video data and baseline models. 50万条多模态短视频数据集和基线模型（TensorFlow2.0）。
wisdomikezogwo/quilt1m
[NeurIPS 2023 Oral] Quilt-1M: One Million Image-Text Pairs for Histopathology.
remyxai/VQASynth
Compose multimodal datasets 🎹
marslanm/Multimodality-Representation-Learning
This repository provides a comprehensive collection of research papers focused on multimodal representation learning, all of which have been cited and discussed in the survey just accepted https://dl.acm.org/doi/abs/10.1145/3617833 .
ImKeTT/Awesome-Multi-Modal-Dialog
[Paperlist] Awesome paper list of multimodal dialog, including methods, datasets and metrics
piresramon/gpt-4-enem
Code and data to evaluate LLMs on the ENEM, the main standardized Brazilian university admission exams.
JunweiLiang/FVTA_MemexQA
Real-world photo sequence question answering system (MemexQA). CVPR'18 and TPAMI'19
OlehOnyshchak/pyWikiMM
Collects a multimodal dataset of Wikipedia articles and their images
lujiaying/MUG-Bench
Data and code of the Findings of EMNLP'23 paper MuG: A Multimodal Classification Benchmark on Game Data with Tabular, Textual, and Visual Fields
gcunhase/AnnotatedMV-PreProcessing
Pre-Processing of Annotated Music Video Corpora (COGNIMUSE and DEAP)
celestialxevermore/CLIP2AE
AI-multimodal : Modeling the new text - video retrieval framework
clp-research/language-models-multimodal-tasks
Official Git repository for "Hakimov, S., and Schlangen, D., (2023). Images in Language Space: Exploring the Suitability of Large Language Models for Vision & Language Tasks. Findings of the Association for Computational Linguistics (ACL 2023 Findings)"
Damorgal/Multimodal-Research-experiments
All experiments were done to classify multimodal data.
GeorgeTouros/video-soundtrack-evaluation
Create a large, well-managed and clean data-set for the task of music composition for video soundtracks.
OlehOnyshchak/WikiImageRecommendation
Image Recommendation for Wikipedia Articles