multimodal-alignment
There are 4 repositories under multimodal-alignment topic.
Eurus-Holmes/MulT
[Reproduce] Code for the ACL2019 paper "Multimodal Transformer for Unaligned Multimodal Language Sequences".
marcomoldovan/multimodal-self-distillation
A generalized self-supervised training paradigm for unimodal and multimodal alignment and fusion.
vijay-jaisankar/multimodal-alignment
Multimodal alignment of images and point clouds on the Modelnet-40-C dataset
marcomoldovan/3d-attention-video-understanding
Using a 3D Nearby Self-Attention Transformer to leverage the spatiotemporal nature of video for representation learning.