hila-chefer/Transformer-MM-Explainability
[ICCV 2021- Oral] Official PyTorch implementation for Generic Attention-model Explainability for Interpreting Bi-Modal and Encoder-Decoder Transformers, a novel method to visualize any Transformer-based network. Including examples for DETR, VQA.
Jupyter NotebookMIT
Issues
- 1
torch.nn.modules.module.ModuleAttributeError: 'ResidualAttentionBlock' object has no attribute 'attn_probs'
#39 opened by TongLi97 - 0
No negative word importance
#40 opened by Faiail - 0
- 8
Swin Transformer
#4 opened by KP-Zhang - 1
- 0
save_visual_results in visualBERT
#36 opened by guanhdrmq - 0
- 0
when trying to use the colab notebook for RN50 im getting AttributeError: 'ModifiedResNet' object has no attribute 'transformer'
#33 opened by jiheddachraoui - 0
self.attn_probs in ResidualAttentionBlock() causes problems - how to make explainability work with mlfoundations / open_clip model
#32 opened by tahirmiri - 1
- 1
- 4
- 1
Use non hacked models
#29 opened by josh-freeman - 1
Application to Sparse/Low-Rank Attention Matrices
#26 opened by FarzanT - 1
Question about the CLIP Demo
#24 opened by Hoyyyaard - 7
Request for vanilla example notebook
#2 opened by oliverdutton - 2
- 2
Problems with running it in Google colab
#21 opened by songhuadan - 1
Object detection/Segmentation Explainability
#19 opened by jaiswati - 1
- 2
- 1
- 2
- 1
In 6.2 LXMERT, report an error"requests.exceptions.MissingSchema: Invalid URL 'val2014COCO_val2014_000000092107.jpg': No schema supplied. "
#16 opened by Shuai-Lv - 2
- 11
CLIP ViT-B/16
#8 opened by sanjayss34 - 2
Questions about the Relavance Matrix
#12 opened by Paandaman - 2
Batching for CLIP Explainability
#11 opened by Alacarter - 2
Question about the visualization for VIT?
#9 opened by zhaoxin94 - 4
Questions about CLIP visualization.
#10 opened by tingxueronghua - 6
Question about Vit
#6 opened by scott870430 - 2
when trying to use the colab notebook for clip-vit/B16 im getting ModuleAttributeError: 'ResidualAttentionBlock' object has no attribute 'attn_probs'
#5 opened by DanJbk - 4
COCO 2014 or 2017?
#7 opened by anguyen8 - 2
- 2
Question about the CLIP Demo
#1 opened by g-luo