hila-chefer/Transformer-Explainability

How to evaluate transformer explainability methods & Compare with other XAI methods

jaiswati opened this issue · 1 comments

jaiswati commented

Hey @hila-chefer ,

Congratulations on this great work

  1. Could you pls suggest the evaluation framework for XAI methods for vision transformers?
  2. is there any wrapper in the existing code base for other XAI methods like Integrated gradients/Smoothgrad etc?

Best,
@jaiswati

hila-chefer commented

Hi @jaiswati, thanks for your interest!

  1. I'm not familiar with a framework that includes all methods.
  2. We didn't implement Integrated gradients/Smoothgrad in this work, but all the baselines in the paper are reproducible in this repo (our variation of GradCAM, LRP, partial LRP, raw attention, and rollout).

I hope this helps,
Hila.