/dino-feature-extraction-dataset

Tutorial on how to extract features from Dino attention layers.

Primary LanguageJupyter Notebook

DINO Attention Layers Vizualization

Tutorial on how to extract features from DINO's attention layers.

Content

  • Extraction of the attention layers' matrixes.
  • Saving as .npz files.
  • Attention matrixes visualization.

Dino Source Code

Example

Original Image

alt text

Attention Matrix Visualization

alt text