1230113202/bertviz

Tool for visualizing attention in BERT and OpenAI GPT-2

BertViz

Tool for visualizing attention in BERT and OpenAI GPT-2. Extends Tensor2Tensor visualization tool and pytorch-pretrained-BERT.

Jupyter Notebooks

OpenAI GPT-2 [new]

Map view:

• Notebook
• Colab
• Article

Original summary view:

• Notebook

BERT

Map view:

• Notebook
• Colab

Attention detail view:

• Notebook
• Colab
• Article

Original summary view:

• Notebook
• Colab
• Article

Authors

• Jesse Vig

License

This project is licensed under the Apache 2.0 License - see the LICENSE file for details

Acknowledgments

This project incorporates code from the following repos:

• https://github.com/tensorflow/tensor2tensor
• https://github.com/huggingface/pytorch-pretrained-BERT