BordiaS/bertviz

Tool for visualizing BERT's self-attention layers

BertViz

Tool for visualizing BERT's attention layers. Extends Tensor2Tensor visualization tool.

Jupyter Notebooks

"Map" of BERT [new]:

• Notebook
• Colab

Attention detail view:

• Notebook
• Colab
• Article

Original summary view:

• Notebook
• Colab
• Article

Authors

• Jesse Vig

License

This project is licensed under the Apache 2.0 License - see the LICENSE file for details

Acknowledgments

This project incorporates code from the following repos:

• https://github.com/tensorflow/tensor2tensor
• https://github.com/huggingface/pytorch-pretrained-BERT