Tool for visualizing attention in BERT and OpenAI GPT-2. Extends Tensor2Tensor visualization tool and pytorch-pretrained-BERT.
OpenAI GPT-2 visualization [new]:
"Map" of BERT:
Attention detail view:
Original summary view:
This project is licensed under the Apache 2.0 License - see the LICENSE file for details
This project incorporates code from the following repos: