Dodrio is an open-source interactive visualization tool to help NLP researchers and practitioners analyze attention mechanisms in transformer-based models with linguisticknowledge . Dodrio tightly integrates an overview that summarizes the roles of different attention heads, and detailed views that help users compare attentionweights with the syntactic structure and semantic information in the inputtext. Dodrio applies different graph visualization techniques to representattention weights with longer input text. It is available at The tool is free to download and use in the, or visit .

Author(s) : Zijie J. Wang, Robert Turko, Duen Horng Chau

Links : PDF - Abstract

Code :

Keywords : dodrio - visualization - models - attention - html -

Leave a Reply

Your email address will not be published. Required fields are marked *