neat, combining info from two phrases is hard to see without such a tool.
are you worried later-layer attention gets drowned out by earlier layers just because there are more of them contributing to the sum?
are you worried later-layer attention gets drowned out by earlier layers just because there are more of them contributing to the sum?
Right now only simple correlations are visible.