Transformer learning explained: Coinductive guide to inductive transformer heads
arxiv.org
arxiv.org
Well, "explained" seems to be a stretching term; I would rather call it a mathematical derivation of the operation of a transformer which is certainly interesting for some specialists.