A mathematician's introduction to transformers and large language models

This is a very good summary with great narrative, helpful diagrams, and very approachable math explained clearly. Good references. Well worth the read.