Great compilation, would be great to see Vision Transformer (ViT) included.

Andrej Karpathy's GPT video is a must have companion for this https://youtu.be/kCc8FmEb1nY I was going nuts trying to grok Key, Query,Position and Value until Andrej broke it down for me.