Yeah. This thing is "assembling a different transformer" on the spot for each token.
If one thinks about it for more than a moment, it's kind of incredible that it works.
If one thinks about it for more than a moment, it's kind of incredible that it works.