The original paper title is catchy but it’s more like “positional encoding and attention and parallelism across attention heads are all you need…”
And it turns out you probably need massive compute, about 1/3 RLHF, all the worlds data and millions of people connecting their private data to the AI to learn from amongst other things :-/