Karpathy had an amazing tweet about this if you’re interested in a deep dive.

[1]https://x.com/karpathy/status/1902046003567718810