Reproduce nanogpt.
Then find a small dataset and see if you can start getting close to some of the reported benchmark numbers with similar architectures.
Then find a small dataset and see if you can start getting close to some of the reported benchmark numbers with similar architectures.
No comments yet.