Running GPT-2 after it's trained wasn't as computationally-easy as nowadays. So, you not only need the best supercomputer in the world to train it, but also a datacenter with similar computational power to run enough instances to make it useful.
No comments yet.