Yep! Nathan did an earlier experiment of this, but it was the smallest gpt model trained on a small dataset of Zork adventures.