For a more in-depth analysis of chatbots playing text adventures, take a look at my project. I haven’t updated it in a while due to time constraints.
The challenge with benchmarking text adventures lies in their trial-and-error nature. It’s easy to get stuck for hundreds of moves on a minor detail before eventually giving up and trying a different approach.
I'd argue that another major challenge is that many of the popular text adventures are described in copious detail by many online sources. A language model "playing" Adventure is likely to use the magic word XYZZY by rote, for example, rather than learning it from the game text.