Your model is only as good as the environment and data it's trained with.

Gaming physics change all the time. I find it hard this "generalist AI agent" can play with a constant shifting gravity in XYZ for example. It does however offer a good training space for real world where gravity and other physics mechanics are consistent.