I started playing the rs-sdk (https://github.com/MaxBittker/rs-sdk) with Claude after seeing it on HN the other day. I haven't looked at the Minecraft experiment but just letting an agent loose in the game and telling it to play did not work well. At first it really did not have a good feel for how the game actually plays and would routinely waste tons of time doing something that makes no sense — very reminiscent of the "four agents spent 11 minutes appointing a ‘sole fertilizer operator’ for a single piece of bone meal on a single wheat block" anecdote in this article.

But, after several hours of correcting and directing Claude (build modular, re-usable snippets of useful code rather than one-off scripts for driving, document your learnings for future agents, etc., explicit guidance on playing more optimally) it can now play the game fully on its own. I just gave it a goal to play through the end of the "Legends quest" (nearing end game content, requires playing through lots of complex quests ) and it's breezing through it.

I haven't experimented with swarms of agents yet, but I know if I had tried to create a swarm in 2004scape before the agent was actually good at playing the game, it would have failed horribly. So, I wonder how good the agents they were experimenting with are at Minecraft when playing alone.