I give it access to write manual packet sequences and a server to try to break my logic, such as crashing the application, giving it an open ended arena to fall 10 blocks without taking damage, or just trying to jump higher than usual.
It requires a bit of pushing to know what type of issues it should even be looking for. Telling it to move even just 0.00001 blocks upwards to reset fall damage mid-fall. Telling it to figure out how to fake being on the ground to jump mid-air to reach the impossible platform. This all used to be done manually, but paying a couple dollars to run it overnight and attempt to find bypasses is worth the cost.
I haven't figured out how to run LLMs to write code 24/7 yet, they just can't see the big picture.
If so, I like the irony.
Sounds like you've freed up some time and created an automated defense later, well done. Are you able to use non-front models? And how is the character and game-state accessed, (MC-)MCP?
Flagship OpenAI/Anthropic models refuse this task due to "Cybersecurity" so I have no idea how good flagship models do. It's unfortunate as IMO minecraft is a sandbox
Java clients (pc version) use the actual game's files modified to not open a window. Minecraft is source available, anyone can load it into an IDE, modify it to double jump height, and run it in minutes without an unmodified server caring. Bedrock clients (the version for phones) just figure it out based on packets and how the anticheat corrects them to what the movement should be.