A benchmark for me would be a game that can handle a MMOPG like eve-online. What with certain tactics in game valid - like griefing, spies etc. An AI can handle that would be not only impressive, but learn a set of skills that many would feel uncomfortable about being within the realms of AI.

After all, humans cheat, would we want that allowed by an AI. Equally an AI could stumble upon an exploit in a game and not realise it is an expliot - ie item duplication.

But this opens up a whole new aspect of gaming that AI has yet to touch that I'm aware of.

Though I feel we are still a way of from having computers with a moral-coprocessor, and still very much early days with AI. But that is certainly something that is within our lifetimes.