They should benchmark it against Pluto. It's a artificial neutral network bot that can easily take games off the best broodwar players.
Pluto is very good at assessing relative army strengths based on units within its vision and will always engage when it judges that its army strength has an advantage, and it uses superior micro and targeting to win battles efficiently. The key weakness of Pluto is that it has no memory of units that are not in its line of sight, so it can be easily exploited with fast skirmishing and harassing units, drops, and spreading out artillery units to deny it from seeing the full army strength all at once.
Its other big weakness is that once you get an army advantage you can force it into a turtling position where it will never try to attack you and you can safely colonize the entire map with expansion bases, giving yourself an insurmountable snowballing resource advantage.
From what I've seen: the Pro's wins mostly rely on exploits, not superior gameplay. Those who fight without exploits lose pretty bad, just in the last few hours: https://www.youtube.com/watch?v=xga636MBOns
Obviously chess bots can beat anyons but this involves a situation where you're making 1 move at a time in a highly constrained environment: exactly 64 squares and a set number of pieces and so in. You also have, relatively speaking, near infinite time to plan your next move and as a result AIs can use a combination of databases and simulation algorithms to derive the best next move.
Almost none of that applies to starcraft.
We can talk about "teaching" the bot to handle other situations but that word covers a gigantic realm of complexity, like how do we encode this information in a way that the ai can actually draw from to apply to its current situation? If people talk about "more chess positions than atoms in the universe" or whatever, this is so many orders of magnitude smaller than the number of valid starcraft positions that we need to invent new numeric notation to accurately describe it.
That being said, there is a substantial difference between humans playing at anywhere from 50-500 apm and a robot that can literally micro every single zergling on the map at the same time and do things like avoid ever taking the splash damage portion of a siege tank shot.