Games are mostly based on the skills of the players, so should games be balanced by assuming a human can do what a machine can? Of course not!
A bot can usually make computations way faster and more presice than humans.
Let's say a bot plays against another bot, both with different characters. One character might seem really overpowered compared to the other, but that might only be because the bots can react to certain events thousands of times faster than a human. Without that reaction time the tables might turn and the other character might be clearly stronger.
So how fast should we assume a human can do a given action? How precise should we assume the player is at fast calculations?
I do see a lot of things it can balance, but letting bots learn by themselves with no limitations will definitely not work out well.