It is already mainly training by playing against itself:
https://googleblog.blogspot.se/2016/01/alphago-machine-learn...
> To do this, AlphaGo learned to discover new strategies for itself, by playing thousands of games between its neural networks, and adjusting the connections using a trial-and-error process known as reinforcement learning.