Controlling a tokamak: https://news.ycombinator.com/item?id=30379973
AlphaZero is RL as well.
Isn't that the sort of thing you thought of as a kid when thinking of AI, rather than "here's another way to serve ads and make hopefully-not-racist financial decisions"?