I imagine for soccer the task of determining where the ball is based on player locations would be a lot harder than you think.
So yeah, surprisingly tricky, but you could set up a big training set along similar lines.
https://www.theguardian.com/football/shortcuts/2015/jan/14/h...