it's not just trained on GPL code. it's trained on code of incompatible licenses, which means that the code is produces is potentially unlicensable in general. There's of course also the question of attribution, which many licenses require
Maybe they chose the Uber strategy of 'What we are doing is bordering on illegal but by the time the bell rings we'll be valuable enough to write the law ourselves'.
The decision to only train it on "open" repositories was one of self preservation.