This entire article reads like some hand wavey nonsense, throwing pretty much every cutting edge AI buzzword around to solve a problem that doesnt exist.

All the top models are moving towards synthetic data - not because they want more data but because they want quality data that is structured to train utility.

Having zettabytes of “invisible” data is effectively pointless. You can’t train on it because there is so much of it, it’s way more expensive to train per byte because of homomorphic magic (if it’s even possible), and most importantly - it’s not quality training data!