Hacker News Reader

> you can feed more and more and more

I have a meta thought..

Hypothetically what happens once there is no more data to be fed to the system? Are we expecting AI to invent its own data and reach full cognition?

Currently we are feeding it the data that humans created but if we stop (i.e "why bother?") thinking that AI will do it all?

View on HN

This is a well-known problem that has been an issue for years now. You can't use models to generate data for models because it leads to "model collapse" where it amplifies quirks in the generated data until it's all quirks. Here is a random university press release about it (grain of salt etc)

https://www.utoronto.ca/news/training-ai-machine-generated-t...

In practice you can do it a bit (generated data from a better / different model is fine, some generated data might be useful if there is non generated data etc.)

Reply on news.ycombinator.com