"Such a low quality post. Are you human or something? Go back to reddit!"
"Such a low quality post. Are you human or something? Go back to reddit!"
But what happens when our JPEG saver only has other JPEGs to start with? And soon, is saving copies of copies of... you get the idea. The images lose more and more of their original real-world structure, and become dominated instead by artifacts of the compression and reconstruction processes.
That's basically the (a) challenge for this AI training paradigm of scraping web-scale content. The more that content is generated by the previous generations of AI, the more we're asking the next generation to learn from copies of copies of the original human intelligence that powers them
It is producing novel information -- pictures or text or otherwise.
Besides, human creativity isn't borne of a vacuum either. Most humans works are derivatives of some other work and depend on the creator's life experiences, etc. Our entire education system is based on "people teaching other people what they know", at a lower fidelity, copies-of-copies style.
I love it when we go back to assumptions. This is exactly what I'm assuming. However, the problem is not solved. what exactly is "new" information? here is more assumptions for you right there.
> Most humans works are derivatives of some other work
Good point. "Most", however, does not equal "All". collectively, we are not just copying. there is a newness. (again, what is new?)