Hacker News Reader

HNHacker News

Top New Best Ask Show Jobs

Comment by ivraatiems | Hacker News Reader

Parent Full thread

ivraatiems·

Why? They're still only going to be trained on human input or input generated by them as derivatives of human input.

Modality change might expand their usefulness, but I don't think it changes the basic parameters of their operation.

Learning to swim might let you see a coral reef, but it won't turn you into one.

View on HN

> or input generated by them as derivatives of human input

Trained mostly on their own data, not ours. The mix changed, from 10% to 90% synthetic data. RL training is now the largest part of the process. The AI work is searching, and I don't think we can claim this process to be credited to us anymore. The origin point is, but not the journey.

That’s the thing. AI won’t be limited to being trained on only human input, why would it? Humans are trained by interacting with their environment plus a genetic world-mapping initial seed. There is no reason AI will not be the same, just at a much more extreme level

This is a very basic misunderstanding of machine learning. The goal is always to learn a representation that generalizes beyond the training set without overfitting. If you succeed in generalizing, you can do more than produce derivative work.

Aren’t humans also mostly trained on human input?

It depends on the knowledge domain. I would argue that much of human knowledge is individual to the person acquired by interacting with their environment

And much of it inaccessible to others, let alone to AI

Reply on news.ycombinator.com