Hacker News Reader

Comment by aresant | Hacker News Reader

Prediction - the business model becomes an external protocol - similar to SSL - that the litany of AI companies working to achieve AGI will leverage (or be regulated to use)

From my hobbyist knowledge of LLMs and compute this is going to be a terrifically complicated problem, but barring a defined protocol & standard there's no hope that "safety" is going to be executed as a product layer given all the different approaches

Ilya seems like he has both the credibility and engineering chops to be in a position to execute this, and I wouldn't be suprised to see OpenAI / MSFT / and other players be early investors / customers / supporters

View on HN

I like your idea. But on the other hand, training an AGI, and then having a layer on top “aligning” the AGI sounds super dystopian and good plot for a movie.

the aligning means it should do what the board of directors wants, not what's good for society.

Poisoning Socrates was done because it was "good for society". I'm frankly even more suspicious of "good for society" than the average untrustworthy board of directors.

seriously? you're more worried about what your elected officials might legislate than what a board of directors whose job is to make profits go brrr at all costs, including poisoning the environment, exploiting people and avoiding taxes?

The vast majority of businesses do none of those things.

and the vast majority of elected officials didn't kill Socrates.

Didn't vast majority of elected officials vote for war in Iraq, Vietnam and Afghanistan?

Vast majority of elected officials are crooks that take millions from foreign interest groups (e.g AIPAC) and from corporations - and make laws in their favour.

weren't the us invited to defend the democratic government of Vietnam? weren't the taleban hiding al quaeda who attacked the US? didn't Saddam Hussein use chemical weapons against his own people? are you comparing all these people with Socrates?

Did the people want to participate in Vietnam? Get drafted so that they can die thousand of miles away from home?

> didn't Saddam Hussein use chemical weapons against his own people?

You can't argue that when US is providing weapons to Israel which are directly used to massacre thousands of innocents. That was just an excuse to the public

> are you comparing all these people with Socrates?

No, my point is that the government does not act in the interest of people or in the interest of upholding human rights.

We create superintelligence, but just feed it a steady dose of soma.

Reply on news.ycombinator.com