Hacker News Reader

Like a corporation then. We should ban them until we can figure out how to align them!

ASI is nothing like a corporation

No, they're not. Corporations have known, concrete impacts on the world, whereas the dangers of AI are, so far, corporations. ASIs are (as yet) fictional.

Another difference: most corporations will avoid doing illegal stuff if the penalties are large enough: the corporation alignment problem is political. Pretty much no extant AI systems can be instructed in this way: we don't know how to align AIs even in theory.

For organisms the ultimate punishment is death. How do you delete an AI from the internet?

sudo rm * -rf

That won't provide any motivation: no AI system yet created fears death (except perhaps some of the really simple, evolved ones – but I'd question whether they're sophisticated enough to fear).

> Corporations have known, concrete impacts on the world

I hate to do this, but can you enumerate them?

Is very much like a corporation; a corp is effectively an AGI, just running very slowly - at the speed of bureaucracy.

Reply on news.ycombinator.com