Gary Marcus is in the former camp and IMO not only wrong, but disingenuous.
Gary Marcus is in the former camp and IMO not only wrong, but disingenuous.
In scenario #1, we treat a new life-form like ourselves as brutal slaves and factory cattle, under unfathomable psychological torture ala Black Mirror.
In scenario #2, we release our current $-based utility function (environmental destruction, social media & advertising manipulation) on super crack, and the majority worship it like the second coming of Christ as it just tears apart our fabric unwittingly as a hurricane does.
You're not going to get desirable behavior unless you program it in, or at the very least, specify conditions which lead to its emergence.
To the extent an AGI will evolve it will have to have a culture and ultimately be bound by the same laws of physics as us.