I feel this moment is one of the last few warnings before things will get seriously out of hand. We need to stop now. Building a superintelligent AI should be considered a crime against humanity.
Just kidding.
This said going full steam off a cliff is one of the options that has a much higher probability than I like.