The big "Oh shit" moment will be when AI and robots can perform any task a human can perform better and/or cheaper than a human can, which would make it fiscally unwise to pay a human for any kind of labor. Even if humans could still be better at creative pursuits (such as writing, music, and art, until AI possibly betters us at that too), that is not feasible for 99% of people to survive on.