Maybe 60 000 years ago, now we're more survivable than ants or cockroaches. Anything short of a Venus hothouse is survivable (not for 9 billion of us, though).
I was being slightly sarcastic, but even 60,000 years ago other environments were available.