People do talk about it a lot; it's often referred to in an optimistic way: "getting your vr legs", instead of a negative manner. That said, the early adopters of VR are self-selecting and probably the least likely to get nausea. I know a few people who are prime candidates for VR (graphics developers, tech nerds, etc) who either sold their devices or refuse to buy one because they know they'll never get over the nausea.
I have no real problems with nausea (or motion sickness in general) and I love my Rift. That said, I do get mild headaches if I play it for more than an hour. So yeah, it's a thing.