I do not own a Rift, but I do fly FPV quad-copters using video goggles. There is no binoccular vision, no headtracking and the FOV/resolution are pretty limited.
I have never experienced ANY nausea and I'll do flying sessions several hours long (though I do take the googles off repeatedly inside that window.)
Given my experience with sea faring ships, I doubt that I am one of those who will not get nausea, so why is my use case not a problem? Is the nausea just due to an uncanny valley of which my setup falls short?