Word from the people who saw it first-hand at Apple's WWDC is that it is not a problem when you're looking at the machine AFK, because your vision has a depth sense, but video and images look very weird.
When I first saw the ads I thought it was two flat pieces of metal with circles cut in each. It took a lot of photographs for me to understand the actual shape. So I can see a shift in perspective making a big difference in perception.