Hacker News Reader

Comment by markingram | Hacker News Reader

HoloLens 3D miniMap of House with Synced Ladies +1 https://www.youtube.com/watch?v=T-JvTZjbwNs GG:)

That cracked me up. Is that blue circle a gaze tracker? because it keeps pointing at virtual boobs whenever he looks at the models :)) not to mention sending avatar to the kitchen, priceless :D

It is! I feel like gaze tracking is one thing that's missing from VR headsets that's in the hololens. Social VR won't work until your eye movement and facial expressions can be translated into the application.

I'm sure gaze tracking would make rendering more efficient, just render the stuff the user is looking at in high def, the rest in low polygon and low rez textures.

Unlike head, eyeballs rotate too fast.

Wikipedia says “the peak angular speed of the eye during a saccade reaches up to 900°/s in humans”.

For reality-like experience, you need to have sub-millisecond rendering latency. For a moderately-complex 3D scene, current GPUs can’t do anything close to that.

Modern mouse sensors can track ridiculous speeds and accelerations, 6000-10000 frames per second are the norm nowadays. Eye might rotate fast, but your brain turns off the picture during saccades.

You’re right, low latency sensor is a minor problems. Low latency rendering is much harder to solve.

A good-looking 3D scene usually takes around 10-15 milliseconds to render. For the last decades, GPUs were optimized for throughput, not for lower latencies.

One common method how existing VR products achieve lower latencies — they render in a larger buffer, then shift the result to accommodate for head rotation since when the rendering was started, then present to the VR headset.

With dynamic LOD based on eye targets this trick will not work. To show better details at the center, you have to actually re-render your scene using better LoDs/textures near the view center. And that, my friend, is going to take 10-15ms.

that's a great idea actually... microsoft needs to work on the peripheral field of view.

yes, the blue circle is a gaze cursor... great attention to details! subconsciousness took over.

Interesting how he walked around the 3D characters instead of taking the easy way though them.

It's kind of unpleasant to have your head stuck into a virtual object. People generally avoid objects in VR, too.

yes, because walking through them sometimes cause minor turbulence :)

Reply on news.ycombinator.com