HNHacker News
TopNewBestAskShowJobs

ladberg

3,485 karma · joined August 10, 2017

Contact me at hackernews@leoadberg.com
submissionscomments
ladberg··on A developer's view of Vision Pro
I don't know the exact FOV specs but it's definitely wide enough to achieve the average movie theater experience, even an IMAX-like experience.
ladberg··on A developer's view of Vision Pro
Locked to the cabin but I've never tried it personally. It has a lot more advanced tracking than the Quest!
ladberg··on A developer's view of Vision Pro
Yep, the simulator (will come with the SDK when it's released) plus an iPhone/iPad is the best you're gonna get. Most code will definitely translate! Would recommend ARKit+RealityKit over Unity for the best OS integration unless you've already started with Unity or don't need OS integration (i.e. a videogame).
ladberg··on A developer's view of Vision Pro
Sorry, I haven't done any color critical work and am unsure of the specs.

If you're wondering about passthrough it's pretty good for most things but is definitely missing the dynamic range of the human eye, which no video camera or display can really match yet. Like a super bright light might just show up as white and you can look directly at it no problem. Basically the same as what you get when you record a video and watch it back on your phone.

ladberg··on A developer's view of Vision Pro
Hah yeah that'd be less than ideal.

> I'm curious if Apple will utilize the gyroscope to try and detect movement faster than a certain speed and show a warning.

The Vision Pro is doing SLAM at all times so it actually always knows exactly where you are (relative to its origin) and your speed!

ladberg··on A developer's view of Vision Pro
It's a pretty simple story: a headhunter reached out through a friend, I applied to a few companies, got a few offers, and joined one of them.

I was already into performance programming beforehand but had no finance knowledge whatsoever.

ladberg··on Apple TV+ 'Monsterverse' Show Filming in 3D for Vision Pro Viewing
Not exactly Jurassic Park, but have you tried Prehistoric Planet?
ladberg··on A developer's view of Vision Pro
1. I don't really know of any feature like this but can't say for certain. I'd highly recommend investing in a bluetooth keyboard for work in the headset (or keep your cable keyboard plugged into your computer and mirror the screen into the headset).

2. Honestly no clue how the public will react to Apple's avatars, but keep in mind that third party apps are free to create experiences like that and I'm sure you'll see a dozen VRChat clones taking off.

3. Not sure! I never ran into any issues but I also don't need glasses.

4. I personally am a VR gaming enthusiast and despite gaming not being the core use case of the Vision Pro, I'm very excited to see what people do with it. If you've played Half Life Alyx you know how fun gravity gloves are, so imagine having games that have graphics and physics that can seamlessly blend with real life. Use your hands to toss around virtual objects that bounce off walls in the real environment! The cool thing is that this is all super easy to develop for now: all the scene understanding, rendering, hand tracking, physics, etc. is all handled by the device so you can probably whip up a gravity gloves prototype in a few lines of code.

ladberg··on A developer's view of Vision Pro
I'm confident I'll buy a version of the headset at some point, but I don't know yet if I'll buy it right at release. I'm not saying that because I have any additional knowledge of future products (I don't), just that, like the rest of you, I want to see the ecosystem get fleshed out and not have to pay the early adopter tax. I think it will be great for work but who knows when a great remote code editor and terminal will show up on the App Store, right?

It's also not novel to me because I've spent a while using it already, so I'm not exactly in a rush to test it out just to see all the features.

ladberg··on A developer's view of Vision Pro
I have experienced what you're describing while gaming on my personal VR headset, but never with Vision Pro.

I'm not sure if that's due to the passthrough or the fact that I was only ever using it to actively do work (and I usually mean work on stuff for the Vision Pro itself, not just "normal" dev work).

ladberg··on A developer's view of Vision Pro
The problem is that it puts a hard cap on how many people can enjoy your home theater, so that might be an issue. If you already have a space carved out for a home theater and were thinking of entertaining >2 people then I'm not entirely sure what the value add of the headset would be. In my opinion the benefit comes in getting a home-theater-like experience that you can bring anywhere and not have to dedicate space in your home for.

Third party developers will definitely be capable of adding a sync feature like you're describing but I have no clue if they will.

ladberg··on A developer's view of Vision Pro
It's more comfortable than other VR headsets I've tried, but still something strapped to your head that's significantly heavier than a pair of glasses. I think I could spend all day in it with no issues but I'm not sure how sick of it I'd get doing that 5x a week, every week.

I'm sure as soon as it's released people will be doing that and reporting back though!

ladberg··on A developer's view of Vision Pro
1. You can drink stuff but have to be careful. Hand-eye coordination gets a bit wonky the closer you are to your face. I've done it and it works though!

2. Never tried sleeping with it... I don't see why it would be any worse than other headsets though.

3. I've never used it outside, but that was for secrecy and not technical reasons.

4. Honestly not sure, maybe an hour without taking it off at all but I've definitely been in it for the majority of a few hour spans many times. At the time the main blocker was the beta OS and not comfort or battery (I would keep the battery pack plugged into the charger most of the time).

5. Nope! We were all super careful with them because prototypes are expensive, much more so than the consumer product. It's not something you could just casually drop while using like your phone though.

ladberg··on A developer's view of Vision Pro
Depends what you mean by "fully switch". I think it's good enough to replace a few monitors but at the same time there are use cases for monitors that it can't replace, like showing something on your screen to someone next to you.

I'm sure some developers will switch over on the first generation, some will wait until it gets lighter/cheaper/more immersive (disclosure: I have no clue what's coming in the future), and some might never switch if they just plain don't like having something on their head.

ladberg··on A developer's view of Vision Pro
Just purely from a PPD perspective a 5K Retina display will beat the Vision Pro, but from a readability standpoint I think they're equal. Like at "normal" text editor scales you can read everything just fine but a 5K display might be crisper.
ladberg··on A developer's view of Vision Pro
I'm not sure what the SOTA is currently but the Vision Pro has much better eye tracking that other systems I've used in the past. Idk if the sensors are actually better or if it's just the native integration into the OS and apps, but it feels more seamless than a mouse and I've never "misclicked" on the wrong thing with my eyes. It kinda feels like if the mouse cursor instantly jumped to the right place every time with no travel time or physical movements required.

I've used a 3D mouse for CAD but am not sure where else it would be helpful?

ladberg··on A developer's view of Vision Pro
I'm not saying 3500 is "alright", it's definitely still expensive!

I would say 6500 is too much for a better version of something I already have that doesn't really enable any additional usecases. The Vision Pro would be used pretty differently than my Vive (which is just the occasional gaming session right now). I'd think of it as more competing with iPads, external monitors, and laptops than a Varjo right now.

ladberg··on A developer's view of Vision Pro
I honestly don't know that will be supported on the final version, but what I was referring to was developing on a Mac through the Vision Pro and deploying to the Vision Pro.

FWIW the iPad supports dumbed down app development through Swift Playgrounds and presumably the Vision Pro will at the very least support that if it supports all iPad apps, but that's pure speculation.

ladberg··on A developer's view of Vision Pro
I think it'll be great for "doing work", but I'm not entirely sure if it'll immediately outclass my in-office setup that my employer has already spent thousands on. However, I don't have a wfh setup in my small apartment because I didn't want to dedicate space for that purpose, so when I occasionally need to wfh I just use a laptop on my couch or dining table and I would love it to replace that. I think if an employer were speccing out a new office it would definitely be a viable option to have a small laptop + Vision Pro instead of desktop (or bigger laptop) + multiple external monitors.

I also don't expect it to be super dystopian or replace real life in general, but it could definitely replace the parts where you're already looking at a screen regardless.

It is technically capable of being "life scale" in the way that you describe: it tries to keep a consistent coordinate system across multiple reboots and from room to room and real life objects can occlude virtual objects, but to be honest I have no clue what the average use case will be or how the OS will enforce it.

ladberg··on A developer's view of Vision Pro
I haven't used the XREAL AIR personally but I've used similar devices and it's pretty night-and-day I think:

- Sensors: It looks like the XREAL AIR doesn't have any sensors so just displays the monitor in a fixed position on screen, which is pretty different than loading up monitors in a fixed point in space and being able to look away at other stuff. Also eye tracking is a pretty killer feature that totally changes the game in my opinion, I wouldn't personally buy a headset without it after having experienced it.

- VR vs AR display: As I'm sure you're aware, with AR sunglasses you can't really have anything darker than the actual light passing through so you're limited to only rendering stuff brighter than the surroundings. Maybe for text it's fine but not for images or video in my opinion. I can't find any footage taken through the XREAL AIR lens (and their website doesn't faithfully show this effect) so idk exactly how big the difference will be for you.

- FOV: I'm not actually sure what the FOV is of the Vision Pro but it's significantly higher than 46°. And because usable area increases with the square, you'd be able to fit a few times more displays and other stuff in.

- Resolution: XREAL AIR looks to be 1080p, Vision Pro is way better than that (per-degree too), so you can have better looking and smaller text.

ladberg··on A developer's view of Vision Pro
Lol, I'll expect people will figure out tells for whether you're slacking off irl in a headset just like being distracted in a zoom meeting. Reprojected eyes jumping around too much? Holding your hands below the table to pinch out of sight?
ladberg··on A developer's view of Vision Pro
I was developing stuff to be shown inside the headset that wouldn't have worked in the simulator, so I was frequently using the headset regardless. It was often easier to just leave it on and develop than constantly put it on and take it off to test things out.

As for development of non-VR stuff I personally didn't because I already had a fully-featured desk setup and the OS at the time was buggy enough to not want to deal with it (as every OS is years before release, not a ding on Vision Pro at all). With a good OS (which it will be upon release) and more native apps (like Termius on iPad) I definitely would though!

ladberg··on A developer's view of Vision Pro
To be honest I'm not entirely sure what reprojection is like on the final device or even if it exists at all, so my experience might be off. There may have been things that changed since I left and I'm not sure what the final plans were.
ladberg··on A developer's view of Vision Pro
Yeah I don't think I'll be using one at dinner or hanging out in-person with friends any time soon, but there are a lot of non-work things I'd happily use it for.

Gaming, TV, casual internet browsing, stationary exercise, socializing with people remotely (e.g. VRChat instead of Zoom/FaceTime), passing time on trains+planes, etc.

ladberg··on A developer's view of Vision Pro
Unfortunately I haven't tried that one! $6,500 is a bit out of my personal price range haha and I didn't get a chance to try all the competitors while I was at Apple.
ladberg··on A developer's view of Vision Pro
To be honest I don't know the actual FOV number. It feels better than some VR headsets I've tried and on par with others. The lenses are definitely a more exotic shape than the ones on my Vive so they're able to get closer to your eyes and have better quality in all areas of the FOV. I feel like for work stuff and entertainment it's definitely good enough, though you might struggle living in it full time haha.
ladberg··on A developer's view of Vision Pro
Heat and condensation build up is a complete non-issue due to the built in fans! I've never once felt hot or stuffy inside the Vision Pro, and I totally do on other VR headsets.

I don't really look at my keyboard while typing so that's also a non-issue. For stuff where you really need hand-eye coordination it's totally fine at normal arms-length but gets worse as you get closer to your face. Finding a key on the keyboard with your eyes is not a big deal but if you try to drink from a glass of water you'll likely spill it on yourself the first time (and then eventually get used to it).

ladberg··on A developer's view of Vision Pro
Not exactly sure at all, I wouldn't have been able to predict this large of a leap before finding out about it myself.

I do think a bunch of incremental improvements will eventually allow different use cases though. E.g. you'd never take it on a run or a bike ride in its current state but with enough weight and battery improvements you could have a HUD for exercise stats + navigation when biking with stuff like a videogame-esque ghost of your PR to race against. Just a random idea, there's a lot of stuff you can dream up.

ladberg··on A developer's view of Vision Pro
I've used other VR headsets and it's significantly better than everything I've tried. You'll be able to put up virtual monitors at the same density as real life and read stuff fine, I couldn't really discern pixels at all. Reading physical monitors through passthrough is a bit harder (I increased text size a few points when I needed to do this) but isn't really something you'd do for actual work.
ladberg··on A developer's view of Vision Pro
Thanks! My motivations were mostly comp based (I'm in HFT now), I loved the product and the team I was on!

Feel free to ask any questions here and I'll answer anything I can (e.g. no unreleased info, but maybe go into more detail about the kind of stuff that was shown to devs at WWDC). No blog right now but maybe in the future :)

← PreviousPage 6 of 24Next →