Nearest Subway App Overlays Subway Directions On the Real World
crunchgear.com
crunchgear.com
I find it clever that they were able to circumvent one major obstacle of doing augmented reality. Usually, you need to interpret something about the video view from the camera in order to figure out where to place the 3D models in the scene.
Instead, they rendered it entirely ignoring the scene, and just used orientation and distance to display the subway signs. That works great for cities like New York or DC, where it's pretty much a grid with no dead ends.
Current user location and database of subway station locations. It's a small enough list that you just rip through all of them and sort by distance. Project badges onto a sphere/flat on a circle depending on the tilt of the phone. Orient on compass location. Overlay display on video feed. Done.
There's no fancy image processing going on, no actual pathfinding, just a nice combination of the new 3GS apis and publically-available data. Good show.
To get the "live overlay" you need to hook into undocumented API. Considering how long we've been asking Apple for precisely this feature, I doubt it's going to happen.
If they are approving them, then I'm getting right on this bandwaggon!
But yes, rad nonetheless.
I wonder if the technology is easily extensible to take new maps and locations. Post that openly and watch the world start creating further content... not just more subway maps, but more geographical locations (restaurants, hotels etc).
Exciting!
You can hand these to visitors and they'd instantly be able to tell which direction to walk when stepping out of the subway.
*
Other augmented reality examples:
-------
- IBM 'Seer' app for Wimbledon 2009: http://www.youtube.com/watch?v=7VZoDmqcZ34
- Google Sky map for android: http://www.youtube.com/watch?v=p6znyx0gjb4&eurl=http%3A%...
- US postal service using augmented reality: http://www.adweek.com/aw/content_display/news/digital/e3i388...
- Augmented reality t-shirt / twitter mashup: http://www.squidder.com/2009/02/17/papertweet3d-augmented-re...
... and there's a lot more products out there - google for: ARSights / D'Fusion / Layar / Project Natal / Releas3D / SixthSense / Wikitude
*
Development kits / APIs:
-------
ARTag - http://www.artag.net/
ARToolkit - http://www.hitl.washington.edu/artoolkit/
FlarToolKit - http://www.libspark.org/wiki/saqoosha/FLARToolKit/en
NyARToolkit - http://nyatla.jp/nyartoolkit/wiki/index.php
You could make a lot of money by solving the problem of how to reliably determine location in major cities indoors and out (and not just relying on known wifi-hotspot triangulation like skyhook does).
They already have street view data that's highly accurate, they also have A-GPS data on roughly where you are. They can refine this by comparing the image coming from your phone to known street view images... The computing power behind this would be pretty insane though.