After a couple dozen more papers and prototypes, we could have ultrasound haptic feedback and some 3D holographic projector where we achieve a true augmented reality.
Going a bit further with this idea, you could essentially create augmented 3D objects that would be indistinguishable from the real thing until you apply enough force enough to break through some upper limit of ultrasound generated haptic pressure (as to not hurt the end user through some legislative regulation). For example, opposing magnets that can be pushed together past a certain point where the illusion of tactility is gone.
What would a reality like that be like? Where you could not only have limitless content media generator but you could conjure up those assets in your living room and have them interact kinetically with the real world. We are talking 3D holographic assets with ultrasound haptic simulator that can apply pressure to any object from all directions.
https://www.youtube.com/watch?v=fwTcfwbrNO4
https://www.youtube.com/watch?v=jDRTghGZ7XU
We might not even need expensive robots in the future. Just conjure up a 3D human via some ultrasound/holograph projector which can apply enough force to objects.