I think a big problem to solve also is the decoding of the external world, so that the AR knows what is empty space, what is floor, what is a wall, etc.