The new Street View in Earth features seamless movement. They apparently do it by mapping the Street View images onto 3D building models. The end result is pretty terrible, though: lots of warping and a visible "pop" when moving from one image to another.