Tons of problems to take care of, especially if you only want to do horizontal passes.

- sensors have to be mounted solid

- sensors have to be mechanically calibrated in two axes

- coefficients of thermal expansion of all the materials between sensors

Afaik most good stereo systems have camera affixed to a heavy lump of alloy