I wonder if you could set up 3 multi panels with a known pattern of red green or blue gels on each, then filter the camera image by color to identify which of the panels is pointed where so you can adjust them individually?
It might be possible with an expensive camera.