I think it's to calculate where the cameras are in the room. If you know where the four corners of the board are in each view you can figure out the position of each camera, and then the two views can be merged properly.
Here is the standard algorithm: http://en.wikipedia.org/wiki/Eight-point_algorithm