Yes, you know exactly where the sun is in a global coordinate system.
The problem is that your mirrors are not fixed in that global coordinate system.
You need to continuously re-calibrate the local coordinate system of the mirrors against the global system.