Great question. You need the simulator to be realistic enough that the optimizer cannot reward hack, but it does not need to be perfectly realistic.
There's two ways to functionally measure this, reconstruction fidelity (which we're able to get to 0.7 - 0.95), and downstream performance (which agrees on the best and worst models, but can sometimes disagrees on the middle of the pack routing).