That's also assuming it isn't maliciously correlated to produce an output that after XOR leaks secret entropy.
1 - The entropy mixing is more complex than simply XOR, making such a thing considerably harder
2 - If you expect this level of backdooring from your CPU, you have bigger problems :)