Failing hardware isn't the problem. The consoles are showing nondeterministic behavior (slight variations in audio/video sync), and probably did from the factory.
There's also no evidence that the clocks are drifting further due to age. We don't have data for what APU frequencies used to be; we have a single measurement from over 20 years ago suggesting that one particular console had a DSP sample rate of 32,040 Hz, which is slightly lower than the current measured average of 32,075 but still well within the range of consoles we've looked at today.