If the universe was just a sequence of random arrangements of random phenomena, then no physics would be possible - there would be no reproducible experiments, and so no way to predict the future based on the present.
Specific things may be variables rather than constants, but we can only ever define that in relation to some other constant. If the hyperfine transition of the cesium-133 atom starts taking longer, how could we measure that, except in relation to some other periodic activity, e.g. the hyperfine transition of hydrogen atoms (or, if we go back to Galileo, human heartbeats)? So we could equally say that the hydrogen transition has got faster or the cesium transition has got slower. Now if 111 elements "agreed" on how fast time was passing and one other element differed, it would probably make sense to say that it was the one element whose transitions were slowing down rather than the 111 elements whose transitions were speeding up. But ultimately there is no single objective measure of time in the universe; rather there are a number of periodic patterns in the universe that are mostly consistent with each other, and most easily explained by there being a single, consensus concept of time passing. If one particular pattern starts going against that consensus, it makes sense to say that that particular pattern is changing, and since we want our definition of the passage of time to agree with the consensus, if the pattern that changed happened to be the "official" definition of time (hyperfine transitions of cesium-133) then we would almost certainly just switch to a different pattern in nature that followed the consensus. But if the consensus itself broke down, well, at that point it no longer makes sense to talk about a single concept of "time" - rather we'd have to talk about the specific patterns we were talking about. And if the patterns went away entirely, physics itself would become impossible.