Randomness is far more profound than it appears to be. Probably it doesn't even belong to the real (materialized) world.
In my conception time is made out of events, and the events are I suppose all material, and all have probabilities. So maybe time follows inevitably from matter. But I think it exists in its own right as a phenomenon that isn't material. There are such things. Knowledge is another one.