Disclaimer: Totally amateur (ignorant?) comment.
At an atomic/particle level, movement (speed) is related to temperature. If something reached 0 degrees Kelvin, there's no particle movement at all. You could argue that since time is relative to space (as opposed to an independent variable), time would slow down as temperature goes down. If the whole universe is cooling, maybe time is slowing down.
Source info: http://en.wikipedia.org/wiki/Thermodynamic_temperature