I am no expert on this, but if you assume the cosmological principle which states that our universe is roughly isotropic, there is a natural set of observers called comoving observers who are at rest with respect to the expansion of the universe. One can define a universal time using the clocks of these observers. Presumably, this is what gives meaning to statements like the universe is 14 billion years old.