The speed of light differs depending on the medium it's transiting already though. I've wondered in the past if in the primordial universe time or space were different than what we've observed "now." It seems like they could both compress or expand like other physical characteristics of reality.