How do you know whether the sun is up or down in a place when all places have the same time?
But how do you know whether the sun is up or down in any given place on Earth right now? You probably don't, if the place is a few thousand miles East or West from where you are. You'd have to look up its time zone. And doing that might not be that much different from looking up at what hour the solar noon is somewhere else.
Oh wait, we’ve reinvented time zones!
Basically, the point of time measured in hours and minutes is to be useful to humans in daily life. And it’s useful to have a common language for things relevant to humans.