I've thought about that in the past, but it is hard to lose the association we have of noon being during daylight, and midnight being during, well, night. While these were somewhat arbitrary when they were invented, we have now simply internalized that "this is how it is". So I think it does make sense to move away from the Hour-Minute nomenclature if we want a single global time for daily use, even if only for the sake of not confusing our dumb brains.