Unfortunately often it's not as simple as that, you have to offset many difference things: ergonomics, aesthetics, intuitiveness, efficiency, information density etc etc. If you drew "using time as an absolute measure" you'd make an interface that was immensely fast but very difficult to learn