Except that they also take advantage of the flexibility of agile. If a story is pointed for 2 days and it takes 3 it's better to take that as a missed estimate than a developer not producing as much as they should. Hammering them because they let a deadline slip leads to all sorts of bad things. But, again, even as a fellow team member I can't tell if they worked for 2 days and fucked off for one or it legitimately just took longer than expected.
And "results are there" is just hand waving away the problem. Nobody can measure developer results in any sort of systematic fashion. If you've got a way then by all means share with the world.
Time does matter because the agreement between companies and workers is money for time/effort. I'm not giving back salary if my project flops and they're not giving me (much) more money if it makes the company millions.