People don't work at the same time, but the time they work is determined by other people's schedules. That's why janitors often work in the middle of the night, and school starts before work, and the doughnut guy has to get to the shop early in the morning.
By the way, I would also love to get rid of clock changes twice a year. I'm mainly playing devil's advocate here. The drawbacks of winter morning darkness are real, and will likely not be solved without DST. I just also think that they're not worth screwing with the clock.
If I lived in a more northerly latitude, maybe I'd change my tune. But as it is, I value daylight at 5pm way more than at 7am. The yearly "fall back" of DST is like an insult added to the injury of winter.