You've never been to a bar/coffee house/grocery store/etc on a weekend? Lots of people work the weekend, often it is those who are paid less and have more rigid schedules. Also you run into religious days where some are not able to perform work.
Honestly it is a hard one to mandate as a single few hour window on a single day. Someone has to be working at hospitals for example.
Maybe it should be election week