Yes, it's a bad system.
Feels to me that if you want that rating system applied consistently you need to only ask one question -- "Was the service acceptable Yes/No".
If more than 50% of your replies are "this service was above average", then you have a meaningless system.
There are plenty of things that could be done, like using the algorithm that was developed for Netflix's prize contest, but nobody seems to be doing them.
>If more than 50% of your replies are "this service was above average", then you have a meaningless system.
Only true mathematically if ratings are for internal comparison only. It could be that the service at restaurant A is consistently above average, because the service at restaurant B is consistently below average. Only their aggregate ratings should show it split half and half.
5 means they did good, anything less means you have complaints that you think are serious enough to warrant effective "demotion" of the driver.
How do you say someone did a better than expected job if the "baseline" is 5?
If they expect the normal to be 5, why give 1-4 as options. Why not "good" and "bad"
Not to mention the cultural differences between countries. While America loves being over-the-top with fake "oh you are so awesome", other countries (say Japan and the UK) are far more reserved.
Some places do use a thumbs up/down rating but I think a lot of companies like the stress the 1-5 or 1-10 ratings put on workers. If you view your workers as easily replaceable, stress is a feature and the false precision lets you say that any particular outcome was data driven.
4 stars => great
3 stars => quite good
2 stars => not so good
1 star => bad
There's no score right in the middle so you can't sit on the fence (unless you ruin it by allowing half stars, Ebert style).
They have an intuitive understanding of what an average is, though. And when provided a scale the vast majority of people assume that the average is in the middle. If some smart arse grading system is not intuitively understood by someone’s customers (and seriously, people have something like 10 seconds to make that choice), it’s not the users who are stupid.