Yes, it's a bad system.
Yes, it's a bad system.
Feels to me that if you want that rating system applied consistently you need to only ask one question -- "Was the service acceptable Yes/No".
If more than 50% of your replies are "this service was above average", then you have a meaningless system.
There are plenty of things that could be done, like using the algorithm that was developed for Netflix's prize contest, but nobody seems to be doing them.
>If more than 50% of your replies are "this service was above average", then you have a meaningless system.
Only true mathematically if ratings are for internal comparison only. It could be that the service at restaurant A is consistently above average, because the service at restaurant B is consistently below average. Only their aggregate ratings should show it split half and half.