This could just be a user option. Turn the scores off by default but allow people to turn them on if they want. You could then easily query how many people had them turned-on and it might give further data points to later query with regards to how it impacts the site.