Can it be decentralized?
What about a browser extension that allows users to "rate" each story/author?
You could follow other users you trust, and get an aggregate of their ratings so you wouldn't just get the global rating, which could be corrupted.