We don't remove the comment scores actually :) For the first 10 days of a comment's life, HN's API always returns 0: so we index 0. After 10 days, comment scores are visible and should be updated in the index.
https://hn.algolia.com/?query=by:redox_&sort=byDate&prefix&p...
ETA: Perhaps incident to this incident: