Why not just parse the color and preface the comment with "Downvoted comment". The same can be done for flagged and dead comments without parsing the color.