I thought HN already did this. At least new comments usually appear at the top of the thread and then gradually fall if they don't get any upvotes.

Someone made a post about your suggestion here: http://danluu.com/randomize-hn/

And another person suggested an even better algorithm here: http://www.bayesianwitch.com/blog/2013/why_hn_shouldnt_use_r...