It seems like an extremely difficult problem, and relevant to the problems many of us are trying to solve. I can come up with plenty of simple metrics, but they all fall apart pretty fast, especially if the community quality starts to tank hard. Think of the sheer number of upvotes that most inane meme references get on reddit.
Situations like an inflammatory comment sparking an insightful debate are one of the things that initially seems like a poor quality comment (and it quite likely is), but overall might be a positive thing for the community.