Just like the gold Apple iPhone, or other luxury items, those who can afford such things will create the market for it. I don't see how diamonds are any different to other luxury goods.
Let those who can afford it buy it, I'm sure it gives pleasure to many people. It's also a status symbol - just like cars, luxury watches, handbags etc.