I agree, though discord recently has put out updates to improve audio quality in those instances.
That being said, I would argue that any voice chat with more than 10, maybe 20, active people talking is going to be nearly unusable. Not due to audio quality.