Based on what I see on Nextdoor and from anti-housing groups in Seattle, I suspect quality of life is coded language for "undesirable" types moving in. If you make your city affordable, you don't get to live in an enclave where everyone has a 7-figure net worth and went to Stanford.