Animal fat and protein cause inflammation, while plant-based fat and protein don't. Dairy contains all sorts of hormones and other stuff (e.g. real estrogen, antibiotics) that people should not consume regularly.
Milk alternatives on the other hand can actually be anti-inflammatory because they contain antioxidants. Whether that still holds true for processed versions of it... probably depends!
The other big risk factor in cheese is saturated fat. I don't know if plant-based cheese is generally healthier in that respect.