Those pieces can all be separated, but increasingly few people seem to be interested in putting in the work to do it. In particular, freedesktop is mostly just a set of standards for common protocols and file formats for an open source desktop -- I doubt anyone wants to get rid of that stuff just to have their applications all break.
It's unpopular, but I don't think most users are going to make it point 2 of a 4 point plan if it gets pulled in while installing desktop stuff from ports and packages.