It's packaging and bundling that's the problem. There is enough people out there that don't want to have to manually install compilers etc versus just installing Xcode.
Well then they have a choice. Pay $5 for the convenience of installing gcc/clang via a 4 GB download, or install gcc/clang manually for free.