The default locations of all the XDG directories are also in your home directory, so you've got a bit of a false dichotomy here.