The downside of submodules is you lose the ability to easily branch across all packages/repos and then just commit.
You could branch the other project but then you have to coordinate this yourself. There is a project called Meta that can help but to me feels like it can quickly get out of control.
Do you find this a problem?