Indeed, this is a huge pain. ADB is, as far as I know, the only generic backup method that does not require root. The fact that it doesn't work with a lot of apps is highly frustrating.