It's true that backups will take a long time too, but you're often in much less of a hurry with them than when restoring.
Also, most remote backup services allow you to restore files and folders selectively, so you just need to download a small amount if you're in a real hurry.