If you're doing direct downloads then there's no reason to be building with bitcode enabled, and so the size increase should not affect you at all.