You're right. My Android smartphone as well asks for my interactions in order to allow data transfer, but who knows. I wouldn't take the risk. What I'd recommend, is to have a "USB condom" (charge-only), in order to ensure physically (besides logically, like you mentioned), that there will be no chance of juicing my data.