You'd loose all that performance gain to ads anyway. I'm truly shocked how horrible the experience is whenever I see someone browsing the web without it.
Sorry for the rant.
To them, ads are part and parcel of "using the internet". Some of them hate ads. But not for technical reasons though.
Outside of complaining why they hate that annoying ad from company X, most people probably won't be motivated enough to actually do anything about it. For some, this is just how they expect the "internet" to work. An ad-free one would feel broken to them.
Ads are not a bother for most casual people.