I'm thinking in particular about the rule that encryption is banned on amateur bands, which really makes it not suitable for general internet access. More sensible people just ignore those rules, and that creates animosity with the above-mentioned group.
2m could get you dialup speeds over a pretty wide radius with some cheap equipment. Get a directional antenna and a hilltop repeater and you'd be in even better shape. The FCC absolutely could shave off a small chunk of the 2m band for encryption-OK Internet links (say, as a way to link up smaller wifi nets), but you're right, most hams would kick and scream even though they all just sit idle on whatever local repeater. And I'd have a hard time blaming them (I'm a ham myself) because they do not want to set a precedent of losing any band space.
High-power wifi is allowed with an amateur radio license, but because you're operating as an amateur licensee you're not allowed to use encryption, so you can't use it to e.g. bring Internet access to a remote RV park.
As it is right now, it makes packet radio pretty much useless, because you can't use it for internet access, since you'd most likely end up accessing TLS services.
But that's what the amateur service is, it's people playing with radios because they think radios are cool. Because it's mostly real-time conversations, the bands aren't insanely congested; if I tried to fetch my email over an encrypted signal on the 40m band, I'm going to tie up a big chunk of the available frequencies for possibly hours on end (cough yacht owners running WINLINK cough).
You'd have to eliminate the "no commercial business" rule too, because fetching your mining operation's email looks pretty similar to browsing ham forums when everything is encrypted.