Wouldn't the pinning service be the thing keeping the site on ipfs and thus the place that someone could take you offline?

Also, I'm pretty sure most ipfs gateways that expose ipfs to http requests do comply with DMCA and other takedown notices. The content might be in the ipfs, but it won't be accessible on every gateway (which might break your url)