Or, Facebook could just not do that stuff.

Part of the problem is that FB still compiles and uses data on people even if they're not FB users. FB assuredly has plenty of data on you, and uses that as they see fit, regardless of if you've agreed to their terms or not. I would hardly consider that to be 'zero effects'.