Your position is logical, but unfortunately there is by now a large body of precedent saying that that gaping loophole is fine. So for example police can’t track your movement without a warrant, but they can buy that info from the phone companies.
This could be fixed very simply by a law. The chances of such a law being passed are sadly extremely low.