There’s a couple of points here. One, it’s not likely that your location or my location are that important from a national security standpoint. We’re just not important enough. Politicians, judges and members of the military are different.
Second, we are well past the point where we can just inconvenience ourselves into getting our privacy back, unless your advice is “don’t use a cell phone or car” and “don’t go out in public” (in which case it will be trivial to determine your location anyways).
Data brokers are lifting your location from every ad in every app, GPS on or not. You have much less control over this than you think. Further, you will likely be identified via license plate readers (those solar powered towers at Home Depot for example) and even your tires report a unique identifier.