The people saying this isn't an issue probably mean the statement with some amount of generality. What usecase are you imagining that this effects enough to be considered an actual issue?
Many of us hold on to the quaint notion that computers we own should be under our control.
If so, that sounds like a terrible idea to me. Sandboxing off applications from the hardware is a key aspect of security here. My opinion: the system should collect the location data (IF the global location services switch is on) and then parse it out following the user's granular selections for what apps they want to receive it. And that seems to be exactly the case.
Obviously the OS will know my location if Location services are on, it’s a case of what it does or does not do with that data.