The distinction I suspect is targeted spying vs mass spying. I don’t think anyone is going to get upset about a targeted counter espionage operation, but spying on the public at large with no evidence of suspicion of wrongdoing is another matter.
We still tolerate some mass surveillance - traffic cameras being the most obvious (albeit public ones, some people are getting upset about private ones)