Poe's Law strikes again, but for reference there are even several major categories:
Some things are nobody's business. If you have religious parents and you're gay, you may not want them to know that, even if your religious parents work for the government.
People have proprietary secrets. A drug company or tech company can't be spending a billion dollars on 95%-finished R&D only to have a random cop take a $10,000 bribe to hand it over to a foreign competitor.
It's important to protect the political opposition from the incumbents. The thing Nixon had to resign over? That.
Sometimes the bad guys work for the government. If your abusive ex is a cop, they shouldn't be able to trivially find you without a warrant.
The government shouldn't be able to go on a fishing expedition. If you do something that isn't illegal, or that you have a right to do, that shouldn't be an excuse to trawl through your life so you can be prosecuted for breaking a law that everybody breaks but only people who step on the toes of the powerful are prosecuted for.
"If you give me six lines written by the hand of the most honest of men, I will find something in them which will hang him." -Cardinal Richelieu
"Saying you don't need privacy because you have nothing to hide is like saying you don't need freedom of speech because you have nothing to say." -Edward Snowden