That's usually the caveat I put when I make that statement, but I forgot to that time (and again, most of my govt work is in public and I would fall under that).
There are times when privacy is essential for govt workers but those times rarely during public interaction, and when they are, it's usually because the tasks are sensitive (an interview with a rape victim for example).
Privacy has to be viewed in the context of relative power. For example, the government has a lot more power than the people. So privacy for the government increases their power and increases the power imbalance between government and the people; it decreases liberty ... Privacy for the people increases their power. It also increases liberty, because it reduces the power imbalance between government and the people