The problem with this view is that government is the way that we - as a society - make collective decisions about the rules and norms under which we want to live, as well as the way we build programs to serve the public good and achieve things that we want to achieve together.
If you make that process - the process of deciding rules and norms - so painstaking slow, and the process of enforcing the rules nearly impossible, then what you end up with is a society with out rules or norms. Which isn't a society. Or with rules and norms locked down and frozen, unable to adjust to the changing needs of the society.
What we need is a government that is as responsive to the needs and wants of the governed as possible.
Usually the way you achieve that is through various forms of democracies, but those are prone to tyrannies of the majority - in which a majority intentionally choose to oppress various minorities. So the trick is to have a super-responsive Democracy that also has safeguards in place to protect the minority from the majority.
And there in lies the rub, what those safeguards should be is the never ending debate.
But "best government is least government" is a truly toxic and self-destructive meme that has badly infected US culture. If you want to understand what you're actually saying with that sentence, s/government/civilization/g. Government is simply the mechanism through which we collectively build our civilization.