That's true in places like India, but not really in the U.S. I own a company that does government contracting and have never "paid someone off" or done anything remotely "corrupt" but we have been wildly successful nonetheless.
There are NUMEROUS mechanisms for oversight and redress at every level - but the typical commercial-focused company doesn't understand them, so they don't research or learn what they are and just give up thereby developing a very misguided interpretation of the system akin to what you believe it is like.