Think about it: Even contracted physical construction gets screwed up in large scale government projects, and building good contracts about software development is much harder that contracts about physical construction.
In-house development simply doesn't have the kind of indirection where the bloodsuckers can get in.
And you're not addressing the main issue: projects being way too big and unwieldy (if now somewhat less expensive) even before they go over budget, over time or flatly fails altogether.
If the CGIs of the world actually delivered a functional product on time and on schedule, the fact that they earn handsomely in the process is at best a secondary concern. Next to the cost of the staggering embarrassment that was the failure of the first Obamacare website, whatever CGI quoted is a rounding error.