Where lack of accountability comes is the idea that contractors can be fired if they don't do a good job, whereas it is much more difficult to fire a full-time employee. So rather than solving that problem, most of the government's software development is farmed out to contractors. The other reasoning for contractors is that contractors don't get retirement benefits that FTE's do, so in theory that saves the govt money but in practice it probably doesn't, given that contractor bill rates are usually 200-300% or in excess of what FTE salaries are.
Not to say that FTE's are great or anything, contractors do tend to me more up-to-date on technology but I think that is a result of the government employee hiring practices and compensation scale.
Yeah I've seen a lot of "business line owner" issues like the ones you've mentioned. Another common one is that software is often built to mirror dysfunctional and wasteful business processes. So you either get software that is needlessly complex, or you build the software then have to re-do it because people realize how bad the underlying business process was.