The budget, for one. It was 2-3% of the GDP at the time. These commercial efforts have nothing remotely close to that. Also failure was seen as a bigger deal for all involved (due to the soviet threat). So, they'd rather waterfall the hell out of that program rather than fail and do things iteratively. I'm sure these commercial projects will eventually succeed. But it takes time.