The hardest part, by far, was ensuring you were delivering value. It was, and is, all too easy to build something technically impressive but completely useless.
Verification isn't nearly as hard. We understand very well how to minimize the chance of error. With humans involved there is still room for mistakes, of course. There is no such thing as a panacea. But the space for failure here is significantly smaller than in the above.
> it's hope and prayers that the software is correct.
I don't think anyone has thrown away their verification systems. If anything, they've doubled down. And for what mistakes can be made within verification, LLMs are quite good at recognizing those mistakes, so it is likely that software has never been closer to being correct. There is still no such thing as a panacea, but we're a long way from relying on hopes and prayers.