I'm not going to psychoanalyze someone by a single text message, but I also thought it was unusual to swing that hard. Probably the decision was not thought well and hence the regret, maybe the neighbors have beautiful babies and FOMO brings regret, maybe it's a mid-life crisis where we worry about our legacy, only they know.
I can only contribute my experience deciding not having kids. We both agreed to not have them, we're 50 now, the window has closed indeed for us, and we don't regret that decision at all. It's fantastic to age together and be the center of our own little family. What little need for forging a malleable mind is left, is fulfilled by the sporadic visits to/from our nephews and nieces.
Whatever OP does, I hope he doesn't do it on impulse. It's immensely better to regret not having kids, than regret having them.