I know people who give up too quickly on an idea and I know people who stayed too long on an idea. The problem is usually that it's never so binary as to quit or keep going. It's easy to end up in a situation where you've spent 6 months or a year building a product. Over that next year you convince yourself that that NEXT feature is all that's needed for your product to explode. In the meantime you have a handful of users that give you validation that there's value to the idea.
A/B testing would be great but there's also a saying that A/B optimization too early is also a mistake. Time could be better spent understanding product-market fit.
Perhaps, more important than this was mentioned in the blog post:"spend a lot of your time thinking about customer acquisition (for me it's ~50%). Only very rarely will they come on their own early on."