Excellent point. Blindly following A/B testing can lead to a good local maximum, but odds are it's not the market maximum. Radical redesigns and new business directions can lead to even higher (or lower) conversions.
In my experience, the trick is finding the balance between optimization and strategy. Doing continuous testing along the way helps you find out what's working and what's not.