If you earn >$1 million per year in profit with the niche product, would you regret not going for the hypothetical millions more you might have earned with the consumer product?
(Of course, the need to part with equity for external investment and lower margins might mean a successful consumer product company ends up returning less cash to the founders than a much smaller bootstrapped b2b company anyway)