As someone who has done this, I'll highly recommend evaluating your circumstances that you have this concern.
Startups need lots of focus, hard-work, runway and luck. Strongly evaluate your appetite to take a shot at it.
I'd recommend a shot but budget atleast 2-5 yrs of staying power.