What matters is that each point you make the decision that makes sense to you.
And if you choose to look back one day, you may find that despite failing being an entrepreneur for some time helped you in ways you may not have realized or anticipated.
Either way, as you said, optimize for your mental health. All responsibilities in life seem like chains some of the time, but if your startup feels like a chain all the time - then by all means - break the chain.