No point of keeping stomping the swamp if cleaner and greener pastures are within your sight.
Even less need to fret over it.
Give your startup a fair warning to allow them enough time to take care of replacement. Offer them to be available on a consulting basis (at your asking hourly rate, subject to change, no negotiations) indefinitely.
This should do.