View it as an opportunity for your promising team members to step and develop. It will give them space to flourish. Sell it that way as a win-win. When you come back, you will hopefully have a stronger team and can build on it as you grow.
If you are short-staff try to hire ASAP.