Nobody in their right mind fires brilliant people. And brilliant people are the ones who are fun and delight to work with. It may sound harsh, but leaving some ballast weight behind may be even healthy for a team.
Again, you have in your mind a spherical cow of a layoff.