Sure, but there's a question of who you need when.
For example, f you're a non-technical founder doing a startup that's more a business model innovation than a tech innovation, you need a solid early team, but you don't really need the full-time services of a strong CTO to do the hiring and set the initial technical direction. If you end up with product-market fit and need to grow beyond one developer team, only then do you really need somebody with more tech experience to be around full time.
Honestly, a lot of pre-fit startups would be better off filling some roles like this. At one point I talked with some friends about setting up a venture labor firm. Startups are risky as hell, and from the labor side it would be great to get some of the de-risking that comes with a portfolio approach. It would also let you share great don't-need-them-all-the-time people without a lot of shenanigans. E.g., visual designers, ops consulting, user research, security expertise, and other technical specialties.
So yeah, the CEO should still be able to get the right permanent people in right seats once there's a real seat for them. But this way you don't have to do without the skills until you have a seat.