Outsourcing is not an all or nothing deal. The startup could outsource server setup to us, do their product and as they get time slowly take charge.
A lot of startups have very limited time to get their idea executed and make it a real success. One of the founders might quit, the team might run out of funding or a big competitor might make your product offering unnecessary. This makes the first few months really critical.
Setting up your server with the right web server, installing wordpress & configuring other tools, keeping the packages updated take a lot of time and those few extra weeks can be the difference. What we do is help the startup get going and your team could take control of the stuff over the course of time as you get comfortable with the components.
For SaaS startups our offerings like creating an effective landing page that is connected to mailchip for double opt-in, managing inhouse development with project management, keeping track of marketing & sales with CRM tools will be useful.
And then once the product is done launching the startup with affordable PR tools, improving their site's search rankings, tracking with right analytics tools can also be done.