If anyone's interested, I recommend Harvard Business Services (Delaware registered agent is $50, Delaware filing fee is $90, and HBS takes a cut of $50 if you use them for both parts). For a business bank, there are several (free) options and the one that Stripe Atlas has partnered with, Silicon Valley Bank, does not have close to the best reputation.
Edit: The AWS credits however substantially change this calculus.