Yes, but if one goes out of business you can buy your domain from someone else! Or even transfer it, if you are warned a nonzero amount of time in advance.
Being able to keep your address across service providers being the important part here, that way your online life doesn't get in a huge jumble when your provider goes away.