It's considerably harder than it looks. The Facebook audience won't necessarily convert or translate off-site. They may well not join email lists, add you to an RSS reader, or come back to your site unless prompted by a Facebook post.
It's been my experience that often, audiences that will join a list and audiences that will Like a page are completely different. Some audiences are very hard to own a relationship with on an off-FB basis, but very lucrative ON Facebook.
On a risk/reward basis, it's often going to be a much better call to just keep on going with FB and accept the chance that your business randomly blows up.
None of this is to say that you shouldn't try that, or it'll never work, or it's a bad idea - but the "obvious" approach of "take 'em all off-site ASAP" is harder than it looks.