I use Google Apps but with my own domain. My own domain gives me the opportunity to take my business elsewhere with limited impact. The caveat is that I pay $6 / month (instead of free).
Yep! This is exactly what I do. With Google Takeout, I don't have to worry about data loss if I get locked out of my account or other issues like that.