All of your reasons are common complaints, and I share them (with the exception of USAA). I work at such a bank, and can tell you from painful firsthand experience how difficult it is to do good UX design work inside of a traditional banking environment. I think Simple had the right idea to essentially decouple the "backend banking" stuff from the UX by partnering with a bank and somewhat removing many of the constraints a full-on bank has to wrangle with.

What's interesting though is that despite these complaints, consumers generally are averse to switching their banks.