They didn't, necessarily. Banks were just a place to get loans and a slightly more secure place to keep money than a hole in the back yard:

http://en.wikipedia.org/wiki/Federal_Deposit_Insurance_Corpo...