IIRC Christians prohibited charging interest on loans (usury), not banking per se. I suppose a bank could be operated by Christians that simply accepted deposits and charged a sum for safekeeping with no loans whatsoever. I don't know that anything like that ever happened in practice, however, since anybody with enough money to require safekeeping in a vault probably had their own vault.
Likewise an interest free loan would be permissible, though there wouldn't be great incentives to offer them except to family members, for example.