They've gotten all the abilities of a bank without any of the responsibilities, and I still think the possibility of changing laws still hangs over them like the sword of Damocles.
Last I checked, they can't do fractional-reserve banking (ie they can't loan out more money than they have on-hand or as some people like to say, "print money"). To me, this is the biggest power that a bank has, and what separates a bank from every other institution. What exactly did you mean by your statement? What "abilities" are you referring to?
I doubt Paypal invests their deposits (or if they do, they only put it in cash-equivalents), unlike banks which have the privilege of taking on short-term liabilities while they only hold long-term assets and a small amount of cash.
That's exactly what it means. When you go to the bank and ask for e.g. $100k to buy a house they make an account entry to first create this money (assuming doing so wouldn't put them past their reserve threshold) and then give it to you. The money only exists because you've promised to pay it back.
Put another way, the loan money they're giving you is like they went into the future, took all the money you paid into the loan account, deducted their fees, etc. came back to today and gave you what was left over.