There were money lenders (argentarii) but they were just individuals setting up stall in the local forum. If you exhausted your credit with one argentarius you just went and found another who didn't talk to the first.