Look at prosper.com. Regulatory costs are astronomical. Between state and federal auditors and Sarbanes-Oxley and CRA, etc, you'll have your hands full.
Also, why would investor capital flow to you? You'd make a lower return with no upside of lower defaults, etc.
But yes go ahead. Start a low rate credit card company. I might sign up for your card!