Doesn't Tesco in the UK have a bank product? Can't say I hear much about it when I shop there.
Makes sense though, why not be a lender as well? Then people can get their groceries before they get their monthly paycheck.
Also on the payments side, why pay the card company when you can make your own card?
These aren't new observations though, anyone looking at a supermarket would think of these things.
Big issue is regulatory. There's a heck of a lot of hoops to jump through to get a bank license.