Phones 30% to 50% larger would be disastrous. Uncomfortable, just too big. I think the way phones are now is about right. Still a bit too large to basically disappear in your pocket, but small enough to not be annoying.
It's not about fashion. Making phones larger would be a stupid idea indeed.