I should note that you're taking this a step further than I was: it's not all "phone games" that are bad (is there anything that "phone games" as a genre have in common?)—it's just what are commonly referred to as "free-to-play casual social games" that are insidious.
You can have great game experiences on a phone! You can build good, fun games, either in-depth or casual, for mobile, just like you can build them for consoles. In fact, just because a game is "casual" doesn't make it bad! Some of my favorite games have been casual few-minutes-at-a-time pick-up-and-put-down things; non-time-based puzzle games (e.g. KAMI[1]) work especially well for this—they're functionally equivalent to doing a crossword puzzle—but even action games like Tiny Wings[2] can work if they're self-contained.
Then, of course, you can also have things like RPGs and action-adventure games, of just the same quality you'd see from a console.
The most important difference, I think, is that people don't tend to play the good games in the middle of a conversation. The good games are actually engrossing, and therefore can only be played as an exclusive action—you might see someone playing them on the bus, but never just fiddling with them while hanging out with friends. It's only the games with no fun-value at all that are capable of the "empty addiction" you see on people stuck pulling a slot-machine arm all day.
[1] http://www.stateofplaygames.com/work/kami/
[2] http://www.andreasilliger.com/