If you don't pay, it destroys your credit rating, which in many areas means you won't be able to rent a place to live from anything but a private party. I believe they could also potentially get an injunction against you and garnish your wages, but I'm not certain about that. Your college also may withhold your transcript, which can impact some employers who require that.

Lots of ways they can make your life just as miserable for not paying.