There's a distinction to be made between "worse off" and "worse". Socrates was arguing that writing-users would be worse as people, not that they would experience lives they didn't like as much.
Hell, I would never have had the pleasure of arguing with you without it! :)