I just... never see "quit" as the response to a bad colleague. I could be wrong, I guess.
There's no guarantee you won't have a bad colleague in the next place, too. That said, if a bad colleague makes your work exceptionally difficult, that's a tough position to be in.