Orthogonal sparse bigrams are another interesting tokenization method, the authors of this paper tested it out against CRM114 with good results:

http://www.siefkes.net/ie/winnow-spam.pdf