I agree. Perplexities (probability of a text) can be compared using different tokenization after normalization.
25 karma · joined February 22, 2015
AFAIK softmax should be used with mutli-class classification and sigmoid can be used with mutli-label classification.