I just don’t understand the use of a decoder model to make a classifier. Jev model will give you probability scores for each of the classes/selections you ask for. The probability is actual statistical probability that a selection is right.

Using a decoder model for this comes down to picking the most probable class based on the probability what the next token assigned to a class is. They are all probabilities but semantically mean totally different things. Am I right?