You can likely just take a small open weight language model and use it like a classifier quite easily.