> why not use LLMs for dataset creation or augmentation in order to train a classic supervised model?
Or, as I mentioned in another comment, just use the embeddings directly. This also does a lot to remove the "cost (money and latency)" part of the problem since you can batch queries to be lightening fast and the dollar cost of generating the embeddings is effectively zero (~3000 pages of text per $1) for most traditional NLP tasks that require a vector representation.