the only time we've found pgvector to be preferable to qdrant is when the per-category embeddings are very few. E.g. in cases where filtering is expected to reduce the dataset greatly for each query (>99.9%).
This is when the relational nature of postgres really shines - you can even do in-mem calculations for distance.