I would run postgres with pgvector https://github.com/pgvector/pgvector.

I wouldn't call postgres lightweight of course, but it's definitely lightweight in the sense that it doesn't add a whole bunch of new garbage to an otherwise traditional application.