FAISS is open source and highly extensible. I don't think it would be very difficult to build atop it.