I've been hearing similar things for a while now but I know about different situations. It seems that as always, your mileage may vary.
4 karma · joined October 30, 2025
-----
SELECT id
FROM index_name
ORDER BY emb <-> $query_vector
LIMIT k;
-----
$query_vector may come from anywhere including being transformed on the fly from 'some text'.
Are you doing this to unlock natural human-to-model conversations? I was speaking to an AI-demo-assistant yesterday and I think I get whay you are talking about when you say the delay has to be really small.
What is the bigger project you're working on?