robintiman11

Yeah I’d say sorting by relevance is similar but MEANS is strictly a boolean operator only allowed in WHERE clauses at the moment.

The way it works is: 1. Prune rows based on semantic index 2. Run surviving rows through the LLM which answer yes or no to the given predicate. 3. Collect final result.

Order by relevance is on the roadmap but I haven’t given it much thought.

The use case I’ve been working with is querying meeting transcripts. May I ask what your use cases are and how you’d like order by relevance to work?

I built it using Apache Datafusion. It adds semantic operators to SQL such as MEANS which can be used to filter data by its meaning. The core idea is that a user should be able to process unstructured data while semcast takes care of optimizing the query, including LLM calls.

Would love some feedback

Very cool