> org-agenda is not fast enough, and is practically unusable with more than a few tens of files.

Please see https://github.com/alphapapa/org-ql, which implements agenda-like views with a much faster search backend.