what do you think about ColBERT? doing embedding on every token feels wrong in ways i can't articulate - is there a time to use it and not use it, or is it the one retrieval technique to rule them all?
Relatedly ColPali (https://arxiv.org/abs/2407.01449) is gaining a ton of steam in the IR community.
In general we are skeptical of silver bullets in retrieval.