That's the only way to do it. You can't index the whole thing. The challenge is chunking. There are several different algorithms to chunk content for vectorization with different pros and cons.
In theory this would be an efficiency boost but the performance math can be tricky.
This is a coarse way to tackle that