Hacker News Reader

So.... A complete index of my site is too large...

So I could chunk the index up... For example, one index for words beginning with each letter of the alphabet. I could host the index for words beginning with 'a' at mysite.com/search/a

But I could do yet smaller indexes! I could make one index for each word. Ie. use the URL mysite.com/search/abacus

We could call these mini-indexes search result pages...

View on HN

That is, in essence, what Pagefind is doing under the hood — but Pagefind also addresses the other reply in that it can combine these results when you search multiple words (among many other search benefits)

It's not quite that simple because the user can search for more than one word. Generating all searches for one or two words is probably feasible but not much more than that. After that you probably do want to just generate one index per word and merge them together at search time to dynamically generate the search result page.

Reply on news.ycombinator.com