This is so weird, why does every user has to use their LLM subscriptions/keys instead of just storing the summarization of the HN posts as a static website somewhere? (e.g. summarize once for all users)
1. The current bring-your-own-key.
2. A central summary storage, filled by me.
3. A central summary storage, crowdsourced.
4. A paid subscription, where I effectively run some LLM proxy.
I wanted something low overhead and be just the right size for yet another weekend project which I could drop at any moment. Supporting some infrastructure, having moderation headaches, let alone receiving payments ruled out pretty much everything but the current approach.
While it is possible, such a service would require advertisements, a (probably monthly) fee, or a benevolent patron to pay for the costs.
With this, the only necessary benevolence is the creator of the extension.
the summarization is where the cost is and it would be cool to have some crowdsourced contributor model there.
smells like a cool crypto/ai crossover project in the making (or maybe drop the crypto and have upvote-driven "moderation").