Show HN: Local embedding and ranking for tech feeds

I follow a bunch of blogs and feeds, and Skimfeed was too busy for me. Initially I built a Glance page, and when colleagues saw it they asked me to share it. That led to (the idea of) okaeri, a minimal startpage & feed recommendation algorithm that runs locally.

In the background it runs EmbeddingGemma 2 (270M, 8-bit ONNX, on CPU) to embed new stories from the feeds you follow, and a custom ranking algorithm uses those embeddings (plus what you open, like and hide) to put the most relevant items on top. Preferences are kept per topic, so liking a lot of AI posts doesn't bury everything else. You can also tune the ranking yourself by playing around with some sliders. Vectors are truncated to 256 dims and stored in SQLite, and the model runs in a short-lived child process, so the server itself stays light (peak around 1.3 GB while embedding).

What I like about this is having a recommendation algorithm that runs on my own machine, and I can see and adjust what it does. Its AGPL and runs on macOS, Linux and Windows (Windows is new, be aware). Installing it takes a single command (see README).

It's still in development and very early, but I really like the feel and look of it.

Some future ideas are: - Creating a self hosted version you can easily sync to your phone - Building & hosting a public version. Clickdata and ranking will still be local, just the embeddings can be done globally. All feeds only have to be embedded once, the ranking & pushing embeddings should be cheap. I don't wanna deal with accounts though, so am open to suggestions. - For self hosted: Maybe syncing to your own social media feeds. That way you can sync up to twitter, linkedIn, etc, but you control the recommendation engine yourself (less doomscrolling!)

Let me know what you guys think. I'm very open to feedback and contributions!