HNHacker News
TopNewBestAskShowJobs

reclusive-sky

8 karma · joined May 10, 2025

submissionscomments
reclusive-sky··on ccai – An open-source local LLM platform for developers
I spent the last few months creating an LLM app built on conflict-free replicated data types (CRDTs) and embedded jupyter notebooks. I don't believe there's a one-size-fits-all approach to tools/RAG/memory and I wanted a chat app that just yields control to the end-user/developer. The CRDTs keep data in sync across devices (collaborative editing) and they also provide message delivery guarantees so prompts never get eaten by networking issues.

I'm pretty happy with how it turned out and I hope other developers will find it useful for working with tool-calling LLMs!

demo: https://youtube.com/shorts/e5T4m0BYn9g?si=AKUtnRewDEycKnYy

reclusive-sky··on Context is the bottleneck for coding agents now
I agree, I often see Opus 4.1 and GPT5 (Thinking) make astoundingly stupid decisions with full confidence, even on trivial tasks requiring minimal context. Assuming they would make better decisions "if only they had more context" is a fallacy
reclusive-sky··on Why haven't local-first apps become popular?
I've been working on a local-first distributed app and found it difficult to design something that is easy to install and maintain. Important prerequisites and user-managed dependencies (i.e. Redis, Docker) are nonstarters for most potential users. It seems cloud hosting is always the end-state when trying to optimize primarily for less-technical users. FWIW I also ended up arriving at CRDTs as the solution for my app.
reclusive-sky··on Chrome's New AI Features
Some of these features would be nice to have, but I'm not sure I even want my browser to have these capabilities unless there is a mechanism to keep it all local. This is a monumental change to the amount of user data Google can collect via Chrome.