2,167 karma · joined January 21, 2009
To be real though I'm sure that many sites would not want this because they rely on GDPR fatigue and users to just accept instead of taking a few seconds to opt-out.
I have ran services on bare metal, and VPSs, and I always got far better performance than I can get from AWS or GCP for a small fraction of the cost. To me "cloud" means vendor lock-in, terrible performance, and wild costs.
We used to talk about AI as having no moat (easy for other players to accomplish similar AI achievements). China has made that clear. Some open weight LLMs are fine and can run on laptops. It seems the new moat is model parameter size and VRAM requirements. I would bet on innovation in hardware or disruptive algorithms changing that game so better LLMs can run on more personal computers. Remember how bitcoin miners all used GPUs then ASICs came along and made that no longer profitable?
There are many ways the AI industry can be disrupted which makes it that much more volatile.
Maybe this concern doesn't apply to libghostty, as I think search would be more of a UI concern.
I feel like people forget that web apps can be rendered server-side, and with HTML-over-the-wire (HMTX, Rails Hotwire, Phoenix LiveView, Larvel LiveWire, etc), server-side rendered apps can have a UX similar to a react app, but with far less total effort.
Metaprogramming has fallen out of fashion in the ruby community for the most part. Rails is a great example of where that shift has happened. ActiveRecord used to have `find_by_<attr-name>(<value>)`, which became `find_by(<attr-name>, <value>)`. Sure devs can still go wild with metaprogramming in ruby, but it is generally discouraged.
0.7 * 8 * ((20 * 12) - 8 - 14) * 3 = $3662
I bought my RTX 4090 for about $2200. I also had the pleasure of being able to use it for gaming when I wasn't working. To be fair, the VRAM requirements for local models keeps climbing and my 4090 isn't able to run many of the latest LLMs. Also, I omitted cost of electricity for my local LLM server cost. I have not been measuring total watts consumed by just that machine.
One nice thing about renting is that it give you flexibility in terms of what you want to try.
If you're really looking for the best deals look at 3rd party hosts serving open models for the API-based pricing, or honestly a Claude subscription can easily be worth it if you use LLMs a fair bit.
I also hate the agreement of maybe one day we might... as a justification for a new microservice. The number of times that premature optimization didn't pay off is far less than I've seen it come to be.
Microservice should be an exception, not the preferred architectural design pattern.
Sometimes I cynically think system architects like them because they make their diagrams look more important.