1,295 karma · joined July 16, 2017
https://github.com/baalimago https://lorentz.app
Whatever the response is, it'll unlikely be from an LLM.
In my own very humble opinion, it becomes "Large" when it's out of non-specialized hardware. So currently, a model which requires more than 32GB vram is large (as that's roughly where the high-end gaming GPUs cut off).
And btw, there is no way you can train a language model on a CPU, even with ddr5, lest you wait a whole week for a single training cycle. Give it a go! I know I did, it's a magnitude away from being feasible.
I doubt you have a machine big enough to make it "Large".
Then I have a second level of this, the superpanic. Here is the "true" alert, which means "drop all things, fix this now". On every superpanic, there are stricter routines which intentionally cause friction, such as creating tickets about said superpanic, potentially hosting post mortems etc. This additional manual labour encourages tweaking the levels of the superpanic so that they sometimes are more lack, sometimes stricter, depending on the quality of the deployed services + the current load.
What signals a superpanic? Key valuable functionality being offline. Off-site uptime-checkers assuring that all primary domains resolve + serve traffic, mostly. Also crontime integration tests of core functionality. Stuff like that.
Same principle applies when designing plans for complex tasks, etc. Token amount to grasp a concept is what matters.
https://www.nasa.gov/image-detail/amf-as11-40-5915/
https://www.google.com/search?q=as11-40-5915
https://www.lpi.usra.edu/resources/apollo/frame/?AS11-40-591...
In the case of a fire, I'm sure you wouldn't prioritize your laptop with NixOS over your cat (let's imagine that the only backup is in the house that's on fire).
Web3, Rust, NixOS. The holy trinity of cult-like appreciation. I do wonder what brings forth such fanaticism.
How good mesh can a human produce in the time that it took for the gen-AI?
Jokes aside, it's very promising. For sure a lucrative market down the line, but definitely not for a model of size 8B. I think lower level intellect param amount is around 80B (but what do I know). Best of luck!
[0]: https://www.euronews.com/business/2026/02/19/made-in-europe-...