1,296 karma · joined December 14, 2022
Weird. I distinctly remember Commodore 64, DOS, and Windows 3.1 at school. Kind of hard to use Windows 95 before 1995, but I am pretty sure I had a Windows 98 SE machine at home when my school finally got Windows 95.
LLMs work on tokens. They literally cannot see individual letters. Yet, unlike humans, they can instantly create a tool to solve this task for them and never be stumped by it again.
I'm so tired of this brain-dead gotcha comment.
For me the cool bit is that it's all in-context learning or whatever so you can use it in any domain with zero setup.
Maybe bert and co. could do all the same things before, but the way in which you use them is quite different and that helps a lot.
I was very excited last year for their coding plan but seeing a burst of requests pulse and then sitting there watching the cooldown reset is really not a great time.
Even though each individual request was fast, the sessions were only maybe 10% faster on wall clock time since there was so much waiting time.
Again, we are not talking about agents or your Python API script but instead talking about exploitable flaws within the inference engine itself. It wouldn't output `rm -rf`. It would output literal CPU instructions that llama.cpp would start executing directly. The payload would never get back to your Python script.
Are there seriously any emacs users who are completely unaware of elisp? Isn't elisp the entire point of picking emacs?
If you give that to an LLM, it is then also able to iterate and develop faster.
The niche language thing is really not a problem at all any more. If you're working in some esolang it doesn't take more than a 1-2k token primer in the context to get great results, and lisp is popular enough to not even need that.
The benefit of having the agent directly in the image like with Autolith here is that it can directly inspect all defined symbols and explore and orient itself automatically. Really doesn't need much guidance to get great results.
For me, it's a law of diminishing returns thing. I would (and have) hand roll assembly if I want actual speed.
But we are talking about personal software. Write once, run everywhere browser's exist with essentially no tooling or complexity or deployment concerns.
What does writing everything in rust get me instead that is worth the significant increase in effort and dev time and deployment?
I run all my apps on my desktop and access them over tailscale. All web apps and I install on phones as PWAs. Super ergonomic.
As for this:
> Local software runs faster
What? Why? Is this some assumption about network requests?
None of my personal software ever has a loading spinner or lag. If it's designed well, each interaction should fit in a single TCP packet so network round trip is imperceptible.
If your web software is slow, that's a choice you've made. Plenty of slow local software around to balance the scales too.
EDIT: Using local files with a web stack is also easy these days. The only con of web software is lacking that native aspect. But native appearance is rare anyway these days with every company just shipping electron bloatware.
It's really easy to do this with server rendered HTML. Put a link with the sort param in the column headers and be done.
It's very rare that I reach for local software these days.
A similar concept: if I type the code via a brain-computer interface, does the interface get ownership because it is inferring my intent? If I type it via an LLM, why is that less legitimately my creation?
It's fine if I vibecode something and never look at or claim ownership of the code, but if I am actively involved in all of the code but it is written to disk by new tools instead of old tools, why is it suddenly not mine?
If I use a fancy brush in Photoshop to paint flowers into a PNG — do I own the resulting image? Code is bytes of text on disk, not much different from bytes of pixel data in a BMP.
If I have to type every character by hand in order to own the bytes, then it would stand that I would have to input every pixel by hand in Paint to own a graphic. No? Even using the Fill tool is automating the creation of those bytes and would mean I don't own them. Right?
I have an intention for some bytes of data to be set. If I use an LLM to set them instead of my own fingers, why are the bytes suddenly not mine?
I do not understand.