Perhaps, but HN apparently is pretty hostile to people explaining why something is not clear and how it could be more clear based on all the downvotes. I'll keep that in mind: "If you don't understand something, shut up!"
2,796 karma · joined December 27, 2012
Perhaps, but HN apparently is pretty hostile to people explaining why something is not clear and how it could be more clear based on all the downvotes. I'll keep that in mind: "If you don't understand something, shut up!"
This article is a bit more of a grey area. It is on a subject that is deeply relevant to this site and I'm sure some HN readers will get value from it. My point is that an even better submission to HN would have been an article on the same topic but written for programmers rather than mathematicians.
1. It uses math notation. This is a software development site, wouldn't this be much more clear to this audience written as psuedo code instead of a complex series of greek and latin letters?
2. It doesn't step through a concrete example. What is hollow R raised to the (M * d_v) ? Is it a number, a set, a list, a matrix?
To use an example I understand: RAG used to seem complicated to me when only math people were talking about it in math words. For example, let's take a line from wikipedia on embeddings:
> the representation is a real-valued vector that encodes the meaning of the word in such a way that the words that are closer in the vector space are expected to be similar in meaning
What made it clear was learning that generating an embedding is just a function(string) -> list[float], and RAG is just taking a list[float] for your prompt and finding other list[float] that are close to it in your dataset.
So what would make this article more clear, is step through a simplified example of putting a value into a memory store and querying that memory store, showing the actual data structures.
(Admittedly I haven't had a printer for over a decade and I have never printed from a phone, so maybe I am missing something.)
My router advertises both the public prefix from my ISP and a ULA prefix for internal LAN connections (essentially the IPv6 equivalent to RFC-1918). This gives me stable local addresses that do not change and work without public internet access.
Privacy extensions are enabled by default on every major operating system.
The simple trash, recycle, compost stuff works because it is only 3 categories so you can have 3 different colored bags/bins. Adding in the special waste stuff is adding 10+ categories. We'd either need a full rainbow of bins or some special stickers to mark each item (which would be yet-another barrier).
While I'd love at-home pickup, what we really need is for people to just be better.
https://www.nyc.gov/site/dsny/what-we-do/programs/special-wa...
That's the problem: if everything stayed at the current level of development, we would be fine. There is no reason to think that will be the case. Intelligence per watt has been rapidly improving [0]
> 1000x
Coincidentally, that is exactly the efficiency gain promised by ASICs like Taalas [1]
Why would we still be alive? Once we have advanced enough AI inside not only computers but robots, the rich will no longer need us. They will have the robots farm the land, clean their homes, fly their planes, etc. We will then have no income and therefore no way to feed ourselves. Most people do not own enough farm land to keep themselves alive.
In the past, such imbalances of power were resolved because the rich still relied upon the poor for everything (security, food, etc). I think we're approaching the point where even armed insurrection is no longer an option with the advances in automated killing machines. We're not there yet, but it's coming.
Uber : Getting replaced by Waymo
Uber Eats : They've been experimenting with ways to replace humans for this. I think the most likely scenario isn't those silly robots on the sidewalks but rather just a Waymo. Have the restaurant send someone to carry food from the restaurant to the Waymo idling at the curb, and have the customer come out to the street to pick up their food from the Waymo. We lose the door-to-door convenience but I think a lot of people would take that trade to eliminate the cost of tips and paying the delivery person.
Security Guard : AI monitoring security cameras and automating calls to police sounds trivial. There are also already "security robots" that move around so they could be dispatched for scenarios which do not warrant a call to the police.
Handyman / physical jobs : While I think these will last longer than the others, I think they won't last much longer. We've already invented all the necessary hardware. The limiting factor was the software. What happens when you take an LLM from the year 2030 and give it a pile of tokens to write the software to drive the robots to do plumbing/building/whatever.
2 years ago AI was a novelty and essentially just "fancy autocomplete". Today a skilled software engineer can use it to mostly one-shot the whole website with a detailed technical prompt and then iterate on it from there.
What happens 2 years from now? If progress continues, I expect we'll start walking up that chain of command. First you eliminate the software engineers and just have the tech leads do the prompting. Then you eliminate the tech leads and have the managers do the prompting. Then you eliminate the managers and designers and eventually you end up with star-trek-esque programming where some C-level person is just telling their computer "I want a website that sells widgets. Good! Now make the navigation bar blue. Could you make the font bigger?"
So what are your plans for when the wealthy no longer need you?
Getting into the unnecessary details: in classic live ISO fashion, the root (/) filesystem is tmpfs. Then I have at most 1 persistence drive and/or at most 1 9pfs mount. From there, I use bind mounts to only persist the few folders/files that I want preserved. For example, I'll have my persistence drive mounted at /persist and I'll bind mount "/var/lib/etcd" to "/persist/var/lib/etcd". Then when I reboot, everything outside of "/persist" is wiped out and I'm back to the initial iso + anything in /persist. So it is very similar to running a docker image with a volume mount, or running tails with persistence.
I build it all via NixOS and I use Impermanence to manage the bind mounts to the persist drive: https://wiki.nixos.org/wiki/Impermanence
Hugging Face has been acquired by NVIDIA
It is quite exciting to be a part of this journey! NVIDIA has been an active supporter of the llama.cpp project. For more than a year now, their engineers have actively contributed to the codebase, collaborated with the community and provisioned hardware for development and testing purposes. The local AI ecosystem has largely benefited from our joint efforts.
Going forward, llama.cpp/ggml will stick to its founding principles. One of the most important qualities of the project is to be hardware-agnostic. Therefore the development and support of all backends will continue to be done as usual - driven and shaped by the community. Open to everyone who is willing to participate. The existence of such an independent software platform is crucial for the rapid adoption of AI locally and for bringing it closer to the user.
Now, with such a significant partner as NVIDIA supporting us, in addition to the wider Hugging Face team, I believe that our long-term goals will be easier to achieve. We will remain focused on building one of the most exciting projects based on the most exciting technology of our lifetime and making it truly available to everyone in the most accessible and efficient way possible.It sort-of does. Naturally this situation can be resolved much cheaper with a flasher, but in this situation you absolutely have the option to replace the "broken" motherboard, while still keeping your screen, laptop chassis, battery, ram, SSD, wifi card, expansion cards, sound board, webcam. Another commenter said the board is available on Ebay for $270 which is going to be less than just the ram for a new laptop.