I am aware of Mamdani using that phrase approximately 5 years before he ran for NYC mayor. Who else has said that?
890 karma · joined January 17, 2023
I am aware of Mamdani using that phrase approximately 5 years before he ran for NYC mayor. Who else has said that?
To the extent that an LLM generates something factual or realistic, it's doing so either accidentally, or because of the various band-aids that the grandparent post describes which will never fully solve the problem.
I want to follow the guy who tracked Elon's jet and documented its fuel usage and CO2 emissions. Oops, can't make that part of my "curated experience" on Twitter. So much for free speech absolutism.
The point is that when you're subject to the whims of an irrational asshole, you can't have any assurance that your curated experience will stay consistent. For this reason alone, Twitter is worse than Reddit.
But I don't use either site anymore at all.
I never said any such thing. Please don’t misrepresent my words.
No.
> Do you think drug users are bad people
No, no one is a bad person only because they use drugs.
> or using drugs is condemnable
As a general statement, no.
But my answer is yes, your actions are condemnable, if you decide to let drugs affect your mental state in any way as you’re making important decisions that affect other people.
For example, if you’re making safety decisions for a vehicle that’s being manufactured. Or if you are making pretty much any decision at all for a company that you run which makes medical devices that are implanted in people's bodies. Or if you’re deciding to gut a government program that is responsible for feeding or medicating thousands of people (meaning that your decisions can directly lead to thousands of deaths).
Do you think an emotionally inept billionare Nazi with a drug problem should have been in charge of deciding whether poor people from other countries (who are often non-white) continue to receive life-saving aid? Do you think if that person makes the decision to cut that aid, killing those people, it's appropriate for him to brag about it publicly using the term "wood chipper" as a metaphor?
Option B: a power tripping drug-addled Nazi billionaire owns the entire site and can change the site behavior for every user on a whim, with no recourse.
This doesn’t seem like a hard choice to make.
> There are news that are circulating much faster on Twitter than anywhere else (for example about war in Ukraine).
I am certain that Twitter is not the only place where you can find these updates, if you really care for up-to-the-minute news. But I don’t.
> There are people and companies that post only on Twitter and nowhere else (especially in tech).
These people and companies are (knowingly or unknowingly) supporting a Nazi billionaire and they are not worth paying any attention to until they change their behavior.
Yes, as I said, bad product decisions.
That’s putting it quite charitably, IMO.
> but rational on product decisions
Hard disagree. You only need to look to his entire tenure at DOGE for literally hundreds (thousands?) of counterexamples.
Or, if you don’t count that work as “product decisions,” there are other highly questionable product decisions that he is responsible for: the rear doors on the Model X; the lack of instruments/gauges of any kind in front of the driver on the Model 3 and Y; the lack of proper safety sensors/protection for the hood of the Cybertruck, leading to mangled fingers; that stupid yoke steering wheel; and the entirety of Neuralink (just to name a handful).
I’ve got a 4060 ti 16gb, and I’m thinking about getting another. I previously specced out a cluster using multiple 3090s. At the time, the 3090s were going for $700 on eBay. They’re more than that now, but there’s no need to spend $4k per GPU at all.
> What about [...] performance per watt which I’ve now mentioned ~~four~~ five times and you’ve ignored the previous ~~three~~ four times?
> Also while the pre fill performance sucks, the Mac isn’t that slow and can use much better model compared to a similarly priced Nvidia workstation so it’s not really taking much longer in practice.
This is exactly backwards; assuming you mean that the Mac has more RAM so you can use a larger model, the mac is going to be _even slower_ since the fastest Mac isn’t as fast as the average nVidia setup.
My point is that comparing apples to apples (no pun intended), an nVidia setup is both faster and (possibly with some tweaking) more efficient than a Mac.
> Mac studio wins in memory capacity, price, perf/watt and value.
Not a great look, YC.
I bristle at general statements like this when it obviously depends on the specific Mac and GPU in question. But yes, comparing a maxed out M5 Ultra with an RTX 6000, the Mac has much more memory.
> Even going with two 5090s, you now have to shard your model and that is a PITA.
Every modern tool does this for you automatically. It is absolutely not a pain in the least (e.g. llama.cpp ships with pipeline parallelism enabled by default).
[citation needed]. I have personally specced out and built an nvidia GPU-based machine which after some optimization, handily beat the Mac Studio in terms of tokens/watt for LLM inference with most models. This was in the M2 Ultra era, and I haven't run the numbers for the later generations, but nvidia's cards have gotten faster just as Apple's CPUs/GPUs have, so I would guess that it's still possible to do.
> RTX 6000 wins in performance, if your model can fit into the VRAM.
"if your model can fit into the VRAM" can be true for the Mac as well.
> There are very obvious and clear advantages to a Mac Studio.
There are certain advantages for sure, depending on your use case. They may _seem_ to be obvious, but as evidenced above, I believe that many people overestimate the Mac's superiority on the metrics you cite when comparing a Mac vs. a dedicated GPU for LLM inference.
If you can show me a model for which a Mac is faster than the RTX 6000 then I’ll be happy to update or retract my statement.
Yes, the Mac might get lukewarm, but it will take 2-3+ times longer to do the same task.