HNHacker News
TopNewBestAskShowJobs

angoragoats

890 karma · joined January 17, 2023

YC is managed by a bunch of fascist-supporting jerks.
submissionscomments
angoragoats··on US Government designates host of noblogs.org a "global terrorist"
The name of the party is the Democratic Party.

I am aware of Mamdani using that phrase approximately 5 years before he ran for NYC mayor. Who else has said that?

angoragoats··on Twitter Viewer – View Twitter Without Account
Yes, but LLMs are hallucination machines by design. What I mean by this is that everything the LLM generates is a hallucination, untethered from truth or reality, since the data is generated purely based on statistics around what word is most likely to come next. This type of algorithm can never model "truth" or "fact."

To the extent that an LLM generates something factual or realistic, it's doing so either accidentally, or because of the various band-aids that the grandparent post describes which will never fully solve the problem.

angoragoats··on Nitter and XCancel receive cease and desist notices
> Twitter is good if you similarly curate your experience and don’t let it push you into garbage.

I want to follow the guy who tracked Elon's jet and documented its fuel usage and CO2 emissions. Oops, can't make that part of my "curated experience" on Twitter. So much for free speech absolutism.

The point is that when you're subject to the whims of an irrational asshole, you can't have any assurance that your curated experience will stay consistent. For this reason alone, Twitter is worse than Reddit.

But I don't use either site anymore at all.

angoragoats··on Nitter and XCancel receive cease and desist notices
> only saying Musk is bad because he's using drugs

I never said any such thing. Please don’t misrepresent my words.

angoragoats··on Nitter and XCancel receive cease and desist notices
> Are you anti-drugs?

No.

> Do you think drug users are bad people

No, no one is a bad person only because they use drugs.

> or using drugs is condemnable

As a general statement, no.

But my answer is yes, your actions are condemnable, if you decide to let drugs affect your mental state in any way as you’re making important decisions that affect other people.

For example, if you’re making safety decisions for a vehicle that’s being manufactured. Or if you are making pretty much any decision at all for a company that you run which makes medical devices that are implanted in people's bodies. Or if you’re deciding to gut a government program that is responsible for feeding or medicating thousands of people (meaning that your decisions can directly lead to thousands of deaths).

Do you think an emotionally inept billionare Nazi with a drug problem should have been in charge of deciding whether poor people from other countries (who are often non-white) continue to receive life-saving aid? Do you think if that person makes the decision to cut that aid, killing those people, it's appropriate for him to brag about it publicly using the term "wood chipper" as a metaphor?

angoragoats··on Twitter Viewer – View Twitter Without Account
Agreed for sure. I think part of the problem is that at least for a while, he was good at selling the lie that he was an intelligent engineer, which caused a lot of people (especially tech-savvy ones) to trust him more than the average random public figure. Unfortunately it seems like some people never realized he was a fraud and still view him this way.
angoragoats··on Xcancel and Nitter have been taken down
Option A: You occasionally encounter power tripping mods on a site where you are free to create your own community and become the mod yourself.

Option B: a power tripping drug-addled Nazi billionaire owns the entire site and can change the site behavior for every user on a whim, with no recourse.

This doesn’t seem like a hard choice to make.

angoragoats··on Nitter and XCancel receive cease and desist notices
Sir, you are voluntarily using a website owned by an unstable Nazi, who purchased it because his feelings were hurt and people were making fun of him there. Now his brain droppings make it into everyone’s feed by default, from what I understand.

> There are news that are circulating much faster on Twitter than anywhere else (for example about war in Ukraine).

I am certain that Twitter is not the only place where you can find these updates, if you really care for up-to-the-minute news. But I don’t.

> There are people and companies that post only on Twitter and nowhere else (especially in tech).

These people and companies are (knowingly or unknowingly) supporting a Nazi billionaire and they are not worth paying any attention to until they change their behavior.

angoragoats··on Twitter Viewer – View Twitter Without Account
Where do you live? Because I’m guessing you’re wrong.
angoragoats··on Hacker News now has an active (official) X account
Sure, I assume you mean with userscripts or custom CSS. I can’t be bothered; just going to continue to visit the site less.
angoragoats··on Twitter Viewer – View Twitter Without Account
> Now, on the flipside, the yoke also exists in the Tesla Model S Plaid, which has a traditional manual rack. In here it is the worst god-damned thing to ever curse a vehicle.

Yes, as I said, bad product decisions.

angoragoats··on Twitter Viewer – View Twitter Without Account
> Musk is aggressively optimistic on what can be achieved and by when

That’s putting it quite charitably, IMO.

> but rational on product decisions

Hard disagree. You only need to look to his entire tenure at DOGE for literally hundreds (thousands?) of counterexamples.

Or, if you don’t count that work as “product decisions,” there are other highly questionable product decisions that he is responsible for: the rear doors on the Model X; the lack of instruments/gauges of any kind in front of the driver on the Model 3 and Y; the lack of proper safety sensors/protection for the hood of the Cybertruck, leading to mangled fingers; that stupid yoke steering wheel; and the entirety of Neuralink (just to name a handful).

angoragoats··on Twitter Viewer – View Twitter Without Account
I learned from experience at least a decade ago that you should not take anything he says seriously or as an assertion of fact. Countless examples[0] prove that this is the case.

[0] https://elonmusk.today

angoragoats··on New Mac Studio with M5 Max and M5 Ultra
You can parallelize inference with much cheaper GPUs as well!

I’ve got a 4060 ti 16gb, and I’m thinking about getting another. I previously specced out a cluster using multiple 3090s. At the time, the 3090s were going for $700 on eBay. They’re more than that now, but there’s no need to spend $4k per GPU at all.

angoragoats··on New Mac Studio with M5 Max and M5 Ultra
You seem to be acting deliberately obtuse.

> What about [...] performance per watt which I’ve now mentioned ~~four~~ five times and you’ve ignored the previous ~~three~~ four times?

angoragoats··on Try Omarchy as a native, hardware-accelerated app on an Apple Silicon Mac
Nah, I don’t think I will.
angoragoats··on New Mac Studio with M5 Max and M5 Ultra
Have you ever actually set up a multi-GPU system for inference? Based on my experience you are drastically overstating the problem. Both tensor and pipeline parallelism (without NVLink) produce a machine which is faster than any Mac on the planet, which is what we’re discussing here. Yes, each has pros and cons, and neither scales perfectly linearly. But it works great regardless.
angoragoats··on Hacker News now has an active (official) X account
I flag and hide every single Twitter post that I see. HN’s code seems to be stuck in the 2000s, so there’s no easy way to automatically block or filter beyond that. To be honest, I just end up coming to this site less than I used to.
angoragoats··on New Mac Studio with M5 Max and M5 Ultra
Yes, I agree. What about the other metrics, including performance per watt which I’ve now mentioned four times and you’ve ignored the previous three times?
angoragoats··on New Mac Studio with M5 Max and M5 Ultra
Okay, so you said “Energy efficiency is in another league with the Mac Studio”; I assume you meant that it was more efficient than an nVidia GPU setup. But when pressed, you agreed that’s not actually the case. So it’s not actually that much different in terms of energy efficiency.

> Also while the pre fill performance sucks, the Mac isn’t that slow and can use much better model compared to a similarly priced Nvidia workstation so it’s not really taking much longer in practice.

This is exactly backwards; assuming you mean that the Mac has more RAM so you can use a larger model, the mac is going to be _even slower_ since the fastest Mac isn’t as fast as the average nVidia setup.

My point is that comparing apples to apples (no pun intended), an nVidia setup is both faster and (possibly with some tweaking) more efficient than a Mac.

angoragoats··on New Mac Studio with M5 Max and M5 Ultra
Do I need to quote your own statement to you, verbatim, again?

> Mac studio wins in memory capacity, price, perf/watt and value.

angoragoats··on Hacker News now has an active (official) X account
Anyone got an Xcancel link? Oh wait...

Not a great look, YC.

angoragoats··on New Mac Studio with M5 Max and M5 Ultra
> It is much more likely for your model to fit in large unified memory of a Mac than the smaller more limited memory of a GPU.

I bristle at general statements like this when it obviously depends on the specific Mac and GPU in question. But yes, comparing a maxed out M5 Ultra with an RTX 6000, the Mac has much more memory.

> Even going with two 5090s, you now have to shard your model and that is a PITA.

Every modern tool does this for you automatically. It is absolutely not a pain in the least (e.g. llama.cpp ships with pipeline parallelism enabled by default).

angoragoats··on New Mac Studio with M5 Max and M5 Ultra
You made claims about performance per watt and other metrics which were completely unsubstantiated and aren't backed up by the line you quoted. That's what I was asking for citations about.
angoragoats··on New Mac Studio with M5 Max and M5 Ultra
> Mac studio wins in memory capacity, price, perf/watt and value.

[citation needed]. I have personally specced out and built an nvidia GPU-based machine which after some optimization, handily beat the Mac Studio in terms of tokens/watt for LLM inference with most models. This was in the M2 Ultra era, and I haven't run the numbers for the later generations, but nvidia's cards have gotten faster just as Apple's CPUs/GPUs have, so I would guess that it's still possible to do.

> RTX 6000 wins in performance, if your model can fit into the VRAM.

"if your model can fit into the VRAM" can be true for the Mac as well.

> There are very obvious and clear advantages to a Mac Studio.

There are certain advantages for sure, depending on your use case. They may _seem_ to be obvious, but as evidenced above, I believe that many people overestimate the Mac's superiority on the metrics you cite when comparing a Mac vs. a dedicated GPU for LLM inference.

angoragoats··on New Mac Studio with M5 Max and M5 Ultra
I was not speaking about specific models so I didn’t feel the need to cite any. Not sure why the backhanded insult was necessary. You need multiple Mac Studios to run the largest models as well, so neither is a one-size-fits-all device.

If you can show me a model for which a Mac is faster than the RTX 6000 then I’ll be happy to update or retract my statement.

angoragoats··on New Mac Studio with M5 Max and M5 Ultra
I’ve run the numbers on this, and an optimized nVidia build can meet or beat Apple platforms in terms of tokens per watt, which is the most important efficiency metric if what you care about is using the least amount of energy to generate a given response.

Yes, the Mac might get lukewarm, but it will take 2-3+ times longer to do the same task.

angoragoats··on Nitter and XCancel receive cease and desist notices
This. Stop going to the Nazi bar, or else you too are effectively a Nazi.
angoragoats··on Nitter and XCancel receive cease and desist notices
I have not used Twitter since 2022 (nuked my account) and I have not missed it even once. You should give it a try.
angoragoats··on Nitter and XCancel receive cease and desist notices
I see many, many Twitter posts here. I flag every single one. Many of them are AI-related, and not something from a big tech CEO. It seems that many fans of AI don’t have any moral quandaries with using it. I will let you be the judge of whether that says anything about their moral compass in general.
← PreviousPage 5 of 30Next →