2,208 karma · joined April 3, 2012
What's the alternative? No pre-release review at all? As a user I would hope that this will not be the case, especially now that we have confirmation that flashy supply chain attacks are being executed in the wild. In fact the review policy protects gorhill himself too, since it makes him a bit less attractive as a target for a rubberhose attack (no point in blackmailing him to put in spyware if the spyware would be caught before release).
In fact, it is sometimes entertaining to imagine that somewhere in the depths of the GNOME cult compound, they keep a single individual, who is legally blind, physically incapable of using a keyboard, simultaneously belongs to all demographic groups that are traditionally underrepresented among computer users, and has in fact never used a computer themselves but was shown a few things on an iPhone by their Gen Alpha great grandnephew. All these factors combine to turn this person (affectionately referred to as Mother Gnome by those in the know) into a utility monster of UI design, so that it becomes an absolute moral imperative to design things to appeal to them, at whatever expense it takes.
Not that your point isn't actually a good one - we do now often see the worst of US-made culture war toxoplasma (in all stages of its lifecycle) being imported wholesale into European cultures where it is barely relevant to local circumstances, which I would squarely blame on sufficient English skills and superior production value of anglophone politics.
I would fully expect no improvements before this lands in stable. To add insult to injury, they might even say that they trialled it in Nightly and found it to be a great success.
Unless you believe it to be so, it seems quite strange to assign any significant share of the blame to Assange for any hypothetical deaths that may occur as a result of him taking actions to reduce the US government's ability to kill people abroad, akin to blaming police who stop a hostage-taker because this might have prompted the hostage-taker to kill the hostage but holding the hostage-taker himself blameless.
I think this understanding of the EU's behaviour may be insufficiently cynical. There's one pattern in politics that is very hard to not see everywhere once you have been primed to, which is "high + low against middle": the faction that is in power allies with one(s) that is so far away from power as to never become a credible threat to it, in order to put the squeeze on a third faction that is actually a serious contender for the position of the first.
A canonical example that's sufficiently historical that it hopefully won't be too incendiary was the practice of early communist states to elevate individuals of peasant/worker background into positions they were unqualified for, as in the famous case of Lysenko - here, high (party brass) supported low (peasants/workers) at the expense of the middle (bourgeois intellectuals, represented in that particular instance by academia, who could have been organised and experienced enough to orchestrate a palace coup).
Within the US, the federal government/military/foreign policy complex and tech-based New Money are widely recognised as two distinct power centres, with it at times being unclear if the former can actually fully dictate terms to the latter. Under normal circumstances one would expect the former to champion the interests of its industries on the international stage, and indeed the US is known to have very sharp elbows in this regard (from the famous oil wars in the Middle East via the slightly less famous fruit ones in Central America to the backdoor arm-twisting in copyright matters). The picture for the tech industry looks quite different - far from starting a war or even merely successfully lobbying the EU to drop its regulation, the USG is looking away and whistling. As it happens, out of the four industries mentioned (oil, fruit, media, tech), the tech industry happens to be the one that is by far the most autonomous and misaligned with federal government interests (Apple randomly grandstanding on privacy, everyone wanting to keep their Chinese supply contracts and market access, general abundance of politically engaged progressives and libertarians...). Wouldn't it make sense if what happened was that the USG (high) actually gave the EU (low) a tacit go-ahead for their anti-US-tech measures, and perhaps even indicated to everyone involved that they may let them crack down even harder if the tech industry (contender for high) keeps falling out of line?
Sophistry about how my solution won't scale to a million users per day or I should have used their framework from the start rather than having a bunch of HTML files won't matter to me nor the <10k people I expect on my website. In many cases, modern languages and frameworks drive adoption for themselves by tricking you into solving a problem that is not actually the problem you have, but they happen to be adapted to.
If anything, we should be grateful for this situation; in a worse world all these governments would abide by gentlemen's agreements to not act against each other when it comes to controlling their subjects, notwithstanding their differences.
To experience the actual ideologies of AI and consolidation of power, one may try to submit an AI paper that dismisses the Gebru and Torres conception of safety as a goal, or, if feeling especially cheeky, push back against Foucauldian discourse being appropriate for deciding questions of scientific ethics and purpose, for example in one of those "how can we improve review and grow our community" sessions every other CS conference seems to have these days. I doubt the pushback will be confined to a few side remarks from a single stray reviewer (no doubt since reprimanded and/or blacklisted). This camp has won comprehensively, and yet here they are talking up a tiny pocket of sheepish anonymous resistance as if all the powers that be were aligned against them.
I do think that there is a real risk that the numbers are wrong (not necessarily "fabricated", as this implies malfeasance, but possibly based on an erroneous measurement insufficiently questioned due to an excess of trust from themselves and others, as the mmap ones were). This is also in part based on the circumstance that at the time (of the mmap story, and myself being more involved in the project) I was actually involved in trying to optimise the SIMD linear algebra code, and unless llama.cpp has since switched to a significantly less performant implementation the proposition that so much more performance could be squeezed out strikes me as quite surprising. Here, your intuitions may say that Justine Tunney is just so brilliant that they make the seemingly impossible possible; but it was exactly this attitude that at the time made it so hard to evaluate the mmap memory usage claims rationally and turned the discussion around it much more dysfunctional than it had to be.
> I'm glad you're happy with the fact that LLaMA 30B (a 20gb file) can be evaluated with only 4gb of memory usage!
The line you quoted occurs in a context where it is also implied that the low memory usage is a fact, and there might only be a bug insofar as that the model is being evaluated incorrectly. This is what is entailed by the assertion that it "is" sparse: that is, a big fraction of the parameters are not actually required to perform inference on the model.
My personal main gripe with JT really was the tone they adopted in the Github discussions, and the effect of the large numbers of drive-by supporters, who were often far less restrained in both unfounded claims about Justine's accomplishments and attacks on any critics. (At this point I'd also like to note that I consider some sibling comments to be uncomfortably hostile in a personal way, like the "hit piece" one.) I think that as a public persona, especially one who actively pursues publicity, you have some responsibility to restrain your followers - Justine, I get the sense, instead uses them as deniable proxies, as also seen with the instances where instead of straight up putting their signature on the "RAM usage reduced to 6GB" claim they instead choose to post a collage of screenshots of supporters making it.
There is nothing wrong with holding people in esteem for their achievements, but in this case the degree of esteem really seems to be excessive. This is not a matter of simply being annoyed that people like "the wrong thing" - the mmap situation was significantly exacerbated by the presence of irrational/excessive supporters of Justine's as well as the irrational/excessive detractors that emerge wherever the former exist.