1,106 karma · joined November 3, 2014
If you have two coins and you spend one, you cannot truthfully say "I spent the coins". The definite article "the" means all of something you have in this usage, not a single member of a class of something you have. It would be true to say "I spent a coin" or "I spent some of the coins".
Question: what is the percentage increase in tariff amounts on wine between the pre- and post-USMCA state of play between the US and Canada?
Sometimes seeing why something has happened requires considering wider context, which is why it's usually good for a nation to ensure primary education includes solid economics, history, media literacy, etc curricula.
Tariffs raise the consumer-visible price of those goods. This then, due to demand elasticity, causes consumers in those non-US countries to buy fewer of those products.
Some impact may be badwill as well but quite a bit is first-order impact of second-order tariffs.
A fair comparison would be this project vs virtio.
See, for example, Marine Layer in San Francisco, or boutiques like Red Ants Pants.
It's not magic because it relies on the "fuel" of cool water to evaporate.
For example, if you have a training corpus where 50% of the text follows "black bobblehead" with "arrested" and 20% of the text follows "white bobblehead" with "arrested", and your LLM is trained such that it produces "arrest" 50% of time after "<color> bobblehead" regardless of color, that's a bias - the output frequency distribution fails to match the "population" (training) frequency distribution. This has nothing to do with races, ethnicities, whatever - it's just statistics and text. To be unbiased, it would need to be less likely to produce the text "arrested" after "white bobblehead" than after "black bobblehead".
A die is supposed to land on each face evenly - a linear probability distribution. So anything other than a linear distribution is biased. But bias can exist for any desired probability distribution. And for an LLM the desired probability distribution of the model output is one that exactly matches the infinitely-many distributions of the various facets of the training data.
Your point about how in the absense of information a token shouldn't influence the distribution is spot-on. But unfortunately almost any token does condition the output, which means you get biased output all the time.
A human's discriminatory bias against an ethnicity is just one type of bias. The LLM isn't a racist, it merely produces text where that text does not perfectly reflect the training data's frequencies.
If you turn off the power cooling a data center, the servers within rapidly stop doing any computing.
Positive feedback loops are dangerous. Negative ones self-regulate.
In other words, if the text "X is wet" and the text "Y is wet" and the text "X is dry" and the text "Y is dry" each appeared exactly one time in the corpus, it's still possible for a model to end up being produced that is more likely to write wet-like words when it sees X in the context window than when it sees Y.
On a side note, it's very unrewarding to try to explain this type of statistical observation when it feels like (anecdotally, hypocritcally...) the entire world wants to use words like "think" and "understand" and "pick up on" to describe inference and training processes. I'm not making a stochastic-parrot argument here, just pointing out that understanding an LLM's behavior is best done by understanding its conditioning.
The LLMs take in text which conditions their output. That means even nonsense text - such as a "tribal affiliation" to a tribe that may not have ever existed - ALSO condition the output, because the tribe name is a token in the context window and there's no such thing as a perfectly neutral token.
Taking away the race/ethnicity layer for a moment, it might be that an LLM develops a predisposition to emit positive terms (like "accept") when the prompt contains "banananow", and negative terms when it contains "pearian". That's the very definition of bias, and hacking those biases could give individuals serious socioeconomic benefits!
Training tries to produce something that scores highly in training evaluations. With one data point, the evaluation is solely how closely the model output resembles the single input text.
Let's say you do that, and the training text is 58,100 tokens long. Let's say you ask the model to produce 58,101 tokens. Will it "reproduce [the] text verbatim"? No, it can't, because of the dissimilar requested length. Something "new" will come out.
It's also entirely possible that no matter how long you train, the model never converges on generating exactly the same output as its training data - you could end up with an average loss value of 0.001 instead of 0.0. It's not a perfectly deterministic process.
You're correct in principle, but in reality even with limited training data real-world models produce something that isn't exactly their training, especially when sampled stochastically. They're biased toward their training data, not forced to it.
I think the intellectual position "it should be illegal for institutions transmitting money between two parties to identify either of those parties" might require some kind of logical argument behind it. Are you saying all financial transactions should be anonmyous by law? How would banks function if they were required to be blind to their customers? How would the government prosecute money laundering if all cash-trails went cold after the first time they passed a bank?
I understand people often like to express extreme positions on the Internet, but I think it's pretty easy to see an ideal society has rules somewhere in between "you're not allowed to know your customers" and "you can't accept a penny unless the giver does a blood draw in front of you and is confirmed to be in a central register of DNA".
The client could do a challenge-response PAKE with the server, proving the client held the password while not transmitting it. The session cookie could be sent from the server as part of that exchange, encrypted so only the holder of the user's password could decrypt it.
That's not how the web works, but it's strictly superior to the accepted standard of the client sending the raw password to the server, and it would be secure even over an active MITM unencrypted link.
I don't think you intended this, but the word choice here gave me a chortle.
An LLM extrapolates from its context window to the immediate next token. This word applies whether you view what's happening as "reasoning", "prediction", or as a math function.
This feature is usually NOT present in desktop computers, and has only really been implemented by the Google Pixel hardware so far. It's unclear why it's viewed as being so critically necessary for Graphene: MTE is certainly useful but I personally wouldn't say its absence indicates an "insecure" device, and it imposes both a clear performance (and battery life!) penalty and a significant hardware burden on the SoC manufacturer. It's a pretty significant trade-off.
Anyway, that's the biggest single reason why GrapheneOS devs say "this hardware is not adequately secure": 99% of phone chips are excluded because they do not support MTE.
I want to install an app now, and protect against its developer doing a rugpull on my local files later. I do not want to need to review each new app version in advance as I install it.
This is clearly a legitimate case where what the Android security model says I should be permitted to do makes me less secure against an attack by the app developer.
To do that, I wish to store a copy of all the files the app has written to my filesystem, and put that copy outside the app's control. This is explicitly to contain data the app's developer does not WANT me to be able to keep.
A. Is my being unable to do this "more secure"? If so, why is the specific threat I described to my data integrity - an app developer deleting my data - invalid?
B. Does GrapheneOS support this protection, ensuring the device owner is secure against the app developer, or do they instead secure the app developer against the user?
- AI centralizes power in the hands of capital, rendering those who can afford compute hardware vastly more capable than those who cannot and thus increasing social stratification
- AI is generally trained on the creative output of humanity without those who train it giving back proportionally (copyright "rules for thee, not for me")
- AI breaks social processes built around the idea that TRYING something is inherently a cost in time or effort, such as filing a legal claim or sending someone a threatening letter. We haven't made the social changes to punish or charge people for using every appeal/option/application, so this makes asymmetric-effort tasks like applying for a job really bad in the interim
- AI use makes it harder to develop the ability to critically think for yourself, especially among those who most need to develop that ability
- AI produces large amounts of mid-tier content, making it harder to discover exceptional human-created creative content produced after AI started to exist
- AI leads to distrust in remote communication, increasing cynicism and breaking social bonds generally. This is NOT your point about "AI spreads misinformation" - no matter whether it's true or not that AI can be used to produce misinformation, having people doubt each other is a harm
- AI demand crunches hardware and time availability for other adjacent markets, such as computer gaming, construction, 3D graphics production, etc. This harms both hobbies and professions in those fields having to cope with rising prices and lower availability of materials
- Everyone is using the same or similar AI, leading to a homogenization of culture and process across humanity. This is perhaps a mixed blessing, because humans are capricious, but less variety can be viewed as a harm
I will also say I personally hate seeing "job loss" said to mean "wealth loss" or "people starving". The goal of life isn't to have a job, it's to be well and happy. If you can be well and happy without a job, great, so it's really painful to me how people don't even see those things are not the same.
For example, let's say hypothetically I want to be secure against the threat of Google pushing a targeted update to my phone that runs malicious code. Turning on automatic software updates from Google would make me vulnerable to that threat. Using MicroG instead of Google Play Services would make me less vulnerable to that threat. But Graphene devs say things like "MicroG is less secure than Google Play Services".
Similarly, if you want privacy you might secure your device by locking the bootloader with your own keys - not a third-party vendor's keys. Saying that's "insecure" is extremely misleading: it just puts you in charge of security, instead of abdicating to someone else.
I wish there were something like GrapheneOS that let you choose, yourself, who to trust instead of requiring you trust an OS vendor implicitly.
Also nobody would offer the contract in the first place because the employee would keep their inalienable right to choose how they spend their own time (not working).
EVERY contract is about giving something up in exchange for getting something. In most legal systems a contract is void if either party gives nothing. So in a world where nothing can be signed away, no contracts exist at all.
If it were inalienable, things like regional distribution agreements would be void, since you could sign away your ability to sell in a certain country and then compete with your distributor anyway.
Let's keep some perspective here - there is no "inalienable right to sell apps to smartphone users via a private commercial storefront".
It doesn't matter if the false partition is unlocked or not - you can plausibly deny there's anything on the phone at all.