20 karma · joined January 7, 2025
Writing: https://istvan.xyz | Studio: https://www.avantmedia.uk
What I am trying to get at is that the frontier is great, but you can be fine with less as well.
They are not wrong, it feels like that Game of Thrones season where someone thought it would be a great idea to let the fanatics re-arm.
> The real story here is that this may be the beginning of governments restricting the availability of strong LLMs to the public, to you. Fable was the strongest model on the market, and the US government has told you you can’t use it (technically, only if you’re not a US citizen, but in practice, even if you are). If you think the solution here is going to be open source Chinese models and / or running on your own hardware, think again. Do you think China is going to allow the strongest LLMs from companies within its borders to be open source a year from now when they have Mythos capabilities, if the US government is keeping the strongest American models back? Unlikely. These are heading in the direction of being powerful cybersecurity weapons and it will be in the interest of nation states to restrict and control them. In 2 years time, I would be surprised if the strongest LLMs are available for general use at all.
The world is a bit bigger than US and China, if Anthropic did it, another company can do it as well.
I am highly skeptical about Mythos's part in the whole cyber security angle and Anthropic seems to agree with me:
> We have reviewed a report that we believe is the basis of the government's directive and validated that the level of capability displayed there is widely available from other models (including OpenAI’s GPT-5.5)
It does sound funny to hear this from Anthropic after they spent recent months with scaremongering about Mythos's capabilities, now they say it was a prank bro, you can actually achieve more or less the same with good old GPT-5.5.
> Will we be the poorer for that, or will we be safer? I think poorer, because I hate being told what technology I can and can’t use, but I’m not certain. Maybe you think the government should restrict strong LLMs. Maybe you don’t. But either way, this is big news and a rubicon has been crossed and a precedent set. That’s true even if the motivation for this is just the government settling scores with Anthropic.
What this has demonstrated: if you can't run the software on your own hardware, you should assume that it can be taken away at any moment.
The US government found a jailbreak that allowed the user to make Fable do bad things, this is so dangerous that this model must be held back in areas that are not the US...
If this is so dangerous why allow US nationals access to it? Are there no evil people in the US?
Going back to my perspective: let's say I control a big enterprise or a government body, how should I view this or US technology? Should I be like: yes, let's use US tech, they are a reliable partner and would never abruptly cut us off! Or should I be like: there are competent alternatives out there and if your work hinges on wether or not you had access to Fable 5, then your business is probably not going to survive for long.
What if you have two machines and the one you give to the agent is constantly backed up?
I am not complaining, I like my investor subsidised tokens, I don't see what these companies see as their end goal when it's becoming more and more possible to run a competent LLM locally(even with today's RAM prices).
I am surprised that there is no Claude or ChatGPT machine that I could buy, I feel like they should be opening up that model, but I guess subscriptions look better on balance sheets.
Your job is now to get the LLMs to write good code the same way you would do it if instead of AI agents, you would be leading a team of humans.