1,186 karma · joined July 28, 2010
- having a log of the most prominent J-space tokens during your customer support chatbot's interactions with a user, so you can have more introspection into why a particular outcome happened
- being able to detect certain thoughts associated with undesirable behavior (hallucinations, overstepping authority, lying, etc.) and trigger some sort of remediation (e.g. upgrading to a better model, redirecting to a human, forcing tool calls)That's one of several reasons why a citation is warranted.
It also seems to happen if you type the domain name in the address bar but hit enter when the suggested URL autofills. For me, typing out aliexpress.com fully will send me directly to AE, but typing aliexpress.c and hitting enter (with the autofill completing "om") redirects through vivaldi.com/bk/aliexpresscom-us
And at the end of the day, no matter the installation method (even just unpacking a tarball and executing the program directly from that directory), you're going to run their program on your computer, and then the program can do whatever it wants. Maybe you don't run it with sudo, but https://xkcd.com/1200/ seems relevant.
Once you get enough downloads to where Apple starts wanting to charge you money, you can consider switching to OpenAI or Anthropic or Google or Deepseek or whatever. Sounds like they've even made that relatively easy to do in the Foundation Models framework -- just implement the LanguageModel protocol. I expect open-source or provider-written adapters to pop up that would let you use your vendor of choice.
Define AI, and define "great"
Shouldn't every cell in this column be the same?
The RSA approach from https://rsa-llm.github.io/, expanded on by https://www.zyphra.com/post/zaya1-8b, looks like a promising way to squeeze a bit more intelligence from a small model. As I understand it, running multiple independent thinking traces in parallel gives you a chance of one of them finding a different local optimum, whereas running a single trace for longer is likely to just circle around one optimum.
That said, at the end of the day, there's only so much information a small model can contain. If a model just doesn't know some key piece of information, no amount of thinking will help it figure out a solution that depends on that information.
Tell that to my partner's grandfather, who managed to find and install malware chrome extensions on his chromebox.
Prediction Stats:
Stop Reason: eosFound
Tokens/Second: 21.10
Time to First Token: 1.827s
Prompt Tokens: 42
Predicted Tokens: 187
Total Tokens: 229Otherwise, if you have a GPU with more than like 4GB of VRAM, there are better models. Gemma4 and Qwen3.6 (or Qwen3.5 if you need the smaller dense models that haven't yet been released for 3.6) are a good place to start.
The geometric mean rule of thumb for MoE models is that the intelligence level of an MoE model with T total parameters and A active parameters is roughly equivalent to that of a dense model with sqrt(A*T) parameters. For qwen3.6-35B-A3B, that equivalent size is 10.24B, spitting distance of an 8B model. Good training can make up the 28% difference in size.
For something paid at regular intervals like RSUs, you really should never be looking at the total value of the grant, and instead think of it in terms of how many shares per paycheck/month/quarter/year you vest.
If you've got a cliff coming up, that's different. I'd be pissed if a company laid me off 11.5 months into a 12 month cliff or a few weeks before an annual bonus and didn't accelerate the vesting / bonus.
I still maintain this is why macOS is the best OS for terminal work -- all the common keybindings for GUI tools use a different modifier key, so e.g. ⌘C and ⌘W work the same in your terminal as they do in your browser.
(Lots of the readline/emacs-style editing keybindings work everywhere in macos as well -- ^A, ^E, ^K, ^Y, but not ^U for some reason)
but the expression given is sqrt((x-1)/(x+1))(x+1), which for x=2 would be sqrt(1/3)*3 = sqrt(3)
did you mean Sinh[ArcCosh[-2]]?