2) AI is forcing UI evolution that is hard to anticipate, but I suspect will be served well by having more kinds of inputs available in advance.
4,886 karma · joined December 11, 2023
2) AI is forcing UI evolution that is hard to anticipate, but I suspect will be served well by having more kinds of inputs available in advance.
What does this mean then?
> they got 0.39 tokens/second on a network consisting of 15 $55 Android TV boxes running Gemma4-26B-A4B
Uselessly slow, probably made the TVs so CPU pegged most users would end up restarting theirs and killing the whole thing, and with a model that isn't close to this capability.
Still feels like a stunt? A bigger model would be more capable and could surely find actual GPUs to run on? Or even more likely, just steal keys to run inference on Claude's own APIs?
Part of what feels annoying about this to me is that there are genuine open source efforts being made to run models on any hardware possible because these huge AI companies are hoovering up all compute, and now they are trying to tell us even our TVs can't be trusted while their massive data centers are behind these massive breaches that keep being reported?
Are they trying to tell us they have <1B param models that have Opus level hacking ability? Because otherwise this really just reads like another thinly veiled attempt to sabotage the open weight community.
And in any case no, you should not pour your money into tech stocks if you need that money to eat, that was true then as it is today.
A lot of my gig work comes from non-technical people who started down the path with vibe-coding and need bailed out. I foresee a future where I'm overseeing a larger portfolio of projects that just need me to keep things from going off the rails completely.