1,189 karma · joined August 5, 2022
Socials: - t.me/szniok
Interests: Cybersecurity, Programming, Web Development
---
Anyone else feels like they can tell when the underlying model is MoE? Dense models are more concise in their answers. MoE seems to stall for time, writing vaugely until a right set of weights gets picked and commits to an answer. MoE also backtracks a whole lot more.
the ai agent is forced to follow some kind of structure you can comprehend. without a framework you don't even have an idea how to refactor this LLM ball of mud
> oh nooooo, what's going to happen to all the Unix vendors with the systems they sell for thousands of dollars?
adobe has fucked their customers for over a decade, is time they're fucked back. I won't miss them. Hope their employees can find jobs at better companies quickly.
also:
>They’re spending minimum $2K to vibe code a Photoshop competitor when Affinity Photo is free and Photoshop costs $200 a year. Not very smart economics.
very smart economics, because they do it once and get to have it forever, for free, for everyone. it's charity.
Opus 5.5 might not be 10x cheaper but it finally made me not hit the limits constantly.
why not try? we'll learn something from it.
Depends on the definition of useful. In a corporation "useful" is "checks regulatory boxes" - it doesn't need to actually be useful, it must just pretend to be useful. Hence all the shit customer service processes. They are useful to the corporation as in that they tick the "we have customer service" box. Whether the consultant just hangs up on you instantly after picking up doesn't matter.
didn't mistral invent the MoE architecture?
They probably have 6.2 just about ready, while 7 and 8 are still being cooked up. You can work on multiple releases in parallel.
We're just getting the latest training checkpoints constantly, just to edge out the other lab, while they are trying to come up with something worthy of a new major version number. It's actually worrying, since there's so much pressure to release now.
It's nothing surprising to anyone who's been to a furry convention. Every time someone tries to label "non-mainstream sexual behaviors" as something objectively wrong, alarm bells in my brain go off.
We've been too bullied in high school to get laid then, gotta catch up now.
Or, the AI is plugged into a machine because efficiency (aka the shareholders need even more profits), and it does some stupidity. And they will be deployed carelessly, because that makes money. And people will suffer.
I set the line at "people" questions. I'll ask an LLM about math, programming, or how to better take care of my flowers. But turning to an AI for the human questions, relationship advice, I don't even understand why one would do that. The machine hasn't experienced that. There is no objective truth to these questions. Asking other people these questions lets you connect and bond.
I noticed a long time ago that each personality trends towards an average of the community they interact with - which makes me even more hesitant to use LLMs outside of work. I don't want to start talking like a clanker myself. I go out of my way to interact with weird people.
Thinking back to pre-LLM days, I would have the same line with classical search engines. I would never Google for relationship advice, since it doesn't know me well enough to actually say something worthwhile.
which the government doesnt want since this will stop progress, while other countries will continue to develop LLMs