While the scores are not good compare to other open weight model, the important thing to note is their training data (as they claimed) is very clean, without any synthetic datasets.
260 karma · joined June 7, 2021
While the scores are not good compare to other open weight model, the important thing to note is their training data (as they claimed) is very clean, without any synthetic datasets.
I have no doubt that we will have another wave of cheap retired server gpus just like before. And that is the time when everyone will have their own models at their home.
Or we can just buy the newest medusa halo mini pc. they will be pretty decent, too, albeit pricey.
> We're talking about a world where you need 5% of every knowledge workers salary to go into tokens. 20% if you're a developer.
with that much money, the companies can easily buy their own hardware and hosting free public models, no need for those expensive subscriptions.
I was waiting for a new GPD win max with amd hx 385 or newer CPU. But they are holding the production plans right now, it sucks.
me for example only use nodejs or bun to run a basic sveltekit server, so it can render the html for the first time. all core functionalities are delegated to backend services written in crystal or rust. I don't need some bloated js runtime that hoard 500MB of ram for that purpose (crystal services only take 20+ MB each).
bun promised a lean runtime, every essential functionality is written in zig to increase the speed and memory footprint. and javascriptcore also uses less memory compare to v8. the only thing we expect is for bun to stabilize and can run 24/7 without memory leaking or crashing.
too bad it is a failed promise now.
They are more willing to wait though, so Chinese models are pretty attractive right now.
It's pretty funny that everyone say that this business is unsustainable, but I have yet seen anyone bankrupt, even the pure hardware providers who are renting out a100 b200.
But even when it happens I doubt it would be as cheap as it is right now. Enjoy it while it lasts!
Google has just recently upgraded their TPUs.
Even anthropic who does not own any hardware still have a big margin providing claude models.
And I guess Gemini 3.5 pro will have the pricing increment, too. 12 x 5 = 60?
It seems like google does want us to use Chinese models.
that will ensure the new codebase can still be well understood and can continue to grow in foreseeable future
or you can just vibe the whole experience if it is a legacy project with all the specs and edge cases known.
since bun rewrite is neither of the case, it will be a crapfest soon enough.
To be honest I hate all the new rust replacement tools, they introduce new behavior just for the sake of it, it's annoying.
That's when you know the new world has begun.
one again the world suffers thank to US stupidity.
Recently all papers are about LLM, it brings up fatigue.
As GPT is almost reaching its limit, new architecture could bring out new discovery.
And the pricing is laughable expensive comparr to OVH.