Come on Facebook/Zuckerberg, set them up with a structured fund that is invested in s&p500 or something equivalent/better and allows them to pay a handful of devs and a person to admin them (all surplus can be earmarked to go to charity to avoid the sinkhole of bureaucracy from a larger org). Would set the PHP Foundation up for life and the whole world would be better off as a result, smallish directed investment with huge payout from a value perspective.
I tend to agree, it's a flipping ridiculous situation; if a local bikers gang had done that on purpose through fire/malaise/whatever they would face severe personal repercussions whereas corporate malaise that is committed on purpose is basically met with the expected outcome: i.e. a fine which is turn was already in the spreadsheet as a calculated expense. Need upgraded law apparatus to deal with it for sure.
This is why local LLMs is THE most interesting thing at this moment in time; the distribution of the tech is fundamental to it's long term viability. But now that this is happening in very solid fashion I would wager that LLMs are technically akin to most things a modern humans use during their daily life, utterly beyond their capability to understand, yet totally practically useful - this trend has been going on for hundreds of years at this point.
A lot of it could probably be brought back to consumption patterns or present day issues with war and outsourcing.. but.. https://wtfhappenedin1971.com/ is worth a (re-)read since I gather this is more of a more macro-structural outcome as opposed to a sudden thing.
Actually think this one-language-focus is the way forward, instead of training AIs for all languages under the sun it would be incredible to have models solving all issues via one very well understood/and-tooled-for language. I'm aware that the model training cross-benefits from different languages so obviously provisions would have to be made for the benefit of this to show.
Yep, it's true, but the reality of what it would take to actually fork and commence with healthy use of AI alongside with the elusive soft/hard stance needed to lead technically and socially is probably a bigger challenge than anyone is willing to take on! Soo.. slow and (rather?) well it goes for Zig.
I for one do not get the hate, nobody needs to use/or-waste-time-commenting on this project if they have no need/want. However, I do agree that it needs some more contributors on-board alongside with a couple months more support and bug squashing. And yes: better rewrite that website without the clanger involved in the wording! ;)
On a positive note: the performance is genuinely impressive.. what does it take to unlock this performance if I'm NOT running one of the big "usual" frameworks? The devil is always in the detail, best get some practical advice up on exactly what needs to happen with a medium piece of custom code to get it to said max performance.
Guess technically true absolutely; I gotta admit I assumed they wouldn't bother implementing the instruction sets unless there was functional, i.e. prospect of reasonable speed, aspect to it.
Given the almost religious attention the term limit of sitting presidents of the US has it is interesting that so very little attention is given to the fact that the EU structure has no effectual limit at all; if the current EU President were to be nominated by the European Council in a circular manner she will effectually serve for perpetuity (while the Parliament can in principle say no they are only ever given one candidate to vote for (...) and has thus far never said no to any nominee).
I for one hold out for them releasing an optimized XFCE variant - don't by any means dislike keyboard driven software but I like it as an extension of a regular functional UI experience not as a "argh the windows are stuck in xyz pattern until I re-remember xyz combo"-experience: the UI surface is not the speed limit in my optics, rather it is the apps I use or (increasingly due to local AI) the computational hardware limits of my machine.
>> The new logo: basically identical to Claude's current one but blue. The new name: Spark. Conveys: absolutely nothing, the blank slate business, our executives don't actually know what we do.
This is my experience as well, people drawn to leadership in our present time often have absolutely no idea about anything except the -idea- of business. Which of course makes things vaguely "professional" seeming while they effectively destroy businesses/organisations.
Talking about bad design what on earth is going on with Amazon's new fav-icon, it's the same reddish-orange as Alibaba and Aliexpress and looks utterly unremarkable.
In a sense it's a clean reminder that all these, especially non-local, llm tools should NEVER run outside a container. I'm currently looking at z-jail specifically for these scenarios; VMs are too heavy & expose too many sec issues of their own for continual integrated use in my case.
OK, I appreciate your excitement and the work you've done here. Also; when presenting a benchmark it -needs- to be done as a comparative measure, i.e. how are those numbers on a vanilla 9b, let alone decent quant of 3.6-35b-a3b? What have you achieved here?
Honestly think a lot of this article is ai babble - check how it ends on several classic ai negative triples such as "you’ll pay both bills on it just the same — plus you’ll comprehend it less, because you didn’t write it." ... etc.
Brexit promised a solution just like loads of solutions had been promised within the EU framework prior to it - all these "solutions" were akin in that they were all promised (from left and right within the political establishment) and all not delivered. This is also why people seek to go outside the regular voting pattern with Reform, it's not cause they suddenly love something completely different but because the former voting pattern did not deliver improvements as expected.
I do find it fascinating how blatantly people lie about things, the article mentions "Organic farming uses 84% more land for the same yield, but yields are 55% lower by area than conventional." yes, and that is the exact signature indicating that organic produce receives less harsh chemicals and is less exploitive of the ecosystem than "regular" produce. Not worth the read, it's simply anti-organic propaganda. Note: I'm not personally religious about organic/not-organic but neither do I enjoy overt misinformation campaigns.
By pointing out the exact things that will likely happen you are oddly enough hedging against (at least some of them) happening!
A) I reckon it's true that smaller models will continue to improve massively through optimization and better and better harnesses, this tech is all still very young and A LOT of resources and (good-)will is being thrown at it.
B) The 1T+ models will be able to sideload and improve upon a lot of the fundamental improvements that happen to the smaller models to speed up incredibly while getting better at tools while (on a gradient) getting -more- things right.
C) More of an observation that I think is worth keeping in mind clearly; Karl Popper's black swan and all, truth in our temporal world IS a gradient!
Worse in my opinion since the look is simply Tesla (whether one likes that or not), no one would have blinked an eyelid if Tesla released this car whereas Ferrari doing so comes off incoherent.