If you adjust for writing speed, this model is already more efficient than humans. It can run at 233 tps on a 5090 which is roughly 10k words per minute compared to human typing speed of 80 wpm. If you duty cycle it down from 575 watts of 5090 to human speeds it’s about 5 watts.
All big LLMs already visibly watermark all their text with easy to detect annoying phrases and turns of speech that everyone is already sick of hearing. Why do AI companies keep making their products worse to appease anti-AI, it’s not like they’ll suddenly start supporting it if you do so. If you’re worried about European customers, just relax your firewalls to let more VPNs through, if the productivity boost is high they will use it anyway if their rules keep crippling their own models
You must not use any open source software, because much of it comes with a whole paragraph of ”IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY“
If you’re on AMD, use llamacpp with the vulkan backend. For the 35B I get around 115 tps without mtp and 150-170tps with it. Also the pcie slot you use affects it
During the dot com boom they said data centers consumed 8% of US electricity. It was later proven to be a lie, created with fake studies by coal companies to trick the US into building more coal power plants using environmental activist outrage to implant the idea that the internet needs coal into the mainstream. Make of that what you will
Reminds me of the “Has The Turing Test Been Passed” website. It says no, but if you read on they cite “The relatively minimal funding allocated to AI research” as one of the reasons AI hasn’t been achieved “yet”. Website stopped being updated before it became relevant, so you will never see it say “yes”, similarly to how the Loebner prize mysteriously vaporized when GPT-2 came out, just when winning it for real started becoming an interesting possibility
Antis: "If AI is so useful, where are the AI shovelwares? Where are the AI open source contributions? It's all hype"
6 months later: Matz used Claude and now Ruby runs 86 times faster after 1 month of work
At this point it's impossible to take antis seriously at all. Every claim is disproven simply by the passage of time. History will remember them just like the dot-com antis (that is, it won't)
They didn’t need to wrap it because it’s modular arithmetic so the result after casting to int is the same regardless of wrapping behavior. 4294990000 after wrapping is 22704 and 4294960000 - 22704 = 4294937296 which is -30000 after uint to int cast
But the TSTMP_GEQ macro casts the difference to int, so any number above the signed integer limit (about 2 billion) becomes negative and the comparison returns false as they said
OP had no problem with pointers prior to trying C++. I think there is a case to be made that C(++) makes pointers unnecessarily confusing and there is no real disconnect between understanding pointers in theory and in practice otherwise
What exactly broke? I had this problem recently and thought the keyboard was done for, but turns out you can also replace the switches (not keycaps) and that solved the issue in my case. You have to be very careful though since it is very easy to break the switch or key cap if you remove it incorrectly (this happened to me while I was trying to clean the keyboard)
Afaik sodium batteries are much safer than li-ion and already in mass production. Unless Donut scales up really quick I think it will be more viable to just use sodium batteries for safety in the medium-term future
There's a big difference between things like Metaverse, social media and AI. The former are mainly entertainment/communication products that rely on network effects, so if people don't like them they're bust. AI is a capital good so it doesn't need to be popular as long as it does profitable work
What RAM? OpenAI booked the silicon wafers, they can print anything they want on them. I wouldn't call them "far behind" on hardware when OpenAI are actively buying Cerebras chips.
The reason is that the web empire is just better at operating systems than Microsoft. If they just had less bad development tools for native UI this would not be a problem. Look at what Google does with Android, or Apple.