Makes me think that mass analysis of archive.org websites (on a much larger scale than 2000 sites) for color distribution from screenshots or other stuff like this is a cool project ripe for picking.
> It took them two months, to develop chip for Llama 3.1 8B. In the AI world where one week is a year, it's super slow. But in a world of custom chips, this is supposed to be insanely fast.
LLama 3.1 is like 2 years at this point. Taking two months to convert a model that only updates every 2 years is very fast
I'm predicting some wave of articles why clawd is over and was overhyped all along in a few months and the position of not having delved into it in the first place will have been the superior use of your limited time alive
What surprises me is that this obvious inefficiency isn't competed out of the market. Ie this is clearly such a suboptimal use of time and yet lots of companies do it and don't get competed out by other ones that don't do this
OpenAI and google are too scared of music industry lawyers to tackle this. Internally they without a doubt have models that would crush these startups over night if they chose to release them.
I find it helps me just forced to be focused on a task for a few hours. Just the blocked out attention I spend on it will help refine and discover new problems and angles etc. I don't think just blocking out the time without actually trying to code it (staring at a wall) is as effective.
I love apple and mainly use one for personal use, but apple users consistently overrate how fast their machines are. I used to see sentiment like "how will nvidia ever catch up with apples unified silicon approach" a few years ago. But if you just try nvidia vs apple and compare on a per dollar level, nvidia is so obviously the winner.
People always claimed this as a data leak vector but I've always been sceptical. Like just writing style and vocabulary is probably extremely shared among too many people to narrow it down much. (How people that you know could have written this reply?) The counter argument is that he had a very specific style in his mail so maybe this is a special case.
> Training and serving frontier AI at scale takes hundreds of thousands of GPUs. xAI’s Colossus cluster reportedly has 200,000 GPUs. OpenAI has plans for millions of them. Competing in this market would require launching hundreds of thousands, if not millions, of satellites into space
No? You'd only need one with lots of gpus on the ship at the same time
Maybe off topic but this site feels very vibe coded to me. Doesn't mean it's necessarily slop, it seems interesting. But I guess it's just too much effort on the UI and other things like that which someone with a limited budget wouldn't spend time on (but an AI can) vs the core thing. Just an observation (and apologies if I'm wrong).
Eventually robots will do this but as long as humans do the actual irl actions it makes me think of a dystopian future where all leadership decision are made by harsh micromanaging AI bosses and low paying physical labor is the only job around for humans.
Does regulators really care about a predicted age? I feel like they require hard proof of being above age to show explicit content. The only ones that care about predicted age is advertisers.
I think this is kinda sad. I always thought coding was so beautiful for creating a (good paying) job for socially awkward people on the spectrum who pre-coding was considered dorks and went into idk what but probably some unsatisfying job. It seems like we're heading back to that which makes me sad and worried about the highly functioning autistic population.
It being activated by microphones makes me think you could add speakers to this tiny format and make a tiny digital instrument that's influenced by blow intensity etc.
The best counter argument to that is that he did manage to predict/make into reality electric vehicles (when going into that industry was crazy) and reusable rockets. If someone makes a thousand moonshot attempts but still succeeds with two that's impressive.
Ultimately capitalism doesn't care if a job is fun or not. The vast majority aren't I've realized. It's an odd bit of coincidence that coding with flow is hugely enjoyable but it seems like that amazing job at this rate will be a momentary bit of history where profit making and fun had a non zero intersection for a strange reason.
Don't really see why you'd need to understand how the transformer works to do LLMs at work. LLMs is just a synthetic human performing reasoning with some failure modes that in-depth knowledge of the transformer interals won't help you predict what they are (just have to use experience with the output to get a sense, or other peoples experiments).
Would be interesting if the US decides to ban or heavily tariff these chips and if the consequence will be significanly cheaper data center access through chinese-owned sites/platforms
We have this in sweden and it works fine. I kinda think the US would be better off with this since it'd lead to less crime or lower costs to investigate it