Nah, it’s more like the top 5% hold half. The top 0.1% are at ~13%.
13,312 karma · joined November 8, 2009
Nah, it’s more like the top 5% hold half. The top 0.1% are at ~13%.
Or you can just use any of the neoclouds' shared hosting. The thing for them to be freaked out is that these models are getting good enough very quickly, and all the shared hosting providers can run them for a tiny fraction of what the frontier model companies charge.
>Clipping a green card to every PhD is probably political non starter. As American, I'd be very leery of such a scheme.
There is actually bipartisan support for trying to make it easier for PhDs to stay - both parties have repeatedly introduced legislation to help with that - but it seems to keep getting derailed by arguments about other aspects of immigration reform.
We should clip a green card to every PhD we grant.
Even for smaller models, I think they’ve found that training an enormous, inefficient model and then distilling it internally to something much more efficient to serve is the way to go.
Everyone has a great researcher piped to their desk now. You can have it follow the Twitter zeitgeist for you, you don't have to do it yourself.
Can also just be an asymmetric bet - relatively small outlay with low chance of working, but massive upside if it does, such that it's still positive expected value.
But mostly, I think all these armchair quarterbacks should not have very strong opinions about something that they almost certainly don't know much about compared to the people who build these. The person I responded to cited a random blog that ran some numbers, and includes such gems as "In space, a broken fan or a fried motherboard is a crisis." Just... lol
But I'd also not dismiss what Tim has to say. For much longer than this stuff has been super hyped, he's reliably been one of the best sources of info on some of this stuff, especially about GPUs and how to run things locally.
Good riddance?
Very happy to have my agent totally ignore the ads trying to hijack my attention.
Seems like you all are already doing a lot of what I’ve been aiming for with mine. Are there useful ways to contribute, or have you all gotten it to a pretty good place technically, and it’s mostly a matter of spreading it at this point?
If you decide to give it a download, let me know if you have any issues with it/suggestions for improvement.