707 karma · joined November 9, 2014
https://andreasthinks.me/
It's only happening now because labs have bucket tons of VC cash to burn and need a big public flex to raise more cash, or because they're subsidised by the Chinese government. I'm not massively confident either of those will stay true forever.
Is this actually known or just broadly suspected? I could never quite figure it out...
Is it a sustainable model? Not really. Will it all blow up in our faces eventually? Maybe. But frankly, releasing code like this is far, far more sustainable than releasing whole models.
Mistral slightly proving me wrong (and I'm not mad).
https://insidegovuk.blog.gov.uk/2026/03/16/5-things-we-learn...
https://lordslibrary.parliament.uk/select-communications-off...
https://dylancastillo.co/posts/pelicanmaxxing.html
Simon made I think a very good argument for why it's still useful, if not the most robust benchmark in the world.