6,843 karma · joined February 15, 2023
So if you can't call/use the 'library' from the 'native' language, it's still a library? Whatever floats your boat. Lol.
They are python libraries because people reached for those languages so they could continue work in python. They are there to serve python and nothing else. It's the same with Rust. It's by no means a C++ thing.
EDIT: Not saying this is always the case. Qt>Pyside is an example where it's both technically and functionally bindings, but the vast majority of the time they are serving python. Some don't even have a native library to speak of.
They are Python libraries. Don't make the mistake of screwing up the cause and effect here. C, Rust etc - those are the replaceable parts of the chain. There is an official C++ pytorch library and virtually nobody uses it for ML Research. People want to code in python and build those libraries so they can.
Google, the titan mega-corp with more money than they know what to do with and a billion+ android devices to ship gemini on and it's made no dent for ChatGPT's consumer growth and adoption. Yet some plucky open source chinese models will?. It takes more than that.
People are naturally sticky. If they're satisfied with a product, they'll stick around unless something comes along that is so much better it gets people talking. Open AI's 1B+ customers won't give a shit about Chinese models. Enterprise customers won't move to Chinese models, especially just to save money. They are a non issue, especially if the M.O is just going to be playing catch-up.
>Coding agents competing with free weight models unencumbered by development cost?
Prices falling doesn't mean a market dissapears. Compute, Bandwidth and Storage requirements have already undergone reductions orders of magnitudes in the last few years and consumption has only exploded. The vast majority of customers, consumer and enterprise alike do not give a shit about open weight models. I have no idea why people here think they do. If they pull ahead significantly enough then they might attract people by value of the amazing service they're providing (nothing to do with open weights).
If they're just going to be playing catchup then they're not gong to gain any signifcant share no matter how free model dev costs become. This is just not how customers work. They're sticky. They value reliability and familiriality and simply having something that works. If you want to unseat google search then you need something so far better people start talking crazy about it. Creating Bing won't do shit even if it's the default search engine on your default browser (you'll just change it).
>I'm not sure if you're claiming a market for original math research, large enough to be more than a distraction, or perhaps you are imagining AGI will emerge from pursuing the problems that mathematicians have set for themselves?
The economic output of math research is very often something other than mathematics. It's not about the market for math papers.
When you see stuff like this
>> Earlier in the year, we had largely handwritten the first version of the git-to-Scion ingestion pipeline as a prototype. We thought it was good—until we got our hands on an early internal snapshot of Claude Mythos Preview. We asked it to rewrite the whole thing, and with no further instructions, it produced a version that consumed 20x less memory and was 4x faster, while preserving all of the implicit invariants around ingestion ordering and data structures.
Do you imagine the gaining advances in math competence had nothing to do with it ? I'm telling they'd be well justified even if their only customer was themselves.
>Good luck with that. Let's see how much ad revenue OpenAI can take away from Google and Meta. The ad-serving product better be free, since the competition is.
They hit $1B in annualized ad revenue run rate ~200 days after launch. They'll be just fine. That you think they might have any trouble taking away or generating their own ad revenue is quite bizarre. If the metrics are good businesses will pay hand over fist, and it seems to me that OpenAI should have a much more complete profile of their median user than Facebook or Google.
>Coding agents competing with free weight models unencumbered by development cost?
The utility of frintier agets isn't remotely limited to software developers. Whoever cracks marketing for agents towars non software professionals will make a lot of money.
And you seem to be confusing the immediate commercial value of a particular math reuslt with the commercial value of a system capable of producing original math research. Thise are 2 different things, and the latter is worth a lot of money.
>AI is in some ways still a technology looking for applications, at least applications with a large enough commercial market to justify the valuations these companies are seeking.
These companies already have the fundamentals they need to justify current valuations. ~1T is nothing to a company that has over 1.2B+ weekly users (and growing) and is entering the ad space, nevermind everything else. What they are hoping to achieve will give them power akin to nation states. Current Valuations would be nothing compared to that.
So now it's just a question of, do you sit on your advances or release them? Why would sitting on them be the 'right thing'?
Where are the verifiable rewards? It's simply not true that RLVR amenable domains are the only things LLMs are improving massively on. Even Vending Bench is improving.
Intelligence is a jagged beast. That's just the nature of things. We evolved in certain environments and situations and sometimes there's a mismatch and it causes all sorts of wonky things. We just call them funny names like optical illusions and cognitive biases. Most people fail a simple conditional reasoning problem unless it’s dressed up in familiar social context, like catching cheaters (Watson Test).
It's fascinating the hills people will die on. Let's even set aside the fact that LLM internals are mostly opaque but logical branching points ? Look at the Watson test. Most people fail a simple conditional reasoning problem unless it’s dressed up in familiar social context, like catching cheaters.
Where does this idea of general intelligence as logic automatons actually exist ? Because it's sure as hell not real life. Humans are not like this, Apes are not like this, Birds are not like this, Cetaceans are not like this. Fiction. Fiction is the only realm this reality of GI exists, so it's patently absurd when people hide behind it like anything that doesn't present as doing it must be obviously wrong.