10 karma · joined December 10, 2021
I think they're more afraid of the current status quo. Distilling, writing textbooks, teaching, ...
And currently, I could be wrong but, I see them being blind to the possibilities it brings. AI could very well be distilling maths, spreading it, and nurturing the ecosystem way better than the few elite mathematicians ever could.
“A Severe Misalignment of AI in Mathematics,” with a list of important mathematicians.
This post makes it clear that, to put it bluntly, they’re psychologically butt-hurt.
They talk about misalignment, but this revolution is a massive step forward in the advancement of mathematics. Everyone has access; everyone can collaborate.
Yes, “plagiarism and attribution” are current-day problems for them. But guess what? Those were stupid things to concern oneself with anyway if your real goal is to advance mathematics and the spreading of it.
This whole post kind of reads like their egos being butt-hurt.
There are tons of developers who published open-source code that made all of this possible without any attribution. And that is indeed the future we must inevitably head towards, if one’s ego would allow it, that is, and if one is properly “aligned” with the right goals.
I envision us all collectively talking to a centralized and open AI. This would really ignite human sharing and collaboration.
It is indeed problematic that currently it’s in the hands of some companies, while it should be a public good.
I hope this progression will eventually, finally, trigger the real solution to all of our problems: true global cooperation, global politics, and genuine collaboration as a human species.
But I hold my heart, because if even these mathematicians have misaligned egos, then what’s to be expected of the rest of the decision-makers?
How can you know it will have failed? I don't think it's that hard, if you clearly define the goal well, and have a bit more compute available, and do some intermediary bookkeeping.
And yet, every day, I see us getting removed further and further away from it.
Terrence Tao is living proof, that it cannot hinder even the most elite.
There's always something you can do with it.
What about all the input data into LLMs and the conversations we're having? That must be able to produce a better next gen model, no?
> it's ridiculously easy for anyone to fine-tune training, we don't need frontier companies for that.
Not for me. It'll take me days, and then I'm pretty sure it won't be better than Gemini 3 pro for my coding needs, especially in reasoning.
> For doing math you'll use one model, for intelligence you'll use a different model, for coding a different model, for health a different model, etc, and the reason is simple: it's faster, lower memory, and more accurate.
Why wouldn't e.g. Gemini just add a triage step? And are you sure it's that much easier to get a better model for math than the big ones?
I think you underestimate the friction this causes regular users by handpicking and/or training specific models, whilst the big vendors are good enough for their needs.
I don't think demand will collapse though, since the Mag7 has the cash flow to spend, and they can monetize if the time's ripe.
What do you think?
The closed LLMs with the biggest amount of users will eventually outperform the open ones too, I believe. They have a lot of closed data that they can train their next generation on. Especially the LLMs that the scientific community uses will be a lot more valuable (for everyone). So in terms of quality, the closed LLMs should eventually outperform the open ones, I believe, which is indeed worrisome.
I also felt anxious early december about the valuations, but, one thing remains certain. Compute is in heavy demand, regardless of which LLM people use. I can't go back to pre-AI. I want more and more and faster and faster AI. The whole world is moving that way it seems like. I'm invested into phsyical AI atm (chips, ram, ...) whose evaluations look decently cheap.
I tried out passwords, and combined with Safari, it's an absolute godsend compared to 1Password. That does mean that I switched from Brave to Safari, and thus have YouTube ads, and so I'm now paying for YouTube haha
The issue is trust. Smart contracts as a solution are a sad attempt at solving that issue. There's always edge cases you can't code in.
E.g. in the example of the neighbour buying goods; What if the other neighbours don't really like this guy, and conspire against him?
The solution to trust, isn't codifying every possible variable and putting in on some silly unmodifiable chain. That solution just shifts the trust. Instead of trusting humans, we're now trusting some poorly written code...
The solution to the trust issue is good ethics, mindfulness and good upbringing. If someone violates your trust, it's probably due to some stress factor in that person's life. We need to create a better world for everyone and actually help the people that our violating our trust, and show them the way.