HNHacker News
TopNewBestAskShowJobs

MichaelRazum

427 karma · joined August 30, 2019

submissionscomments
MichaelRazum··on "Jewish Mathematics"?
is it not similar to what happens in the US?

https://m.youtube.com/watch?v=cTokizGa6zQ

MichaelRazum··on Grok
Thanks a lot for the hint :)! It awesome that it might run even on a MacBook, actually this is a reason to switch to Mac. Seems, there is nothing similar for a PC laptop with linux or windows.
MichaelRazum··on Grok
If I may ask, how do you load such big models? 300gb seems like a lot to play around with.
MichaelRazum··on Devin: AI Software Engineer
This is awesome to bootstrap some ideas. The question is can it work with (large) existing code bases or modify it's own code. Guess a good test would be, can it reproduce Devin;)
MichaelRazum··on Ask HN: Free online courses for gifted maths students
The Problem is math=!math.

To be honest, this might be very challenging. BUT it may be possible. Just try entry level Analysis or Linear algebra. They often start kind of from scratch. How to construct numbers and so on. You could go very slow but at least you would be ready for real math...

MichaelRazum··on Mixtral 8x7B: A sparse Mixture of Experts language model
Exactly, same thought. Actually I would expect, that they trained each expert separately and later together, since you need to train the router network as well. I'm far from an expert in LLMs. But this would be interesting to know, especially how different training setups influence the performance.
MichaelRazum··on Blueprint health protocol
Maybe the guy is overdoing it (obviously). On the other hand, it seems that he put a lot of research into optimal nutrition. So would consider the meals pretty solid.
MichaelRazum··on [dead]
Human Rights Watch is biased

https://en.wikipedia.org/wiki/Criticism_of_Human_Rights_Watc...

MichaelRazum··on A Mathematical Perspective on Transformers
Maybe the right title would be a (statistical) physics perspective...
MichaelRazum··on Ilya Sutskever has become invisible at OpenAI, his future uncertain
Exactly, he could go and train grog. But seriously, some AI companies raise with ease 100MM or even more. Guess Ilya would have no trouble to raise the same amount or even more. He knows for sure what is needed to get to GPT4 level.
MichaelRazum··on AMD MI300 performance – Faster than H100, but how much?
It costs about 20k$ as far as I understand. Why is it so expensive?
MichaelRazum··on Nvidia H100 GPU Shipments by Customer
Maybe, if you already reached the atmosphere with it. Obviously, current AI tech scales with compute. It "may" be the case, that just more compute is enough to reach the moon..
MichaelRazum··on Nvidia H100 GPU Shipments by Customer
As I understand a H100 (SXM) gets you about 4 Petaflops on FP8. So 150k H100 is about 600 Exaflops on FP8. That is huge. Maybe enough to get AGI?
MichaelRazum··on Show HN: Dobb·E – towards home robots with an open-source platform
Same thought. For 20k$ you can get a car. What you get here, at least looks like, a roomba with an arm gripper.

I understand why it is so expensive, since it is not a mass product. Or in other words, it should be 10x cheaper, if it would be a mass product.

MichaelRazum··on Microsoft joins OpenAI's board with Sam Altman officially back as CEO
Just curious. What type of "stuff" is discussed in a board? I mean, if it is about methods/approaches/techniques that worked well, then msft gets the full insight, or do I miss something?
MichaelRazum··on Training for one trillion parameter model backed by Intel and US govt has begun
Have seen an interview with someone from openai. At least they claimed, that they are far away from running out of data and they are able to generate data if needed.
MichaelRazum··on Training for one trillion parameter model backed by Intel and US govt has begun
Was thinking the same, so 1T might bring you to the league of GPT-4. Actually in the best case, since it seems that meta, google, openai and so on have the most talent.

Anyway, to bring it to the next level, how big should it be? Maybe 10T? 100T?

MichaelRazum··on We have reached an agreement in principle for Sam to return to OpenAI as CEO
You could say the same about any person on the top. In general CEO's do not do research. Still they are critical for success.

By the way the AI scientists get a lot of respect and admiration see Ilya for example.

MichaelRazum··on Sam Altman, Greg Brockman and others to join Microsoft
Haha, agree, it would take longer for sure.

What I meant is, most likely assuming that you are using pytorch / jax you could code down the model pretty fast. Just compare it to llama, sure it is far behind, but the llama model is under 1000 lines of code and pretty good.

There is tons of work, for the training, infra, preparing the data and so on. That would result guess in millions lines of code. But the core ideas and the model are likely thin I would argue. So that is my point.

MichaelRazum··on Sam Altman, Greg Brockman and others to join Microsoft
I think you overestimate the technical part. Just speculating (no inside, no expert), but I would assume that the models are pretty "easy" and can be coded in few days. There are for sure some tweaks to the standard transformer architecture, but guess the tweaks are well known to sam and co.

The dataset is more challenging, but here msft can help - since they have bing and github as well. So they might be able to make few shortcuts here.

The most time consuming part is compute, but here again msft has the compute.

Will they beat chat-gpt 4 in a year? Guess no. But they will come very close to it and maybe it would not matter that much if you focus on the product.

MichaelRazum··on Sam Altman, Greg Brockman and others to join Microsoft
Never change a good running system. OpenAI ran quite good, even if things heated up, it sound kind of stupid to fire the CEO when the company is winning on every front.
MichaelRazum··on IBM pauses advertising on X after ads show up next to antisemitic content
Guess you are right. Anyway in my opinion, it actually doesn't matter where exactly the ads appear. I think to be fair, you would have to compare the feeds.
MichaelRazum··on IBM pauses advertising on X after ads show up next to antisemitic content
As a user of Twitter/X, Instagram, and to some extent TikTok, I can say that, at least for me, Twitter/X is much cleaner and more aligned with the people I follow.

In contrast, Instagram Reels are annoying; even after reporting certain content, the same or similar Reels reappear. We don't even need to discuss TikTok. From my perspective, it tends to have far more hateful content.

MichaelRazum··on Ask HN: Besides TikTok, what other innovations have come out of China recently?
which?
MichaelRazum··on Google researchers deal a major blow to the theory AI about to outsmart humans
I took a quick look into the paper. To be honest (I'm far from being an expert). As I understand it seems they took some toy models, and tried to show that the models do not generalize out of sample.

To me it is unclear what does it say about much more complex models? So for example there might be already so much structure, that you do not need to generalize out of sample and maybe humans don't do it as well.

MichaelRazum··on How to Think Computationally about AI, the Universe and Everything
Exactly, if something come out - guess it would be a funny nightmare to the physic society. As you said, it doesn't seem to be the case a right now.

On the personal level, maybe you are right - but it doesn't matter, if he is right...

MichaelRazum··on How to Think Computationally about AI, the Universe and Everything
Guess two reasons

- the theory is not mainstream, guess it is not attractive enough to study it right now

- the theory is not able to make any new predictions (yet). This has to change I think to get traction.

MichaelRazum··on How to self study pure math – a step-by-step guide [video]
True. Without exercises I would say you learned close to nothing.
MichaelRazum··on Elon Musk is considering taking X out of Europe amid EU compliance investigation
Exactly just luck and money. For sure he is just dumb. Just a dumb lucky guy who somehow got into a phd program for physics in some dumb university...
MichaelRazum··on Anti-ageing molecule boosts fertility in ageing mice
How about chlorella powder? That is what Bryan Johnson uses.
← PreviousPage 2 of 10Next →