Nvidia to Share New Details on Grace CPU, Hopper GPU, NVLink Switch, Jetson Orin | Hacker News Reader

Nvidia to Share New Details on Grace CPU, Hopper GPU, NVLink Switch, Jetson Orin

blogs.nvidia.com

100 pointsbcaulfield20 comments

Seems like this will end up driving more research into very large ML models. Some of the performance benchmarks here are for trillion parameter models. I’ve observed that often Innovation directly follows silicon improvements.

> Grace CPU uses LPDDR5X

Looks like we’re finally going with soldered RAM in the data center?

That's pretty much inevitable I think when chasing density.

Why can't we have both? L4 cache anyone?

There are chances that in the future data centers the DIMM sockets from the CPU boards will be replaced by a combination of soldered DRAM on the CPU boards, for the lowest latency, combined with separate memory boards attached to the CPU through CXL links, for high capacity memories that can be allocated flexibly to the CPU boards, and that can be replaced or expanded independently of the CPUs.

Intel has already shown Sapphire Rapids samples with 64 GB of HBM 2e [1]. It's a safe bet that the HBM is not exclusive with external main memory. That'll be DDR5 of course, not CXL. Maybe in the 5th gen?

[1] https://www.anandtech.com/show/17422/intel-showcases-sapphir...

That’s probably how the new M2 Mac Pro is going to work.

M2 supports CXL?

This is what I was wondering. Or why isn't there something like a 2 GB HBM2 cache on GPUs? Is it cost or latency?

IBM have been working with eDRAM in mainframes as cache, but mainframes and servers do different jobs.

I want one. Damn hotchips always has stuff I want and then can never afford even when it gets to market

Are the vertical-specific Nvidia SDKs like DRIVE and Clara widely used?

grace and hopper? from stranger things?

No grace hopper the computer scientist

> the computer scientist

She was a maths PhD who became a US Navy Rear Admiral, along the way leading the team that developed the COBOL language and compiler [0]

[0] https://en.wikipedia.org/wiki/Grace_Hopper

From your own link, literally the first sentence of the article.

> Grace Brewster Murray Hopper was an American computer scientist

I'm not sure why you're trying to be pedantic here, she is widely recognized as one of the pioneers of computer science.

I don't think KineticLensman is being pedantic. Those look more like examples of her being more than a mere "computer scientist", and expanding on her accomplishments. I know I forget that she was a Rear Admiral.

I disagree. There isn't really a reason to quote out specifically the "computer scientist" part and begin with saying she had a Math background. That indicates disagreement with the quoted text.

I wasn't trying to be pedantic or to disagree. My intent was to make it clear, to those that didn't know, that she was an extremely accomplished person. Very few people can put 'computer science' and 'rear admiral' on the same CV. I can only do the first one and am in awe of people who can do both.

you learn something everyday. grateful for this community

Reply on news.ycombinator.com