Wait for just 2 days, 17 hours and 18 minutes - and NVIDIA will give you (rumored) 96GB of RAM inside GeForce RTX 4090 TI: https://www.nvidia.com/en-eu/geforce/special-event/
Sure the m3 with 128GB of RAM costs $7k, which is an absurd number, but that will run high quality LLMs that can have sci-fi level intelligent conversations.
Not a bad price for a laptop capable of doing things that was literally "haha that'll never happen" levels of unimaginable 5 years ago.
It would appear the poster misread reports about the L2 cache (96MB) for the VRAM (24GB).
That would be more than an H100, which costs around $30k.
1. https://www.tomshardware.com/news/nvidia-makes-1000-profit-o...
That's literally what BOM means: bill of materials. It's not supposed to include any of those other costs. BOM is not always the right kind of cost to be talking about, but in a case like this where you're talking about just swapping out the memory on an existing product, BOM accounts for all the costs that change significantly.
The blog post really highlights how effective those headlines are at getting clicks but not informing readers: it leads with “nearly 1,000%” because that sounds even more rage bait-y than the already high “823%”, and that's clearly the impression people take away from the story even though starting with the second paragraph it makes it clear that this is a very fuzzy claim which is likely significant understating the true cost for Nvidia to make the hardware as sold or the other factors I also mentioned.
Finally, “swapping out the memory on an existing product” can mean “we replaced part A with larger part B” or it can mean “we upgraded a controller, added additional channels, and redesigned the physical form factor to provide better mechanical and thermal capacity for the extra chips”. That's why those extra details are so important since it's otherwise easy for someone to make a tweet which sounds like they know what they're talking about but is in fact leaving out a lot of important context.
Not very portable either.