amazing to think there was a time (literally not too long ago) where you would throw 80 GB of HBM onto a chip and turn 90% of it off
It is much more of "let's sell cards to crypto people, but nerf them, to not harm our enterprise margins", not "we've got a ton of subpar hardware, let's to something with it".
That's why this works. The yield on those HBM stacks is excellent. The binned cards had failures in the logic die, and hyperscalers want uniformity in their clusters. That's why the mining market took the downbinned cards.
Mounting the HBM on the interposer has to happen before putting the interposer in the package.
So it's the "must be in-package" yield tests that drive this.