Hacker News Reader

Yeah, cooling AND underclocking will probably be required to somewhat safely operate these.

That said, 80G for something that you picked up for cheap could be an absolute steal these days.

No need for underclocking, though power limiting doesn't sacrifice much performance.

Currently listening to the soothing drone of my $200 Octominer cooling my cards while I'm fine tuning a model (almost makes a good space heater).

I run mine in octominer too, with fan control too. No noise, did fine during the winter with heat and it's very comforting as we enter winter.

https://www.reddit.com/r/LocalLLaMA/comments/1wjr59t/768gb_v...

Yeah the fan noise is only noticeable when I push the cards to ~180W, otherwise they idle pretty quiet.

How are you dealing with the RAM limit (32GB)? I had upgraded mine to an i7 but it was unstable so I’m back to the stock Celeron class CPU.

I'm not using octominer MB or CPU. That MB on my octominer case is running everything, it's an epyc cpu with 512gb of dram. octominer is also pcie limited, i get faster pcie lane with this.

Reply on news.ycombinator.com