Lots of the newer stuff is watercooled
Yes they use pcie electrically, but its not the same slot shape and there is usually carrier boards
You wouldn’t repurpose these for home gaming, it would still be for llms
Yes they use pcie electrically, but its not the same slot shape and there is usually carrier boards
You wouldn’t repurpose these for home gaming, it would still be for llms
You can order the SXM carrier boards on eBay/Alibaba today.
> You wouldn’t repurpose these for home gaming, it would still be for llms
When small businesses, home-labbers and prosumers have cheap access to potent GPUs, there will be a Cambrian explosion of grassroots creativity and innovation in areas that are "beneath" AI labs expansive ambitions; I want to see the OBS-equivalent of LLMs. Hell, I'd love to see what some broke artist can do with OBS, an H100, and an open video model.
It can certainly be parted out with proper motivation but it’s going to take a whole new ecosystem to support these in your typical home lab. Even then 20-30kw slices are electric car level energy consumers.
> Good luck powering a 400kw rack in your basement
Wut? Open-weight models already exist and don't need a cottage industry.
I'd gamble on 1 million curious people with 1 SoTA GPU each over one AIaaS lab or company with 1M GPUs when it comes to developing delightful things and experiences. We still don't know what small, specialized models can do because AI labs only ship products that could justify the trillions invested so far. With a single Nvidia A100, I have trained small models that beat the brakes off "SoTA" models in niche areas (estimated TAM is <10M people, world wide) - the "Bitter Truth" doesn't apply to the long tail.
You can just mod them to run on consumer fans that are designed to spin much slower but have higher diameter
This is already happening.