Hacker News Reader

You simply don't ship. Enterprise deep learning doesn't ship their training code - large models are trained on purpose-designed, dedicated hardware. Hardware compatability doesn't matter, software does. Even that's flexible if it's significantly faster.

(The models can be executed on low-powered, commodity CPUs. No need for any GPU there.)

View on HN

You simply don't ship

That's totally an option for our product, great idea! Why did I never think of this!

No seriously we are shipping, using OpenCL and it gives about a 20 times performance advantage for most users regardless if they have AMD or NVIDIA hardware. If something that's actually better than OpenCL comes along (or if AMD RTG goes out of business) I'll switch to it no heart broken.

But that hasn't happened yet.

General-purpose programming on the GPU has many use cases apart from deep learning, e.g. image processing, computer vision, offline rendering and other high performance computing applications. OpenCL allows you to have a single code-base working on NVidia, AMD and Intel GPUs without having to recompile or put any special effort - the same kernel that works on NVidia will work anywhere.

Reply on news.ycombinator.com