11 karma · joined April 9, 2024
since you're in the EU (I assume), check friedhats.com for some fancy roasts
EDIT: oh, and if you dont mind - what was the cheap grinder you got?
From your description of how this plugin works, I see why it works so well. It is basically just focusing on the essentials (populating the appropriate context) and then does as best as it can to get out of the way ( <- this part is really important I think)
OpenMP is still a thing in 2024, but I presume that is not the kind of scale you are asking about.
If you have MI accelerators, you'll be using ROCm anyway (although AMD contracted Andrzej Janik in 2022 to make ZLUDA run on AMD GPUs. I have no idea what the practical applications of it are at the moment.)
The only other serious challenger (apart from the existing GPU manufactures like AMD) who is trying to give Nvidia a run for its money is Tenstorrent and their TT-Buda software kit.