I happen to have a couple of 16 core Xeons available with 128GB RAM and a decent high end Radeon GPU. Could I run a decent text transform model on this?
It's not as starightforward, because the M1 has a unified memory model while the PC will have to copy data between system RAM and VRAM. But it should be possible, see FlexGen for example.
It is straightforward for this code, which is CPU-only.
Within the last couple of hours, AVX support was added to the repo. Should be a lot faster on your Intel CPUs.