What do you mean by "kneecapped for training"?
Isn't it 128GB of VRAM enougth for small model training, that a current GC can't do?
Obviously, even with connectx, it's only 240Gi of VRAM, so no big models can be trained.
Obviously, even with connectx, it's only 240Gi of VRAM, so no big models can be trained.
But if FP4 means 4bit floating point, and that the hardware capability of the DGX Spark is effectively only in FP4, then yes. That was nonsense to wish it could have been used for training. But it wasn't obvious from the advertising of nvidia.