An NVIDIA RTX 4090 generates 73 TFLOPS. This iPad gives you nearly half that. The memory bandwidth of 120 GBps is roughly 1/10th of the NVIDIA hardware, but who’s counting!
Apple M3: 29685
RTX 4090: 320220
When you line it up like that it's kinda surprising the 4090 is just $1800. They could sell it for $5,000 a pop and it would still be better value than the highest end Apple Silicon.
The 4090 is highly specialized and not usable for general purpose computing.
Whether or not it's a better value than Apple Silicon will highly depend on what you intend to do with it. Especially if your goal is to have a device you can put in your backpack.
Adding also M3 MAX: 86072
I wonder the results if the test would be done on Asahi Linux some day. Apple implementation is fairly unoptimized AFAK.
It's stupid to look at OpenCL when that's not what's used in real use.
People have been tiling 24gb+ models on a single (or several) 3090/4090s for a while now.
RTX 4090 Tensor 1,321 TOPS according to spec sheet so roughly 35x.
RTX 4090 is 191 Tensor TFLOPS vs M2 5.6 TFLOPS (M3 is tough to find spec).
RTX 4090 is also 1.5 years old.
What irritates me the most though is people comparing a mobile accelerator with an extreme high end desktop GPU. Some models only run on a dual GPU stack of those. Smaller GPUs are not worth the money. NPUs are primarily eating the lunch of low end GPUs.
Memory bandwidth is literally the main bottleneck when it comes to the types of applications gpus are used for, so everyone is counting