What they did was to say "hey, we can leverage your idle computer to help process this".
Different perspective.
What they did was to say "hey, we can leverage your idle computer to help process this".
Different perspective.
It seems to me it's economically optimal for inference providers to intentionally close markets that would allow local inference at all, even if that's bad for users as a whole.
And if they're wrong, you'll be able to purchase second hand cheap data centre grade hardware in a couple of years and DRAM prices will return to normal.
There is opportunity theft here.
"Efficient use of resources" is not some absolute based on mere energy or economics calculations, it depends on the goal.
If the goal is "reduce reliance on big tech", "privacy", "autonomy", and so on, then the most efficient use of resources if to say fuck you to Big AI and not let them hoard ram and gpus.