When a new generation like this is released, will a typical AI company replace the current GPUs? Is there a chance to acquire the older versions for private use or is it too early for that?
When a new generation like this is released, will a typical AI company replace the current GPUs? Is there a chance to acquire the older versions for private use or is it too early for that?
(Not speaking for everyone of course)
No we keep the current GPUs as well, the one we throw away are several generations old (like K80s), so not very interesting.
For private use, those GPUs are really not worth it. Once their used price reaches an acceptable level, you can be sure that the new general public GPUs will outperform them.
For example a Titan RTX is probably still twice as cheap as V100, while only being ~20% slower.
Edit: Actually a Titan RTX is about the same price as a P100 now, while being much better.
That and I suppose there could be a premium for older setups of any kind if for whatever there are licensing agreements that are negotiated for certain hardware (or for certain numbers of cores).