Tesla and GeForce products are made from the same chips. The GeForce products have several features turned off, and are then sold for a fraction of the price and often with more aggressive clock speeds. For any given workload, you have to assess whether you need the extra reliability of the Tesla products and whether the features disabled in the GeForce matter to the problem at hand. For many uses, the high-end consumer parts come out way ahead in this comparison; the Tesla parts are never an automatic win.

Tesla really shines when you want double precision computations, e.g., for scientific computing, solving PDEs etc. Extra precision is however seldom useful in deep learning, so you will likely get the same performance with the much cheaper GeForce series.