Quantized models will run well, otherwise inference might be really really slow or the client crashes all together with some CUDA out of memory error.