Yep, they will use the specialized hardware by default if CUDA/cuBLAS has been installed on the system.