Currently this library can generate multiple images and upscale them through RealESRGAN: https://github.com/hlky/stable-diffusion

If you are not using this library already, give it a shot.

Also, I'm using Nvidia Studio drivers though I'm not sure if that would make a difference.