I just ran a 512x512 Stable Diffusion benchmark with this yesterday

Pytorch Eager Mode with some optimizations: ~6it/s

Pytorch Inductor (torch.compile with dynamic=True): ~7it/s

AITemplate: ~9it/s

All of them support changing settings and such, albeit with some work in progress bugs/caveats.

That is 512x512 on a 2060, so I would expect the gains to be bigger on newer GPUs with more overhead to take advantage of.