g4dn.xlarge will be slow as molasses using a T4. g5.xlarge uses an A100 (roughly equivalent to a 3080 Ti). It costs more, but I think the ratio is in its favor if you want images fast. (Plus you can always just turn it on and off.)
Thanks for the insights, will check the price/ performance ratio and update the recommendations accordingly.