It's the opposite, the T4 is far behind gaming GPUs.
Reasons to buy a T4:
- You need the 16Gb RAM. You usually won't for inference, though.
- You need single slot cards to use in server chassis. Even here you are likely better off buying a Quadros than a T4
- You need the high power efficiency of the T4 (75W TDP)