You are ignoring a few simple facts here.
1. The left doesn't congregate and worship at the cult of personality like the right does.
2. The first cases were in Wuhan. The right/Trumpets immediately blamed China. And this blame had exactly zero to do with any facts at the time. And in blaming China, hate crimes against all Asians increased dramatically, not even just Chinese.
3. It wasn't being called racist just saying it. It was racist being racists. Most people admitted it was a possibility, but definitely not confirmed in any way
The fact of the matter is it was turned into a political talking point.
The right says "IT IS THIS WAY BECAUSE THAT'S WHAT I BELIEVE AND IF YOU DON'T AGREE YOU ARE RADICAL LEFT"
The left says "We can't say that yet"
Learn the definition of gaslighting