The last Sars or Coronavirus illnesses differed from this one, as in those cases asymptomatic people were not spreading the virus very much.
So the (reasonable) assumption was that people mostly know when they are contagious and stay at home.
In that scenario "community masks" (everything below FPP-2) don't matter much.
When researchers found that Covid-19 is different (and that has to do with the massively higher virus load in the throat, where former similar diseases built most of the virus load in the lungs), the stance changed.
That is a good thing! Learn new information, adapt your response.
What's fueling conspiracy theories now is that the messaging back then centered on "we need to preserve masks for the medical community", which was a smaller component of the motivation, sure, but got mostly conflated with the real argument. I think that is because it was much easier to explain to the public and to journalists.
In hindsight that was a mistake. But the conspiracy theories that health officials just flip-flopped for no reason is wrong, and it's damaging the fabric of society even more.