This change is not "minor". Twitter employees have just had massive risk and uncertainty added to their short term career. There was some risk and uncertainty prior, because the company would probably have been doing layoffs, but a clearly impulsive, mercurial, uncaring and overstretched person is now in charge of decisions that affect all employees income, health insurance, etc.)
You also have to consider your political values and alignment with the company's goals. I think a lot of people at Twitter also believe in the value of the "public square" which Musk purports to care about. But if you look at Musk's always hyper deferential statements in China, or one of his large investors now being the Saudi government, or his "solution" to the war in Ukraine, it seems that he has a much more favorable outlook on authoritarianism than the previous leadership. Twitter's not about to be a voice for the powerless but a megaphone for the rich and powerful. That has to weigh in on one's thinking about work.