What's the alternative? Cutting and pasting instead of using masters in Figma, or repeating styles everywhere rather than using variables in your CSS? The results either way are inconsistent UI everywhere.
Yes you should have consistent design. That doesn't mean you can't change your design, it just means you make that button change in one place rather than 94.