1. These concepts generally come with weaker governance for company managers, allowing them greater latitude to act inefficiently in general. By contrast with maximizing shareholder value, managers can undertake almost any program under some pretense or justification, ranging from excessive empire building, to justifying sweetheart deals with friends at greater cost citing "environmental" concerns. This doesn't matter for Patagonia because it's family-owned, but this would be a huge problem with making this a widespread practice in the Fortune 500.
2. Widespread use represents a de facto tax on businesses through less efficient operations, but without the control of the political process to direct it. Even if you aren't in favor of governmental interference, it is generally better for organizations that are going to have charitable aims to be directly accountable, whether via the democratic process or the donation process.
3. Returns to shareholders, in light of the returns that go to other stakeholders, are reduced, thus potentially reducing the amount of financing available from capital providers.
So it doesn't really matter if Patagonia does this, but doing it on an economy-wide scale would potentially be a big mistake.