We don't let corporations do anything because they provide value through jobs and taxes. What company do you know that exists (beyond transiently) solely by paying taxes and employing people?
Companies are an extension of the individual, they exist to make money for the individuals that own them so that those individuals can acquire goods and services that they themselves need or desire.
How do companies make this money? Holding people at gun point and taking it is generally illegal; instead they resort to providing goods or services to some set of people who are willing to pay for them.
To provide these goods or services they need to employ people. The fewer people companies in aggregate can employ, the better for people in aggregate since those people can acquire "things" (food, jewellery, phones,...) for less of their own labour (or equivalent dollars).
If the "benefits dry up" as you say, people will stop sending their hard earned money to this company and the company will eventually cease to exist. Your fallacy was assuming the benefits were the jobs and taxes, not the goods and services provided.