You are assuming 100% of these people are moving to countries with lower taxes. That's simply not true.
In fact, countries that have high standard of living usually have equal or higher taxes than the states.
Contrary to what you may assume, especially people who have sought an alternative lifestyle abroad value value having a high standard of living, and not going to move to some shithole just because it has lower taxes.