I think you’re right. Most people dream of becoming rich, not “filthy” rich. So taxing >100 million should not impact things, and there are plenty of other reasons to move to the US
Bill Gates dreams of eradicating polio. Is $100M enough? No
Elon Musk dreams of colonizing Mars. Is $100M enough? Absolutely not.