Too bad they didn't crowdsource the decision about whether the olympics should happen this year: https://sports.yahoo.com/cancel-the-olympics-japanese-people...
Hosting the games ends up costing the host countries more money anyway so if IOC skips over them in the future...so what?
E: this assumes the fine isn't already in escrow
Beyond a certain point, fines become a game of political chicken.