Big update: Slack support tells me its their bug and have opened a ticket with their billing team.