>The Swedish party in question seems to hold a position on immigrants that is fascist due to their hostility towards immigrants.

Advocating for controlling borders and opposing immigration is a legitimate political position, whether you agree with it or not. Those who describe everything they disagree with as 'fascism' are not credible people.