Admittedly I had never heard of this party before, but after looking into them calling them far-right seems to be quite a leap.

If you didn't know, Sweden used to be extremely welcoming to asylum seekers and refugees about a decade ago. What they got out of it were gangs, their youth being exploited to enact crimes (due to leniency towards minors), and neighborhoods that even the police doesn't dare drive through. Having a party that calls for integration and adaption to Swedish values, and at worst remigration, seems rather tame. Especially so if you just take a look across Øresund and see what's happening in Denmark.