At the time they were not far right/left though. We are applying that label in hindsight compared to present day politics. It doesn't make much sense to call the mainstream right far right. If they get in power and hold it for 50 years democratically, they obviously don't remain far right, they would just be what "the right" is. I argue that when they become more popular than "the right" they automatically take that moniker and lose the "far" label.
We have to anchor the center somewhere for the labels to have meaning; anchoring it to some point that is not the average/typical view needs heavy justification. Maybe we can say afd is still far right today, using some trailing average, but eventually if they remain popular we'd have to admit they're just the right.