AMD processors have so far been immune to all but one attack and in the previous gen processor the mitigation caused a 2% performance hit. This gen has specific hardware for mitigating these side channel effects so the numbers you're seeing are with the mitigations.