Hate to be the bearer of bad news, but you are likely over training. Check out heart rate zones, optimal workouts for weight loss/muscle gain. IE for endurance sports most of your training time should be zone 2, which if casually “a level of breathing where you could have a conversation”. So not breathing hard. It’s counterintuitive, but you should do workouts pretty close to easy.