Models have plenty of skin in the game during training, but zero during inference