Normal daily physical activity (not hours of cardio at the gym) isn’t responsible for a huge part of your typical caloric expenditure.

If you’re noticing a large difference, it’s likely due to appetite related changes or even simply perception differences, not actual energy expenditure changes.