Yes it does, but it's not like your metabolism tracks your activity like that.
Until relatively recently(20 years) studies have been measuring the wrong thing, assuming metabolism is flexible and follows activity.
Studies measuring actual energy expenditure (using methods like double labelled water) confirmed, counterintuitively, that adjusted for weight, lean mass and age, people have roughly the same metabolic rate regardless of activity.
It's an evolutionary adaptation for periods of low food availability - the body does everything it can to not touch those fat stores.