No you don't. You will always burn calories by simply existing. You can get no exercise and still lose weight simply by cutting calories. Cutting 100 calories from your daily diet may be matched one-to-one with metabolism decreases, but I guarantee that if you cut 1,000 calories from your daily diet you will lose weight.