Well, a Fitbit operates the same way your phone does. GPS not on all the time. The battery is much smaller than it is on your phone.
However, Google doesn't need your precise location 24/7. Polling GPS once every 5-10 minutes is more than enough to advertise things in your area or know every place you go throughout your day.