To be slightly pedantic here: Power is energy per second, so power consumption itself would go down. Total energy consumption, which is power*time could go up.
The rule of thumb you learned is useful for optimizing PC software, but has no place in CPU architecture discussions.
Also, "usually" leaves a lot of important cases out.