nobody likes paying more for the same service.
When the economy is worse and employers can choose, even 3 years look like "job hopping individual, will jump ship as soon as economy turns around and he can get $1 more somewhere else".
Just decide if you optimize for comfort or money, and make sure you have a few months buffer for the bad times.
It's business, they aren't your friends, you don't need to tell them the whole truth.