Generally there are also non-denominated "forever" stamps available whose real value will remain the same despite changing rates.
Are we talking about US? If so, it might be your office. The one near me tries to sell me all kinds when I actually go in to do stuff. USPS still sells varying rate stamps ranging 1 cent additional postage to $30 priority mail express stamps.
Of course you don't need a stamp, you can purchase postage online.