Yes but if you're on IBR this is minuscule. I only paid ~$2k my first year in repayment, a small part of that was interest, and because my income was low enough the taxes on that small part was only a few dozens of dollars.
But absolutely when you're making $2250/mo before taxes and extra $20 in your refund is awesome :)