False. Once a bank acquires title to a property they are legally liable for the property tax. Local governments can (and have) foreclose on REO properties for failure to pay property tax.
This article proves that banks used the homestead exemption to avoid property tax: http://jacksonville.com/business/real-estate/2011-01-30/stor...