I think it's hard to criticize the man on those grounds since he has pledged to give the "bulk of his fortune" to the Gates Foundation. That's arguably more productive than donating money to the government.
http://www.washingtonpost.com/wp-dyn/content/article/2006/06...