In 2013 the IRS was successfully sued for doing the exact same thing:

https://www.healthcareitnews.com/news/irs-face-lawsuit-over-...