I deal with 3 tax agencies every year. I submit my personal and my business's tax returns to the British HMRC as that's where I live. I deal with my home country's (Hungary) tax agency too for various, boring reasons. And, ultimately, as I tend to do my wife's tax returns as well and she's a citizen of the United States I file taxes with the IRS.
I don't know how else I could put this: the US tax system is absolutely insane. It's several orders of magnitude more complicated than any other I'm familiar with. It's simply ridiculous. It's really, really bad.