> Not to mention having fewer resources to fight if you are audited.
Can't find the link now, but I read somewhere that the IRS avoids audits if the risk of losing is higher (i.e. the person in question has more resources to fight it $). So their enforcement is heavily skewed towards average people.
Which corroborates this statement.
> more modest means is more likely to attract attention