Personally, I believe saving tens of billions of dollars in potential fraud costs every tax filing season buys a lot of tolerance to people complaining about the interim solution. The complaints are valid, but so are the attempts at fraud. And so, we balance the risk of the implementation.
[1] https://www.justice.gov/tax/stolen-identity-refund-fraud ("The IRS estimated that during the 2013 filing season alone, over 5 million tax returns were filed using stolen identities, claiming approximately $30 billion in refunds. The IRS was able to stop or recover over $24 billion of that total, or approximately 81% of the fraudulent claims.")
[2] https://en.wikipedia.org/wiki/The_Mythical_Man-Month
[3] https://en.wikipedia.org/wiki/Brooks%27s_law
(interviewed with a team that worked on fraud prevention at IRS as part of a US Digital Service interview)
https://cyberscoop.com/irs-facial-recognition-identity-priva...
https://www.cbsnews.com/news/irs-id-me-tax-file-2022/
https://www.irs.gov/newsroom/new-identity-verification-proce...
So, now that we've acknowledged reality--what now? Do nothing, while the active harm continues, because of fear of a hypothetical future (but with a limited time horizon) one?