One tenth of the taxes you pay on your labour, is covering for someone not paying the tax on their wealth income. While it is not world-changing, that's not an insubstantial either. Unless you are currently making more by wealth income than labour income, you would see your total taxes decrease in this operation.
And all of what I write above is ignoring the idea that it might be more moral to tax wealth income higher than labour income! The above is purely asking for both to be taxed equally.