This is a strawman argument, but the logic actually does hold: If the original premise is true, "taxing the poor to give to the rich" would accelerate economic growth.

The problem is of diminishing returns - it would have a disproportionate negative effect on the poor and a minimal impact on accelerating growth, so it would be considered one of the most inefficient ways to achieve the latter.