I sympathize with people that feel like this makes a big difference in productivity but you would have to be swapping between windows an absurd amount of times in a day for this to make an actual difference in productivity.
It takes (rough estimate) about an extra 200ms to hover the task bar icon and select the window you want.
So you lose a minute of time for every 300 times you do it. Doesn't add up to much unless you are switching windows hundreds or thousands of times a day.
Not to mention the fact that selecting icons from your taskbar isn't even the most efficient way of switching windows, which would be win+number or alt+tab.