Not to mention the fact that selecting icons from your taskbar isn't even the most efficient way of switching windows, which would be win+number or alt+tab.
Not sure that's true in the setup under discussion: win+# requires figuring out which number to press - and if the count is wrong, I mind even end up on an entirely different desktop via some apps I keep pinned on the taskbar. And at the very least subjectively, alt-tab feels rather jarring and requires some mental re-adjustment before I find the proper window to click.