If you struggle so hard to imitate an authentic native English speaker accent doesn't that have the side effect of ruining your accent in your native accent?

For example I changed to a Dvorak-like layout, and could barely type QWERTY. (I changed back to QWERTY because it's just too ingrained into everything.)