If there's an issue with your design and you need to rearrange it to accommodate some production limitation, do you think it might be helpful to be able to walk down to the factory floor and look at it first hand?
There's tons of companies where you can do all the work remotely. If that's a high priority, don't work at Tesla. When you need to make physical products, it's helpful to be at the place where the physical product are being made, because they don't just exist entirely in your code editor.