>You can make the electric field disappear by choosing the right gauge. Same goes for the magnetic field (can't make both disappear together though).

What? No you can't. The fields are invariant under gauge transformations.