You can make the electric field disappear by choosing the right gauge. Same goes for the magnetic field (can't make both disappear together though). The vector potential, in that sense, can be regarded as a more fundamental description of the electromagnetic field. It can't be observed directly though, but electric and magnetic field strengths are manifestations of the vector potential, they are not fundamental in that sense. Not sure if it's that what he's getting at, though.