The electric field gets quickly attenuated in saltwater though, especially at high frequency: https://en.wikipedia.org/wiki/Communication_with_submarines
Free space impedance is 377 Ohms/meter; the ratio of E/H fields. Seawater is much, much lower, but the ratio is still there. If there's a propagating H field, there is a corresponding E field; that's the law according to Maxwell.
The VLF antennas on the subs are trailing wires; electrically short dipoles. Those are mostly sensitive to E fields.