I know Google Cloud by default encrypts the entire disk, which will include swap. Not sure about other providers though.