You can make the further out zooms look better (not salt and pepper like) by using a sinc filter with a 5 or more lobes when to generate those layers. It looks like there is just some simple nearest neighbor or bilinear filtering happening, which is the source of the saltiness.