One thing the OP overlooks is that high res images allow for resolution to be maintained when the user does pinch-to-zoom. Perhaps, downloading these larger images is actually a necessity.
Really great point. Maybe load the low res version initially and then predictively load higher resolutions as the gesture proceeds and fade between them to compensate for the latency.