There's also progressive PNGs. Progressive JPEGs have the advantage that they increase compression ratio (though they're more expensive to decode, as you need multiple passes and refresh)
(Converting JPEG images to progressive format is one of the optimizations mod_pagespeed makes.)