Sounds like a low cpu overhead compression approach would have helped here, something like lossy lz4 :)