Anyone interested in this approach to lossless compression should visit (and try to win!) Hutter Prize website[1][2]. The goal is to compress 1GB of english wikipedia
The trained neural network weights tend to be very large, and hard to compress, and the hutter prize requires the size of them to be counted too.
To win the hutter prize, you'd probably need some kind of training-during-inference system.