yes the original paper already covered that. I was looking at what else this new technique could do.
159 karma · joined September 4, 2016
Every prediction model is inherently a compressor, and all compression algorithms are prediction models.
Reference: Language Modeling Is Compression — Delétang et al., DeepMind, 2023. The prediction-compression equivalence, with the Chinchilla-beats-PNG result.
This is the right mindset.
What else is people using ? Haiku 4.5 ?