Lilian's latest blog about the reward hacking in reinforcement learning. It's more about the practical solutions research instead of how to define reward hacking.