I feel like both this comment and the parent comment highlight how RL has been going through a cycle of misunderstanding recently from another one of its popularity booms due to being used to train LLMs
They also force exploration as a part of the algorithm.
They can be used for synthetic data generation once the reward model is good enough.