Until elegance can be trained through RLVF, it will not be elegant. A lot of problems in AI seem to be finding ways to bring RLVF to more domains, as the current "spikiness" of AI seems to be mostly related to how effective RL is for a particular domain (if you need RLHF you are fucked and it's why it has not gotten better at writing and individual models still have "styles")