You do this to distill a model.
You can submit your users' questions async too, but if you do it sync, then you can also RLHF on the users' behavior after the output.
You can submit your users' questions async too, but if you do it sync, then you can also RLHF on the users' behavior after the output.
I get those A/B responses chatting in Gemini fairly often, and I really don't think I'd feel deceived if I later learned one of the choices was actually from a competitor's model.
I think they are pretty fair and explicitly say “Distillation itself is a legitimate training method […] Distillation is commonly used because it reduces the resources needed to achieve more advanced capabilities”. And go on to say their definition that makes it illicit in these cases.
And, also, they almost certainly __were__ tricking users and sending their data overseas.
Do you see it any differently?