What is meant by "understanding" the likelihood?
Diffusion models, surely, are "trained with next-[pixel] prediction", and that should suffice, no?
Diffusion models, surely, are "trained with next-[pixel] prediction", and that should suffice, no?
Empirically they learn an approximation to the derivative of the likelihood (Ie the score function). So we have a bound on the true likelihood distribution, but don’t have exact likelihoods (which we do have in LLMs).
In practice this bound is too loose to be used for train with GRPO effectively (though folks have tried).