Is it similar to https://loopyavatar.github.io/. I was reading about this today and even the videos are exactly the same.
I am curious if you are anyway related to this team?
I am curious if you are anyway related to this team?
Loopy is a Unet-based diffusion model, ours is a diffusion transformer. This is our own custom foundation model we've trained.
For whoever wants to, folks can re-make all the videos themselves with our model by extracting the 1st frame and audio.
Also, Loopy is not available yet (they just published the research paper). But you can try our model today, and see if it lives up to the examples : )
https://news.ycombinator.com/item?id=41463726
Examples are very impressive, here's hoping we get an implementation of it on huggingface soon so we can try it out, and even potentially self-host it later.