The repository linked is just a part of the entire model so it can't be used as is.

That said there is a completely implementation made by lucidrains[1] with some results, the only missing component now is the dataset.

[1]: https://github.com/lucidrains/DALLE-pytorch

A thread of examples from the provided notebook: https://twitter.com/ak92501/status/1364666124919447558

Note that these just demonstrate that arbitrary encoded input images match the decoded images, which is what would be expected from a VAE.