Is their a paper / technical report out on this?
As far as I understand (based on reading for less than 5 minutes) it is still a transformer model, but they simply start predicting tokens in random positions, with the possibility of updating existing tokens, rather than producing tokens from left to right.
That isn't too different from say good old stable diffusion.
When o3 solved the ARC[1] challenge, Sam Altman said it was recognizing the image pixel by pixel linearly, and i found it pretty hilarious that they start by using a chip which computes in two dimensions, they use it to compute a line, and that line is a two dimensional image of the ARC challenge.