Notably, this is a looped (latent recurrent) transformer. GPT-6 Astra is speculated to be the same.