Not in the sense of an architect actually building a generative AI blueprint. But transformer ANNs are simply incapable of designing physically plausible construction plans. Theoretically, not being able to solve graph connectivity seems like a big issue. Empirically, not being able to count is a fatal flaw.