The openai-wiles retraction is instructive here. First of all, openai did not formalize the theorem they proved. Probably because it would have required a considerable uplift of Lean's mathlib to get there (or shimming a lot of existing theorems as axioms, which OpenAI did not choose to do).
Interestingly, if you shim the well-known theorems, it does not uncover the error in the proofs (tldr there are competing conventions for tracking an invariant which make theorems incompatible) which are not obvious unless you work in the field I guess? A theorem checker cannot check the compatibility of conventions unless you go ALL the way to the mathematical roots.
If you're interested in a formalization of the retracted proof by openai (apologies for the LLM-speak in the documentation, but that is the point, can LLMs do XYZ):