> contains contradictions

It definitely does not say that. Only that we cannot make a proof of consistency of them. It is possible, and believed, that the Zermelo–Fraenkel axioms we use for set theory for example are consistent. But we cannot prove that because of Godel.