In vertebrate females, all oogonia mature to oocytes before birth. In males, spermatogonia mature to spermatocytes continuously after puberty. I gather that oocytes and spermatocytes are more sensitive than spermatogonia to radiation damage. Damaged spermatocytes and sperm get replaced after a few weeks. But there's no replacement for damaged oocytes.

So yes, birth defects.