Domain verification should typically be a one-time or at least rare event. You shouldn't have to keep the txt records after the verification is completed.
At least ACME's DNS challenge protocol is designed this way.
> The client SHOULD de-provision the resource record(s) provisioned for this challenge once the challenge is complete, i.e., once the "status" field of the challenge has the value "valid" or "invalid".