To me the strongest non-religious argument against doing this is that it will further accelerate wealth benefits, eg if you could make your kids smarter. One of the problems with that however is that this technique is so cheap and easy that banning it will just create a black market, or a single country decides to allow it for economic or political reasons and people travel there to get pregnant.
That impossibility of controlling this is why I think we have no choice but to proceed slowly, cautiously, but under full transparency.
* there are also uncertainties about off-target effects and overall safety of the technique but I'm confident those issues will eventually be fixed too.