You probably didn’t mean it this way, but that reasoning emphasizes bringing beings into this world to avoid your own bad emotions, and not so they can experience their own good ones.
What might be considered selfish is to not have kids when we are way below replacement rate, while expecting to be taken care of by other's kids in old age. Unless we reach AGI and humanoid robots soon, the food, housing, services and healthcare has to be provided by younger people.
It's not "remaining". If you had decided to not have kids, the kids wouldn't be there in the first place, so they wouldn't (couldn't) feel any regret about.
I don't want to die because it's scary and likely painful, but I definitely would have preferred I wasn't here to begin with.