If you do believe those things I'm certainly not one to say you're wrong. I could imagine a scenario where removing all child labor is beneficial to the whole, but I do think it's a much more simple model to believe that the more options a family has, the better off they are long term.
Of course all of this rests on child labor being a choice for the family and not compulsory, something I don't know the specifics of for every situation.