It depends on how you ascribe causation to hereditary factors. Does it make sense to say that a 4 year old is poor because of his low IQ? I don't think so, because a 4 year old has no agency over his economic circumstances.
No.
But it does make sense to say that a 4 year old is both poor and has a low IQ because his parents do. And this applies whether you believe that his low IQ is due to heredity or a poor environment caused by his parents.