It seems like you are interjecting morality again into our discussion where none was included. A deficit of personal empowerment IS a structural and environmental factor. Not the only one, but it is one of the most important if not the most important in determining outcomes.
If you take a poor, abused, and neglected child and teach them they can not and will not amount to anything because of the material conditions of their birth, you are actively damaging their outcomes.
If you take the same poor, abused, and neglected child and teach them that that there is hope and clear goals which will get them out of poverty the vast majority of the time, you are actively improving their outcomes.
This doesn't require judging anyone. This is actively improving environmental factors which lead to success. The impacts are statistically robust and well understood.
Luck and environment played a huge role in my success. A huge environmental factor was parenting and education which made me understand how those 5 factors impact success, and instilling a belief that it was within my reach if I stuck to them.