Ego is constructed by the person viewing what encompasses reality and comparing the self to form self-esteem or self-importance.
As a person who understands determinism, I feel my ego has diminished when it comes to individuals. I realize me comparing others who are "unfortunate or fortunate" to myself is nonsense and accountability for individuality is diminished to null. My accountability for society as a whole is instead greatly increased and where I view the complete system of what makes an individual who they are being at fault for any undesired outcome.
Basically if someone were to do a horrible act it is by fate, how they were raised in the family they were born, with genetics and all the events that happened in the specific linear order of no real control because free will does not exist. I would see everything at fault "the will of the universe" and where the best humanity can do is study what made the outcome; with working on fixing the problem and rehabilitation for the person.