In other words, you need to be in control of your own narrative, or someone else will do it for you to fill the void. For example, someone can use cold reading to deduce what others suspect and fear and then paint you in that specific light, essentially planting individually targeted nasty rumours about you while increasing their rapport with others. That kind of rumours tend to spread.
Eventually you become the outcast in your social circles and you will be hard pressed to regain control of ”you” in the eyes of others.