No, you don't. In fact that's exactly the wrong approach because it recognizes them as institutions.
Tax them. Reduce money in politics. Investigate them if they did something wrong.
Note that I'm using the term oligarch precisely. Not just rich people. Rich people holding direct political power. You don't control that without empowering it, you remove the direct political power.