Usually when I'm confronted with such conundrums it's a signal to me that I'm thinking about the problem too narrowly. Surely being at the table, unless you are the one making decisions, is lending yourself to someone else's cause. If you weren't a yes man one way or another you'd probably be thrown off the team anyway and replaced by another yes man. Maybe you get to sway them towards competency but you aren't changing their end goal.
There are other ways of changing the world than working with those who perpetuate violence.