I guess there must be a feeling of sunk costs, in that you reached a high level in your martial art(s) of choice. But surely it would be better to do any kind of exercise, just for health and happiness, than to be thwarted by your ego? (When I say your ego is thwarting you, I mean to say that you control your reaction. The groups you mentioned are contemptible, but it is your choice whether you stop exercise entirely because of their malfeasance.)