Being extreme gives people a lot of energy so these activists put a lot of effort into lobbying for their view. It’s hard to get centrists fired up to fight for their beliefs with the same intensity.
It's hard to centre a rebellion around the reasonable middle ground.
Practically speaking, I fear, that puts you in the position of the Liberal Democratic party in the UK, without its advantage of now and then being able to form part of a coalition government.