If you don't do anything at all it still would get worse. Look at the 1923 Beer House Coup in Germany and the lax response of the German Kaiserreich to calm Hitlers supporters.