Nobody is stopping their way of life. Why do they need special rights and privileges others don't have?
The alternative is civil uprising and violence, the same as many other demographs and groups of people throughout history have caused because their government and society decided to ignore their demands.