Freedom never meant that the society much be changed to accommodate you. You're free from persecution (Conditions apply), you're free to behave the way you want, to associate with who you want. Likewise, Society is free to not associate with you and move in a different direction.

Nobody is stopping the Amish from doing what they want. Why do they want special rights above others?