Every driver in the US has to pass a driving test in order to be legally allowed on the road. Is air travel somehow different? Maybe all you folks should be boiling your blood over the fact that you have to prove to the government you're capable of driving!
Here is the deal: flying brings you conveniences and comes with inconveniences. It's entirely up to you which one outweighs the other, but whatever the choice you make, you can't claim that a right is being taken away from you if you are turned away from a flight.
If you really think you have a case, call the ACLU and see them laugh at you.
Again I ask, what modes of transport are privileges and how many of them can we take away (not because you are incompetent at controlling them, but because you refused to subject yourself to a search) without completely destroying freedom of movement?