no the power lies with the politicians...it's just too small of an issue for the general public to make it a deciding voting issue. Most people travel once a year(if that) so they don't really care about it
I also suspect many people actually do believe it makes us safer. Many others probably don't care one way or another, but if a politician were to seriously attempt to end the TSA, they would be branded as soft on terror so fast their head would spin.