Government agencies sometimes have reputations for employing people not smart or competent to work in the private sector. Only a handful of agencies in the U.S, such as the NSA and the CDC, have reputations for hiring highly intelligent people. The chance to work with some of the best people in your field is attractive to many people.
Not all intelligence and defense contractors are created equal, and some people want to work for these companies or agencies because they think it is "cool". Most of these people find out that the job is not as "cool" as they thought it would be, and soon find employment elsewhere.