The way I understand it, leaded solder is not really more harmful to those working with it. Temperatures used in soldering are below the point where vaporization is of concern, and you need good ventilation anyways, no matter the kind of solder, because of flux fumes. Wearing gloves, hand washing, room cleaning and avoid eating where soldering happens may be a good idea, to avoid ingesting lead dust, but I guess these are general rules of cleanliness that would be appropriate for safety-critical equipment regardless of the presence of lead. Plus, elemental lead is one of the least harmful forms of lead.
What I think the problem is and why they have banned lead in consumer electronics is about where all that lead solder ends up. Maybe some is recycled, but I guess most of it ends up in landfills, and a good fraction is just dumped in nature, possibly near drinking water supplies. A few boards won't do much harm, but millions of tons of e-waste will.
That's why I believe lead solder is still used in the aerospace industry, because it is only a small fraction of all the electronics. It is very critical, you really don't want tin whiskers to cause short circuits, a problem with lead-free solder. And if needed it is easier to impose rules regarding waste management in such a highly regulated field than in mass produced consumer goods.