You're conflating all instances of speeding with "the idiot who drives 50mph on my street, which is 1/4 mile long, and has children under the age of 12 in all ten houses on this road."
Instead of being able to have a measured conversation about what speed is safe in a given street or area, we get hysterical fear mongering that does two things:
1. It causes the speed limit on a majority of roads to be set to a level that is well below a safe speed to drive, instead of setting reasonable limits in most places and then carving out exceptions in places that are more dangerous.
2. Your tone, both when talking about behavior you'd like to see changed and when referring to the other people whose comfort/time/opinion you "don't give a rats (sic) ass about", is alienating and all too common in these kind of conversations.
Both of these factors contribute to people, en mass, deciding speed limits (on their own) are never actually meaningful, and so they must use other factors to decide how quickly they should drive.
Maybe Traffic Calming should be implemented on your street, instead of posting a small sign that people will ignore?