The feature is to silence unknown callers. If you know the numbers that they're calling from, you can simply add them as contacts. As a whole, I think the feature is worth the tradeoffs.