In other words, both fsckboy's wife and misc. people in their life tend to only point out that fsckboy is being "overly considerate" when it appears that fsckboy is letting someone benefit from their considerate nature. The implication is that fsckboy considers the behavior as being kind and/or safe, while their wife/companions think of it as being taken advantage of.
The broad concept of this exchange concerns where the line is between being considerate and being taken advantage of, and how others might be incentivized to view that one way or the other.