In other words, both fsckboy's wife and misc. people in their life tend to only point out that fsckboy is being "overly considerate" when it appears that fsckboy is letting someone benefit from their considerate nature. The implication is that fsckboy considers the behavior as being kind and/or safe, while their wife/companions think of it as being taken advantage of.
The broad concept of this exchange concerns where the line is between being considerate and being taken advantage of, and how others might be incentivized to view that one way or the other.
>I can't speak about your (wife), but in my (wife), people who say this are the people who personally enjoy taking advantage of my nature, and my "overly considerate behavior" is only pointed out when someone else seems to be getting benefit at the expense of my (wife); i.e it's a statement of selfishness.