IME when a candidate gets dinged for a reason that would make people quit to avoid working with him (e.g. "he obviously doesn't shower") then people don't tend to invoke the words "culture fit".