I've worked in the converse - hire-quickly, fire-slowly - and I found it a horrible, hollow experience. Nobody, from the top down, gave a shit about getting anything done or learning. This is a place that refused to allow generics in Java code because people might not understand them. There were enough C players across the ranks that had moved up the ranks just by being there forever that the culture revolved around ignoring problems and not making waves, and it nearly killed the company. I bet you've heard of them. The company was AIG.
You're absolutely correct that hiring and firing, like all management, is highly dependent on culture.
In North America, the overwhelming majority of research has shown that organizations that "hire slow, fire fast" have more positive work environments, with happier employees and lower job insecurity. You could literally fill a small library with the books and papers that have been written on this topic.
I would love to know more about your culture and the "hollow experiences" you're referencing.
By contrast, British companies tend to focus more on getting the job done, going home and spending time with the family. Sometimes you pull late ones, but you're not expected to be in the office at 9am the next day. In some places there's beer after work, but you're not expected to go (at the risk of being denounced as a 'non-team player').
To provide a comparison, working in France is completely different. In France the work-life balance is shifted further towards the life end, in the Middle East (if you're a local) even more so.
[1] - http://www.youtube.com/watch?v=wvsboPUjrGc - ok, that's an extreme example, but tone it down about 97%, crank the alcohol levels up by 40% and you're roughly where ISS was in 2001.
Do you really think that OP's man management skills could be so infallible that he's already getting the absolute best from this guy? If he's not a cultural fit, then it's distinctly possible that the things that motivate the others don't motivate him. Surely it's better to make sure that the employee is as motivated as he can be, and is given an opportunity to improve before just throwing him out of the door.
I would never again work in the types of places that follows the maxim you describe. I've worked in those types of places before, they're horrible, hollow experiences where everyone chants about how awesome they all are and pulls all-nighters instead of being with their families, just to hide the deep seated job insecurities underneath.