> There's some kind of logical fallacy in this line of argument, but I can't put my finger on a name for it.

"Cowardice"? From an old version of the Wikipedia article, "Fear and excessive self-concern lead one to not do things of benefit to oneself and one's group" [0]

[0] https://en.wikipedia.org/wiki/Cowardice