Ah yeah, I could imagine that. Foreign passport + visa puts you in the "foreigner" line, even if it's a long-term visa, which is usually slower and typically has more suspicious / less helpful staff. Green card holders get to go through the "U.S. Citizens & Permanent Residents" line, which is a bit friendlier and faster.

(Not that I disagree that the whole setup is ridiculous and probably doesn't meaningfully add to security.)