It's this kind of inference that doesn't belong on a hiring committee; you likely don't have enough data to support this kind of conclusion about a person. The parent comment made a similar assumption about racial animus. I just don't think spying or eavesdropping is an effective way to evaluate a candidate.
In the interview room, any candidate will be on their best behavior since impressing those people "matters" greatly. Same for the behavioral lunch sessions that many companies also use. If I have any sense, I'm going to recognize that this is still part of the "interview" even though we may be at a restaurant offsite discussing anything from the job to the Yankees pitchers.
The argument, that I tend to agree with, is that gathering info from the taxi driver is a better indicator of true character. I don't expect the taxi driver to deliver a full psychological report but I would like to know if they felt mistreated in some way.
Doesn't make me rude, just makes me normal.
Would I be an asshole according to US standards? Probably. Doesn't mean I am a shot person, just unaccustomed to new normal.