I think you’re right that people sometimes take it that way, but I’ve always thought it a rather uncharitable assumption. The answer could be a different place in the US. It doesn’t seem to imply anything about whether you’re American or not?

I’m in California and it’s somewhat unusual for someone to be native Californian.