I don't think it's obvious at all, and I think people often mistake a number of other things in others (philosophical agreement, expertise in a domain, certain social skills, among others) for general intelligence.

There's also considerable evidence, IIRC, that, while the upper limit a person can reach in intelligence is genetic, that environmental factors play significant roles in both how closely that limit will ever be approached and how well/long what is achieved will be maintained.