This is what STIR/SHAKEN is supposed to do. Your phone and carrier in the US probably support it, but it’s not obvious. On iPhones there will be a little check mark under the number for inbound calls on your recent call list. This doesn’t carry over to things like voicemail however - where the check isn’t shown.

This model also doesn’t work for businesses that route all outgoing calls through one number, as that is essentially caller ID spoofing.