That could be possible, but I don't think that we can assume that.
It's not your brain's fault, really. It doesn't know any better. Your brain has a way of interpreting the sensory perceptions communicated to it. It conflates this with 'reality' because it doesn't know anything thing else. And because it doesn't have anything else, it also declares itself the universal understander. Just like there are sounds you cannot hear, and chemicals you cannot taste, wavelengths you cannot see -- consider that there may be thoughts that you physically cannot think.
No magic and no spooky mysterious stuff. Just that it seems quite possible that our brains are limited in their ability to construct a representation of the universe, and insofar as the representation is true, we have kno way of knowing if it's the only true one.
It seems pretty obvious that there are thoughts that are too big to fit inside our heads.
Pointing out possible edge cases is a non sequitur. Of course there will be things we don’t have in common. Yes, we know that. The fact we’re explicitly looking at common ground from first principles implicitly acknowledges there will be ground not in common. That’s given.
As a limited computing system, our brain has been optimized to process the world in specific ways using various heuristics and compression techniques. Alien brains would presumably be optimized in different ways. Given our limited capabilities, it seems quite possible that translating any concepts between the two systems would be unfeasible for either our brain or the alien one.
I would like to think that there would common ground but that isn't something that can be known a priori, and is thus not presently "proveable".
There's a character Rimmer in a comedy series Red Dwarf that's always going on about how aliens would be unimaginable to use because they're alien and everything they do would be... well.. 'alien'. It's poking fun at SF that presents aliens as inherently utterly unintelligible to us simply by virtue of being alien, but frankly that's absurd. Physics doesn't care who or where you are, the same rules apply.