Sentence embeddings have precisely the limitations you'd expect for syntax-only correlative models, which is what they are.

We forget this at our peril.

Sometimes we also forget that semantics also exist, but “you can’t argue with a zombie” was already posted recently …