Yeah, the only reason this is possible in the situation is because you already know there’s only one possible person on the other end (you have already exchanged some meta-information about the channel).

QE doesn’t stop anyone from creating a new node in the middle of a single edge and then re-establishing the QE channel in between.