No, PTT would send audio from the caller without the receiver accepting anything, but it wouldn't send anything from the receiver without action on the receiver end.

It was obnoxious at times, but very different than the kind of privacy invasion that the receiver's sending data without active involvement is.