It was funny, but inaccurate. Don't you usually exchange public keys? Of course if he said public, then the joke wouldn't have made sense, which is probably why he said it that way.