You have to then fully trust your counterparty to not have retained a copy of the key to do his own BTC transaction on the network, later, forever.

You could probably use trusted computing/smartcards with a wallet inside them to do some kind of awesome self-attesting "no one has seen my key yet" physical payment token. Sort of like those Casascius coins, but without the need to trust the maker so much.