A paypal-style site can create a new bitcoin account on behalf of the new user.
Then the payer can transfer funds to it, using a transaction that requires signing with keys that only the payer knows and can pass to the payee directly. Bitcoin transactions can also have timeouts and have the inputs locked while the outputs are still floating.
I guess this requires a trusted central third party as an eschew to hold the fund for the email recipent and for verifying the recipent's account via email.