You are identifying eBay with Paypal. If you accept, say, only bank transfer, the worst thing that can happen (in "regular" conditions; of course there are exceptional cases) is a negative feedback.

I've sold hundreds of items on eBay, almost all payable only via bank transfer/cash, and never had serious problems. If I get a smaller audience, well, that's an acceptable compromise in the long term.