You could use a business bank account with an associated debit card. Continue accepting PayPal but only use it as a processor and transfer funds to your business account regularly. This also makes it easier to have multiple payment methods, like if you want to test Stripe. It's a little bit more work but it's probably worth it. Oh, and most banks let you download some sort of spreadsheet for accounting.