No, you can use a registered agent same as you do in the US when you incorporate in Delaware. You can open a bank account too, though many banks apparently won't participate because of some bank scandals in a nearby baltic country. I happened to be near Estonia and so opened one in person. The scandal problem happened more recently so I am not sure how easy that is right now.

The e-residency card comes with a chip reader that plugs into your computer and does a handshake with the bank. There are a bunch of companies who authenticate via the e-e-residency card: https://e-resident.gov.ee/run-a-company/