France has had good online banks for years now, with free accounts/cards/transfers and everything managed online.

You just have to choose your bank carefully. Boursorama or Fortuneo are typical decent examples.