I'm OK if there are one or two exceptions, like if my banking app needs to be manually reinstalled after 'failover'.

Out of curiosity, do open source phones like the Librem 5 or Pinephone Pro have a secure element and if so do they provide you with tools to provision and manage it yourself?