Marginal performance (i.e. 100 ms to 10 s per action, not multiple minute delays) is somewhat important to end users and matters only if they can switch easily. End users typically have little to no say in choosing the business software, especially after it's already bought.
Based off how slow every SaaS service is in the B2B space, performance isn't important in all scenarios.