The difference is that 'centralized' parts are a commodity. Infura itself is centralized, but if it creates problems, it can be replaced with any other rpc, including your own node. Therefore, those services have zero power over the user.