Additionally what about services or products that don't exist or haven't had time to be replicated in one's country. Then that country cannot be on the cutting edge of new technology simply because they penalize buying from international companies.
If the product or service doesn't exist locally, then the purchasing company will indeed need to pay tax, if and only if it's local sales are greater than local costs. If buying this overseas service such as AWS hosting gives it an advantage such as cheaper and simpler scaling then it may well be worth them buying it to pay the tax.
At the moment, an outside company can come in and pay little to no tax by licensing IP from another subsidiary in a third country. A local company is then at a disadvantage and is effectively paying for the infrastructure through their own taxes to support a competitor.
When you start a company, you have many local costs (wages, rent, utilities) and yet you haven't made any sales. In the tech sector, when you do make sales they are likely to be at least in part overseas.
Therefore, it will be a while before you then have to pay any tax. When you get big enough that your local sales become larger than your local costs, then you will probably be able to afford the extra tax as you are now benefiting from the infrastructure provided by the state.
Someone like Google could probably get away with doing business remotely, but then any business that buys from them would not be able to deduct that as a cost when calculating tax which would effectively mean that they pay the tax, making a local rival more competitive.