Having an uninterruptable communication network led to the internet. Being able to deploy ICBMs across the nation led to the Highway System. Going to space created a ton of new materials and manufacturing systems that have created products that couldn't have existed before.
Having the fastest supercomputer is the trees, the forest is the wealth of technology and industries born out of that race.
Sure, and this answers the question "why have super-computers", indeed, the US has several.
I'm not just sure if any of the reasons you specify, all valid, suddenly become invalid when there is simply a delta between the power of US vs China systems.
I believe that in general, the really fast machines serve one of two purposes-- simulating nukes (for example, to test new designs), and simulating global environment (for example, to improve climate predictions).