In my opinion, another important reason to support of keeping these large accelerators alive is there is a very real chance that the expertise to build these kind of devices could atrophy or be lost entirely given the long timescales involved. Even if one is opposed to building this specific collider, I think the prospect of losing this kind of institutional knowledge is concerning (though if one finds these things useless, you might care less if we lost that capability).
I entirely agree with your second point. I’ll add that it is also important to keep these people (from highly specialised technicians and physicists to diplomats and support staff) employed in positions where they can keep their skills sharp. Some of them then go back to their countries of origin to apply this experience and knowledge to help improve research and policy at home, whilst retaining personal links with their counterparts abroad.
In the grand scheme of things, the expenditure is a rounding error anyway.
Whilst they are not commonly used today, it is not entirely improbable that they play a significant role in the future.
There’s also some developments related to grid computing, sensors, and electronics, which could be reasonably useful in other contexts.
So yeah, chasing the next fancy particle itself is not very relevant to most people (though still very important in our quest of trying to understand the world around us), but it still contributes to technological progress.
Another aspect is international collaboration. It’s not perfect, but CERN and ITER are organisations within which Chinese, Russians, Americans and Europeans (and many, many others) work together towards a common goal.