I assume at least 50% of US voters would agree, but it is one of those things that extremists are willing to put a lot of effort into fighting and so the majority will let them have it because there are bigger problems. Especially since physical currency is less and less relevant.