There were also real Communist agents. See
https://en.wikipedia.org/wiki/Venona_project
https://en.wikipedia.org/wiki/Klaus_Fuchs
https://en.wikipedia.org/wiki/Julius_and_Ethel_Rosenberg
There were also real, devastating consequences to Communist ideology. See
https://en.wikipedia.org/wiki/Holodomor
https://en.wikipedia.org/wiki/Great_Chinese_Famine
https://en.wikipedia.org/wiki/Cambodian_genocide
for three examples.
Communism wasn’t a “common enemy”, it was a boogeyman used as a cudgel by the government to strike down inconvenient dissent and ruin innocent peoples’ lives. There were plenty of Americans with Communist ideals, and plenty more who were branded as “communists” for suggesting such outrageous things as poverty reform or labor rights, including Martin Luther King Jr. See COINTELPRO and the Red Scare for examples of the government’s abhorrent treatment of suspected communists.