Over 20% of American adults have a literacy proficiency at or below Level 1. This is defined as "difficulty using or understanding print materials" and "may struggle to understand texts beyond filling out basic forms." So 1 out of every 5 Americans is functionally illiterate. I would say that counts as "many of them don't even know how to read."