No, they don’t make a difference.
Generally credit scores falls in wide bands that give a general credit risk.
573 vs 605 are both very high risk and you’re getting slammed regardless.
The scores are no more arbitrary than the requirement that bankruptcies roll off your score after 7 years.
Don't they, though? How do you know? For a person who gets refused access to some important service or product because they're just 1 point under some arbitrary and unknown threshold, yes there's an impact.