It's as much about personality as physical threat.

Cats are far more skittish around people as a rule. There are practically zero stray/outdoor cats that will attack a person unless they're backed into a corner and provoked. The same thing isn't true for dogs, some dogs are simply aggressive.