This is one of my favorite sayings, so I feel compelled to minorly correct it here. The full saying is "When you hear hoofbeats in Texas, think horses not zebras." The "in Texas" is a key piece of context, as there are some places where zebras might well be more common than horses. The point being that one should suspect and rule out the most common differential diagnoses first.