If you don't take into account cooperation, complex communication, and the ability to abstract (e.g. a rock isn't just something to step over, it's also a potential weapon and when many are combined a dwelling, bridge, etc.), then your observation has merit.

We're a relatively weak, slow animal. We don't see well at night. Our teeth and nails are fairly useless from a hunting or even defensive perspective. We don't procreate quickly and our young mature slowly. Our survival advantage is working in coordinated teams and having flexible minds with respect to the world around us. Cats are closer to what you described.