As some other people mentioned, Caps Lock on Mac keyboards are special, Apple added a delay or something for people hitting it accidentally. If you google around there's some fix for it, I think.

If you're not having trouble with any other key, your keyboard probably works fine. Keep that dust cover on!