It only seems to affect some stations (the ones I frequent at least), I've always assumed is due do an additional API call to the banks system on top of the normal Oyster check, but it's certainly slower than Oyster even when it's not this slow.

I haven't tried with a different bank though, so it could be bank specific.