There are a number of confounds for measuring things like this because we're often not talking about exactly the same thing: for example, the times needed to perceive motion, size, color, orientation, and recognize something are all different (to a first approximation, the relative latencies are roughly what you'd expect if the most important selection criteria was a relatively weak fructivorous ape trying not to get eaten) and there are measurable differences between how you respond to things you're predicting will happen, continuous motion, or truly unexpected events. This also varies considerably for novel and trained behavior — e.g. if you're waiting to shoot when you see a pixel change, your body is primed and presumably quite well practiced vs. something random happening in a video. All of that means that something like extra keyboard latency is especially noticeable because you're initiating the action, it's extremely practiced, and you thus have a well-honed expectation for when the response should be visible
The most responsive games achieve sub 30 ms motion to photon locally, with proper hardware.
Yea, author never played MMOS or FPS games online?
Going from 20ms to 100 is going to be VERY noticable.