There is quite a delay between the eye detecting something and it being consciously processed to the point of being used in decision making. Away from built-in reactions (move hand away from burning sensation and so forth) that are not consciously controlled there is a sometimes surprising amount of latency in our view of the world. It is surprising because the brain does a rather good job of smoothing it out with guesses/predictions such that you generally don't notice.
Only when things fall outside the range of patterns you naturally cope with or expect because they are consequences of your own actions, do you really become aware of them. So he might not notice usually, but would if an error or something else unexpected occurred.
This is why 100ms, or even sometimes 200ms, is fine for many things, but others cause irritation despite delays of 40ms or sometimes significantly lower. The brain smooths out what it can, the rest sets of warnings of potential trouble.
We may be slow to react to sudden events, but we are very good at noticing the lag for predictive events (keyboard typing, piano playing, ...).
[0] This is the first one about the recent experiments: https://www.youtube.com/watch?v=VyIk0IqC7SQ
For higher fidelity tasks like mouse movements, I'm pretty sure I can notice the difference between 16ms at 60hz and 8ms at 120hz. But it's hard to tell if that's because of pure latency or smoothness, I would suspect the latter.
I remember Dan posting that he typed at ~120wpm somewhere. 120wpm is 0.002 words per ms or 0.4 words per 200ms. Wouldn't one notice if they're almost halfway through a word and nothing has shown up on the screen?