Yes, a single 60-Hz-frame delay (~16.7 ms) can certainly be noticeable.
Martin Molin of the Wintergatan fame recently posted some experiments regarding latency on his YouTube channel[0]. From watching those videos it becomes quite obvious that your statement is definitely correct.
[0] This is the first one about the recent experiments: https://www.youtube.com/watch?v=VyIk0IqC7SQ
Yeah this rule of thumb was for low fidelity things like hand radio buttons.
For higher fidelity tasks like mouse movements, I'm pretty sure I can notice the difference between 16ms at 60hz and 8ms at 120hz. But it's hard to tell if that's because of pure latency or smoothness, I would suspect the latter.
We may be slow to react to sudden events, but we are very good at noticing the lag for predictive events (keyboard typing, piano playing, ...).