Yes, all of the specific experiments Tog describes are bogus. In versions of the experiments where the keyboard user isn't crippled by weird limitations that don't apply to actual computer users, the keyboard is often superior to the mouse (not always, just often): https://danluu.com/keyboard-v-mouse/
If you saw them, you probably noted they were fully keyboard-operated, had a lot of functionality accessible under function keys, and enabled the clerks to accomplish a lot of tasks without actually looking at the screen(!). You can't beat something like a muscle-remembered "F2, enter, enter, <type name>, tab, enter, enter" with a dropdown menu. I've seen cashiers do the former faster than it'd take to select a single option from a menu.
The only way I can imagine Tog's assertion to make sense is if we're comparing a mouse menu vs. looking up a shortcut on a physical, printed cheat sheet (which is essentially a menu-equivalent), for an operation that you're using for the first time in your life. None of that resembles actual use of real software.
The more items in your menu the slower it is to find things in it. I can type NY faster than I can find New York in your states menu (I picked a state near the middle to ensure you have to scroll, but can't scroll to the end which might be faster if you know).
Tog was forced to back off his claim, but this wasn't publicized as much. A well trained expert with key shortcuts used all the time is faster than someone with a mouse - but if you don't use the shortcut often, or there are too many keystrokes the mouse wins.
"Showing users things they can recognize improves usability over needing to recall items from scratch because the extra context helps users retrieve information from memory."
Perhaps if you're restricting context to one app that doesn't have too much going on it's a different story, but compared to 30 years ago there is a lot more people (especially devs, or Starcraft players) need to be doing on the computer at a given time.
> I would also like somebody—anybody—to show up with one properly-conducted test report that shows that command keys are equivalent or superior to pull-down menus somewhere, somehow.
It's been 30 years since he wrote that. Has anyone in that time been able to produce data that refutes Apple's findings?